2023-12-08T08:03:16.159 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T08:03:16.159 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --owner scheduled_vshankar@teuthology --verbose --name vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi --archive /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778 -- /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/orig.config.yaml 2023-12-08T08:03:16.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T08:03:16.289 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778 branch: wip-vshankar-testing-20231206.125818 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: vshankar@redhat.com first_in_suite: false job_id: '7483778' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20231206.125818 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a2cd52c00149b5caff897ea7f79d0529b62620da ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2cd52c00149b5caff897ea7f79d0529b62620da thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231206.125818 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4099 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da sleep_before_teardown: 0 subset: 359/1024 suite: fs suite_branch: wip-vshankar-testing-20231206.125818 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a2cd52c00149b5caff897ea7f79d0529b62620da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7oxiOYntLysSSVuZVCqY5GSlTgDlXicqBhjOI9zXL8PLyU0TAggQ/8kMRlcuwHAIkGZHA3MFyVCziOogafIdw= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHrqlqrdMfTyN+dpTr/N1G7eeyJKe2GxvX9vOHdIjm6ByxTiwA66XWPGhH9E7WVsXBijxaK2tyDwxtz8lIx32dA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-08_07:46:48 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-08T08:03:16.289 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa; will attempt to use it 2023-12-08T08:03:16.290 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks 2023-12-08T08:03:16.290 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-08T08:03:16.292 INFO:teuthology.task.internal:Checking packages... 2023-12-08T08:03:16.319 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2cd52c00149b5caff897ea7f79d0529b62620da' 2023-12-08T08:03:16.319 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-08T08:03:16.319 INFO:teuthology.packaging:ref: None 2023-12-08T08:03:16.319 INFO:teuthology.packaging:tag: None 2023-12-08T08:03:16.319 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231206.125818 2023-12-08T08:03:16.319 INFO:teuthology.packaging:sha1: a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:03:16.320 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20231206.125818 2023-12-08T08:03:16.535 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-46.ga2cd52c0 2023-12-08T08:03:16.535 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-08T08:03:16.541 INFO:teuthology.task.internal:no buildpackages task found 2023-12-08T08:03:16.541 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-08T08:03:16.583 INFO:teuthology.task.internal:Saving configuration 2023-12-08T08:03:16.601 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-08T08:03:16.607 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:03:16.633 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:58:14.431195', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7oxiOYntLysSSVuZVCqY5GSlTgDlXicqBhjOI9zXL8PLyU0TAggQ/8kMRlcuwHAIkGZHA3MFyVCziOogafIdw='} 2023-12-08T08:03:16.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:58:14.433179', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHrqlqrdMfTyN+dpTr/N1G7eeyJKe2GxvX9vOHdIjm6ByxTiwA66XWPGhH9E7WVsXBijxaK2tyDwxtz8lIx32dA='} 2023-12-08T08:03:16.656 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-08T08:03:16.663 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-08T08:03:16.663 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-08T08:03:16.663 INFO:teuthology.run_tasks:Running task console_log... 2023-12-08T08:03:16.766 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc132a7da60>, signals=[15]) 2023-12-08T08:03:16.767 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-08T08:03:16.774 INFO:teuthology.task.internal:Opening connections... 2023-12-08T08:03:16.774 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:03:16.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:03:16.874 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:03:16.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:03:16.963 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-08T08:03:16.970 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-12-08T08:03:16.988 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-12-08T08:03:16.989 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-12-08T08:03:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2023-12-08T08:03:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2023-12-08T08:03:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2023-12-08T08:03:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2023-12-08T08:03:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2023-12-08T08:03:17.045 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-08T08:03:17.046 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T08:03:17.047 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-12-08T08:03:17.071 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-12-08T08:03:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-12-08T08:03:17.089 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-12-08T08:03:17.148 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-12-08T08:03:17.148 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-08T08:03:17.149 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T08:03:17.149 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-12-08T08:03:17.170 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-08T08:03:17.180 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-08T08:03:17.201 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-08T08:03:17.201 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2023-12-08T08:03:17.204 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2023-12-08T08:03:17.220 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-08T08:03:17.226 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-08T08:03:17.226 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2023-12-08T08:03:17.262 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2023-12-08T08:03:17.287 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-08T08:03:17.345 INFO:teuthology.run_tasks:Running task kernel... 2023-12-08T08:03:17.359 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-08T08:03:17.359 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-08T08:03:17.360 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T08:03:17.360 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-08T08:03:17.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:03:17.376 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2023-12-08T08:03:17.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:03:17.377 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-12-08T08:03:17.434 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-361.el9.x86_64 2023-12-08T08:03:17.435 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-361.el9.x86_64 2023-12-08T08:03:17.435 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2023-12-08T08:03:17.436 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-361.el9.x86_64 2023-12-08T08:03:17.436 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.14.0-361.el9.x86_64 2023-12-08T08:03:17.436 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2023-12-08T08:03:19.658 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-12-08T08:03:19.742 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 9.6 MB/s | 6.4 MB 00:00 2023-12-08T08:03:21.142 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2023-12-08T08:03:21.258 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2023-12-08T08:03:22.607 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 7.9 MB 00:01 2023-12-08T08:03:22.824 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 7.9 MB 00:01 2023-12-08T08:03:24.409 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 27 MB/s | 18 MB 00:00 2023-12-08T08:03:25.742 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 18 MB 00:01 2023-12-08T08:03:28.818 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 5.8 MB 00:00 2023-12-08T08:03:29.984 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 5.8 MB 00:00 2023-12-08T08:03:30.494 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2023-12-08T08:03:32.201 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2023-12-08T08:03:32.295 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-08T08:03:34.002 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-08T08:03:37.216 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2023-12-08T08:03:38.677 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2023-12-08T08:03:39.502 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-08T08:03:39.502 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-08T08:03:39.599 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-08T08:03:39.606 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout: Package Architecture Version Repository Size 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout: kernel x86_64 5.14.0-390.el9 baseos 5.6 M 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core x86_64 5.14.0-390.el9 baseos 20 M 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules x86_64 5.14.0-390.el9 baseos 38 M 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core x86_64 5.14.0-390.el9 baseos 32 M 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 96 M 2023-12-08T08:03:39.607 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 121 M 2023-12-08T08:03:39.608 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-08T08:03:40.925 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-08T08:03:40.925 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-08T08:03:41.023 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-390.el9 baseos 5.6 M 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-390.el9 baseos 20 M 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-390.el9 baseos 38 M 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-390.el9 baseos 32 M 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:03:41.031 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2023-12-08T08:03:41.032 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2023-12-08T08:03:41.032 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2023-12-08T08:03:41.032 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:03:41.032 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 96 M 2023-12-08T08:03:41.032 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 121 M 2023-12-08T08:03:41.032 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2023-12-08T08:03:41.180 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): kernel-5.14.0-390.el9.x86_64.rpm 4.3 MB/s | 5.6 MB 00:01 2023-12-08T08:03:41.679 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-390.el9.x86_64.rpm 10 MB/s | 5.6 MB 00:00 2023-12-08T08:03:41.705 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): kernel-core-5.14.0-390.el9.x86_64.rpm 11 MB/s | 20 MB 00:01 2023-12-08T08:03:42.354 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-core-5.14.0-390.el9.x86_64.rpm 17 MB/s | 20 MB 00:01 2023-12-08T08:03:42.572 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): kernel-modules-5.14.0-390.el9.x86_64.rpm 14 MB/s | 38 MB 00:02 2023-12-08T08:03:42.912 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-modules-core-5.14.0-390.el9.x86_6 26 MB/s | 32 MB 00:01 2023-12-08T08:03:43.562 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-5.14.0-390.el9.x86_64.rpm 16 MB/s | 38 MB 00:02 2023-12-08T08:03:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2023-12-08T08:03:43.563 INFO:teuthology.orchestra.run.smithi170.stdout:Total 38 MB/s | 96 MB 00:02 2023-12-08T08:03:44.417 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2023-12-08T08:03:44.771 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2023-12-08T08:03:44.771 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2023-12-08T08:03:44.922 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): kernel-modules-core-5.14.0-390.el9.x86_6 8.7 MB/s | 32 MB 00:03 2023-12-08T08:03:44.922 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-08T08:03:44.922 INFO:teuthology.orchestra.run.smithi050.stdout:Total 18 MB/s | 96 MB 00:05 2023-12-08T08:03:45.813 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-08T08:03:46.095 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2023-12-08T08:03:46.095 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2023-12-08T08:03:46.227 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-08T08:03:46.227 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-08T08:03:47.605 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-08T08:03:47.605 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-08T08:03:49.004 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2023-12-08T08:03:49.649 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-390.el9.x86_64 1/4 2023-12-08T08:03:49.771 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-08T08:03:50.428 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-08T08:03:51.094 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-core-5.14.0-390.el9.x86_64 1/4 2023-12-08T08:03:51.222 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-08T08:03:52.550 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-08T08:03:52.751 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-08T08:03:54.132 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-08T08:03:54.311 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-08T08:03:57.354 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-08T08:03:57.475 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:03:59.282 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-08T08:03:59.412 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : kernel-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:02.096 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:30.785 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:30.828 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:31.217 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:31.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-390.el9.x86_64 1/4 2023-12-08T08:04:31.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-08T08:04:31.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-390.el9.x86_64 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-390.el9.x86_64 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-390.el9.x86_64 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-390.el9.x86_64 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:04:31.641 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2023-12-08T08:04:32.144 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T08:04:32.277 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-08T08:04:32.278 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-08T08:04:32.278 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-390.el9.x86_64 2023-12-08T08:04:32.278 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-08T08:04:32.278 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-08T08:04:32.278 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-08T08:04:32.279 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2023-12-08T08:04:32.279 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T08:04:32.398 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-08T08:04:32.401 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-08T08:04:32.402 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2023-12-08T08:04:32.435 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 68.el9 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8264254 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2023-12-08T08:04:32.436 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:04:32.437 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2023-12-08T08:04:32.438 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-08T08:04:32.438 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-390.el9.x86_64 2023-12-08T08:04:32.438 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-08T08:04:33.109 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2023-12-08T08:04:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-08T08:04:34.545 INFO:teuthology.orchestra.run.smithi170.stderr:done 2023-12-08T08:04:34.553 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2023-12-08T08:04:34.609 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.cIZhdUo9x8 2023-12-08T08:04:34.609 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cIZhdUo9x8 2023-12-08T08:04:34.683 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.cIZhdUo9x8 2023-12-08T08:04:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:35.050 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.cIZhdUo9x8 is 6KB 2023-12-08T08:04:35.099 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.cIZhdUo9x8 2023-12-08T08:04:35.114 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2023-12-08T08:04:35.182 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-08T08:04:35.182 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-08T08:04:35.182 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-08T08:04:35.182 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64.conf 2023-12-08T08:04:35.184 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64 2023-12-08T08:04:35.295 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: kernel-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:35.295 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-5.14.0-390.el9.x86_64 1/4 2023-12-08T08:04:35.296 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-08T08:04:35.296 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-08T08:04:35.357 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-5.14.0-390.el9.x86_64 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-core-5.14.0-390.el9.x86_64 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-5.14.0-390.el9.x86_64 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: kernel-modules-core-5.14.0-390.el9.x86_64 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:04:35.754 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-08T08:04:36.299 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T08:04:36.444 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-08T08:04:36.444 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-08T08:04:36.444 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-390.el9.x86_64 2023-12-08T08:04:36.444 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-08T08:04:36.444 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-08T08:04:36.444 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-08T08:04:36.444 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2023-12-08T08:04:36.444 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q kernel | sort -rV | head -n 1 2023-12-08T08:04:36.567 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-08T08:04:36.567 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-08T08:04:36.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo rpm -qi grub2-tools 2023-12-08T08:04:36.616 INFO:teuthology.orchestra.run.smithi050.stdout:Name : grub2-tools 2023-12-08T08:04:36.616 INFO:teuthology.orchestra.run.smithi050.stdout:Epoch : 1 2023-12-08T08:04:36.616 INFO:teuthology.orchestra.run.smithi050.stdout:Version : 2.06 2023-12-08T08:04:36.616 INFO:teuthology.orchestra.run.smithi050.stdout:Release : 68.el9 2023-12-08T08:04:36.616 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: x86_64 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Group : Unspecified 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Size : 8264254 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:License : GPLv3+ 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Packager : builder@centos.org 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Vendor : CentOS 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-08T08:04:36.617 INFO:teuthology.orchestra.run.smithi050.stdout:Summary : Support tools for GRUB. 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout:Description : 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout:hardware devices. 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:04:36.618 INFO:teuthology.orchestra.run.smithi050.stdout:This subpackage provides tools for support of all platforms. 2023-12-08T08:04:36.619 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-08T08:04:36.619 INFO:teuthology.task.kernel:Updating grub on smithi050 to boot 5.14.0-390.el9.x86_64 2023-12-08T08:04:36.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-08T08:04:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2023-12-08T08:04:38.585 INFO:teuthology.orchestra.run.smithi050.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-08T08:04:38.630 INFO:teuthology.orchestra.run.smithi050.stderr:done 2023-12-08T08:04:38.643 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-12-08T08:04:38.658 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.g6LR84EyK7 2023-12-08T08:04:38.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.g6LR84EyK7 2023-12-08T08:04:38.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.g6LR84EyK7 2023-12-08T08:04:38.877 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.g6LR84EyK7 is 6KB 2023-12-08T08:04:38.926 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.g6LR84EyK7 2023-12-08T08:04:38.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo /bin/ls /boot/loader/entries || true 2023-12-08T08:04:39.019 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-08T08:04:39.020 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-08T08:04:39.020 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-08T08:04:39.020 INFO:teuthology.orchestra.run.smithi050.stdout:15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64.conf 2023-12-08T08:04:39.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64 2023-12-08T08:04:39.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2023-12-08T08:05:05.386 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-08T08:05:05.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-08T08:05:05.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:05:09.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-08T08:05:09.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-08T08:05:09.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:05:23.939 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-08T08:05:27.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-12-08T08:05:32.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-08T08:05:32.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:05:36.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-12-08T08:05:36.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-08T08:05:36.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:05:48.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-08T08:05:48.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:19.877 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-12-08T08:06:20.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-08T08:06:20.292 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-390.el9.x86_64"... 2023-12-08T08:06:20.292 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2023-12-08T08:06:20.306 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-390.el9.x86_64 2023-12-08T08:06:20.307 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-390.el9.x86_64 vs 5.14.0-390.el9.x86_64 2023-12-08T08:06:20.307 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T08:06:20.307 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-08T08:06:21.307 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-08T08:06:21.308 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-08T08:06:21.402 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2023-12-08T08:06:21.441 DEBUG:teuthology.parallel:result is None 2023-12-08T08:06:36.530 DEBUG:teuthology.orchestra.remote:timed out 2023-12-08T08:06:48.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-08T08:06:48.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:06:48.894 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-12-08T08:06:49.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-08T08:06:49.258 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-390.el9.x86_64"... 2023-12-08T08:06:49.258 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2023-12-08T08:06:49.273 INFO:teuthology.orchestra.run.smithi050.stdout:5.14.0-390.el9.x86_64 2023-12-08T08:06:49.273 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-390.el9.x86_64 vs 5.14.0-390.el9.x86_64 2023-12-08T08:06:49.274 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-08T08:06:49.274 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-08T08:06:50.275 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-08T08:06:50.275 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-08T08:06:50.360 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2023-12-08T08:06:50.396 DEBUG:teuthology.parallel:result is None 2023-12-08T08:06:50.396 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-08T08:06:50.402 INFO:teuthology.task.internal:Creating test directory... 2023-12-08T08:06:50.402 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T08:06:50.405 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-08T08:06:50.424 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-08T08:06:50.437 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-08T08:06:50.472 INFO:teuthology.task.internal:Creating archive directory... 2023-12-08T08:06:50.472 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T08:06:50.474 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-08T08:06:50.509 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-08T08:06:50.517 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-08T08:06:50.517 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T08:06:50.544 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-08T08:06:50.579 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:06:50.585 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:06:50.595 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:06:50.599 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-08T08:06:50.601 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-08T08:06:50.608 INFO:teuthology.task.internal:Configuring sudo... 2023-12-08T08:06:50.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T08:06:50.644 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-08T08:06:50.674 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-08T08:06:50.688 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-08T08:06:50.688 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T08:06:50.720 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-08T08:06:50.736 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T08:06:50.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T08:06:50.879 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T08:06:50.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T08:06:51.015 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:06:51.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T08:06:51.089 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T08:06:51.133 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-08T08:06:51.184 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T08:06:51.268 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-08T08:06:51.313 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:06:51.314 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-08T08:06:51.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2023-12-08T08:06:51.387 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2023-12-08T08:06:51.432 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T08:06:51.477 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T08:06:51.819 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-08T08:06:51.827 INFO:teuthology.task.internal:Starting timer... 2023-12-08T08:06:51.827 INFO:teuthology.run_tasks:Running task pcp... 2023-12-08T08:06:51.859 INFO:teuthology.run_tasks:Running task selinux... 2023-12-08T08:06:52.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2023-12-08T08:06:52.057 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2023-12-08T08:06:52.059 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2023-12-08T08:06:52.115 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2023-12-08T08:06:52.117 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-08T08:06:52.117 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2023-12-08T08:06:52.145 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2023-12-08T08:06:52.146 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2023-12-08T08:06:52.166 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2023-12-08T08:06:52.166 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2023-12-08T08:06:52.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T08:06:52.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:06:52.221 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T08:06:52.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:06:52.249 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-08T08:06:52.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2023-12-08T08:06:52.305 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2023-12-08T08:06:52.343 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-08T08:06:52.353 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-08T08:06:52.358 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-08T08:06:52.521 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-08T08:06:52.538 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-08T08:06:52.539 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-08T08:12:34.729 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2023-12-08T08:12:34.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-08T08:12:34.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:12:34.827 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-12-08T08:12:34.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-12-08T08:12:34.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-08T08:12:34.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T08:12:34.981 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-12-08T08:12:35.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-12-08T08:12:35.048 INFO:teuthology.run_tasks:Running task clock... 2023-12-08T08:12:35.059 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-08T08:12:35.060 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T08:12:35.060 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:12:35.062 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-08T08:12:35.063 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:12:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-08T08:12:35.115 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-08T08:12:35.119 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-08T08:12:35.135 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-08T08:12:35.151 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2023-12-08T08:12:35.165 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2023-12-08T08:12:35.168 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2023-12-08T08:12:35.177 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2023-12-08T08:12:35.188 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-08T08:12:35.194 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-08T08:12:35.208 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-08T08:12:35.210 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-08T08:12:35.253 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:12:35.255 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:12:35.256 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:12:35.256 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2023-12-08T08:12:35.256 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.256 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.256 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.256 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.259 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:12:35.259 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-12-08T08:12:35.259 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.259 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.259 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.259 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:12:35.260 INFO:teuthology.run_tasks:Running task install... 2023-12-08T08:12:35.269 DEBUG:teuthology.task.install:project ceph 2023-12-08T08:12:35.270 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}} 2023-12-08T08:12:35.270 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'} 2023-12-08T08:12:35.270 INFO:teuthology.task.install:Using flavor: default 2023-12-08T08:12:35.276 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-08T08:12:35.276 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-08T08:12:35.277 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'tag': None, 'wait_for_package': False} 2023-12-08T08:12:35.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:12:35.279 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'tag': None, 'wait_for_package': False} 2023-12-08T08:12:35.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:12:35.495 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/ 2023-12-08T08:12:35.496 INFO:teuthology.task.install.rpm:Package version is 19.0.0-46.ga2cd52c0 2023-12-08T08:12:35.500 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/ 2023-12-08T08:12:35.500 INFO:teuthology.task.install.rpm:Package version is 19.0.0-46.ga2cd52c0 2023-12-08T08:12:35.610 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-08T08:12:35.610 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:12:35.611 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-08T08:12:35.639 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-08T08:12:35.640 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2cd52c00149b5caff897ea7f79d0529b62620da/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-08T08:12:35.664 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-08T08:12:35.664 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:12:35.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-08T08:12:35.696 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-08T08:12:35.696 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2cd52c00149b5caff897ea7f79d0529b62620da/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-08T08:12:35.708 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-08T08:12:35.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-08T08:12:35.787 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-08T08:12:35.854 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-08T08:12:35.854 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2023-12-08T08:12:35.856 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2023-12-08T08:12:35.884 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2023-12-08T08:12:35.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2023-12-08T08:12:36.098 INFO:teuthology.orchestra.run.smithi170.stdout:73 files removed 2023-12-08T08:12:36.125 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-08T08:12:36.139 INFO:teuthology.orchestra.run.smithi050.stdout:73 files removed 2023-12-08T08:12:36.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-08T08:12:36.845 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 195 kB/s | 78 kB 00:00 2023-12-08T08:12:36.979 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 164 kB/s | 78 kB 00:00 2023-12-08T08:12:37.196 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 31 kB/s | 9.5 kB 00:00 2023-12-08T08:12:37.447 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-12-08T08:12:37.613 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2023-12-08T08:12:37.797 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-12-08T08:12:38.149 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-08T08:12:38.250 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-08T08:12:39.633 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2023-12-08T08:12:39.716 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.0 MB 00:00 2023-12-08T08:12:43.599 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-12-08T08:12:44.847 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 7.9 MB 00:04 2023-12-08T08:12:47.857 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 18 MB 00:01 2023-12-08T08:12:48.708 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 18 MB 00:03 2023-12-08T08:12:53.299 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 5.8 MB 00:02 2023-12-08T08:12:53.751 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 5.8 MB 00:01 2023-12-08T08:12:55.235 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 15 kB 00:00 2023-12-08T08:12:56.609 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2023-12-08T08:13:01.490 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-12-08T08:13:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:13:04.136 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:13:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-08T08:13:04.148 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-08T08:13:04.149 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-08T08:13:04.150 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-08T08:13:04.152 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-08T08:13:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-08T08:13:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-08T08:13:04.232 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2023-12-08T08:13:04.252 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================== 2023-12-08T08:13:04.252 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2023-12-08T08:13:04.252 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================== 2023-12-08T08:13:04.252 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2023-12-08T08:13:04.252 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-08T08:13:04.252 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 6.5 k 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 5.2 M 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 860 k 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 141 k 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 1.5 M 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 133 k 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 1.8 M 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 7.4 M 2023-12-08T08:13:04.253 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 50 k 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 8.6 M 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 41 M 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 262 k 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 801 k 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 217 k 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 18 k 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-08T08:13:04.254 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 31 k 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 719 k 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 126 k 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-08T08:13:04.255 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 161 k 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 320 k 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 298 k 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 99 k 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 85 k 2023-12-08T08:13:04.256 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:13:04.257 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 170 k 2023-12-08T08:13:04.257 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-08T08:13:04.257 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2023-12-08T08:13:04.257 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-08T08:13:04.257 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-08T08:13:04.257 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-08T08:13:04.258 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-08T08:13:04.258 INFO:teuthology.orchestra.run.smithi050.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-08T08:13:04.259 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-08T08:13:04.259 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-08T08:13:04.259 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-08T08:13:04.259 INFO:teuthology.orchestra.run.smithi050.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-08T08:13:04.259 INFO:teuthology.orchestra.run.smithi050.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-08T08:13:04.259 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.3 M 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-08T08:13:04.260 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 19 M 2023-12-08T08:13:04.261 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 28 k 2023-12-08T08:13:04.261 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 2.1 M 2023-12-08T08:13:04.261 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 243 k 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.4 M 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 18 M 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 15 k 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 24 k 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-08T08:13:04.262 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-08T08:13:04.263 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-08T08:13:04.263 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-08T08:13:04.263 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 164 k 2023-12-08T08:13:04.263 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-08T08:13:04.263 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-08T08:13:04.263 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-08T08:13:04.263 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 476 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.8 M 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-08T08:13:04.264 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 45 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 129 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-08T08:13:04.265 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-08T08:13:04.266 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-08T08:13:04.267 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-08T08:13:04.268 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout:========================================================================================== 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout:Install 132 Packages 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 15 Packages 2023-12-08T08:13:04.269 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:04.270 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 204 M 2023-12-08T08:13:04.270 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2023-12-08T08:13:04.983 INFO:teuthology.orchestra.run.smithi050.stdout:(1/147): ceph-19.0.0-46.ga2cd52c0.el9.x86_64.rp 38 kB/s | 6.5 kB 00:00 2023-12-08T08:13:05.167 INFO:teuthology.orchestra.run.smithi050.stdout:(2/147): ceph-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 4.6 MB/s | 860 kB 00:00 2023-12-08T08:13:05.225 INFO:teuthology.orchestra.run.smithi050.stdout:(3/147): ceph-immutable-object-cache-19.0.0-46. 2.4 MB/s | 141 kB 00:00 2023-12-08T08:13:05.543 INFO:teuthology.orchestra.run.smithi050.stdout:(4/147): ceph-mds-19.0.0-46.ga2cd52c0.el9.x86_6 6.6 MB/s | 2.1 MB 00:00 2023-12-08T08:13:05.726 INFO:teuthology.orchestra.run.smithi050.stdout:(5/147): ceph-base-19.0.0-46.ga2cd52c0.el9.x86_ 5.7 MB/s | 5.2 MB 00:00 2023-12-08T08:13:05.785 INFO:teuthology.orchestra.run.smithi050.stdout:(6/147): ceph-mgr-19.0.0-46.ga2cd52c0.el9.x86_6 6.1 MB/s | 1.5 MB 00:00 2023-12-08T08:13:06.260 INFO:teuthology.orchestra.run.smithi050.stdout:(7/147): ceph-mon-19.0.0-46.ga2cd52c0.el9.x86_6 8.2 MB/s | 4.4 MB 00:00 2023-12-08T08:13:06.810 INFO:teuthology.orchestra.run.smithi050.stdout:(8/147): ceph-common-19.0.0-46.ga2cd52c0.el9.x8 9.5 MB/s | 19 MB 00:02 2023-12-08T08:13:06.885 INFO:teuthology.orchestra.run.smithi050.stdout:(9/147): ceph-selinux-19.0.0-46.ga2cd52c0.el9.x 320 kB/s | 24 kB 00:00 2023-12-08T08:13:07.178 INFO:teuthology.orchestra.run.smithi050.stdout:(10/147): ceph-radosgw-19.0.0-46.ga2cd52c0.el9. 9.4 MB/s | 8.6 MB 00:00 2023-12-08T08:13:07.269 INFO:teuthology.orchestra.run.smithi050.stdout:(11/147): cephfs-mirror-19.0.0-46.ga2cd52c0.el9 2.3 MB/s | 217 kB 00:00 2023-12-08T08:13:07.345 INFO:teuthology.orchestra.run.smithi050.stdout:(12/147): libcephfs-devel-19.0.0-46.ga2cd52c0.e 415 kB/s | 31 kB 00:00 2023-12-08T08:13:07.462 INFO:teuthology.orchestra.run.smithi050.stdout:(13/147): libcephfs2-19.0.0-46.ga2cd52c0.el9.x8 6.0 MB/s | 719 kB 00:00 2023-12-08T08:13:07.554 INFO:teuthology.orchestra.run.smithi050.stdout:(14/147): libcephsqlite-19.0.0-46.ga2cd52c0.el9 1.7 MB/s | 164 kB 00:00 2023-12-08T08:13:07.662 INFO:teuthology.orchestra.run.smithi050.stdout:(15/147): librados-devel-19.0.0-46.ga2cd52c0.el 1.1 MB/s | 126 kB 00:00 2023-12-08T08:13:07.771 INFO:teuthology.orchestra.run.smithi050.stdout:(16/147): libradosstriper1-19.0.0-46.ga2cd52c0. 4.3 MB/s | 476 kB 00:00 2023-12-08T08:13:08.155 INFO:teuthology.orchestra.run.smithi050.stdout:(17/147): ceph-osd-19.0.0-46.ga2cd52c0.el9.x86_ 7.5 MB/s | 18 MB 00:02 2023-12-08T08:13:08.213 INFO:teuthology.orchestra.run.smithi050.stdout:(18/147): python3-ceph-argparse-19.0.0-46.ga2cd 776 kB/s | 45 kB 00:00 2023-12-08T08:13:08.280 INFO:teuthology.orchestra.run.smithi050.stdout:(19/147): librgw2-19.0.0-46.ga2cd52c0.el9.x86_6 9.4 MB/s | 4.8 MB 00:00 2023-12-08T08:13:08.305 INFO:teuthology.orchestra.run.smithi050.stdout:(20/147): python3-ceph-common-19.0.0-46.ga2cd52 1.4 MB/s | 129 kB 00:00 2023-12-08T08:13:08.364 INFO:teuthology.orchestra.run.smithi050.stdout:(21/147): python3-cephfs-19.0.0-46.ga2cd52c0.el 1.9 MB/s | 161 kB 00:00 2023-12-08T08:13:08.389 INFO:teuthology.orchestra.run.smithi050.stdout:(22/147): python3-rados-19.0.0-46.ga2cd52c0.el9 3.7 MB/s | 320 kB 00:00 2023-12-08T08:13:08.439 INFO:teuthology.orchestra.run.smithi050.stdout:(23/147): python3-rbd-19.0.0-46.ga2cd52c0.el9.x 3.9 MB/s | 298 kB 00:00 2023-12-08T08:13:08.464 INFO:teuthology.orchestra.run.smithi050.stdout:(24/147): python3-rgw-19.0.0-46.ga2cd52c0.el9.x 1.3 MB/s | 99 kB 00:00 2023-12-08T08:13:08.509 INFO:teuthology.orchestra.run.smithi050.stdout:(25/147): rbd-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 1.2 MB/s | 85 kB 00:00 2023-12-08T08:13:08.590 INFO:teuthology.orchestra.run.smithi050.stdout:(26/147): rbd-nbd-19.0.0-46.ga2cd52c0.el9.x86_6 2.0 MB/s | 170 kB 00:00 2023-12-08T08:13:08.674 INFO:teuthology.orchestra.run.smithi050.stdout:(27/147): ceph-grafana-dashboards-19.0.0-46.ga2 338 kB/s | 28 kB 00:00 2023-12-08T08:13:08.749 INFO:teuthology.orchestra.run.smithi050.stdout:(28/147): ceph-mgr-cephadm-19.0.0-46.ga2cd52c0. 1.7 MB/s | 133 kB 00:00 2023-12-08T08:13:08.891 INFO:teuthology.orchestra.run.smithi050.stdout:(29/147): rbd-mirror-19.0.0-46.ga2cd52c0.el9.x8 7.1 MB/s | 3.0 MB 00:00 2023-12-08T08:13:08.966 INFO:teuthology.orchestra.run.smithi050.stdout:(30/147): ceph-mgr-dashboard-19.0.0-46.ga2cd52c 8.1 MB/s | 1.8 MB 00:00 2023-12-08T08:13:09.058 INFO:teuthology.orchestra.run.smithi050.stdout:(31/147): ceph-mgr-modules-core-19.0.0-46.ga2cd 2.6 MB/s | 243 kB 00:00 2023-12-08T08:13:09.142 INFO:teuthology.orchestra.run.smithi050.stdout:(32/147): ceph-mgr-rook-19.0.0-46.ga2cd52c0.el9 604 kB/s | 50 kB 00:00 2023-12-08T08:13:09.226 INFO:teuthology.orchestra.run.smithi050.stdout:(33/147): ceph-prometheus-alerts-19.0.0-46.ga2c 181 kB/s | 15 kB 00:00 2023-12-08T08:13:09.326 INFO:teuthology.orchestra.run.smithi050.stdout:(34/147): ceph-volume-19.0.0-46.ga2cd52c0.el9.n 2.6 MB/s | 262 kB 00:00 2023-12-08T08:13:09.451 INFO:teuthology.orchestra.run.smithi050.stdout:(35/147): cephadm-19.0.0-46.ga2cd52c0.el9.noarc 6.3 MB/s | 801 kB 00:00 2023-12-08T08:13:09.535 INFO:teuthology.orchestra.run.smithi050.stdout:(36/147): cephfs-top-19.0.0-46.ga2cd52c0.el9.no 219 kB/s | 18 kB 00:00 2023-12-08T08:13:09.911 INFO:teuthology.orchestra.run.smithi050.stdout:(37/147): ceph-test-19.0.0-46.ga2cd52c0.el9.x86 14 MB/s | 41 MB 00:03 2023-12-08T08:13:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:(38/147): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2023-12-08T08:13:10.169 INFO:teuthology.orchestra.run.smithi050.stdout:(39/147): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 106 kB 00:00 2023-12-08T08:13:10.220 INFO:teuthology.orchestra.run.smithi050.stdout:(40/147): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 920 kB 00:00 2023-12-08T08:13:10.245 INFO:teuthology.orchestra.run.smithi050.stdout:(41/147): automake-1.16.2-8.el9.noarch.rpm 933 kB/s | 662 kB 00:00 2023-12-08T08:13:10.262 INFO:teuthology.orchestra.run.smithi050.stdout:(42/147): elfutils-libelf-devel-0.190-1.el9.x86 236 kB/s | 21 kB 00:00 2023-12-08T08:13:10.287 INFO:teuthology.orchestra.run.smithi050.stdout:(43/147): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2023-12-08T08:13:10.321 INFO:teuthology.orchestra.run.smithi050.stdout:(44/147): flexiblas-3.0.4-8.el9.x86_64.rpm 546 kB/s | 32 kB 00:00 2023-12-08T08:13:10.404 INFO:teuthology.orchestra.run.smithi050.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 17 kB 00:00 2023-12-08T08:13:10.505 INFO:teuthology.orchestra.run.smithi050.stdout:(46/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2023-12-08T08:13:10.527 INFO:teuthology.orchestra.run.smithi050.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 907 kB/s | 186 kB 00:00 2023-12-08T08:13:10.554 INFO:teuthology.orchestra.run.smithi050.stdout:(48/147): libaio-devel-0.3.111-13.el9.x86_64.rp 68 kB/s | 10 kB 00:00 2023-12-08T08:13:10.577 INFO:teuthology.orchestra.run.smithi050.stdout:(49/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.2 MB/s | 159 kB 00:00 2023-12-08T08:13:10.602 INFO:teuthology.orchestra.run.smithi050.stdout:(50/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 888 kB/s | 44 kB 00:00 2023-12-08T08:13:10.713 INFO:teuthology.orchestra.run.smithi050.stdout:(51/147): librdkafka-1.6.1-102.el9.x86_64.rpm 4.0 MB/s | 661 kB 00:00 2023-12-08T08:13:10.770 INFO:teuthology.orchestra.run.smithi050.stdout:(52/147): libtool-2.4.6-45.el9.x86_64.rpm 2.9 MB/s | 578 kB 00:00 2023-12-08T08:13:10.795 INFO:teuthology.orchestra.run.smithi050.stdout:(53/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 128 kB/s | 24 kB 00:00 2023-12-08T08:13:10.820 INFO:teuthology.orchestra.run.smithi050.stdout:(54/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 434 kB/s | 46 kB 00:00 2023-12-08T08:13:10.845 INFO:teuthology.orchestra.run.smithi050.stdout:(55/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-08T08:13:10.871 INFO:teuthology.orchestra.run.smithi050.stdout:(56/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-12-08T08:13:10.888 INFO:teuthology.orchestra.run.smithi050.stdout:(57/147): openblas-0.3.21-2.el9.x86_64.rpm 511 kB/s | 34 kB 00:00 2023-12-08T08:13:11.105 INFO:teuthology.orchestra.run.smithi050.stdout:(58/147): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2023-12-08T08:13:11.147 INFO:teuthology.orchestra.run.smithi050.stdout:(59/147): postgresql-13.11-1.el9.x86_64.rpm 5.9 MB/s | 1.5 MB 00:00 2023-12-08T08:13:11.174 INFO:teuthology.orchestra.run.smithi050.stdout:(60/147): postgresql-contrib-13.11-1.el9.x86_64 2.8 MB/s | 811 kB 00:00 2023-12-08T08:13:11.206 INFO:teuthology.orchestra.run.smithi050.stdout:(61/147): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2023-12-08T08:13:11.364 INFO:teuthology.orchestra.run.smithi050.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2023-12-08T08:13:11.421 INFO:teuthology.orchestra.run.smithi050.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.0 MB/s | 228 kB 00:00 2023-12-08T08:13:11.507 INFO:teuthology.orchestra.run.smithi050.stdout:(64/147): postgresql-server-13.11-1.el9.x86_64. 17 MB/s | 5.7 MB 00:00 2023-12-08T08:13:11.531 INFO:teuthology.orchestra.run.smithi050.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 147 kB/s | 24 kB 00:00 2023-12-08T08:13:11.557 INFO:teuthology.orchestra.run.smithi050.stdout:(66/147): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 18 kB 00:00 2023-12-08T08:13:11.582 INFO:teuthology.orchestra.run.smithi050.stdout:(67/147): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-08T08:13:11.607 INFO:teuthology.orchestra.run.smithi050.stdout:(68/147): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2023-12-08T08:13:11.699 INFO:teuthology.orchestra.run.smithi050.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-12-08T08:13:11.724 INFO:teuthology.orchestra.run.smithi050.stdout:(70/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2023-12-08T08:13:11.750 INFO:teuthology.orchestra.run.smithi050.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2023-12-08T08:13:11.775 INFO:teuthology.orchestra.run.smithi050.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 551 kB/s | 41 kB 00:00 2023-12-08T08:13:11.792 INFO:teuthology.orchestra.run.smithi050.stdout:(73/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-12-08T08:13:11.817 INFO:teuthology.orchestra.run.smithi050.stdout:(74/147): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-12-08T08:13:11.842 INFO:teuthology.orchestra.run.smithi050.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 716 kB/s | 47 kB 00:00 2023-12-08T08:13:11.867 INFO:teuthology.orchestra.run.smithi050.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 859 kB/s | 43 kB 00:00 2023-12-08T08:13:12.026 INFO:teuthology.orchestra.run.smithi050.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 214 kB/s | 39 kB 00:00 2023-12-08T08:13:12.235 INFO:teuthology.orchestra.run.smithi050.stdout:(78/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2023-12-08T08:13:12.268 INFO:teuthology.orchestra.run.smithi050.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 755 kB/s | 300 kB 00:00 2023-12-08T08:13:12.293 INFO:teuthology.orchestra.run.smithi050.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 213 kB/s | 56 kB 00:00 2023-12-08T08:13:12.319 INFO:teuthology.orchestra.run.smithi050.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-12-08T08:13:12.344 INFO:teuthology.orchestra.run.smithi050.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 834 kB/s | 63 kB 00:00 2023-12-08T08:13:12.369 INFO:teuthology.orchestra.run.smithi050.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 586 kB/s | 44 kB 00:00 2023-12-08T08:13:12.394 INFO:teuthology.orchestra.run.smithi050.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-08T08:13:12.420 INFO:teuthology.orchestra.run.smithi050.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-12-08T08:13:12.445 INFO:teuthology.orchestra.run.smithi050.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2023-12-08T08:13:12.470 INFO:teuthology.orchestra.run.smithi050.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-08T08:13:12.503 INFO:teuthology.orchestra.run.smithi050.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-08T08:13:12.529 INFO:teuthology.orchestra.run.smithi050.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-12-08T08:13:12.554 INFO:teuthology.orchestra.run.smithi050.stdout:(90/147): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-08T08:13:12.579 INFO:teuthology.orchestra.run.smithi050.stdout:(91/147): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-12-08T08:13:12.605 INFO:teuthology.orchestra.run.smithi050.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-12-08T08:13:13.230 INFO:teuthology.orchestra.run.smithi050.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 393 kB/s | 245 kB 00:00 2023-12-08T08:13:13.313 INFO:teuthology.orchestra.run.smithi050.stdout:(94/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 436 kB/s | 309 kB 00:00 2023-12-08T08:13:13.455 INFO:teuthology.orchestra.run.smithi050.stdout:(95/147): libarrow-doc-9.0.0-10.el9.noarch.rpm 228 kB/s | 26 kB 00:00 2023-12-08T08:13:13.606 INFO:teuthology.orchestra.run.smithi050.stdout:(96/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.9 MB/s | 4.1 MB 00:01 2023-12-08T08:13:13.635 INFO:teuthology.orchestra.run.smithi050.stdout:(97/147): liboath-2.6.7-2.el9.x86_64.rpm 279 kB/s | 49 kB 00:00 2023-12-08T08:13:13.723 INFO:teuthology.orchestra.run.smithi050.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2023-12-08T08:13:13.948 INFO:teuthology.orchestra.run.smithi050.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 2.7 MB/s | 548 kB 00:00 2023-12-08T08:13:14.048 INFO:teuthology.orchestra.run.smithi050.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 435 kB/s | 43 kB 00:00 2023-12-08T08:13:14.140 INFO:teuthology.orchestra.run.smithi050.stdout:(101/147): python3-cachetools-4.2.4-1.el9.noarc 351 kB/s | 32 kB 00:00 2023-12-08T08:13:14.216 INFO:teuthology.orchestra.run.smithi050.stdout:(102/147): libarrow-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2023-12-08T08:13:14.232 INFO:teuthology.orchestra.run.smithi050.stdout:(103/147): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2023-12-08T08:13:14.316 INFO:teuthology.orchestra.run.smithi050.stdout:(104/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2023-12-08T08:13:14.358 INFO:teuthology.orchestra.run.smithi050.stdout:(105/147): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-12-08T08:13:14.408 INFO:teuthology.orchestra.run.smithi050.stdout:(106/147): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.1 MB/s | 838 kB 00:00 2023-12-08T08:13:14.434 INFO:teuthology.orchestra.run.smithi050.stdout:(107/147): python3-google-auth-2.23.4-1.el9.noa 1.6 MB/s | 197 kB 00:00 2023-12-08T08:13:14.459 INFO:teuthology.orchestra.run.smithi050.stdout:(108/147): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2023-12-08T08:13:14.509 INFO:teuthology.orchestra.run.smithi050.stdout:(109/147): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2023-12-08T08:13:14.534 INFO:teuthology.orchestra.run.smithi050.stdout:(110/147): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2023-12-08T08:13:14.560 INFO:teuthology.orchestra.run.smithi050.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2023-12-08T08:13:14.610 INFO:teuthology.orchestra.run.smithi050.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2023-12-08T08:13:14.635 INFO:teuthology.orchestra.run.smithi050.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-12-08T08:13:14.660 INFO:teuthology.orchestra.run.smithi050.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 407 kB/s | 41 kB 00:00 2023-12-08T08:13:14.736 INFO:teuthology.orchestra.run.smithi050.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2023-12-08T08:13:14.769 INFO:teuthology.orchestra.run.smithi050.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 726 kB/s | 79 kB 00:00 2023-12-08T08:13:14.811 INFO:teuthology.orchestra.run.smithi050.stdout:(117/147): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2023-12-08T08:13:14.845 INFO:teuthology.orchestra.run.smithi050.stdout:(118/147): python3-natsort-7.1.1-5.el9.noarch.r 531 kB/s | 58 kB 00:00 2023-12-08T08:13:14.887 INFO:teuthology.orchestra.run.smithi050.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2023-12-08T08:13:14.912 INFO:teuthology.orchestra.run.smithi050.stdout:(120/147): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2023-12-08T08:13:14.946 INFO:teuthology.orchestra.run.smithi050.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2023-12-08T08:13:14.988 INFO:teuthology.orchestra.run.smithi050.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2023-12-08T08:13:15.021 INFO:teuthology.orchestra.run.smithi050.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-08T08:13:15.038 INFO:teuthology.orchestra.run.smithi050.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2023-12-08T08:13:15.080 INFO:teuthology.orchestra.run.smithi050.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2023-12-08T08:13:15.131 INFO:teuthology.orchestra.run.smithi050.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 467 kB/s | 51 kB 00:00 2023-12-08T08:13:15.156 INFO:teuthology.orchestra.run.smithi050.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-12-08T08:13:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:(128/147): python3-websocket-client-1.2.3-2.el9 713 kB/s | 90 kB 00:00 2023-12-08T08:13:15.248 INFO:teuthology.orchestra.run.smithi050.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-12-08T08:13:15.273 INFO:teuthology.orchestra.run.smithi050.stdout:(130/147): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2023-12-08T08:13:15.324 INFO:teuthology.orchestra.run.smithi050.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-12-08T08:13:15.415 INFO:teuthology.orchestra.run.smithi050.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2023-12-08T08:13:15.449 INFO:teuthology.orchestra.run.smithi050.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-08T08:13:15.483 INFO:teuthology.orchestra.run.smithi050.stdout:(134/147): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-08T08:13:15.516 INFO:teuthology.orchestra.run.smithi050.stdout:(135/147): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-08T08:13:15.550 INFO:teuthology.orchestra.run.smithi050.stdout:(136/147): elfutils-libelf-0.190-1.el9.x86_64.r 5.6 MB/s | 192 kB 00:00 2023-12-08T08:13:15.592 INFO:teuthology.orchestra.run.smithi050.stdout:(137/147): elfutils-libs-0.190-1.el9.x86_64.rpm 6.0 MB/s | 255 kB 00:00 2023-12-08T08:13:15.634 INFO:teuthology.orchestra.run.smithi050.stdout:(138/147): libacl-2.3.1-4.el9.x86_64.rpm 531 kB/s | 22 kB 00:00 2023-12-08T08:13:15.676 INFO:teuthology.orchestra.run.smithi050.stdout:(139/147): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2023-12-08T08:13:15.811 INFO:teuthology.orchestra.run.smithi050.stdout:(140/147): librados2-19.0.0-46.ga2cd52c0.el9.x8 6.2 MB/s | 3.3 MB 00:00 2023-12-08T08:13:15.868 INFO:teuthology.orchestra.run.smithi050.stdout:(141/147): librbd1-19.0.0-46.ga2cd52c0.el9.x86_ 5.6 MB/s | 3.0 MB 00:00 2023-12-08T08:13:15.952 INFO:teuthology.orchestra.run.smithi050.stdout:(142/147): NetworkManager-team-1.45.7-1.el9.x86 522 kB/s | 43 kB 00:00 2023-12-08T08:13:16.052 INFO:teuthology.orchestra.run.smithi050.stdout:(143/147): NetworkManager-tui-1.45.7-1.el9.x86_ 2.4 MB/s | 246 kB 00:00 2023-12-08T08:13:16.160 INFO:teuthology.orchestra.run.smithi050.stdout:(144/147): NetworkManager-libnm-1.45.7-1.el9.x8 5.1 MB/s | 1.8 MB 00:00 2023-12-08T08:13:16.219 INFO:teuthology.orchestra.run.smithi050.stdout:(145/147): openssl-3.0.7-25.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2023-12-08T08:13:16.352 INFO:teuthology.orchestra.run.smithi050.stdout:(146/147): NetworkManager-1.45.7-1.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2023-12-08T08:13:16.603 INFO:teuthology.orchestra.run.smithi050.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.9 MB/s | 2.2 MB 00:00 2023-12-08T08:13:16.611 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2023-12-08T08:13:16.611 INFO:teuthology.orchestra.run.smithi050.stdout:Total 17 MB/s | 204 MB 00:12 2023-12-08T08:13:16.781 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2023-12-08T08:13:16.989 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2023-12-08T08:13:16.989 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2023-12-08T08:13:18.936 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2023-12-08T08:13:18.937 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2023-12-08T08:13:25.162 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2023-12-08T08:13:25.282 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-12-08T08:13:25.317 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-12-08T08:13:25.378 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-12-08T08:13:25.416 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-12-08T08:13:25.441 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-12-08T08:13:25.478 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-12-08T08:13:25.825 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-12-08T08:13:25.875 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:13:25.997 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:13:26.026 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:13:26.118 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:13:26.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:13:26.191 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-12-08T08:13:26.380 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-12-08T08:13:26.437 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-12-08T08:13:26.465 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:13:26.592 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:13:26.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:13:26.823 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:13:26.927 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:13:26.979 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:13:27.055 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 469 B/s | 15 kB 00:32 2023-12-08T08:13:27.080 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:13:27.131 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:13:27.339 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:13:27.441 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/162 2023-12-08T08:13:27.476 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-12-08T08:13:27.548 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-12-08T08:13:27.608 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-12-08T08:13:27.638 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-12-08T08:13:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-12-08T08:13:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-12-08T08:13:27.796 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-12-08T08:13:27.830 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-12-08T08:13:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-12-08T08:13:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-12-08T08:13:27.963 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 29/162 2023-12-08T08:13:27.998 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 30/162 2023-12-08T08:13:28.071 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 31/162 2023-12-08T08:13:28.209 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-12-08T08:13:28.275 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-12-08T08:13:28.541 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-12-08T08:13:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-12-08T08:13:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-12-08T08:13:28.951 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-12-08T08:13:29.001 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-12-08T08:13:29.038 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 38/162 2023-12-08T08:13:29.080 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-12-08T08:13:29.216 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-12-08T08:13:29.255 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-12-08T08:13:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-12-08T08:13:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/162 2023-12-08T08:13:29.456 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-12-08T08:13:29.528 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-12-08T08:13:29.558 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-12-08T08:13:29.595 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-12-08T08:13:29.642 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-12-08T08:13:29.687 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-12-08T08:13:29.730 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-12-08T08:13:29.866 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-12-08T08:13:29.914 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-12-08T08:13:29.956 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-12-08T08:13:30.051 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-12-08T08:13:30.090 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-12-08T08:13:30.131 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-12-08T08:13:30.171 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-12-08T08:13:30.268 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/162 2023-12-08T08:13:30.332 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-12-08T08:13:30.390 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-12-08T08:13:30.454 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-12-08T08:13:30.650 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-12-08T08:13:30.838 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-12-08T08:13:30.972 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-12-08T08:13:31.015 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-12-08T08:13:31.043 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-12-08T08:13:31.087 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-12-08T08:13:31.119 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-12-08T08:13:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-12-08T08:13:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-12-08T08:13:31.224 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-12-08T08:13:31.257 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-12-08T08:13:31.287 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-12-08T08:13:31.365 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-12-08T08:13:31.398 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-12-08T08:13:31.431 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-12-08T08:13:31.472 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-12-08T08:13:31.507 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-12-08T08:13:31.598 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-12-08T08:13:31.635 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-12-08T08:13:31.740 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-12-08T08:13:31.794 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-12-08T08:13:32.550 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-12-08T08:13:32.591 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-12-08T08:13:32.624 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-12-08T08:13:32.672 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-12-08T08:13:33.002 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-12-08T08:13:33.056 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-12-08T08:13:33.141 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-12-08T08:13:33.222 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-12-08T08:13:33.816 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-12-08T08:13:33.931 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-12-08T08:13:35.239 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-12-08T08:13:35.314 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-12-08T08:13:35.345 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-12-08T08:13:35.376 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-12-08T08:13:35.405 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-12-08T08:13:35.438 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-12-08T08:13:35.747 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-12-08T08:13:35.800 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:13:35.800 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-08T08:13:35.812 INFO:teuthology.orchestra.run.smithi170.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-08T08:13:35.812 INFO:teuthology.orchestra.run.smithi170.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-08T08:13:35.813 INFO:teuthology.orchestra.run.smithi170.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-08T08:13:35.814 INFO:teuthology.orchestra.run.smithi170.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-08T08:13:35.816 INFO:teuthology.orchestra.run.smithi170.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-08T08:13:35.818 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-08T08:13:35.819 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-08T08:13:35.826 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:13:35.894 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2023-12-08T08:13:35.917 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:13:35.920 INFO:teuthology.orchestra.run.smithi170.stdout:========================================================================================== 2023-12-08T08:13:35.920 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2023-12-08T08:13:35.920 INFO:teuthology.orchestra.run.smithi170.stdout:========================================================================================== 2023-12-08T08:13:35.920 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 6.5 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 5.2 M 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 860 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 141 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 1.5 M 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 133 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 1.8 M 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 7.4 M 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 50 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 8.6 M 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 41 M 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 262 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 801 k 2023-12-08T08:13:35.921 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 217 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 18 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 31 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 719 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 126 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-08T08:13:35.922 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 161 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 320 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 298 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 99 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 85 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 170 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-08T08:13:35.923 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.3 M 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 3.0 M 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-08T08:13:35.924 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 19 M 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 28 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 2.1 M 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 243 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.4 M 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 18 M 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-46.ga2cd52c0.el9 ceph-noarch 15 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 24 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-08T08:13:35.925 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 164 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 476 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 4.8 M 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-08T08:13:35.926 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 45 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el9 ceph 129 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-08T08:13:35.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-08T08:13:35.928 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-08T08:13:35.929 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-08T08:13:35.930 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout:========================================================================================== 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout:Install 132 Packages 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 15 Packages 2023-12-08T08:13:35.931 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:13:35.932 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 204 M 2023-12-08T08:13:35.932 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2023-12-08T08:13:35.947 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 100/162 2023-12-08T08:13:35.984 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-12-08T08:13:36.436 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/162 2023-12-08T08:13:36.462 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:13:36.533 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:13:36.555 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 104/162 2023-12-08T08:13:36.915 INFO:teuthology.orchestra.run.smithi170.stdout:(1/147): ceph-19.0.0-46.ga2cd52c0.el9.x86_64.rp 31 kB/s | 6.5 kB 00:00 2023-12-08T08:13:37.587 INFO:teuthology.orchestra.run.smithi170.stdout:(2/147): ceph-base-19.0.0-46.ga2cd52c0.el9.x86_ 5.9 MB/s | 5.2 MB 00:00 2023-12-08T08:13:37.637 INFO:teuthology.orchestra.run.smithi170.stdout:(3/147): ceph-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 1.2 MB/s | 860 kB 00:00 2023-12-08T08:13:37.662 INFO:teuthology.orchestra.run.smithi170.stdout:(4/147): ceph-immutable-object-cache-19.0.0-46. 1.8 MB/s | 141 kB 00:00 2023-12-08T08:13:38.037 INFO:teuthology.orchestra.run.smithi170.stdout:(5/147): ceph-common-19.0.0-46.ga2cd52c0.el9.x8 14 MB/s | 19 MB 00:01 2023-12-08T08:13:38.079 INFO:teuthology.orchestra.run.smithi170.stdout:(6/147): ceph-mgr-19.0.0-46.ga2cd52c0.el9.x86_6 3.5 MB/s | 1.5 MB 00:00 2023-12-08T08:13:38.338 INFO:teuthology.orchestra.run.smithi170.stdout:(7/147): ceph-mon-19.0.0-46.ga2cd52c0.el9.x86_6 15 MB/s | 4.4 MB 00:00 2023-12-08T08:13:38.582 INFO:teuthology.orchestra.run.smithi170.stdout:(8/147): ceph-mds-19.0.0-46.ga2cd52c0.el9.x86_6 2.2 MB/s | 2.1 MB 00:00 2023-12-08T08:13:38.655 INFO:teuthology.orchestra.run.smithi170.stdout:(9/147): ceph-selinux-19.0.0-46.ga2cd52c0.el9.x 321 kB/s | 24 kB 00:00 2023-12-08T08:13:38.729 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:13:38.769 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:13:38.981 INFO:teuthology.orchestra.run.smithi170.stdout:(10/147): ceph-radosgw-19.0.0-46.ga2cd52c0.el9. 13 MB/s | 8.6 MB 00:00 2023-12-08T08:13:39.047 INFO:teuthology.orchestra.run.smithi170.stdout:(11/147): cephfs-mirror-19.0.0-46.ga2cd52c0.el9 3.2 MB/s | 217 kB 00:00 2023-12-08T08:13:39.106 INFO:teuthology.orchestra.run.smithi170.stdout:(12/147): libcephfs-devel-19.0.0-46.ga2cd52c0.e 532 kB/s | 31 kB 00:00 2023-12-08T08:13:39.206 INFO:teuthology.orchestra.run.smithi170.stdout:(13/147): libcephfs2-19.0.0-46.ga2cd52c0.el9.x8 7.0 MB/s | 719 kB 00:00 2023-12-08T08:13:39.273 INFO:teuthology.orchestra.run.smithi170.stdout:(14/147): libcephsqlite-19.0.0-46.ga2cd52c0.el9 2.4 MB/s | 164 kB 00:00 2023-12-08T08:13:39.340 INFO:teuthology.orchestra.run.smithi170.stdout:(15/147): librados-devel-19.0.0-46.ga2cd52c0.el 1.9 MB/s | 126 kB 00:00 2023-12-08T08:13:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:13:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:13:39.424 INFO:teuthology.orchestra.run.smithi170.stdout:(16/147): libradosstriper1-19.0.0-46.ga2cd52c0. 5.6 MB/s | 476 kB 00:00 2023-12-08T08:13:39.488 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:13:39.489 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-08T08:13:39.489 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-08T08:13:39.489 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:39.531 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:13:39.799 INFO:teuthology.orchestra.run.smithi170.stdout:(17/147): ceph-osd-19.0.0-46.ga2cd52c0.el9.x86_ 10 MB/s | 18 MB 00:01 2023-12-08T08:13:39.883 INFO:teuthology.orchestra.run.smithi170.stdout:(18/147): librgw2-19.0.0-46.ga2cd52c0.el9.x86_6 10 MB/s | 4.8 MB 00:00 2023-12-08T08:13:39.908 INFO:teuthology.orchestra.run.smithi170.stdout:(19/147): python3-ceph-argparse-19.0.0-46.ga2cd 416 kB/s | 45 kB 00:00 2023-12-08T08:13:39.933 INFO:teuthology.orchestra.run.smithi170.stdout:(20/147): python3-ceph-common-19.0.0-46.ga2cd52 2.5 MB/s | 129 kB 00:00 2023-12-08T08:13:39.967 INFO:teuthology.orchestra.run.smithi170.stdout:(21/147): python3-cephfs-19.0.0-46.ga2cd52c0.el 2.7 MB/s | 161 kB 00:00 2023-12-08T08:13:39.992 INFO:teuthology.orchestra.run.smithi170.stdout:(22/147): python3-rados-19.0.0-46.ga2cd52c0.el9 5.3 MB/s | 320 kB 00:00 2023-12-08T08:13:40.034 INFO:teuthology.orchestra.run.smithi170.stdout:(23/147): python3-rbd-19.0.0-46.ga2cd52c0.el9.x 4.4 MB/s | 298 kB 00:00 2023-12-08T08:13:40.067 INFO:teuthology.orchestra.run.smithi170.stdout:(24/147): python3-rgw-19.0.0-46.ga2cd52c0.el9.x 1.3 MB/s | 99 kB 00:00 2023-12-08T08:13:40.093 INFO:teuthology.orchestra.run.smithi170.stdout:(25/147): rbd-fuse-19.0.0-46.ga2cd52c0.el9.x86_ 1.4 MB/s | 85 kB 00:00 2023-12-08T08:13:40.160 INFO:teuthology.orchestra.run.smithi170.stdout:(26/147): rbd-nbd-19.0.0-46.ga2cd52c0.el9.x86_6 2.5 MB/s | 170 kB 00:00 2023-12-08T08:13:40.235 INFO:teuthology.orchestra.run.smithi170.stdout:(27/147): ceph-grafana-dashboards-19.0.0-46.ga2 375 kB/s | 28 kB 00:00 2023-12-08T08:13:40.302 INFO:teuthology.orchestra.run.smithi170.stdout:(28/147): rbd-mirror-19.0.0-46.ga2cd52c0.el9.x8 13 MB/s | 3.0 MB 00:00 2023-12-08T08:13:40.328 INFO:teuthology.orchestra.run.smithi170.stdout:(29/147): ceph-mgr-cephadm-19.0.0-46.ga2cd52c0. 1.4 MB/s | 133 kB 00:00 2023-12-08T08:13:40.511 INFO:teuthology.orchestra.run.smithi170.stdout:(30/147): ceph-mgr-dashboard-19.0.0-46.ga2cd52c 8.4 MB/s | 1.8 MB 00:00 2023-12-08T08:13:40.578 INFO:teuthology.orchestra.run.smithi170.stdout:(31/147): ceph-mgr-modules-core-19.0.0-46.ga2cd 3.6 MB/s | 243 kB 00:00 2023-12-08T08:13:40.645 INFO:teuthology.orchestra.run.smithi170.stdout:(32/147): ceph-mgr-rook-19.0.0-46.ga2cd52c0.el9 753 kB/s | 50 kB 00:00 2023-12-08T08:13:40.712 INFO:teuthology.orchestra.run.smithi170.stdout:(33/147): ceph-prometheus-alerts-19.0.0-46.ga2c 228 kB/s | 15 kB 00:00 2023-12-08T08:13:40.779 INFO:teuthology.orchestra.run.smithi170.stdout:(34/147): ceph-volume-19.0.0-46.ga2cd52c0.el9.n 3.8 MB/s | 262 kB 00:00 2023-12-08T08:13:40.912 INFO:teuthology.orchestra.run.smithi170.stdout:(35/147): cephadm-19.0.0-46.ga2cd52c0.el9.noarc 5.9 MB/s | 801 kB 00:00 2023-12-08T08:13:41.046 INFO:teuthology.orchestra.run.smithi170.stdout:(36/147): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2023-12-08T08:13:41.071 INFO:teuthology.orchestra.run.smithi170.stdout:(37/147): cephfs-top-19.0.0-46.ga2cd52c0.el9.no 115 kB/s | 18 kB 00:00 2023-12-08T08:13:41.230 INFO:teuthology.orchestra.run.smithi170.stdout:(38/147): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2023-12-08T08:13:41.280 INFO:teuthology.orchestra.run.smithi170.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 4.3 MB/s | 920 kB 00:00 2023-12-08T08:13:41.306 INFO:teuthology.orchestra.run.smithi170.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2023-12-08T08:13:41.322 INFO:teuthology.orchestra.run.smithi170.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 514 kB/s | 21 kB 00:00 2023-12-08T08:13:41.348 INFO:teuthology.orchestra.run.smithi170.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-12-08T08:13:41.364 INFO:teuthology.orchestra.run.smithi170.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 766 kB/s | 32 kB 00:00 2023-12-08T08:13:41.423 INFO:teuthology.orchestra.run.smithi170.stdout:(44/147): flexiblas-openblas-openmp-3.0.4-8.el9 297 kB/s | 17 kB 00:00 2023-12-08T08:13:41.482 INFO:teuthology.orchestra.run.smithi170.stdout:(45/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2023-12-08T08:13:41.499 INFO:teuthology.orchestra.run.smithi170.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2023-12-08T08:13:41.524 INFO:teuthology.orchestra.run.smithi170.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 242 kB/s | 10 kB 00:00 2023-12-08T08:13:41.549 INFO:teuthology.orchestra.run.smithi170.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-08T08:13:41.575 INFO:teuthology.orchestra.run.smithi170.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2023-12-08T08:13:41.600 INFO:teuthology.orchestra.run.smithi170.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-08T08:13:41.625 INFO:teuthology.orchestra.run.smithi170.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-12-08T08:13:41.654 INFO:teuthology.orchestra.run.smithi170.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 497 kB/s | 24 kB 00:00 2023-12-08T08:13:41.677 INFO:teuthology.orchestra.run.smithi170.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 907 kB/s | 46 kB 00:00 2023-12-08T08:13:41.702 INFO:teuthology.orchestra.run.smithi170.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.4 MB/s | 282 kB 00:00 2023-12-08T08:13:41.728 INFO:teuthology.orchestra.run.smithi170.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-12-08T08:13:41.753 INFO:teuthology.orchestra.run.smithi170.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 688 kB/s | 34 kB 00:00 2023-12-08T08:13:41.845 INFO:teuthology.orchestra.run.smithi170.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2023-12-08T08:13:41.879 INFO:teuthology.orchestra.run.smithi170.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2023-12-08T08:13:41.904 INFO:teuthology.orchestra.run.smithi170.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2023-12-08T08:13:41.929 INFO:teuthology.orchestra.run.smithi170.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-12-08T08:13:42.046 INFO:teuthology.orchestra.run.smithi170.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2023-12-08T08:13:42.163 INFO:teuthology.orchestra.run.smithi170.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2023-12-08T08:13:42.188 INFO:teuthology.orchestra.run.smithi170.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-12-08T08:13:42.214 INFO:teuthology.orchestra.run.smithi170.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2023-12-08T08:13:42.239 INFO:teuthology.orchestra.run.smithi170.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2023-12-08T08:13:42.266 INFO:teuthology.orchestra.run.smithi170.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-08T08:13:42.289 INFO:teuthology.orchestra.run.smithi170.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2023-12-08T08:13:42.399 INFO:teuthology.orchestra.run.smithi170.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-08T08:13:42.424 INFO:teuthology.orchestra.run.smithi170.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-12-08T08:13:42.449 INFO:teuthology.orchestra.run.smithi170.stdout:(70/147): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-12-08T08:13:42.475 INFO:teuthology.orchestra.run.smithi170.stdout:(71/147): python3-prettytable-0.7.2-27.el9.noar 987 kB/s | 41 kB 00:00 2023-12-08T08:13:42.492 INFO:teuthology.orchestra.run.smithi170.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-12-08T08:13:42.517 INFO:teuthology.orchestra.run.smithi170.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-08T08:13:42.543 INFO:teuthology.orchestra.run.smithi170.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 946 kB/s | 47 kB 00:00 2023-12-08T08:13:42.584 INFO:teuthology.orchestra.run.smithi170.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 43 kB 00:00 2023-12-08T08:13:43.034 INFO:teuthology.orchestra.run.smithi170.stdout:(76/147): ceph-test-19.0.0-46.ga2cd52c0.el9.x86 9.4 MB/s | 41 MB 00:04 2023-12-08T08:13:43.067 INFO:teuthology.orchestra.run.smithi170.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 80 kB/s | 39 kB 00:00 2023-12-08T08:13:43.226 INFO:teuthology.orchestra.run.smithi170.stdout:(78/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2023-12-08T08:13:43.251 INFO:teuthology.orchestra.run.smithi170.stdout:(79/147): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2023-12-08T08:13:43.276 INFO:teuthology.orchestra.run.smithi170.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 274 kB/s | 56 kB 00:00 2023-12-08T08:13:43.302 INFO:teuthology.orchestra.run.smithi170.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.1 MB/s | 85 kB 00:00 2023-12-08T08:13:43.327 INFO:teuthology.orchestra.run.smithi170.stdout:(82/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2023-12-08T08:13:43.352 INFO:teuthology.orchestra.run.smithi170.stdout:(83/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 831 kB/s | 63 kB 00:00 2023-12-08T08:13:43.377 INFO:teuthology.orchestra.run.smithi170.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-08T08:13:43.411 INFO:teuthology.orchestra.run.smithi170.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2023-12-08T08:13:43.436 INFO:teuthology.orchestra.run.smithi170.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.4 MB/s | 195 kB 00:00 2023-12-08T08:13:43.461 INFO:teuthology.orchestra.run.smithi170.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2023-12-08T08:13:43.495 INFO:teuthology.orchestra.run.smithi170.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-08T08:13:43.520 INFO:teuthology.orchestra.run.smithi170.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-08T08:13:43.546 INFO:teuthology.orchestra.run.smithi170.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-12-08T08:13:43.571 INFO:teuthology.orchestra.run.smithi170.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-08T08:13:43.596 INFO:teuthology.orchestra.run.smithi170.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-08T08:13:43.830 INFO:teuthology.orchestra.run.smithi170.stdout:(93/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.3 MB/s | 309 kB 00:00 2023-12-08T08:13:44.447 INFO:teuthology.orchestra.run.smithi170.stdout:(94/147): python3-devel-3.9.17-2.el9.x86_64.rpm 280 kB/s | 245 kB 00:00 2023-12-08T08:13:44.588 INFO:teuthology.orchestra.run.smithi170.stdout:(95/147): libarrow-doc-9.0.0-10.el9.noarch.rpm 184 kB/s | 26 kB 00:00 2023-12-08T08:13:44.647 INFO:teuthology.orchestra.run.smithi170.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 835 kB/s | 49 kB 00:00 2023-12-08T08:13:44.747 INFO:teuthology.orchestra.run.smithi170.stdout:(97/147): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2023-12-08T08:13:44.772 INFO:teuthology.orchestra.run.smithi170.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2023-12-08T08:13:44.840 INFO:teuthology.orchestra.run.smithi170.stdout:(99/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.2 MB/s | 4.1 MB 00:01 2023-12-08T08:13:44.965 INFO:teuthology.orchestra.run.smithi170.stdout:(100/147): python3-asyncssh-2.13.2-3.el9.noarch 2.8 MB/s | 548 kB 00:00 2023-12-08T08:13:44.998 INFO:teuthology.orchestra.run.smithi170.stdout:(101/147): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.3 MB/s | 838 kB 00:00 2023-12-08T08:13:45.015 INFO:teuthology.orchestra.run.smithi170.stdout:(102/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 248 kB/s | 43 kB 00:00 2023-12-08T08:13:45.041 INFO:teuthology.orchestra.run.smithi170.stdout:(103/147): python3-cachetools-4.2.4-1.el9.noarc 426 kB/s | 32 kB 00:00 2023-12-08T08:13:45.057 INFO:teuthology.orchestra.run.smithi170.stdout:(104/147): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2023-12-08T08:13:45.091 INFO:teuthology.orchestra.run.smithi170.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2023-12-08T08:13:45.133 INFO:teuthology.orchestra.run.smithi170.stdout:(106/147): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2023-12-08T08:13:45.158 INFO:teuthology.orchestra.run.smithi170.stdout:(107/147): python3-google-auth-2.23.4-1.el9.noa 1.9 MB/s | 197 kB 00:00 2023-12-08T08:13:45.183 INFO:teuthology.orchestra.run.smithi170.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2023-12-08T08:13:45.209 INFO:teuthology.orchestra.run.smithi170.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2023-12-08T08:13:45.225 INFO:teuthology.orchestra.run.smithi170.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2023-12-08T08:13:45.251 INFO:teuthology.orchestra.run.smithi170.stdout:(111/147): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2023-12-08T08:13:45.268 INFO:teuthology.orchestra.run.smithi170.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2023-12-08T08:13:45.285 INFO:teuthology.orchestra.run.smithi170.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 154 kB/s | 9.0 kB 00:00 2023-12-08T08:13:45.302 INFO:teuthology.orchestra.run.smithi170.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 811 kB/s | 41 kB 00:00 2023-12-08T08:13:45.318 INFO:teuthology.orchestra.run.smithi170.stdout:(115/147): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2023-12-08T08:13:45.344 INFO:teuthology.orchestra.run.smithi170.stdout:(116/147): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2023-12-08T08:13:45.361 INFO:teuthology.orchestra.run.smithi170.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2023-12-08T08:13:45.394 INFO:teuthology.orchestra.run.smithi170.stdout:(118/147): python3-portend-3.1.0-2.el9.noarch.r 496 kB/s | 16 kB 00:00 2023-12-08T08:13:45.436 INFO:teuthology.orchestra.run.smithi170.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2023-12-08T08:13:45.461 INFO:teuthology.orchestra.run.smithi170.stdout:(120/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-12-08T08:13:45.495 INFO:teuthology.orchestra.run.smithi170.stdout:(121/147): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2023-12-08T08:13:45.521 INFO:teuthology.orchestra.run.smithi170.stdout:(122/147): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2023-12-08T08:13:45.546 INFO:teuthology.orchestra.run.smithi170.stdout:(123/147): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-12-08T08:13:45.580 INFO:teuthology.orchestra.run.smithi170.stdout:(124/147): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2023-12-08T08:13:45.605 INFO:teuthology.orchestra.run.smithi170.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2023-12-08T08:13:45.630 INFO:teuthology.orchestra.run.smithi170.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 608 kB/s | 51 kB 00:00 2023-12-08T08:13:45.655 INFO:teuthology.orchestra.run.smithi170.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2023-12-08T08:13:45.681 INFO:teuthology.orchestra.run.smithi170.stdout:(128/147): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-12-08T08:13:45.706 INFO:teuthology.orchestra.run.smithi170.stdout:(129/147): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2023-12-08T08:13:45.748 INFO:teuthology.orchestra.run.smithi170.stdout:(130/147): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-12-08T08:13:45.773 INFO:teuthology.orchestra.run.smithi170.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-12-08T08:13:46.023 INFO:teuthology.orchestra.run.smithi170.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2023-12-08T08:13:46.082 INFO:teuthology.orchestra.run.smithi170.stdout:(133/147): librbd1-19.0.0-46.ga2cd52c0.el9.x86_ 9.8 MB/s | 3.0 MB 00:00 2023-12-08T08:13:46.107 INFO:teuthology.orchestra.run.smithi170.stdout:(134/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 810 kB/s | 68 kB 00:00 2023-12-08T08:13:46.216 INFO:teuthology.orchestra.run.smithi170.stdout:(135/147): librados2-19.0.0-46.ga2cd52c0.el9.x8 7.1 MB/s | 3.3 MB 00:00 2023-12-08T08:13:46.241 INFO:teuthology.orchestra.run.smithi170.stdout:(136/147): acl-2.3.1-4.el9.x86_64.rpm 434 kB/s | 69 kB 00:00 2023-12-08T08:13:46.266 INFO:teuthology.orchestra.run.smithi170.stdout:(137/147): elfutils-debuginfod-client-0.190-1.e 230 kB/s | 36 kB 00:00 2023-12-08T08:13:46.400 INFO:teuthology.orchestra.run.smithi170.stdout:(138/147): elfutils-libelf-0.190-1.el9.x86_64.r 1.0 MB/s | 192 kB 00:00 2023-12-08T08:13:46.500 INFO:teuthology.orchestra.run.smithi170.stdout:(139/147): elfutils-libs-0.190-1.el9.x86_64.rpm 1.1 MB/s | 255 kB 00:00 2023-12-08T08:13:46.525 INFO:teuthology.orchestra.run.smithi170.stdout:(140/147): libacl-2.3.1-4.el9.x86_64.rpm 85 kB/s | 22 kB 00:00 2023-12-08T08:13:46.617 INFO:teuthology.orchestra.run.smithi170.stdout:(141/147): xfsdump-3.1.12-4.el9.x86_64.rpm 1.4 MB/s | 321 kB 00:00 2023-12-08T08:13:47.917 INFO:teuthology.orchestra.run.smithi170.stdout:(142/147): NetworkManager-team-1.45.7-1.el9.x86 33 kB/s | 43 kB 00:01 2023-12-08T08:13:48.026 INFO:teuthology.orchestra.run.smithi170.stdout:(143/147): NetworkManager-tui-1.45.7-1.el9.x86_ 2.2 MB/s | 246 kB 00:00 2023-12-08T08:13:48.118 INFO:teuthology.orchestra.run.smithi170.stdout:(144/147): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2023-12-08T08:13:48.202 INFO:teuthology.orchestra.run.smithi170.stdout:(145/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 26 MB/s | 2.2 MB 00:00 2023-12-08T08:13:51.533 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:13:51.533 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2023-12-08T08:13:51.533 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2023-12-08T08:13:51.533 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2023-12-08T08:13:51.534 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2023-12-08T08:13:51.534 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2023-12-08T08:13:51.534 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2023-12-08T08:13:51.534 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2023-12-08T08:13:51.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-08T08:13:51.719 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:53.339 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:13:53.368 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:13:53.368 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:53.368 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-08T08:13:53.368 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:13:53.369 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:13:53.369 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:53.573 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:13:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:13:53.597 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:53.597 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-08T08:13:53.597 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:13:53.597 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:13:53.597 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:53.909 INFO:teuthology.orchestra.run.smithi170.stdout:(146/147): NetworkManager-libnm-1.45.7-1.el9.x8 246 kB/s | 1.8 MB 00:07 2023-12-08T08:13:54.065 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:13:54.089 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:13:54.090 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:54.090 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-08T08:13:54.090 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:13:54.090 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:13:54.090 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:54.184 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-12-08T08:13:54.587 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:13:54.615 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:13:54.646 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 114/162 2023-12-08T08:13:54.709 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 115/162 2023-12-08T08:13:54.738 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:13:54.975 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:13:55.006 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:13:56.021 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:13:56.047 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:13:56.151 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:13:56.314 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 119/162 2023-12-08T08:13:56.343 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:13:56.368 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:13:56.368 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:56.368 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-08T08:13:56.368 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:13:56.368 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:13:56.368 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:56.402 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:13:56.413 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:13:56.465 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 122/162 2023-12-08T08:13:57.283 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-12-08T08:13:57.313 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:13:57.337 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:13:57.337 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:57.337 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-08T08:13:57.337 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:13:57.337 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:13:57.337 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:13:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:13:57.404 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:57.404 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-08T08:13:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:13:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:13:57.471 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:57.471 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-08T08:13:57.471 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:13:57.471 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:13:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:13:57.773 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:13:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:13:57.797 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:13:57.797 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-08T08:13:57.797 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:13:57.797 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:13:57.797 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:14:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 128/162 2023-12-08T08:14:01.893 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 129/162 2023-12-08T08:14:01.934 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 130/162 2023-12-08T08:14:01.966 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-12-08T08:14:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-12-08T08:14:02.277 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-12-08T08:14:02.314 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 134/162 2023-12-08T08:14:02.347 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:14:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-12-08T08:14:02.469 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:14:02.515 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/162 2023-12-08T08:14:02.545 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 139/162 2023-12-08T08:14:02.590 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 140/162 2023-12-08T08:14:03.189 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:14:03.231 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:14:03.251 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:14:04.114 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 142/162 2023-12-08T08:14:04.223 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-12-08T08:14:04.277 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-12-08T08:14:04.320 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-12-08T08:14:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-12-08T08:14:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-12-08T08:14:04.489 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-12-08T08:14:04.514 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-12-08T08:14:04.541 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-12-08T08:14:04.541 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:14:04.625 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:14:04.653 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-12-08T08:14:04.684 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-12-08T08:14:04.709 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-12-08T08:14:04.709 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:14:04.793 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:14:04.819 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:14:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:14:04.825 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:14:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:14:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:14:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:14:05.104 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-12-08T08:14:05.130 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-12-08T08:14:05.155 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-12-08T08:14:05.224 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 1/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 3/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 4/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 5/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 6/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 7/162 2023-12-08T08:14:09.735 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 11/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 12/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 13/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 15/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 16/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 17/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 18/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 19/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 20/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 21/162 2023-12-08T08:14:09.736 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 22/162 2023-12-08T08:14:09.737 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 23/162 2023-12-08T08:14:09.737 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 24/162 2023-12-08T08:14:09.737 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 25/162 2023-12-08T08:14:09.737 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 26/162 2023-12-08T08:14:09.737 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 27/162 2023-12-08T08:14:09.737 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 28/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 29/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 30/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 31/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 32/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 33/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 34/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 35/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 36/162 2023-12-08T08:14:09.749 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 37/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 38/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-12-08T08:14:09.750 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-12-08T08:14:09.751 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-12-08T08:14:09.752 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 96/162 2023-12-08T08:14:09.753 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 97/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 100/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-12-08T08:14:09.754 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-12-08T08:14:09.755 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 133/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : acl-2.3.1-4.el9.x86_64 139/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : acl-2.3.1-3.el9.x86_64 140/162 2023-12-08T08:14:09.756 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 141/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 142/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 143/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 144/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 145/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 146/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 147/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 148/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 149/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 150/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 151/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 152/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 153/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 155/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:14:09.757 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 157/162 2023-12-08T08:14:09.758 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:14:09.758 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-12-08T08:14:09.758 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-12-08T08:14:09.758 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-12-08T08:14:12.198 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-12-08T08:14:12.198 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:14:12.198 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2023-12-08T08:14:12.198 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-08T08:14:12.198 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-08T08:14:12.198 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: acl-2.3.1-4.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2023-12-08T08:14:12.199 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.200 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-08T08:14:12.201 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.6-16.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-08T08:14:12.202 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-08T08:14:12.203 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.11-1.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-08T08:14:12.204 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-08T08:14:12.205 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-08T08:14:12.206 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-08T08:14:12.207 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-3.el9.x86_64 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-08T08:14:12.208 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-08T08:14:12.209 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-08T08:14:12.209 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-08T08:14:12.209 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-08T08:14:12.210 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:14:12.211 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2023-12-08T08:14:12.781 DEBUG:teuthology.parallel:result is None 2023-12-08T08:15:57.770 INFO:teuthology.orchestra.run.smithi170.stdout:[MIRROR] NetworkManager-1.45.7-1.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://mirror.siena.edu/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.45.7-1.el9.x86_64.rpm [Failed to connect to mirror.siena.edu port 80: Connection timed out] 2023-12-08T08:15:58.708 INFO:teuthology.orchestra.run.smithi170.stdout:(147/147): NetworkManager-1.45.7-1.el9.x86_64.r 17 kB/s | 2.3 MB 02:12 2023-12-08T08:15:58.708 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2023-12-08T08:15:58.709 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.4 MB/s | 204 MB 02:22 2023-12-08T08:15:58.872 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2023-12-08T08:15:59.054 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2023-12-08T08:15:59.054 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2023-12-08T08:16:00.941 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2023-12-08T08:16:00.941 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2023-12-08T08:16:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2023-12-08T08:16:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-12-08T08:16:06.937 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-12-08T08:16:06.991 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-12-08T08:16:07.028 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-12-08T08:16:07.054 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-12-08T08:16:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-12-08T08:16:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-12-08T08:16:07.488 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:16:07.590 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:16:07.614 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:16:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:16:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:16:07.781 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-12-08T08:16:07.970 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-12-08T08:16:08.026 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-12-08T08:16:08.055 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:16:08.139 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:16:08.164 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:16:08.386 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 15/162 2023-12-08T08:16:08.510 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:16:08.553 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/162 2023-12-08T08:16:08.642 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:16:08.704 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:16:08.922 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/162 2023-12-08T08:16:09.014 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/162 2023-12-08T08:16:09.042 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-12-08T08:16:09.128 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-12-08T08:16:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-12-08T08:16:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-12-08T08:16:09.257 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-12-08T08:16:09.304 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-12-08T08:16:09.368 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-12-08T08:16:09.404 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-12-08T08:16:09.431 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-12-08T08:16:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-12-08T08:16:09.528 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 29/162 2023-12-08T08:16:09.563 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 30/162 2023-12-08T08:16:09.635 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 31/162 2023-12-08T08:16:09.770 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-12-08T08:16:09.823 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-12-08T08:16:10.330 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-12-08T08:16:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-12-08T08:16:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-12-08T08:16:10.499 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-12-08T08:16:10.536 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 38/162 2023-12-08T08:16:10.579 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-12-08T08:16:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-12-08T08:16:10.763 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-12-08T08:16:10.860 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-12-08T08:16:10.899 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/162 2023-12-08T08:16:10.953 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-12-08T08:16:11.018 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-12-08T08:16:11.050 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-12-08T08:16:11.086 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-12-08T08:16:11.132 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-12-08T08:16:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-12-08T08:16:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-12-08T08:16:11.343 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-12-08T08:16:11.389 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-12-08T08:16:11.430 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-12-08T08:16:11.522 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-12-08T08:16:11.557 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-12-08T08:16:11.597 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-12-08T08:16:11.630 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-12-08T08:16:11.722 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/162 2023-12-08T08:16:11.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-12-08T08:16:11.814 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-12-08T08:16:11.869 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-12-08T08:16:12.056 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-12-08T08:16:12.094 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-12-08T08:16:12.210 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-12-08T08:16:12.250 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-12-08T08:16:12.271 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-12-08T08:16:12.305 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-12-08T08:16:12.337 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-12-08T08:16:12.368 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-12-08T08:16:12.396 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-12-08T08:16:12.439 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-12-08T08:16:12.492 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-12-08T08:16:12.522 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-12-08T08:16:12.596 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-12-08T08:16:12.632 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-12-08T08:16:12.666 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-12-08T08:16:12.707 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-12-08T08:16:12.725 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-12-08T08:16:12.812 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-12-08T08:16:12.853 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-12-08T08:16:12.952 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-12-08T08:16:13.003 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-12-08T08:16:13.711 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-12-08T08:16:13.759 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-12-08T08:16:13.784 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-12-08T08:16:13.817 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-12-08T08:16:13.994 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-12-08T08:16:14.024 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-12-08T08:16:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-12-08T08:16:14.734 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-12-08T08:16:14.852 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-12-08T08:16:16.058 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-12-08T08:16:16.133 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-12-08T08:16:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-12-08T08:16:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-12-08T08:16:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-12-08T08:16:16.257 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-12-08T08:16:16.558 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-12-08T08:16:16.587 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:16:16.661 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 99/162 2023-12-08T08:16:16.691 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 100/162 2023-12-08T08:16:16.728 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-12-08T08:16:17.154 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/162 2023-12-08T08:16:17.182 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:16:17.253 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 103/162 2023-12-08T08:16:17.275 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 104/162 2023-12-08T08:16:19.333 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:16:19.372 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:16:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 105/162 2023-12-08T08:16:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:16:20.034 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 106/162 2023-12-08T08:16:20.034 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-08T08:16:20.034 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-08T08:16:20.034 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:20.068 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:16:31.527 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 107/162 2023-12-08T08:16:31.527 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2023-12-08T08:16:31.527 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2023-12-08T08:16:31.527 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2023-12-08T08:16:31.527 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2023-12-08T08:16:31.527 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2023-12-08T08:16:31.528 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2023-12-08T08:16:31.528 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2023-12-08T08:16:31.528 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:31.698 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:16:31.713 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 108/162 2023-12-08T08:16:31.713 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:31.713 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-08T08:16:31.713 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:33.293 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:16:33.330 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 109/162 2023-12-08T08:16:33.330 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:33.330 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-08T08:16:33.330 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:16:33.330 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-08T08:16:33.330 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:16:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 110/162 2023-12-08T08:16:33.542 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:33.542 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-08T08:16:33.542 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:16:33.542 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-08T08:16:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:16:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 111/162 2023-12-08T08:16:34.016 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:34.016 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-08T08:16:34.017 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:16:34.017 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-08T08:16:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-12-08T08:16:34.574 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:16:34.603 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 113/162 2023-12-08T08:16:34.632 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 114/162 2023-12-08T08:16:34.693 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 115/162 2023-12-08T08:16:34.726 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:16:34.950 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 116/162 2023-12-08T08:16:34.985 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:16:35.939 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 117/162 2023-12-08T08:16:35.969 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:16:36.068 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 118/162 2023-12-08T08:16:36.227 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 119/162 2023-12-08T08:16:36.280 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:16:36.302 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 120/162 2023-12-08T08:16:36.302 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:36.302 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-08T08:16:36.302 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:16:36.303 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-08T08:16:36.303 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:36.347 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:16:36.357 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 121/162 2023-12-08T08:16:36.410 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 122/162 2023-12-08T08:16:37.179 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-12-08T08:16:37.216 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:16:37.237 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 124/162 2023-12-08T08:16:37.238 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:37.238 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-08T08:16:37.238 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:16:37.238 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-08T08:16:37.238 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:37.275 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:16:37.296 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 125/162 2023-12-08T08:16:37.296 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:37.296 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-08T08:16:37.296 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:37.342 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:16:37.364 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 126/162 2023-12-08T08:16:37.364 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:37.364 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-08T08:16:37.364 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:16:37.364 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-08T08:16:37.364 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:37.659 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:16:37.681 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 127/162 2023-12-08T08:16:37.682 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-08T08:16:37.682 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-08T08:16:37.682 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:16:37.682 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-08T08:16:37.682 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:41.496 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 128/162 2023-12-08T08:16:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 129/162 2023-12-08T08:16:41.578 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 130/162 2023-12-08T08:16:41.610 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-12-08T08:16:41.804 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-12-08T08:16:41.918 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-12-08T08:16:41.959 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 134/162 2023-12-08T08:16:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:16:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-12-08T08:16:42.091 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:16:42.127 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 138/162 2023-12-08T08:16:42.156 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 139/162 2023-12-08T08:16:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 140/162 2023-12-08T08:16:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:16:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:16:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-12-08T08:16:43.607 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 142/162 2023-12-08T08:16:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-12-08T08:16:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-12-08T08:16:43.823 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-12-08T08:16:43.929 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-12-08T08:16:43.969 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-12-08T08:16:43.994 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-12-08T08:16:44.019 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-12-08T08:16:44.048 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-12-08T08:16:44.048 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:16:44.124 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-12-08T08:16:44.152 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-12-08T08:16:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-12-08T08:16:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-12-08T08:16:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:16:44.300 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-12-08T08:16:44.325 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:16:44.332 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:16:44.332 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:16:44.511 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-12-08T08:16:44.511 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:16:44.596 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:16:44.628 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-12-08T08:16:44.653 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-12-08T08:16:44.678 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-12-08T08:16:44.744 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:16:49.303 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 1/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 3/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 4/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 5/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 6/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 7/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 8/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 9/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 10/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 11/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 12/162 2023-12-08T08:16:49.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 13/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 14/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 15/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 16/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 17/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_6 18/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 19/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9. 20/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x8 21/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 22/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 23/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 24/162 2023-12-08T08:16:49.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 25/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 26/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 27/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 28/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 29/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarc 30/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noa 31/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 32/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9. 33/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 34/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9 35/162 2023-12-08T08:16:49.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 36/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 37/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 38/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-12-08T08:16:49.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-12-08T08:16:49.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-12-08T08:16:49.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-12-08T08:16:49.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 96/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 97/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 100/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-12-08T08:16:49.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-12-08T08:16:49.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 133/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 135/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-4.el9.x86_64 139/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-3.el9.x86_64 140/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 141/162 2023-12-08T08:16:49.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 142/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 143/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 144/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 145/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 146/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 147/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 148/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 149/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 150/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 151/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 152/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 153/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 154/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 155/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-12-08T08:16:49.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 157/162 2023-12-08T08:16:49.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 158/162 2023-12-08T08:16:49.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-12-08T08:16:49.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-12-08T08:16:49.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: acl-2.3.1-4.el9.x86_64 2023-12-08T08:16:51.757 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: automake-1.16.2-8.el9.noarch 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: bison-3.7.4-5.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-08T08:16:51.758 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.759 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top-2:19.0.0-46.ga2cd52c0.el9.noarch 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: flex-2.6.4-9.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: jq-1.6-16.el9.x86_64 2023-12-08T08:16:51.760 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-08T08:16:51.761 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-08T08:16:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-08T08:16:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-08T08:16:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-08T08:16:51.762 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-13.11-1.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-08T08:16:51.763 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-08T08:16:51.764 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-08T08:16:51.765 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-08T08:16:51.766 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-08T08:16:51.767 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-46.ga2cd52c0.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-08T08:16:51.768 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-08T08:16:51.769 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-08T08:16:51.769 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:51.769 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2023-12-08T08:16:52.379 DEBUG:teuthology.parallel:result is None 2023-12-08T08:16:52.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:16:52.601 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-08T08:16:52.627 INFO:teuthology.orchestra.run.smithi050.stdout:19.0.0-46.ga2cd52c0.el9 2023-12-08T08:16:52.628 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46.ga2cd52c0.el9 2023-12-08T08:16:52.628 INFO:teuthology.task.install:The correct ceph version 19.0.0-46.ga2cd52c0 is installed. 2023-12-08T08:16:52.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-08T08:16:52.857 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-08T08:16:52.881 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-46.ga2cd52c0.el9 2023-12-08T08:16:52.881 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46.ga2cd52c0.el9 2023-12-08T08:16:52.881 INFO:teuthology.task.install:The correct ceph version 19.0.0-46.ga2cd52c0 is installed. 2023-12-08T08:16:52.881 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-08T08:16:52.882 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:52.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T08:16:52.922 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:52.922 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-08T08:16:52.955 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-08T08:16:52.955 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:52.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T08:16:52.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T08:16:53.071 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:53.071 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2023-12-08T08:16:53.104 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-08T08:16:53.173 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-08T08:16:53.173 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:53.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T08:16:53.207 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T08:16:53.277 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:53.278 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-08T08:16:53.307 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-08T08:16:53.375 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-08T08:16:53.376 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:53.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T08:16:53.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T08:16:53.478 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:53.478 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2023-12-08T08:16:53.507 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-08T08:16:53.575 INFO:teuthology.run_tasks:Running task ceph... 2023-12-08T08:16:53.646 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-08T08:16:53.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2023-12-08T08:16:53.648 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2023-12-08T08:16:53.677 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-08T08:16:53.677 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T08:16:53.719 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-08T08:16:53.747 INFO:tasks.ceph:Creating extra log directories... 2023-12-08T08:16:53.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T08:16:53.790 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-08T08:16:53.825 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-08T08:16:53.825 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-08T08:16:53.825 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-08T08:16:53.825 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:53.825 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T08:16:53.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:54.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:54.030 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:54.030 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-08T08:16:54.045 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:54.164 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-08T08:16:54.196 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-08T08:16:54.196 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-08T08:16:54.196 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778', 'branch': 'wip-vshankar-testing-20231206.125818', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7483778', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231206.125818'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231206.125818', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4099, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'sleep_before_teardown': 0, 'subset': '359/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231206.125818', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7oxiOYntLysSSVuZVCqY5GSlTgDlXicqBhjOI9zXL8PLyU0TAggQ/8kMRlcuwHAIkGZHA3MFyVCziOogafIdw=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHrqlqrdMfTyN+dpTr/N1G7eeyJKe2GxvX9vOHdIjm6ByxTiwA66XWPGhH9E7WVsXBijxaK2tyDwxtz8lIx32dA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-08_07:46:48', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-08T08:16:54.197 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T08:16:54.199 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-08T08:16:54.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T08:16:54.254 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2023-12-08T08:16:54.313 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:54.313 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T08:16:54.337 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T08:16:54.337 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-08 08:14:05.571664223 +0000 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-08 08:12:06.089005790 +0000 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-08 08:12:06.089005790 +0000 2023-12-08T08:16:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-08 08:12:06.089005790 +0000 2023-12-08T08:16:54.394 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T08:16:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-08T08:16:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-08T08:16:54.463 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000100136 s, 5.1 MB/s 2023-12-08T08:16:54.464 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T08:16:54.520 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2023-12-08T08:16:54.575 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T08:16:54.575 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:54.575 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-08T08:16:54.575 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:54.575 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:54.576 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-08 08:14:05.571664223 +0000 2023-12-08T08:16:54.576 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-08 08:12:06.593993002 +0000 2023-12-08T08:16:54.576 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-08 08:12:06.593993002 +0000 2023-12-08T08:16:54.576 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-08 08:12:06.593993002 +0000 2023-12-08T08:16:54.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T08:16:54.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-08T08:16:54.644 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-08T08:16:54.644 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000103656 s, 4.9 MB/s 2023-12-08T08:16:54.645 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T08:16:54.701 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-08 08:14:05.571664223 +0000 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-08 08:12:07.088980468 +0000 2023-12-08T08:16:54.756 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-08 08:12:07.088980468 +0000 2023-12-08T08:16:54.757 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-08 08:12:07.088980468 +0000 2023-12-08T08:16:54.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T08:16:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-08T08:16:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-08T08:16:54.825 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 8.9966e-05 s, 5.7 MB/s 2023-12-08T08:16:54.826 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T08:16:54.882 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2023-12-08T08:16:54.937 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T08:16:54.937 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:54.937 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-08T08:16:54.937 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:54.937 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:54.938 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2023-12-08 08:14:05.572664198 +0000 2023-12-08T08:16:54.938 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2023-12-08 08:12:07.568968313 +0000 2023-12-08T08:16:54.938 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2023-12-08 08:12:07.568968313 +0000 2023-12-08T08:16:54.938 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2023-12-08 08:12:07.568968313 +0000 2023-12-08T08:16:54.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T08:16:55.006 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2023-12-08T08:16:55.006 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2023-12-08T08:16:55.007 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.2662e-05 s, 5.5 MB/s 2023-12-08T08:16:55.007 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T08:16:55.064 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:16:55.065 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:55.065 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2023-12-08T08:16:55.082 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-08T08:16:55.083 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2023-12-08T08:16:55.139 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-12-08 08:16:45.058200501 +0000 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-12-08 08:11:57.285414278 +0000 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-12-08 08:11:57.285414278 +0000 2023-12-08T08:16:55.140 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-12-08 08:11:57.285414278 +0000 2023-12-08T08:16:55.141 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-08T08:16:55.208 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-12-08T08:16:55.208 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-12-08T08:16:55.208 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000115289 s, 4.4 MB/s 2023-12-08T08:16:55.209 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-08T08:16:55.266 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2023-12-08T08:16:55.322 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-12-08 08:16:45.058200501 +0000 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-12-08 08:11:57.775402355 +0000 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-12-08 08:11:57.775402355 +0000 2023-12-08T08:16:55.323 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-12-08 08:11:57.775402355 +0000 2023-12-08T08:16:55.323 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-08T08:16:55.389 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-12-08T08:16:55.390 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-12-08T08:16:55.390 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000110178 s, 4.6 MB/s 2023-12-08T08:16:55.391 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-08T08:16:55.447 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2023-12-08T08:16:55.503 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-08T08:16:55.503 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:55.504 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-08T08:16:55.504 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:55.504 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:55.504 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-12-08 08:16:45.059200476 +0000 2023-12-08T08:16:55.504 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-12-08 08:11:58.255390674 +0000 2023-12-08T08:16:55.504 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-12-08 08:11:58.255390674 +0000 2023-12-08T08:16:55.504 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-12-08 08:11:58.255390674 +0000 2023-12-08T08:16:55.504 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-08T08:16:55.570 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-12-08T08:16:55.570 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-12-08T08:16:55.570 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.00010299 s, 5.0 MB/s 2023-12-08T08:16:55.571 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-08T08:16:55.627 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2023-12-08T08:16:55.682 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-08T08:16:55.682 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-08T08:16:55.682 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-08T08:16:55.683 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-08T08:16:55.683 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-12-08T08:16:55.683 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-12-08 08:16:45.059200476 +0000 2023-12-08T08:16:55.683 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-12-08 08:11:58.728379164 +0000 2023-12-08T08:16:55.683 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-12-08 08:11:58.728379164 +0000 2023-12-08T08:16:55.683 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-12-08 08:11:58.728379164 +0000 2023-12-08T08:16:55.683 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-08T08:16:55.749 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-12-08T08:16:55.749 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-12-08T08:16:55.749 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.2099e-05 s, 6.2 MB/s 2023-12-08T08:16:55.750 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-08T08:16:55.806 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:16:55.806 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T08:16:55.806 INFO:tasks.ceph:Generating config... 2023-12-08T08:16:55.807 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-08T08:16:55.808 INFO:tasks.ceph:[client] debug client = 20 2023-12-08T08:16:55.808 INFO:tasks.ceph:[client] debug ms = 1 2023-12-08T08:16:55.808 INFO:tasks.ceph:[client] pid file = 2023-12-08T08:16:55.808 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-08T08:16:55.808 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-08T08:16:55.808 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-08T08:16:55.808 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-08T08:16:55.808 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-08T08:16:55.808 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-08T08:16:55.809 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-08T08:16:55.809 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-08T08:16:55.809 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-08T08:16:55.809 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-08T08:16:55.810 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-08T08:16:55.810 INFO:tasks.ceph:Setting up mon.a... 2023-12-08T08:16:55.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-08T08:16:55.867 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2023-12-08T08:16:55.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-08T08:16:55.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:16:55.951 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.b', '172.21.15.170'), ('mon.c', '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]')] 2023-12-08T08:16:55.952 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-08T08:16:55.953 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:55.953 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T08:16:56.008 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --add b 172.21.15.170 --addv c '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:16:56.094 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:16:56.094 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid e65cfade-ffb6-4f9a-b644-0a4f3f758761 2023-12-08T08:16:56.094 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = pacific 2023-12-08T08:16:56.094 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:fsid e65cfade-ffb6-4f9a-b644-0a4f3f758761 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2023-12-08T08:16:56.092973+0000 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:created 2023-12-08T08:16:56.092973+0000 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 16 (pacific) 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2023-12-08T08:16:56.095 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-08T08:16:56.096 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-08T08:16:56.111 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e65cfade-ffb6-4f9a-b644-0a4f3f758761... 2023-12-08T08:16:56.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T08:16:56.153 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.205 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2023-12-08T08:16:56.206 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2023-12-08T08:16:56.207 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.50,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = e65cfade-ffb6-4f9a-b644-0a4f3f758761 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2023-12-08T08:16:56.208 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.209 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 20 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 20 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 10 2023-12-08T08:16:56.210 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:16:56.211 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T08:16:56.212 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2023-12-08T08:16:56.213 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2023-12-08T08:16:56.214 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2023-12-08T08:16:56.215 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2023-12-08T08:16:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2023-12-08T08:16:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = e65cfade-ffb6-4f9a-b644-0a4f3f758761 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 20 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 20 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 10 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2023-12-08T08:16:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.222 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2023-12-08T08:16:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: mon op complaint time = 120 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-08T08:16:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: client mount timeout = 600 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = "" 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout:[mds] 2023-12-08T08:16:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds balancer = 20 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug frag = True 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: mds debug scatterstat = True 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: mds op complaint time = 180 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: mds verify scatter = True 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: osd op complaint time = 180 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: rados mon op timeout = 900 2023-12-08T08:16:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: rados osd op timeout = 900 2023-12-08T08:16:56.229 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-08T08:16:56.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-08T08:16:56.329 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-08T08:16:56.329 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:56.329 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-08T08:16:56.344 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:56.344 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-08T08:16:56.399 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:16:56.399 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:56.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T08:16:56.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:16:56.485 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:16:56.485 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:16:56.540 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:16:56.540 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:56.540 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-08T08:16:56.540 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-08T08:16:56.580 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:16:56.581 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:16:56.636 INFO:tasks.ceph:Setting up mon nodes... 2023-12-08T08:16:56.636 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-08T08:16:56.637 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T08:16:56.699 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-08T08:16:56.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T08:16:56.762 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-08T08:16:56.765 INFO:tasks.ceph:Setting up mds nodes... 2023-12-08T08:16:56.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T08:16:56.827 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-08T08:16:56.829 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-08T08:16:56.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T08:16:56.965 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-08T08:16:56.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-08T08:16:56.998 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T08:16:57.053 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-08T08:16:57.055 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-08T08:16:57.082 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T08:16:57.176 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-08T08:16:57.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-08T08:16:57.205 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-08T08:16:57.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-08T08:16:57.253 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-08T08:16:57.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-08T08:16:57.317 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-08T08:16:57.335 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-08T08:16:57.379 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-08T08:16:57.394 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-08T08:16:57.435 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-08T08:16:57.450 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-08T08:16:57.451 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-08T08:16:57.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-08T08:16:57.482 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:16:57.482 INFO:tasks.ceph:role: osd.0 2023-12-08T08:16:57.482 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:16:57.482 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T08:16:57.552 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:16:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:16:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:16:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:16:57.553 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:16:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:16:57.553 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:16:57.553 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:16:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:16:57.553 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:16:57.584 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-12-08T08:16:57.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-08T08:16:57.586 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-08T08:16:57.661 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-08T08:16:57.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-08T08:16:57.812 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:16:57.812 INFO:tasks.ceph:role: osd.1 2023-12-08T08:16:57.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:16:57.813 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T08:16:57.883 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:16:57.884 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:16:57.915 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-12-08T08:16:57.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-08T08:16:57.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-08T08:16:57.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-08T08:16:58.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-08T08:16:58.139 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:16:58.139 INFO:tasks.ceph:role: osd.2 2023-12-08T08:16:58.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:16:58.139 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T08:16:58.208 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:16:58.209 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:16:58.241 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-12-08T08:16:58.243 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-08T08:16:58.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-08T08:16:58.324 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-08T08:16:58.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-08T08:16:58.483 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-08T08:16:58.483 INFO:tasks.ceph:role: osd.3 2023-12-08T08:16:58.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:16:58.483 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T08:16:58.557 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:16:58.557 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:16:58.557 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:16:58.558 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:16:58.558 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:16:58.558 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:16:58.558 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:16:58.558 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:16:58.558 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:16:58.558 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:16:58.589 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2023-12-08T08:16:58.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2023-12-08T08:16:58.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-08T08:16:58.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-08T08:16:58.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:16:58.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:16:58.873+0000 7f87bbe0c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-08T08:16:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:16:58.873+0000 7f87bbe0c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-08T08:16:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:16:58.873+0000 7f87bbe0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:16:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:16:58.873+0000 7f87bbe0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:16:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:16:58.873+0000 7f87bbe0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-08T08:16:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:16:58.874+0000 7f87bbe0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-08T08:17:01.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-08T08:17:01.760 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:01.852+0000 7f2de36a9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-08T08:17:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:01.853+0000 7f2de36a9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-08T08:17:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:01.853+0000 7f2de36a9500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:17:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:01.853+0000 7f2de36a9500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:17:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:01.853+0000 7f2de36a9500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-08T08:17:01.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:01.853+0000 7f2de36a9500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-08T08:17:04.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-08T08:17:04.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:04.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:04.832+0000 7f2b5a825500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-08T08:17:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:04.833+0000 7f2b5a825500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-08T08:17:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:04.833+0000 7f2b5a825500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:17:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:04.833+0000 7f2b5a825500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:17:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:04.833+0000 7f2b5a825500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-08T08:17:04.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:04.833+0000 7f2b5a825500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-08T08:17:07.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-08T08:17:07.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:07.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:07.813+0000 7fd58252b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-08T08:17:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:07.813+0000 7fd58252b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-08T08:17:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:07.813+0000 7fd58252b500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:17:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:07.813+0000 7fd58252b500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:17:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:07.813+0000 7fd58252b500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-08T08:17:07.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:07.813+0000 7fd58252b500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-08T08:17:10.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-08T08:17:10.703 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-08T08:17:10.734 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:17:10.735 INFO:tasks.ceph:role: osd.4 2023-12-08T08:17:10.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:17:10.735 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-08T08:17:10.807 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:17:10.808 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:17:10.840 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-12-08T08:17:10.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-12-08T08:17:10.843 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-08T08:17:10.916 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-08T08:17:10.989 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-08T08:17:11.056 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:17:11.057 INFO:tasks.ceph:role: osd.5 2023-12-08T08:17:11.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:17:11.057 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-08T08:17:11.123 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:17:11.124 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:17:11.157 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-12-08T08:17:11.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-12-08T08:17:11.159 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-08T08:17:11.233 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-08T08:17:11.304 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-08T08:17:11.371 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:17:11.371 INFO:tasks.ceph:role: osd.6 2023-12-08T08:17:11.371 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:17:11.372 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-08T08:17:11.437 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:17:11.438 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:17:11.470 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-12-08T08:17:11.472 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-12-08T08:17:11.472 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-08T08:17:11.543 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-08T08:17:11.614 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-08T08:17:11.681 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-08T08:17:11.681 INFO:tasks.ceph:role: osd.7 2023-12-08T08:17:11.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:17:11.682 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-08T08:17:11.747 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-08T08:17:11.748 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-08T08:17:11.780 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-12-08T08:17:11.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-12-08T08:17:11.782 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-08T08:17:11.855 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-08T08:17:11.926 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:12.018 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:12.015+0000 7f24b3eb4500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-08T08:17:12.018 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:12.015+0000 7f24b3eb4500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-08T08:17:12.018 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:12.015+0000 7f24b3eb4500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:17:12.018 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:12.015+0000 7f24b3eb4500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:17:12.018 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:12.015+0000 7f24b3eb4500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-08T08:17:12.018 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:12.015+0000 7f24b3eb4500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-08T08:17:14.861 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-08T08:17:14.891 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:14.982 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:14.979+0000 7f6ffe819500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-08T08:17:14.983 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:14.980+0000 7f6ffe819500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-08T08:17:14.983 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:14.980+0000 7f6ffe819500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:17:14.983 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:14.980+0000 7f6ffe819500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:17:14.983 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:14.980+0000 7f6ffe819500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-08T08:17:14.983 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:14.980+0000 7f6ffe819500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-08T08:17:17.825 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-08T08:17:17.857 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:17.949 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:17.946+0000 7f2956907500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-08T08:17:17.949 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:17.946+0000 7f2956907500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-08T08:17:17.949 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:17.946+0000 7f2956907500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:17:17.949 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:17.946+0000 7f2956907500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:17:17.949 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:17.946+0000 7f2956907500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-08T08:17:17.949 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:17.946+0000 7f2956907500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-08T08:17:20.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-08T08:17:20.823 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:20.915 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:20.912+0000 7f06b5421500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-08T08:17:20.915 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:20.912+0000 7f06b5421500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-08T08:17:20.915 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:20.912+0000 7f06b5421500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:17:20.915 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:20.912+0000 7f06b5421500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:17:20.915 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:20.912+0000 7f06b5421500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-08T08:17:20.915 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:20.912+0000 7f06b5421500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-08T08:17:23.757 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-08T08:17:23.786 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-08T08:17:23.786 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:23.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-08T08:17:23.822 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:23.822 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-08T08:17:23.896 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:23.896 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-08T08:17:23.971 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:23.971 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-08T08:17:24.044 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:24.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-08T08:17:24.117 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:24.117 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-08T08:17:24.188 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:24.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-08T08:17:24.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:24.237 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:24.265 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.265 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-08T08:17:24.311 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.311 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-08T08:17:24.395 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.395 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-08T08:17:24.470 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.470 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-08T08:17:24.551 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.552 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-08T08:17:24.628 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.629 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-08T08:17:24.719 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.720 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-08T08:17:24.789 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:24.790 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-08T08:17:24.809 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:24.809 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-08T08:17:24.868 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.868 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-08T08:17:24.883 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:24.883 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-08T08:17:24.939 INFO:tasks.ceph:Adding keys to all mons... 2023-12-08T08:17:24.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T08:17:24.942 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD40HJlGu+ZKRAAIlksM6WcF58EtQMpAY6OGg== 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD40HJlaG07MRAAZ2C/ACHBbMU0P3IDa4516A== 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.c] 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD40HJlvkB4ORAAEQfiX2naCRnFje/FOMizXg== 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD60HJlpPofNBAA0REn7uUB/Aw/ZUIJbVXi6w== 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2023-12-08T08:17:24.984 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD90HJlbeXjMhAAlllaC0AovOXt52peQyZxUA== 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAA0XJl1wG0MRAAMSfSCEAMMoaZg2yN34XAOg== 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAD0XJl07uHMBAATuVeBNRe/TDGswgteMtbbA== 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD40HJlau9hLRAAS/TfKtA/MZF8TMtkAvCD7A== 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.b] 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJl0UcYAxAAc5kskq3L748xnYJS3a/PqQ== 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.d] 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJlrYp1ChAAxmo/NoWZQ0WYvxrDQHg4eQ== 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAI0XJlnhr4ABAAd/FP6Mh+uBHwROBFS1NtLQ== 2023-12-08T08:17:24.985 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAK0XJl6ll3OhAADDM1OFDZ7Gj4TR221Emwkg== 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAN0XJl3hN1OBAA3tbsaT8CSnH4UUqbPlXpug== 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQAQ0XJldVlvNhAAHkTT6FkK2/lqQ7CNO2e3wA== 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout:[client.2] 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJl8yrWEhAA8ZmN36Sg2PS+3amjVbA14g== 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJlQLWGFhAAwqipxJ5qn/WzWLns1fy2BA== 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout:[client.3] 2023-12-08T08:17:24.986 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJlgnHlGRAAgLbG+IB+A9ncV9o+9antbA== 2023-12-08T08:17:25.005 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD40HJlGu+ZKRAAIlksM6WcF58EtQMpAY6OGg== 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD40HJlaG07MRAAZ2C/ACHBbMU0P3IDa4516A== 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD40HJlvkB4ORAAEQfiX2naCRnFje/FOMizXg== 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD60HJlpPofNBAA0REn7uUB/Aw/ZUIJbVXi6w== 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD90HJlbeXjMhAAlllaC0AovOXt52peQyZxUA== 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2023-12-08T08:17:25.006 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAA0XJl1wG0MRAAMSfSCEAMMoaZg2yN34XAOg== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAD0XJl07uHMBAATuVeBNRe/TDGswgteMtbbA== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD40HJlau9hLRAAS/TfKtA/MZF8TMtkAvCD7A== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD50HJl0UcYAxAAc5kskq3L748xnYJS3a/PqQ== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD50HJlrYp1ChAAxmo/NoWZQ0WYvxrDQHg4eQ== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAI0XJlnhr4ABAAd/FP6Mh+uBHwROBFS1NtLQ== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAK0XJl6ll3OhAADDM1OFDZ7Gj4TR221Emwkg== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAN0XJl3hN1OBAA3tbsaT8CSnH4UUqbPlXpug== 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2023-12-08T08:17:25.007 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAQ0XJldVlvNhAAHkTT6FkK2/lqQ7CNO2e3wA== 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout:[client.2] 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD50HJl8yrWEhAA8ZmN36Sg2PS+3amjVbA14g== 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD50HJlQLWGFhAAwqipxJ5qn/WzWLns1fy2BA== 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout:[client.3] 2023-12-08T08:17:25.008 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD50HJlgnHlGRAAgLbG+IB+A9ncV9o+9antbA== 2023-12-08T08:17:25.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:17:25.031 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:17:25.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.104 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.164 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.169 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.232 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.290 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.343 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.350 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.408 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:17:25.469 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-08T08:17:25.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.528 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.588 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-08T08:17:25.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.648 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.704 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.759 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.815 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-08T08:17:25.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:25.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:25.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:25.931 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:25.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:25.990 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:26.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:26.048 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-08T08:17:26.106 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-08T08:17:26.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-08T08:17:26.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:17:26.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-08T08:17:26.269 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-08T08:17:26.296 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:17:26.394 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-08T08:17:26.421 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-08T08:17:26.488 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-08T08:17:26.584 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-08T08:17:26.611 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:26.613 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-08T08:17:26.666 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-08T08:17:26.666 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-08T08:17:26.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-08T08:17:26.669 INFO:tasks.ceph.mon.a:Started 2023-12-08T08:17:26.669 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-08T08:17:26.669 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-08T08:17:26.708 INFO:tasks.ceph.mon.b:Started 2023-12-08T08:17:26.708 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-08T08:17:26.709 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-08T08:17:26.710 INFO:tasks.ceph.mon.c:Started 2023-12-08T08:17:26.710 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-08T08:17:26.711 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-08T08:17:26.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-08T08:17:26.713 INFO:tasks.ceph.mgr.y:Started 2023-12-08T08:17:26.713 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-08T08:17:26.713 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-08T08:17:26.715 INFO:tasks.ceph.mgr.x:Started 2023-12-08T08:17:26.715 INFO:tasks.ceph:Setting crush tunables to default 2023-12-08T08:17:26.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2023-12-08T08:17:26.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.821+0000 7fcfd4be5640 1 Processor -- start 2023-12-08T08:17:26.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.821+0000 7fcfd4be5640 1 -- start start 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfd4be5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfd4be5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00ce790 con 0x7fcfd00b3c80 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfd4be5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00ceba0 con 0x7fcfd00d1950 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfd4be5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00cee80 con 0x7fcfd015e6a0 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfce59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfced9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcfd00b3c80 0x7fcfd00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50266/0 (socket says 172.21.15.50:50266) 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfced9d640 1 -- 172.21.15.50:0/1914789729 learned_addr learned my addr 172.21.15.50:0/1914789729 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:26.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:26.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:26.822+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T08:17:27.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.023+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.023+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:27.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.023+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:27.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.023+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:27.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.023+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T08:17:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.424+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.424+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.424+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.424+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:27.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:27.424+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T08:17:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:28.225+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:28.225+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:28.226+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:28.226+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:28.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:28.226+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 msgr2=0x7fcfd00ce250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfd015e6a0 0x7fcfd00ce250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 >> v1:172.21.15.170:6789/0 conn(0x7fcfd00d1950 legacy=0x7fcfd00cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 >> v1:172.21.15.50:6789/0 conn(0x7fcfd00b3c80 legacy=0x7fcfd00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00cee80 con 0x7fcfb00036e0 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0008d20 con 0x7fcfb0006180 2023-12-08T08:17:29.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:29.823+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:30.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:30.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.024+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-08T08:17:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T08:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T08:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:30.425+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-08T08:17:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.226+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfcdd9b640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T08:17:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:31.227+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-08T08:17:32.465 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:32.463+0000 7f31c6c2c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T08:17:32.509 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:32.507+0000 7faebfe32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-08T08:17:32.516 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:32.514+0000 7f31c6c2c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T08:17:32.563 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:32.561+0000 7faebfe32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 msgr2=0x7fcfb0008600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb0006180 0x7fcfb0008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 msgr2=0x7fcfb0005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00036e0 0x7fcfb0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfced9d640 1 -- 172.21.15.50:0/1914789729 reap_dead start 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfb0003b30 0x7fcfb00065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00086c0 0x7fcfb000d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00cbcb0 con 0x7fcfb0006b10 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00cee80 con 0x7fcfb0003b30 2023-12-08T08:17:32.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfc7fff640 1 -- 172.21.15.50:0/1914789729 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb0008d20 con 0x7fcfb00086c0 2023-12-08T08:17:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.50:3300/0 conn(0x7fcfb0003b30 0x7fcfb00065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfced9d640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00086c0 0x7fcfb000d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00086c0 msgr2=0x7fcfb000d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00086c0 0x7fcfb000d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 >> v1:172.21.15.50:6789/0 conn(0x7fcfb0006b10 legacy=0x7fcfb0006f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfce59c640 1 -- 172.21.15.50:0/1914789729 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb000e970 con 0x7fcfb0003b30 2023-12-08T08:17:32.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.823+0000 7fcfcd59a640 1 -- 172.21.15.50:0/1914789729 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387524154 0 0) 0x7fcfd00cbcb0 con 0x7fcfb0006b10 2023-12-08T08:17:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.824+0000 7fcfce59c640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfb00065d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0008690 tx=0x7fcfc002dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8254361ec40b918b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.824+0000 7fcfcd59a640 1 -- 172.21.15.50:0/1914789729 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc002e870 con 0x7fcfb0003b30 2023-12-08T08:17:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.824+0000 7fcfcd59a640 1 -- 172.21.15.50:0/1914789729 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0032070 con 0x7fcfb0003b30 2023-12-08T08:17:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.824+0000 7fcfcd59a640 1 -- 172.21.15.50:0/1914789729 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc002ec10 con 0x7fcfb0003b30 2023-12-08T08:17:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 -- 172.21.15.50:0/1914789729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 msgr2=0x7fcfb00065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:32.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfb00065d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0008690 tx=0x7fcfc002dcc0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 -- 172.21.15.50:0/1914789729 shutdown_connections 2023-12-08T08:17:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 --2- 172.21.15.50:0/1914789729 >> v2:172.21.15.170:3300/0 conn(0x7fcfb00086c0 0x7fcfb000d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 --2- 172.21.15.50:0/1914789729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfb00065d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 -- 172.21.15.50:0/1914789729 >> 172.21.15.50:0/1914789729 conn(0x7fcfd00d0e30 msgr2=0x7fcfd00d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 -- 172.21.15.50:0/1914789729 shutdown_connections 2023-12-08T08:17:32.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.825+0000 7fcfd4be5640 1 -- 172.21.15.50:0/1914789729 wait complete. 2023-12-08T08:17:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.826+0000 7fcfd4be5640 1 Processor -- start 2023-12-08T08:17:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.826+0000 7fcfd4be5640 1 -- start start 2023-12-08T08:17:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfd4be5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfd015d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:32.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfd4be5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb0006b10 0x7fcfd0159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfd4be5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb00086c0 0x7fcfd01596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfd4be5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00c6ba0 con 0x7fcfb0003b30 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfd4be5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00c5f90 con 0x7fcfb0006b10 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfd4be5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd00c6270 con 0x7fcfb00086c0 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfd015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfd015d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39424/0 (socket says 172.21.15.50:39424) 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfce59c640 1 -- 172.21.15.50:0/3320491731 learned_addr learned my addr 172.21.15.50:0/3320491731 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb0006b10 0x7fcfd0159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.827+0000 7fcfced9d640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb00086c0 0x7fcfd01596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:32.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfce59c640 1 -- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb00086c0 msgr2=0x7fcfd01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfce59c640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb00086c0 0x7fcfd01596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfce59c640 1 -- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb0006b10 msgr2=0x7fcfd0159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfce59c640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb0006b10 0x7fcfd0159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfce59c640 1 -- 172.21.15.50:0/3320491731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0009b80 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfcdd9b640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb0006b10 0x7fcfd0159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfce59c640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfd015d150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0000f80 tx=0x7fcfc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfc6ffd640 1 -- 172.21.15.50:0/3320491731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0004250 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfc6ffd640 1 -- 172.21.15.50:0/3320491731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc00043b0 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfc6ffd640 1 -- 172.21.15.50:0/3320491731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0004760 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd00c6550 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd015a530 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfc6ffd640 1 -- 172.21.15.50:0/3320491731 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcfc0041780 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.828+0000 7fcfc6ffd640 1 -- 172.21.15.50:0/3320491731 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcfc0043470 con 0x7fcfb0003b30 2023-12-08T08:17:32.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.829+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd0067ad0 con 0x7fcfb0003b30 2023-12-08T08:17:32.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.831+0000 7fcfc6ffd640 1 -- 172.21.15.50:0/3320491731 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcfc0034070 con 0x7fcfb0003b30 2023-12-08T08:17:32.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.898+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcfd006dbe0 con 0x7fcfb0003b30 2023-12-08T08:17:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.900+0000 7fcfc6ffd640 1 -- 172.21.15.50:0/3320491731 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcfc0041bc0 con 0x7fcfb0003b30 2023-12-08T08:17:32.902 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 msgr2=0x7fcfd015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfd015d150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0000f80 tx=0x7fcfc0004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 shutdown_connections 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfb00086c0 0x7fcfd01596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfb0006b10 0x7fcfd0159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 --2- 172.21.15.50:0/3320491731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfb0003b30 0x7fcfd015d150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 >> 172.21.15.50:0/3320491731 conn(0x7fcfd00d0e30 msgr2=0x7fcfd006e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:32.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 shutdown_connections 2023-12-08T08:17:32.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:32.901+0000 7fcfd4be5640 1 -- 172.21.15.50:0/3320491731 wait complete. 2023-12-08T08:17:32.913 INFO:tasks.ceph:check_enable_crimson: False 2023-12-08T08:17:32.914 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-08T08:17:32.914 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:32.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-08T08:17:32.944 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:32.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-08T08:17:33.015 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:33.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-08T08:17:33.052 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.050+0000 7f31c6c2c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T08:17:33.086 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:17:33.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-08T08:17:33.103 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.101+0000 7f31c6c2c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T08:17:33.123 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.120+0000 7faebfe32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-08T08:17:33.147 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.145+0000 7f31c6c2c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T08:17:33.153 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:33.153 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-08T08:17:33.179 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.177+0000 7faebfe32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-08T08:17:33.180 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:33.180 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-08T08:17:33.204 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.201+0000 7f31c6c2c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T08:17:33.225 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.223+0000 7faebfe32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-08T08:17:33.230 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:33.230 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-08T08:17:33.248 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.246+0000 7f31c6c2c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T08:17:33.275 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:17:33.275 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-08T08:17:33.281 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.279+0000 7faebfe32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-08T08:17:33.325 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.323+0000 7faebfe32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-08T08:17:33.344 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 2d501454-1f27-48d6-b0bb-fe0f8a8717a7 0 2023-12-08T08:17:33.354 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.352+0000 7f31c6c2c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-08T08:17:33.427 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.425+0000 7f31c6c2c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T08:17:33.431 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.428+0000 7faebfe32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-08T08:17:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.451+0000 7f6981a3d640 1 Processor -- start 2023-12-08T08:17:33.454 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f6981a3d640 1 -- start start 2023-12-08T08:17:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f6981a3d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f697c0caae0 0x7f697c161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f6981a3d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f697c0af030 0x7f697c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f6981a3d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c15dd90 con 0x7f697c0caec0 2023-12-08T08:17:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f6981a3d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c15e600 con 0x7f697c0af030 2023-12-08T08:17:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f6981a3d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c15e040 con 0x7f697c0caae0 2023-12-08T08:17:33.456 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f697affd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f697c0caae0 0x7f697c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f697affd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f697c0caae0 0x7f697c161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55248/0 (socket says 172.21.15.170:55248) 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f697affd640 1 -- 172.21.15.170:0/4148141753 learned_addr learned my addr 172.21.15.170:0/4148141753 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.452+0000 7f697a7fc640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f697c0caec0 0x7f697c15d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51656/0 (socket says 172.21.15.170:51656) 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.453+0000 7f697b7fe640 1 --2- 172.21.15.170:0/4148141753 >> v2:172.21.15.50:3300/0 conn(0x7f697c0af030 0x7f697c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.453+0000 7f697affd640 1 -- 172.21.15.170:0/4148141753 >> v2:172.21.15.50:3300/0 conn(0x7f697c0af030 msgr2=0x7f697c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.453+0000 7f697affd640 1 --2- 172.21.15.170:0/4148141753 >> v2:172.21.15.50:3300/0 conn(0x7f697c0af030 0x7f697c06a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.453+0000 7f697affd640 1 -- 172.21.15.170:0/4148141753 >> v1:172.21.15.170:6789/0 conn(0x7f697c0caec0 legacy=0x7f697c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.453+0000 7f697affd640 1 -- 172.21.15.170:0/4148141753 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c15e320 con 0x7f697c0caae0 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.453+0000 7f6979ffb640 1 -- 172.21.15.170:0/4148141753 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354346450 0 0) 0x7f697c15dd90 con 0x7f697c0caec0 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f697affd640 1 --2- 172.21.15.170:0/4148141753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0caae0 0x7f697c161510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f697c0b2920 tx=0x7f697402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39330af8275f134e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6979ffb640 1 -- 172.21.15.170:0/4148141753 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697402ca80 con 0x7f697c0caae0 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6979ffb640 1 -- 172.21.15.170:0/4148141753 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697402cbe0 con 0x7f697c0caae0 2023-12-08T08:17:33.457 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6979ffb640 1 -- 172.21.15.170:0/4148141753 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740343f0 con 0x7f697c0caae0 2023-12-08T08:17:33.460 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 -- 172.21.15.170:0/4148141753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0caae0 msgr2=0x7f697c161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 --2- 172.21.15.170:0/4148141753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0caae0 0x7f697c161510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f697c0b2920 tx=0x7f697402bee0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 -- 172.21.15.170:0/4148141753 shutdown_connections 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 --2- 172.21.15.170:0/4148141753 >> v2:172.21.15.50:3300/0 conn(0x7f697c0af030 0x7f697c06a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 --2- 172.21.15.170:0/4148141753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0caae0 0x7f697c161510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 -- 172.21.15.170:0/4148141753 >> 172.21.15.170:0/4148141753 conn(0x7f697c0cfcd0 msgr2=0x7f697c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 -- 172.21.15.170:0/4148141753 shutdown_connections 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.454+0000 7f6981a3d640 1 -- 172.21.15.170:0/4148141753 wait complete. 2023-12-08T08:17:33.461 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 Processor -- start 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 -- start start 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0af030 0x7f697c0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c0caae0 0x7f697c0c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f697c0caec0 0x7f697c1f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0c6180 con 0x7f697c0caae0 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0c8210 con 0x7f697c0af030 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.456+0000 7f6981a3d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0c8480 con 0x7f697c0caec0 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0af030 0x7f697c0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0af030 0x7f697c0c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55260/0 (socket says 172.21.15.170:55260) 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 -- 172.21.15.170:0/1592127979 learned_addr learned my addr 172.21.15.170:0/1592127979 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697b7fe640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f697c0caec0 0x7f697c1f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697a7fc640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c0caae0 0x7f697c0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.462 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 -- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f697c0caec0 msgr2=0x7f697c1f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f697c0caec0 0x7f697c1f3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 -- 172.21.15.170:0/1592127979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c0caae0 msgr2=0x7f697c0c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c0caae0 0x7f697c0c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 -- 172.21.15.170:0/1592127979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974009b30 con 0x7f697c0af030 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f697affd640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0af030 0x7f697c0c5c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6974000f80 tx=0x7f6974004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f6973fff640 1 -- 172.21.15.170:0/1592127979 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974009510 con 0x7f697c0af030 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f6973fff640 1 -- 172.21.15.170:0/1592127979 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697403e450 con 0x7f697c0af030 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c161bd0 con 0x7f697c0af030 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f6973fff640 1 -- 172.21.15.170:0/1592127979 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697403e800 con 0x7f697c0af030 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c0c8a40 con 0x7f697c0af030 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f6973fff640 1 -- 172.21.15.170:0/1592127979 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f697402cd50 con 0x7f697c0af030 2023-12-08T08:17:33.463 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.457+0000 7f6973fff640 1 -- 172.21.15.170:0/1592127979 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6974048860 con 0x7f697c0af030 2023-12-08T08:17:33.464 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.458+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c067ad0 con 0x7f697c0af030 2023-12-08T08:17:33.464 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.462+0000 7f6973fff640 1 -- 172.21.15.170:0/1592127979 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6974043020 con 0x7f697c0af030 2023-12-08T08:17:33.478 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.475+0000 7f31c6c2c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T08:17:33.504 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.502+0000 7faebfe32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-08T08:17:33.532 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.529+0000 7f31c6c2c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T08:17:33.536 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.534+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d501454-1f27-48d6-b0bb-fe0f8a8717a7", "id": 0} v 0) v1 -- 0x7f697c0ca370 con 0x7f697c0af030 2023-12-08T08:17:33.540 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.538+0000 7f6973fff640 1 -- 172.21.15.170:0/1592127979 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d501454-1f27-48d6-b0bb-fe0f8a8717a7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f697403ee40 con 0x7f697c0af030 2023-12-08T08:17:33.540 INFO:teuthology.orchestra.run.smithi170.stdout:0 2023-12-08T08:17:33.541 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0af030 msgr2=0x7f697c0c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.541 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0af030 0x7f697c0c5c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6974000f80 tx=0x7f6974004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:33.541 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 shutdown_connections 2023-12-08T08:17:33.542 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f697c0caae0 0x7f697c0c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.542 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f697c0caec0 0x7f697c1f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.542 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 --2- 172.21.15.170:0/1592127979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f697c0af030 0x7f697c0c5c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.542 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 >> 172.21.15.170:0/1592127979 conn(0x7f697c0cfcd0 msgr2=0x7f697c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:33.542 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 shutdown_connections 2023-12-08T08:17:33.542 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.539+0000 7f6981a3d640 1 -- 172.21.15.170:0/1592127979 wait complete. 2023-12-08T08:17:33.551 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new d57b1030-3522-4270-ae79-7225554985e0 1 2023-12-08T08:17:33.553 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.550+0000 7faebfe32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-08T08:17:33.582 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.580+0000 7f31c6c2c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T08:17:33.607 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.605+0000 7faebfe32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-08T08:17:33.651 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.649+0000 7f7693ee5640 1 Processor -- start 2023-12-08T08:17:33.652 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.649+0000 7f7693ee5640 1 -- start start 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7693ee5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f768c15dc20 0x7f768c06d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7693ee5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f768c06de60 0x7f768c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7693ee5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0cada0 con 0x7f768c159f70 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7693ee5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c06e310 con 0x7f768c15dc20 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7693ee5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c0cea60 con 0x7f768c06de60 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7692482640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f768c06de60 0x7f768c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7691c81640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f768c159f70 0x7f768c0ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51672/0 (socket says 172.21.15.170:51672) 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7692482640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f768c06de60 0x7f768c0cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55274/0 (socket says 172.21.15.170:55274) 2023-12-08T08:17:33.655 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7691c81640 1 -- 172.21.15.170:0/194760245 learned_addr learned my addr 172.21.15.170:0/194760245 (peer_addr_for_me v1:172.21.15.170:0/0) 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7691480640 1 --2- 172.21.15.170:0/194760245 >> v2:172.21.15.50:3300/0 conn(0x7f768c15dc20 0x7f768c06d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7692482640 1 -- 172.21.15.170:0/194760245 >> v2:172.21.15.50:3300/0 conn(0x7f768c15dc20 msgr2=0x7f768c06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7692482640 1 --2- 172.21.15.170:0/194760245 >> v2:172.21.15.50:3300/0 conn(0x7f768c15dc20 0x7f768c06d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7692482640 1 -- 172.21.15.170:0/194760245 >> v1:172.21.15.170:6789/0 conn(0x7f768c159f70 legacy=0x7f768c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7692482640 1 -- 172.21.15.170:0/194760245 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0cec50 con 0x7f768c06de60 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.650+0000 7f7691480640 1 --2- 172.21.15.170:0/194760245 >> v2:172.21.15.50:3300/0 conn(0x7f768c15dc20 0x7f768c06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.651+0000 7f7692482640 1 --2- 172.21.15.170:0/194760245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c06de60 0x7f768c0cb530 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f768c0c6d30 tx=0x7f768402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c09515a9f82409 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.651+0000 7f7690c7f640 1 -- 172.21.15.170:0/194760245 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768402cc80 con 0x7f768c06de60 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.651+0000 7f7690c7f640 1 -- 172.21.15.170:0/194760245 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768402cde0 con 0x7f768c06de60 2023-12-08T08:17:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.651+0000 7f7690c7f640 1 -- 172.21.15.170:0/194760245 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684034660 con 0x7f768c06de60 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 -- 172.21.15.170:0/194760245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c06de60 msgr2=0x7f768c0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 --2- 172.21.15.170:0/194760245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c06de60 0x7f768c0cb530 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f768c0c6d30 tx=0x7f768402bed0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 -- 172.21.15.170:0/194760245 shutdown_connections 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 --2- 172.21.15.170:0/194760245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c06de60 0x7f768c0cb530 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 --2- 172.21.15.170:0/194760245 >> v2:172.21.15.50:3300/0 conn(0x7f768c15dc20 0x7f768c06d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 -- 172.21.15.170:0/194760245 >> 172.21.15.170:0/194760245 conn(0x7f768c0b1860 msgr2=0x7f768c0b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 -- 172.21.15.170:0/194760245 shutdown_connections 2023-12-08T08:17:33.657 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.652+0000 7f7693ee5640 1 -- 172.21.15.170:0/194760245 wait complete. 2023-12-08T08:17:33.658 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:33.653+0000 7faebfe32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-08T08:17:33.661 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.653+0000 7f7693ee5640 1 Processor -- start 2023-12-08T08:17:33.661 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.653+0000 7f7693ee5640 1 -- start start 2023-12-08T08:17:33.661 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7693ee5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06de60 0x7f768c153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.661 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7693ee5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c159f70 0x7f768c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7693ee5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c15dc20 0x7f768c0c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7693ee5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c156560 con 0x7f768c06de60 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7693ee5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c155950 con 0x7f768c15dc20 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7693ee5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c155c30 con 0x7f768c159f70 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7691480640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c159f70 0x7f768c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7692482640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c15dc20 0x7f768c0c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7691480640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c159f70 0x7f768c1569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54310/0 (socket says 172.21.15.170:54310) 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7692482640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c15dc20 0x7f768c0c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55278/0 (socket says 172.21.15.170:55278) 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7691480640 1 -- 172.21.15.170:0/1924106703 learned_addr learned my addr 172.21.15.170:0/1924106703 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7691c81640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06de60 0x7f768c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7692482640 1 -- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c159f70 msgr2=0x7f768c1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7692482640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c159f70 0x7f768c1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.662 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7692482640 1 -- 172.21.15.170:0/1924106703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06de60 msgr2=0x7f768c153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7692482640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06de60 0x7f768c153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7692482640 1 -- 172.21.15.170:0/1924106703 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684009a70 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.654+0000 7f7691480640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c159f70 0x7f768c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f7692482640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c15dc20 0x7f768c0c6410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f768c06f000 tx=0x7f7684004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f76827fc640 1 -- 172.21.15.170:0/1924106703 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684009450 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f76827fc640 1 -- 172.21.15.170:0/1924106703 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7684040450 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c155f10 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f76827fc640 1 -- 172.21.15.170:0/1924106703 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684040800 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0c6950 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f76827fc640 1 -- 172.21.15.170:0/1924106703 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7684040c60 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.655+0000 7f76827fc640 1 -- 172.21.15.170:0/1924106703 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f768403e7b0 con 0x7f768c15dc20 2023-12-08T08:17:33.663 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.656+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c0c6ba0 con 0x7f768c15dc20 2023-12-08T08:17:33.664 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.658+0000 7f76827fc640 1 -- 172.21.15.170:0/1924106703 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7684044030 con 0x7f768c15dc20 2023-12-08T08:17:33.732 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.729+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d57b1030-3522-4270-ae79-7225554985e0", "id": 1} v 0) v1 -- 0x7f768c1566d0 con 0x7f768c15dc20 2023-12-08T08:17:33.735 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.733+0000 7f76827fc640 1 -- 172.21.15.170:0/1924106703 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d57b1030-3522-4270-ae79-7225554985e0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7684039070 con 0x7f768c15dc20 2023-12-08T08:17:33.735 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-12-08T08:17:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c15dc20 msgr2=0x7f768c0c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c15dc20 0x7f768c0c6410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f768c06f000 tx=0x7f7684004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 shutdown_connections 2023-12-08T08:17:33.737 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c15dc20 0x7f768c0c6410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c159f70 0x7f768c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 --2- 172.21.15.170:0/1924106703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f768c06de60 0x7f768c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 >> 172.21.15.170:0/1924106703 conn(0x7f768c0b1860 msgr2=0x7f768c0ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 shutdown_connections 2023-12-08T08:17:33.738 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.734+0000 7f7693ee5640 1 -- 172.21.15.170:0/1924106703 wait complete. 2023-12-08T08:17:33.746 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9 2 2023-12-08T08:17:33.887 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.885+0000 7f46bfe9b640 1 Processor -- start 2023-12-08T08:17:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.885+0000 7f46bfe9b640 1 -- start start 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bfe9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f46b80cfa30 0x7f46b80b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bfe9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b80b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bfe9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b80c6be0 con 0x7f46b80cfe10 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bfe9b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b80d3ff0 con 0x7f46b80cfa30 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bfe9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80b4860 con 0x7f46b80b4150 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bd436640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b80b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bdc37640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f46b80cfa30 0x7f46b80b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bdc37640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f46b80cfa30 0x7f46b80b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55294/0 (socket says 172.21.15.170:55294) 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bdc37640 1 -- 172.21.15.170:0/2085116304 learned_addr learned my addr 172.21.15.170:0/2085116304 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bd436640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b80b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54320/0 (socket says 172.21.15.170:54320) 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bdc37640 1 -- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 msgr2=0x7f46b80b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bdc37640 1 --2- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b80b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.890 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bdc37640 1 -- 172.21.15.170:0/2085116304 >> v1:172.21.15.50:6789/0 conn(0x7f46b80cfe10 legacy=0x7f46b8161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.890 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bdc37640 1 -- 172.21.15.170:0/2085116304 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b80d3d50 con 0x7f46b80cfa30 2023-12-08T08:17:33.890 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.886+0000 7f46bd436640 1 --2- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b80b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:33.891 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.887+0000 7f46bdc37640 1 --2- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfa30 0x7f46b80b2f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98fd65e06463bcde server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:33.891 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.887+0000 7f46bcc35640 1 -- 172.21.15.170:0/2085116304 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8031640 con 0x7f46b80cfa30 2023-12-08T08:17:33.891 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.887+0000 7f46bcc35640 1 -- 172.21.15.170:0/2085116304 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a80317a0 con 0x7f46b80cfa30 2023-12-08T08:17:33.891 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.887+0000 7f46bcc35640 1 -- 172.21.15.170:0/2085116304 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8031b30 con 0x7f46b80cfa30 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 -- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfa30 msgr2=0x7f46b80b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 --2- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfa30 0x7f46b80b2f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a802b8f0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 -- 172.21.15.170:0/2085116304 shutdown_connections 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 --2- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b80b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 --2- 172.21.15.170:0/2085116304 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfa30 0x7f46b80b2f20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 -- 172.21.15.170:0/2085116304 >> 172.21.15.170:0/2085116304 conn(0x7f46b80d3090 msgr2=0x7f46b80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 -- 172.21.15.170:0/2085116304 shutdown_connections 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.888+0000 7f46bfe9b640 1 -- 172.21.15.170:0/2085116304 wait complete. 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.889+0000 7f46bfe9b640 1 Processor -- start 2023-12-08T08:17:33.892 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.889+0000 7f46bfe9b640 1 -- start start 2023-12-08T08:17:33.894 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bfe9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b81525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.894 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bfe9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b80cfa30 0x7f46b81f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bfe9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfe10 0x7f46b806c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bfe9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80ccef0 con 0x7f46b80cfa30 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bfe9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8152af0 con 0x7f46b80cfe10 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bfe9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b81f7670 con 0x7f46b80b4150 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b81525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b81525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54326/0 (socket says 172.21.15.170:54326) 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 -- 172.21.15.170:0/3516462464 learned_addr learned my addr 172.21.15.170:0/3516462464 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46be438640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfe10 0x7f46b806c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bd436640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b80cfa30 0x7f46b81f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 -- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfe10 msgr2=0x7f46b806c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfe10 0x7f46b806c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 -- 172.21.15.170:0/3516462464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b80cfa30 msgr2=0x7f46b81f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b80cfa30 0x7f46b81f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 -- 172.21.15.170:0/3516462464 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009400 con 0x7f46b80b4150 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.890+0000 7f46bdc37640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b81525b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.891+0000 7f46ae7fc640 1 -- 172.21.15.170:0/3516462464 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a803a930 con 0x7f46b80b4150 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.891+0000 7f46ae7fc640 1 -- 172.21.15.170:0/3516462464 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a803aa90 con 0x7f46b80b4150 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.891+0000 7f46ae7fc640 1 -- 172.21.15.170:0/3516462464 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a803ae40 con 0x7f46b80b4150 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.891+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a80094d0 con 0x7f46b80b4150 2023-12-08T08:17:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.891+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b80cc5c0 con 0x7f46b80b4150 2023-12-08T08:17:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.891+0000 7f46ae7fc640 1 -- 172.21.15.170:0/3516462464 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f46a802f050 con 0x7f46b80b4150 2023-12-08T08:17:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.891+0000 7f46ae7fc640 1 -- 172.21.15.170:0/3516462464 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f46a8044950 con 0x7f46b80b4150 2023-12-08T08:17:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.892+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b8067430 con 0x7f46b80b4150 2023-12-08T08:17:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.894+0000 7f46ae7fc640 1 -- 172.21.15.170:0/3516462464 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f46a8035020 con 0x7f46b80b4150 2023-12-08T08:17:33.968 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.965+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9", "id": 2} v 0) v1 -- 0x7f46b80743e0 con 0x7f46b80b4150 2023-12-08T08:17:33.971 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.969+0000 7f46ae7fc640 1 -- 172.21.15.170:0/3516462464 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46a802d040 con 0x7f46b80b4150 2023-12-08T08:17:33.971 INFO:teuthology.orchestra.run.smithi170.stdout:2 2023-12-08T08:17:33.972 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.969+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 msgr2=0x7f46b81525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:33.972 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.969+0000 7f46bfe9b640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b81525b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a80046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.972 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.970+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 shutdown_connections 2023-12-08T08:17:33.973 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.970+0000 7f46bfe9b640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46b80cfa30 0x7f46b81f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.973 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.970+0000 7f46bfe9b640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b80cfe10 0x7f46b806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.973 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.970+0000 7f46bfe9b640 1 --2- 172.21.15.170:0/3516462464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46b80b4150 0x7f46b81525b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:33.973 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.970+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 >> 172.21.15.170:0/3516462464 conn(0x7f46b80d3090 msgr2=0x7f46b815c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:33.973 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.970+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 shutdown_connections 2023-12-08T08:17:33.973 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:33.970+0000 7f46bfe9b640 1 -- 172.21.15.170:0/3516462464 wait complete. 2023-12-08T08:17:33.981 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:33.979+0000 7f31c6c2c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-08T08:17:33.982 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 40ed428f-1158-4103-aab8-c4a1709d2706 3 2023-12-08T08:17:34.057 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.054+0000 7faebfe32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-08T08:17:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.080+0000 7f4d6b810640 1 Processor -- start 2023-12-08T08:17:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.080+0000 7f4d6b810640 1 -- start start 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d6b810640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d64071940 0x7f4d640ae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d6b810640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d6406e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d6b810640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6406dcd0 con 0x7f4d64159d90 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d6b810640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6415e880 con 0x7f4d64071940 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d6b810640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6415a170 con 0x7f4d640b48a0 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d69dad640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d6406e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d69dad640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d6406e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54338/0 (socket says 172.21.15.170:54338) 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d69dad640 1 -- 172.21.15.170:0/3128521933 learned_addr learned my addr 172.21.15.170:0/3128521933 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d68dab640 1 --2- 172.21.15.170:0/3128521933 >> v2:172.21.15.50:3300/0 conn(0x7f4d64071940 0x7f4d640ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.085 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d69dad640 1 -- 172.21.15.170:0/3128521933 >> v2:172.21.15.50:3300/0 conn(0x7f4d64071940 msgr2=0x7f4d640ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:34.085 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d69dad640 1 --2- 172.21.15.170:0/3128521933 >> v2:172.21.15.50:3300/0 conn(0x7f4d64071940 0x7f4d640ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.085 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d69dad640 1 -- 172.21.15.170:0/3128521933 >> v1:172.21.15.50:6789/0 conn(0x7f4d64159d90 legacy=0x7f4d64071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.085 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.081+0000 7f4d69dad640 1 -- 172.21.15.170:0/3128521933 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6415dd00 con 0x7f4d640b48a0 2023-12-08T08:17:34.086 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.082+0000 7f4d69dad640 1 --2- 172.21.15.170:0/3128521933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d6406e140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00d150 tx=0x7f4d5c02e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a731f63ce5904c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.086 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.082+0000 7f4d5bfff640 1 -- 172.21.15.170:0/3128521933 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00b0d0 con 0x7f4d640b48a0 2023-12-08T08:17:34.086 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.082+0000 7f4d5bfff640 1 -- 172.21.15.170:0/3128521933 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00b230 con 0x7f4d640b48a0 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.082+0000 7f4d5bfff640 1 -- 172.21.15.170:0/3128521933 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c009600 con 0x7f4d640b48a0 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 -- 172.21.15.170:0/3128521933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 msgr2=0x7f4d6406e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 --2- 172.21.15.170:0/3128521933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d6406e140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00d150 tx=0x7f4d5c02e160 comp rx=0 tx=0).stop 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 -- 172.21.15.170:0/3128521933 shutdown_connections 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 --2- 172.21.15.170:0/3128521933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d6406e140 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 --2- 172.21.15.170:0/3128521933 >> v2:172.21.15.50:3300/0 conn(0x7f4d64071940 0x7f4d640ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 -- 172.21.15.170:0/3128521933 >> 172.21.15.170:0/3128521933 conn(0x7f4d6406b5e0 msgr2=0x7f4d6406b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 -- 172.21.15.170:0/3128521933 shutdown_connections 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.083+0000 7f4d6b810640 1 -- 172.21.15.170:0/3128521933 wait complete. 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.084+0000 7f4d6b810640 1 Processor -- start 2023-12-08T08:17:34.087 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.084+0000 7f4d6b810640 1 -- start start 2023-12-08T08:17:34.089 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d6b810640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64071940 0x7f4d64158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.090 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d6b810640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d64148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.090 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d6b810640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d64159d90 0x7f4d64149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.090 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d6b810640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d64149c40 con 0x7f4d64071940 2023-12-08T08:17:34.090 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d6b810640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6415c5f0 con 0x7f4d64159d90 2023-12-08T08:17:34.090 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d6b810640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6415c8d0 con 0x7f4d640b48a0 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d68dab640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d64148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d69dad640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d64159d90 0x7f4d64149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d68dab640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d64148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54342/0 (socket says 172.21.15.170:54342) 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d68dab640 1 -- 172.21.15.170:0/3084389989 learned_addr learned my addr 172.21.15.170:0/3084389989 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d695ac640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64071940 0x7f4d64158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d69dad640 1 -- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 msgr2=0x7f4d64148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d69dad640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d64148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d69dad640 1 -- 172.21.15.170:0/3084389989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64071940 msgr2=0x7f4d64158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d69dad640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64071940 0x7f4d64158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d69dad640 1 -- 172.21.15.170:0/3084389989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c00bd40 con 0x7f4d64159d90 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d68dab640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d64148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d695ac640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64071940 0x7f4d64158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.085+0000 7f4d69dad640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d64159d90 0x7f4d64149400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c034000 tx=0x7f4d5c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.091 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.086+0000 7f4d59ffb640 1 -- 172.21.15.170:0/3084389989 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c009e90 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.086+0000 7f4d59ffb640 1 -- 172.21.15.170:0/3084389989 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00b720 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.086+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6415cbb0 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.086+0000 7f4d59ffb640 1 -- 172.21.15.170:0/3084389989 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0408c0 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.086+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6415d170 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.086+0000 7f4d59ffb640 1 -- 172.21.15.170:0/3084389989 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d5c040d20 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.086+0000 7f4d59ffb640 1 -- 172.21.15.170:0/3084389989 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4d5c04ac70 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.087+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d64150eb0 con 0x7f4d64159d90 2023-12-08T08:17:34.092 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.089+0000 7f4d59ffb640 1 -- 172.21.15.170:0/3084389989 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4d64150eb0 con 0x7f4d64159d90 2023-12-08T08:17:34.123 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.121+0000 7f31c6c2c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T08:17:34.162 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.160+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "40ed428f-1158-4103-aab8-c4a1709d2706", "id": 3} v 0) v1 -- 0x7f4d640aef30 con 0x7f4d64159d90 2023-12-08T08:17:34.166 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.163+0000 7f4d59ffb640 1 -- 172.21.15.170:0/3084389989 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40ed428f-1158-4103-aab8-c4a1709d2706", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d5c045020 con 0x7f4d64159d90 2023-12-08T08:17:34.166 INFO:teuthology.orchestra.run.smithi170.stdout:3 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d64159d90 msgr2=0x7f4d64149400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d64159d90 0x7f4d64149400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c034000 tx=0x7f4d5c004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 shutdown_connections 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d64159d90 0x7f4d64149400 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d640b48a0 0x7f4d64148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 --2- 172.21.15.170:0/3084389989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d64071940 0x7f4d64158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 >> 172.21.15.170:0/3084389989 conn(0x7f4d6406b5e0 msgr2=0x7f4d640b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 shutdown_connections 2023-12-08T08:17:34.167 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.164+0000 7f4d6b810640 1 -- 172.21.15.170:0/3084389989 wait complete. 2023-12-08T08:17:34.177 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 99449a45-1d66-4c48-9b62-42e7a416c449 4 2023-12-08T08:17:34.199 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.197+0000 7faebfe32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-08T08:17:34.244 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.242+0000 7f31c6c2c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T08:17:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.275+0000 7f4dcf61c640 1 Processor -- start 2023-12-08T08:17:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.275+0000 7f4dcf61c640 1 -- start start 2023-12-08T08:17:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcf61c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4dc815d120 0x7f4dc80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcf61c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc815d500 con 0x7f4dc806bbf0 2023-12-08T08:17:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcf61c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc80ad7c0 con 0x7f4dc80ad290 2023-12-08T08:17:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcf61c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc80b2f80 con 0x7f4dc815d120 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcd3b8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4dc815d120 0x7f4dc80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dccbb7640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f4dc80ad290 0x7f4dc806b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51680/0 (socket says 172.21.15.170:51680) 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dccbb7640 1 -- 172.21.15.170:0/2881165895 learned_addr learned my addr 172.21.15.170:0/2881165895 (peer_addr_for_me v1:172.21.15.170:0/0) 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcd3b8640 1 -- 172.21.15.170:0/2881165895 >> v1:172.21.15.170:6789/0 conn(0x7f4dc80ad290 legacy=0x7f4dc806b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcd3b8640 1 -- 172.21.15.170:0/2881165895 >> v1:172.21.15.50:6789/0 conn(0x7f4dc806bbf0 legacy=0x7f4dc80b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.276+0000 7f4dcd3b8640 1 -- 172.21.15.170:0/2881165895 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80b3260 con 0x7f4dc815d120 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.277+0000 7f4dcd3b8640 1 --2- 172.21.15.170:0/2881165895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc815d120 0x7f4dc80ac880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40097a0 tx=0x7f4dc402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a0d244541641a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.277+0000 7f4dbffff640 1 -- 172.21.15.170:0/2881165895 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4030610 con 0x7f4dc815d120 2023-12-08T08:17:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.277+0000 7f4dbffff640 1 -- 172.21.15.170:0/2881165895 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4030770 con 0x7f4dc815d120 2023-12-08T08:17:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.277+0000 7f4dbffff640 1 -- 172.21.15.170:0/2881165895 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4030b00 con 0x7f4dc815d120 2023-12-08T08:17:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.278+0000 7f4dcf61c640 1 -- 172.21.15.170:0/2881165895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc815d120 msgr2=0x7f4dc80ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.278+0000 7f4dcf61c640 1 --2- 172.21.15.170:0/2881165895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc815d120 0x7f4dc80ac880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40097a0 tx=0x7f4dc402b960 comp rx=0 tx=0).stop 2023-12-08T08:17:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.278+0000 7f4dcf61c640 1 -- 172.21.15.170:0/2881165895 shutdown_connections 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.278+0000 7f4dcf61c640 1 --2- 172.21.15.170:0/2881165895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc815d120 0x7f4dc80ac880 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.278+0000 7f4dcf61c640 1 -- 172.21.15.170:0/2881165895 >> 172.21.15.170:0/2881165895 conn(0x7f4dc8070960 msgr2=0x7f4dc8070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.278+0000 7f4dcf61c640 1 -- 172.21.15.170:0/2881165895 shutdown_connections 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.278+0000 7f4dcf61c640 1 -- 172.21.15.170:0/2881165895 wait complete. 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.279+0000 7f4dcf61c640 1 Processor -- start 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.279+0000 7f4dcf61c640 1 -- start start 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcf61c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc806bbf0 0x7f4dc814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcf61c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc80ad290 0x7f4dc814f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcf61c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc815d120 0x7f4dc814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcf61c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cc6d0 con 0x7f4dc80ad290 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcf61c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cbda0 con 0x7f4dc806bbf0 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcf61c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80cc010 con 0x7f4dc815d120 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc806bbf0 0x7f4dc814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc806bbf0 0x7f4dc814d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55328/0 (socket says 172.21.15.170:55328) 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 -- 172.21.15.170:0/3599052371 learned_addr learned my addr 172.21.15.170:0/3599052371 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcdbb9640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc815d120 0x7f4dc814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dccbb7640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc80ad290 0x7f4dc814f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 -- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc815d120 msgr2=0x7f4dc814fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc815d120 0x7f4dc814fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 -- 172.21.15.170:0/3599052371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc80ad290 msgr2=0x7f4dc814f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc80ad290 0x7f4dc814f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 -- 172.21.15.170:0/3599052371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4009400 con 0x7f4dc806bbf0 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcd3b8640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc806bbf0 0x7f4dc814d260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40098c0 tx=0x7f4dc40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dbdffb640 1 -- 172.21.15.170:0/3599052371 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc403e070 con 0x7f4dc806bbf0 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dbdffb640 1 -- 172.21.15.170:0/3599052371 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4039a10 con 0x7f4dc806bbf0 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc80cc2f0 con 0x7f4dc806bbf0 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.280+0000 7f4dbdffb640 1 -- 172.21.15.170:0/3599052371 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4039da0 con 0x7f4dc806bbf0 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.281+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc81f74e0 con 0x7f4dc806bbf0 2023-12-08T08:17:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.281+0000 7f4dbdffb640 1 -- 172.21.15.170:0/3599052371 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4dc404b700 con 0x7f4dc806bbf0 2023-12-08T08:17:34.288 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.281+0000 7f4dbdffb640 1 -- 172.21.15.170:0/3599052371 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4dc4042a90 con 0x7f4dc806bbf0 2023-12-08T08:17:34.288 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.281+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc8067ad0 con 0x7f4dc806bbf0 2023-12-08T08:17:34.288 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.283+0000 7f4dbdffb640 1 -- 172.21.15.170:0/3599052371 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4dc4034070 con 0x7f4dc806bbf0 2023-12-08T08:17:34.292 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.290+0000 7f31c6c2c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T08:17:34.328 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.326+0000 7faebfe32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-08T08:17:34.358 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.355+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "99449a45-1d66-4c48-9b62-42e7a416c449", "id": 4} v 0) v1 -- 0x7f4dc8073be0 con 0x7f4dc806bbf0 2023-12-08T08:17:34.360 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.358+0000 7f4dbdffb640 1 -- 172.21.15.170:0/3599052371 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99449a45-1d66-4c48-9b62-42e7a416c449", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4dc4042cf0 con 0x7f4dc806bbf0 2023-12-08T08:17:34.361 INFO:teuthology.orchestra.run.smithi170.stdout:4 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc806bbf0 msgr2=0x7f4dc814d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc806bbf0 0x7f4dc814d260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40098c0 tx=0x7f4dc40046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 shutdown_connections 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dc80ad290 0x7f4dc814f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc815d120 0x7f4dc814fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 --2- 172.21.15.170:0/3599052371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc806bbf0 0x7f4dc814d260 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 >> 172.21.15.170:0/3599052371 conn(0x7f4dc8070960 msgr2=0x7f4dc806e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 shutdown_connections 2023-12-08T08:17:34.362 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.359+0000 7f4dcf61c640 1 -- 172.21.15.170:0/3599052371 wait complete. 2023-12-08T08:17:34.372 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 47d14850-5181-422b-9083-72df560b4ee7 5 2023-12-08T08:17:34.376 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.374+0000 7faebfe32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-08T08:17:34.395 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.393+0000 7f31c6c2c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:17:34.472 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.470+0000 7f2a373b0640 1 Processor -- start 2023-12-08T08:17:34.472 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.470+0000 7f2a373b0640 1 -- start start 2023-12-08T08:17:34.473 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a373b0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2a3006b6e0 0x7f2a3006bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.473 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a373b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a300adae0 0x7f2a3006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a373b0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a300b1260 con 0x7f2a30160980 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a373b0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a300d04f0 con 0x7f2a300adae0 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a373b0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a300b0930 con 0x7f2a3006b6e0 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3494b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2a3006b6e0 0x7f2a3006bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3494b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2a3006b6e0 0x7f2a3006bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55332/0 (socket says 172.21.15.170:55332) 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3494b640 1 -- 172.21.15.170:0/2688310837 learned_addr learned my addr 172.21.15.170:0/2688310837 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3594d640 1 --2- 172.21.15.170:0/2688310837 >> v2:172.21.15.50:3300/0 conn(0x7f2a300adae0 0x7f2a3006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3494b640 1 -- 172.21.15.170:0/2688310837 >> v2:172.21.15.50:3300/0 conn(0x7f2a300adae0 msgr2=0x7f2a3006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3494b640 1 --2- 172.21.15.170:0/2688310837 >> v2:172.21.15.50:3300/0 conn(0x7f2a300adae0 0x7f2a3006c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3494b640 1 -- 172.21.15.170:0/2688310837 >> v1:172.21.15.50:6789/0 conn(0x7f2a30160980 legacy=0x7f2a300cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.474 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.471+0000 7f2a3494b640 1 -- 172.21.15.170:0/2688310837 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a300b0c10 con 0x7f2a3006b6e0 2023-12-08T08:17:34.475 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.472+0000 7f2a3494b640 1 --2- 172.21.15.170:0/2688310837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3006b6e0 0x7f2a3006bca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2a3006bc50 tx=0x7f2a2002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27faba43dbcb0e51 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.475 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.472+0000 7f2a27fff640 1 -- 172.21.15.170:0/2688310837 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2002f850 con 0x7f2a3006b6e0 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.472+0000 7f2a27fff640 1 -- 172.21.15.170:0/2688310837 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2002f9b0 con 0x7f2a3006b6e0 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.472+0000 7f2a27fff640 1 -- 172.21.15.170:0/2688310837 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2002fd40 con 0x7f2a3006b6e0 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 -- 172.21.15.170:0/2688310837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3006b6e0 msgr2=0x7f2a3006bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 --2- 172.21.15.170:0/2688310837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3006b6e0 0x7f2a3006bca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2a3006bc50 tx=0x7f2a2002ba30 comp rx=0 tx=0).stop 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 -- 172.21.15.170:0/2688310837 shutdown_connections 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 --2- 172.21.15.170:0/2688310837 >> v2:172.21.15.50:3300/0 conn(0x7f2a300adae0 0x7f2a3006c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 --2- 172.21.15.170:0/2688310837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a3006b6e0 0x7f2a3006bca0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 -- 172.21.15.170:0/2688310837 >> 172.21.15.170:0/2688310837 conn(0x7f2a300d0e30 msgr2=0x7f2a300d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 -- 172.21.15.170:0/2688310837 shutdown_connections 2023-12-08T08:17:34.476 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.473+0000 7f2a373b0640 1 -- 172.21.15.170:0/2688310837 wait complete. 2023-12-08T08:17:34.477 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.474+0000 7f2a373b0640 1 Processor -- start 2023-12-08T08:17:34.477 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.474+0000 7f2a373b0640 1 -- start start 2023-12-08T08:17:34.479 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a373b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a3006b6e0 0x7f2a301492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.479 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a373b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a300adae0 0x7f2a3015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a373b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a30160980 0x7f2a3015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a373b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30156890 con 0x7f2a3006b6e0 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a373b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30156b30 con 0x7f2a30160980 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a373b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30156e10 con 0x7f2a300adae0 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a30160980 0x7f2a3015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3494b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a300adae0 0x7f2a3015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a30160980 0x7f2a3015cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55340/0 (socket says 172.21.15.170:55340) 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 -- 172.21.15.170:0/4047939001 learned_addr learned my addr 172.21.15.170:0/4047939001 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3514c640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a3006b6e0 0x7f2a301492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 -- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a300adae0 msgr2=0x7f2a3015c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a300adae0 0x7f2a3015c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 -- 172.21.15.170:0/4047939001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a3006b6e0 msgr2=0x7f2a301492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a3006b6e0 0x7f2a301492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3594d640 1 -- 172.21.15.170:0/4047939001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200094d0 con 0x7f2a30160980 2023-12-08T08:17:34.480 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.475+0000 7f2a3494b640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a300adae0 0x7f2a3015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a3594d640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a30160980 0x7f2a3015cd70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800efc0 tx=0x7f2a2800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a25ffb640 1 -- 172.21.15.170:0/4047939001 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28009ca0 con 0x7f2a30160980 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a25ffb640 1 -- 172.21.15.170:0/4047939001 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2800f040 con 0x7f2a30160980 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a301570f0 con 0x7f2a30160980 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a25ffb640 1 -- 172.21.15.170:0/4047939001 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280146c0 con 0x7f2a30160980 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a301578f0 con 0x7f2a30160980 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a25ffb640 1 -- 172.21.15.170:0/4047939001 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a28014b20 con 0x7f2a30160980 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.476+0000 7f2a25ffb640 1 -- 172.21.15.170:0/4047939001 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f2a2801dcc0 con 0x7f2a30160980 2023-12-08T08:17:34.481 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.477+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a30157610 con 0x7f2a30160980 2023-12-08T08:17:34.482 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.476+0000 7faebfe32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:17:34.482 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.479+0000 7f2a25ffb640 1 -- 172.21.15.170:0/4047939001 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2a2803bce0 con 0x7f2a30160980 2023-12-08T08:17:34.496 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.493+0000 7f31c6c2c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T08:17:34.553 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.549+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47d14850-5181-422b-9083-72df560b4ee7", "id": 5} v 0) v1 -- 0x7f2a30067ad0 con 0x7f2a30160980 2023-12-08T08:17:34.556 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.552+0000 7f2a25ffb640 1 -- 172.21.15.170:0/4047939001 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47d14850-5181-422b-9083-72df560b4ee7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2a2802a070 con 0x7f2a30160980 2023-12-08T08:17:34.556 INFO:teuthology.orchestra.run.smithi170.stdout:5 2023-12-08T08:17:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.553+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a30160980 msgr2=0x7f2a3015cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.553+0000 7f2a373b0640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a30160980 0x7f2a3015cd70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800efc0 tx=0x7f2a2800c490 comp rx=0 tx=0).stop 2023-12-08T08:17:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.553+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 shutdown_connections 2023-12-08T08:17:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.553+0000 7f2a373b0640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a30160980 0x7f2a3015cd70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.553+0000 7f2a373b0640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a300adae0 0x7f2a3015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.553+0000 7f2a373b0640 1 --2- 172.21.15.170:0/4047939001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a3006b6e0 0x7f2a301492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.557 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.553+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 >> 172.21.15.170:0/4047939001 conn(0x7f2a300d0e30 msgr2=0x7f2a3015f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.554+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 shutdown_connections 2023-12-08T08:17:34.558 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.554+0000 7f2a373b0640 1 -- 172.21.15.170:0/4047939001 wait complete. 2023-12-08T08:17:34.567 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new f5abb5c0-7321-4390-b67c-88b4c4b6e44c 6 2023-12-08T08:17:34.577 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.575+0000 7faebfe32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-08T08:17:34.642 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.639+0000 7f31c6c2c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:17:34.686 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.683+0000 7f31c6c2c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T08:17:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.704+0000 7f1940a7c640 1 Processor -- start 2023-12-08T08:17:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.704+0000 7f1940a7c640 1 -- start start 2023-12-08T08:17:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f1940a7c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f193c15b3d0 0x7f193c0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f1940a7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f1940a7c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c0cea70 con 0x7f193c15aff0 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f1940a7c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0d1760 con 0x7f193c15b3d0 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f1940a7c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c06f8c0 con 0x7f193c0d12b0 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f193ad9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f193ad9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c0cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54366/0 (socket says 172.21.15.170:54366) 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f193ad9d640 1 -- 172.21.15.170:0/2319599518 learned_addr learned my addr 172.21.15.170:0/2319599518 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f1939d9b640 1 --2- 172.21.15.170:0/2319599518 >> v2:172.21.15.50:3300/0 conn(0x7f193c15b3d0 0x7f193c0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f193ad9d640 1 -- 172.21.15.170:0/2319599518 >> v2:172.21.15.50:3300/0 conn(0x7f193c15b3d0 msgr2=0x7f193c0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f193ad9d640 1 --2- 172.21.15.170:0/2319599518 >> v2:172.21.15.50:3300/0 conn(0x7f193c15b3d0 0x7f193c0d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f193ad9d640 1 -- 172.21.15.170:0/2319599518 >> v1:172.21.15.50:6789/0 conn(0x7f193c15aff0 legacy=0x7f193c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.705+0000 7f193ad9d640 1 -- 172.21.15.170:0/2319599518 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0cece0 con 0x7f193c0d12b0 2023-12-08T08:17:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.706+0000 7f193ad9d640 1 --2- 172.21.15.170:0/2319599518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c0cf4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1934009e50 tx=0x7f193402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee60e6a07e3cd5b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.706+0000 7f193959a640 1 -- 172.21.15.170:0/2319599518 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193402cb00 con 0x7f193c0d12b0 2023-12-08T08:17:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.706+0000 7f193959a640 1 -- 172.21.15.170:0/2319599518 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193402cc60 con 0x7f193c0d12b0 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.706+0000 7f193959a640 1 -- 172.21.15.170:0/2319599518 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340343f0 con 0x7f193c0d12b0 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 -- 172.21.15.170:0/2319599518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 msgr2=0x7f193c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 --2- 172.21.15.170:0/2319599518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c0cf4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1934009e50 tx=0x7f193402bf60 comp rx=0 tx=0).stop 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 -- 172.21.15.170:0/2319599518 shutdown_connections 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 --2- 172.21.15.170:0/2319599518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c0cf4e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 --2- 172.21.15.170:0/2319599518 >> v2:172.21.15.50:3300/0 conn(0x7f193c15b3d0 0x7f193c0d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 -- 172.21.15.170:0/2319599518 >> 172.21.15.170:0/2319599518 conn(0x7f193c099a10 msgr2=0x7f193c099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 -- 172.21.15.170:0/2319599518 shutdown_connections 2023-12-08T08:17:34.711 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.707+0000 7f1940a7c640 1 -- 172.21.15.170:0/2319599518 wait complete. 2023-12-08T08:17:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.708+0000 7f1940a7c640 1 Processor -- start 2023-12-08T08:17:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.708+0000 7f1940a7c640 1 -- start start 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f1940a7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f1940a7c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f193c15aff0 0x7f193c15d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f1940a7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c15b3d0 0x7f193c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f1940a7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0b6540 con 0x7f193c15b3d0 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f1940a7c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0c6310 con 0x7f193c15aff0 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f1940a7c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c15d9b0 con 0x7f193c0d12b0 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c15dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54374/0 (socket says 172.21.15.170:54374) 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 -- 172.21.15.170:0/3544686197 learned_addr learned my addr 172.21.15.170:0/3544686197 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f1939d9b640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f193c15aff0 0x7f193c15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193ad9d640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c15b3d0 0x7f193c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 -- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f193c15aff0 msgr2=0x7f193c15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f193c15aff0 0x7f193c15d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 -- 172.21.15.170:0/3544686197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c15b3d0 msgr2=0x7f193c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c15b3d0 0x7f193c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 -- 172.21.15.170:0/3544686197 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934009b30 con 0x7f193c0d12b0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f193a59c640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c15dfd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c450 tx=0x7f192c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.709+0000 7f192affd640 1 -- 172.21.15.170:0/3544686197 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0052d0 con 0x7f193c0d12b0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.710+0000 7f192affd640 1 -- 172.21.15.170:0/3544686197 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c005430 con 0x7f193c0d12b0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.710+0000 7f192affd640 1 -- 172.21.15.170:0/3544686197 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c012870 con 0x7f193c0d12b0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.710+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c0c6520 con 0x7f193c0d12b0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.710+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c0c6ae0 con 0x7f193c0d12b0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.710+0000 7f192affd640 1 -- 172.21.15.170:0/3544686197 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f192c012cd0 con 0x7f193c0d12b0 2023-12-08T08:17:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.710+0000 7f192affd640 1 -- 172.21.15.170:0/3544686197 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f192c01b9f0 con 0x7f193c0d12b0 2023-12-08T08:17:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.711+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c15e510 con 0x7f193c0d12b0 2023-12-08T08:17:34.716 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.713+0000 7f192affd640 1 -- 172.21.15.170:0/3544686197 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f192c01b400 con 0x7f193c0d12b0 2023-12-08T08:17:34.723 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.721+0000 7faebfe32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-08T08:17:34.767 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.765+0000 7faebfe32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-08T08:17:34.788 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.785+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f5abb5c0-7321-4390-b67c-88b4c4b6e44c", "id": 6} v 0) v1 -- 0x7f193c067ad0 con 0x7f193c0d12b0 2023-12-08T08:17:34.791 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.788+0000 7f192affd640 1 -- 172.21.15.170:0/3544686197 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5abb5c0-7321-4390-b67c-88b4c4b6e44c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f192c02a0b0 con 0x7f193c0d12b0 2023-12-08T08:17:34.792 INFO:teuthology.orchestra.run.smithi170.stdout:6 2023-12-08T08:17:34.792 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 msgr2=0x7f193c15dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c15dfd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c450 tx=0x7f192c00c910 comp rx=0 tx=0).stop 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 shutdown_connections 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f193c15b3d0 0x7f193c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f193c15aff0 0x7f193c15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 --2- 172.21.15.170:0/3544686197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f193c0d12b0 0x7f193c15dfd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 >> 172.21.15.170:0/3544686197 conn(0x7f193c099a10 msgr2=0x7f193c15a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 shutdown_connections 2023-12-08T08:17:34.793 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.789+0000 7f1940a7c640 1 -- 172.21.15.170:0/3544686197 wait complete. 2023-12-08T08:17:34.803 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 65eeaf4d-6b8e-4be9-90a5-2336250556df 7 2023-12-08T08:17:34.834 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:34.831+0000 7f31c6c2c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T08:17:34.915 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:34.913+0000 7faebfe32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-08T08:17:34.935 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.932+0000 7fce77ae7640 1 Processor -- start 2023-12-08T08:17:34.936 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.932+0000 7fce77ae7640 1 -- start start 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce77ae7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700cd8f0 0x7fce700cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce77ae7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce700cdd50 con 0x7fce700d01b0 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce77ae7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7006ee00 con 0x7fce700b4980 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce77ae7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7006d030 con 0x7fce700cd8f0 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce75082640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700cd8f0 0x7fce700cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce75883640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fce700b4980 0x7fce700cf560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:51688/0 (socket says 172.21.15.170:51688) 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce75883640 1 -- 172.21.15.170:0/131141725 learned_addr learned my addr 172.21.15.170:0/131141725 (peer_addr_for_me v1:172.21.15.170:0/0) 2023-12-08T08:17:34.937 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce75082640 1 -- 172.21.15.170:0/131141725 >> v1:172.21.15.170:6789/0 conn(0x7fce700b4980 legacy=0x7fce700cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce75082640 1 -- 172.21.15.170:0/131141725 >> v1:172.21.15.50:6789/0 conn(0x7fce700d01b0 legacy=0x7fce70071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce74881640 1 -- 172.21.15.170:0/131141725 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662806983 0 0) 0x7fce7006ee00 con 0x7fce700b4980 2023-12-08T08:17:34.938 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.933+0000 7fce75082640 1 -- 172.21.15.170:0/131141725 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7006d310 con 0x7fce700cd8f0 2023-12-08T08:17:34.939 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.934+0000 7fce75082640 1 --2- 172.21.15.170:0/131141725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700cd8f0 0x7fce700cfc70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0097d0 tx=0x7fce6c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bbecc8927d2e0f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.939 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.934+0000 7fce74881640 1 -- 172.21.15.170:0/131141725 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c031890 con 0x7fce700cd8f0 2023-12-08T08:17:34.939 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.934+0000 7fce74881640 1 -- 172.21.15.170:0/131141725 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c0319f0 con 0x7fce700cd8f0 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.934+0000 7fce74881640 1 -- 172.21.15.170:0/131141725 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c031d80 con 0x7fce700cd8f0 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.935+0000 7fce77ae7640 1 -- 172.21.15.170:0/131141725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700cd8f0 msgr2=0x7fce700cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.935+0000 7fce77ae7640 1 --2- 172.21.15.170:0/131141725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700cd8f0 0x7fce700cfc70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0097d0 tx=0x7fce6c02b930 comp rx=0 tx=0).stop 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.935+0000 7fce77ae7640 1 -- 172.21.15.170:0/131141725 shutdown_connections 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.935+0000 7fce77ae7640 1 --2- 172.21.15.170:0/131141725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700cd8f0 0x7fce700cfc70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.935+0000 7fce77ae7640 1 -- 172.21.15.170:0/131141725 >> 172.21.15.170:0/131141725 conn(0x7fce700b1a70 msgr2=0x7fce700b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.935+0000 7fce77ae7640 1 -- 172.21.15.170:0/131141725 shutdown_connections 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.935+0000 7fce77ae7640 1 -- 172.21.15.170:0/131141725 wait complete. 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.936+0000 7fce77ae7640 1 Processor -- start 2023-12-08T08:17:34.940 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.936+0000 7fce77ae7640 1 -- start start 2023-12-08T08:17:34.943 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700b4980 0x7fce7013a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.943 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce700cd8f0 0x7fce70139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce700d01b0 0x7fce701f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700ae820 con 0x7fce700d01b0 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700ae540 con 0x7fce700cd8f0 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7015a4d0 con 0x7fce700b4980 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700b4980 0x7fce7013a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700b4980 0x7fce7013a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:54390/0 (socket says 172.21.15.170:54390) 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75082640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce700cd8f0 0x7fce70139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 -- 172.21.15.170:0/3374533352 learned_addr learned my addr 172.21.15.170:0/3374533352 (peer_addr_for_me v2:172.21.15.170:0/0) 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce76084640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce700d01b0 0x7fce701f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 -- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce700cd8f0 msgr2=0x7fce70139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.944 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce700cd8f0 0x7fce70139a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 -- 172.21.15.170:0/3374533352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce700d01b0 msgr2=0x7fce701f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce700d01b0 0x7fce701f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 -- 172.21.15.170:0/3374533352 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c009400 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75082640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce700cd8f0 0x7fce70139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce75883640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700b4980 0x7fce7013a690 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c4a0 tx=0x7fce6400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce627fc640 1 -- 172.21.15.170:0/3374533352 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640074e0 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce627fc640 1 -- 172.21.15.170:0/3374533352 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64007640 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce627fc640 1 -- 172.21.15.170:0/3374533352 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64004a00 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7015a7b0 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.937+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce70139f60 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.938+0000 7fce627fc640 1 -- 172.21.15.170:0/3374533352 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce64012400 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.938+0000 7fce627fc640 1 -- 172.21.15.170:0/3374533352 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fce6401b9c0 con 0x7fce700b4980 2023-12-08T08:17:34.945 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.938+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7013a150 con 0x7fce700b4980 2023-12-08T08:17:34.946 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:34.940+0000 7fce627fc640 1 -- 172.21.15.170:0/3374533352 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fce64018070 con 0x7fce700b4980 2023-12-08T08:17:35.016 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.013+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "65eeaf4d-6b8e-4be9-90a5-2336250556df", "id": 7} v 0) v1 -- 0x7fce7015acd0 con 0x7fce700b4980 2023-12-08T08:17:35.019 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.015+0000 7fce627fc640 1 -- 172.21.15.170:0/3374533352 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65eeaf4d-6b8e-4be9-90a5-2336250556df", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce7015acd0 con 0x7fce700b4980 2023-12-08T08:17:35.019 INFO:teuthology.orchestra.run.smithi170.stdout:7 2023-12-08T08:17:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700b4980 msgr2=0x7fce7013a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700b4980 0x7fce7013a690 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c4a0 tx=0x7fce6400c960 comp rx=0 tx=0).stop 2023-12-08T08:17:35.020 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 shutdown_connections 2023-12-08T08:17:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce700d01b0 0x7fce701f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce700cd8f0 0x7fce70139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 --2- 172.21.15.170:0/3374533352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700b4980 0x7fce7013a690 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 >> 172.21.15.170:0/3374533352 conn(0x7fce700b1a70 msgr2=0x7fce7006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.016+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 shutdown_connections 2023-12-08T08:17:35.021 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:17:35.017+0000 7fce77ae7640 1 -- 172.21.15.170:0/3374533352 wait complete. 2023-12-08T08:17:35.030 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-08T08:17:35.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-08T08:17:35.032 INFO:tasks.ceph.osd.0:Started 2023-12-08T08:17:35.032 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-08T08:17:35.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-08T08:17:35.034 INFO:tasks.ceph.osd.1:Started 2023-12-08T08:17:35.034 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-08T08:17:35.034 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-08T08:17:35.036 INFO:tasks.ceph.osd.2:Started 2023-12-08T08:17:35.036 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-08T08:17:35.037 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-08T08:17:35.039 INFO:tasks.ceph.osd.3:Started 2023-12-08T08:17:35.039 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-08T08:17:35.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-08T08:17:35.041 INFO:tasks.ceph.osd.4:Started 2023-12-08T08:17:35.042 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-08T08:17:35.042 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-08T08:17:35.044 INFO:tasks.ceph.osd.5:Started 2023-12-08T08:17:35.044 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-08T08:17:35.044 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-08T08:17:35.046 INFO:tasks.ceph.osd.6:Started 2023-12-08T08:17:35.046 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-08T08:17:35.046 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-08T08:17:35.048 INFO:tasks.ceph.osd.7:Started 2023-12-08T08:17:35.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:35.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.171+0000 7f3c72b41640 1 Processor -- start 2023-12-08T08:17:35.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.171+0000 7f3c72b41640 1 -- start start 2023-12-08T08:17:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.171+0000 7f3c72b41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c1608a0 0x7f3c6c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.171+0000 7f3c72b41640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3c6c0b1d70 0x7f3c6c0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:35.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.171+0000 7f3c72b41640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c0d20b0 con 0x7f3c6c0afce0 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c72b41640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c0d0620 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c72b41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0d1dd0 con 0x7f3c6c1608a0 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c710de640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c6c0afce0 0x7f3c6c0b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33456/0 (socket says 172.21.15.50:33456) 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c710de640 1 -- 172.21.15.50:0/1892072261 learned_addr learned my addr 172.21.15.50:0/1892072261 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c708dd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c1608a0 0x7f3c6c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c6bfff640 1 --2- 172.21.15.50:0/1892072261 >> v2:172.21.15.170:3300/0 conn(0x7f3c6c0b1d70 0x7f3c6c0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c708dd640 1 -- 172.21.15.50:0/1892072261 >> v2:172.21.15.170:3300/0 conn(0x7f3c6c0b1d70 msgr2=0x7f3c6c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c708dd640 1 --2- 172.21.15.50:0/1892072261 >> v2:172.21.15.170:3300/0 conn(0x7f3c6c0b1d70 0x7f3c6c0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c708dd640 1 -- 172.21.15.50:0/1892072261 >> v1:172.21.15.50:6789/0 conn(0x7f3c6c0afce0 legacy=0x7f3c6c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:35.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.172+0000 7f3c708dd640 1 -- 172.21.15.50:0/1892072261 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0cff60 con 0x7f3c6c1608a0 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.173+0000 7f3c708dd640 1 --2- 172.21.15.50:0/1892072261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c1608a0 0x7f3c6c0d0f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3c600097a0 tx=0x7f3c6002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f2fa47584ef64c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.173+0000 7f3c6b7fe640 1 -- 172.21.15.50:0/1892072261 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6002e070 con 0x7f3c6c1608a0 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.173+0000 7f3c6b7fe640 1 -- 172.21.15.50:0/1892072261 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c600315a0 con 0x7f3c6c1608a0 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.173+0000 7f3c6b7fe640 1 -- 172.21.15.50:0/1892072261 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60031930 con 0x7f3c6c1608a0 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 -- 172.21.15.50:0/1892072261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c1608a0 msgr2=0x7f3c6c0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 --2- 172.21.15.50:0/1892072261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c1608a0 0x7f3c6c0d0f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3c600097a0 tx=0x7f3c6002b840 comp rx=0 tx=0).stop 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 -- 172.21.15.50:0/1892072261 shutdown_connections 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 --2- 172.21.15.50:0/1892072261 >> v2:172.21.15.170:3300/0 conn(0x7f3c6c0b1d70 0x7f3c6c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 --2- 172.21.15.50:0/1892072261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c1608a0 0x7f3c6c0d0f30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 -- 172.21.15.50:0/1892072261 >> 172.21.15.50:0/1892072261 conn(0x7f3c6c0d3030 msgr2=0x7f3c6c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 -- 172.21.15.50:0/1892072261 shutdown_connections 2023-12-08T08:17:35.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.174+0000 7f3c72b41640 1 -- 172.21.15.50:0/1892072261 wait complete. 2023-12-08T08:17:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.175+0000 7f3c72b41640 1 Processor -- start 2023-12-08T08:17:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.175+0000 7f3c72b41640 1 -- start start 2023-12-08T08:17:35.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c72b41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c6c0afce0 0x7f3c6c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c72b41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c0b1d70 0x7f3c6c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c72b41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c6c1608a0 0x7f3c6c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c72b41640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c15cbb0 con 0x7f3c6c0afce0 2023-12-08T08:17:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c72b41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c06c410 con 0x7f3c6c1608a0 2023-12-08T08:17:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c72b41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0cc470 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c708dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c6c0afce0 0x7f3c6c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:35.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c0b1d70 0x7f3c6c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c708dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c6c0afce0 0x7f3c6c0cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39464/0 (socket says 172.21.15.50:39464) 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c710de640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c6c1608a0 0x7f3c6c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c708dd640 1 -- 172.21.15.50:0/262796244 learned_addr learned my addr 172.21.15.50:0/262796244 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c0b1d70 0x7f3c6c15c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:50774/0 (socket says 172.21.15.50:50774) 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c6bfff640 1 -- 172.21.15.50:0/262796244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c6c1608a0 msgr2=0x7f3c6c15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c6bfff640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c6c1608a0 0x7f3c6c15c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c6bfff640 1 -- 172.21.15.50:0/262796244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c6c0afce0 msgr2=0x7f3c6c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c6bfff640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c6c0afce0 0x7f3c6c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c6bfff640 1 -- 172.21.15.50:0/262796244 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60009400 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.176+0000 7f3c708dd640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c6c0afce0 0x7f3c6c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c6bfff640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c0b1d70 0x7f3c6c15c130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800e870 tx=0x7f3c5800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c697fa640 1 -- 172.21.15.50:0/262796244 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800ee60 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c697fa640 1 -- 172.21.15.50:0/262796244 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5800c8e0 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c0cc710 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c697fa640 1 -- 172.21.15.50:0/262796244 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800cc70 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c0cccd0 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c697fa640 1 -- 172.21.15.50:0/262796244 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c58005c90 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.177+0000 7f3c697fa640 1 -- 172.21.15.50:0/262796244 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3c58006750 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.178+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c067430 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.180+0000 7f3c697fa640 1 -- 172.21.15.50:0/262796244 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3c58021060 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.241+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c6c0b1820 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.242+0000 7f3c697fa640 1 -- 172.21.15.50:0/262796244 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3c58017070 con 0x7f3c6c0b1d70 2023-12-08T08:17:35.245 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:17:35.245 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:17:35.015710+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c0b1d70 msgr2=0x7f3c6c15c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c0b1d70 0x7f3c6c15c130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800e870 tx=0x7f3c5800ed30 comp rx=0 tx=0).stop 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 shutdown_connections 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c6c1608a0 0x7f3c6c15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c6c0b1d70 0x7f3c6c15c130 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 --2- 172.21.15.50:0/262796244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c6c0afce0 0x7f3c6c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 >> 172.21.15.50:0/262796244 conn(0x7f3c6c0d3030 msgr2=0x7f3c6c06b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 shutdown_connections 2023-12-08T08:17:35.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:35.243+0000 7f3c72b41640 1 -- 172.21.15.50:0/262796244 wait complete. 2023-12-08T08:17:35.256 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-08T08:17:35.256 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-08T08:17:35.653 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-12-08T08:17:35.649+0000 7fcddfac7500 -1 Falling back to public interface 2023-12-08T08:17:35.653 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-12-08T08:17:35.650+0000 7fa3b6625500 -1 Falling back to public interface 2023-12-08T08:17:35.655 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-08T08:17:35.653+0000 7f9b0481a500 -1 Falling back to public interface 2023-12-08T08:17:35.660 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-12-08T08:17:35.657+0000 7f3de6625500 -1 Falling back to public interface 2023-12-08T08:17:35.663 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-08T08:17:35.661+0000 7f085a416500 -1 Falling back to public interface 2023-12-08T08:17:35.664 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-08T08:17:35.661+0000 7f5c2f9fe500 -1 Falling back to public interface 2023-12-08T08:17:35.664 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:35.661+0000 7f31c6c2c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T08:17:35.666 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-12-08T08:17:35.663+0000 7f4bcd00c500 -1 Falling back to public interface 2023-12-08T08:17:35.672 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-08T08:17:35.670+0000 7f0ed1016500 -1 Falling back to public interface 2023-12-08T08:17:35.793 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:35.791+0000 7faebfe32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-08T08:17:35.934 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:35.931+0000 7f31c6c2c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T08:17:35.987 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:35.983+0000 7f31c6c2c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T08:17:36.061 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:36.081 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:36.078+0000 7faebfe32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-08T08:17:36.089 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:36.086+0000 7f31c6c2c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T08:17:36.137 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:36.135+0000 7faebfe32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-08T08:17:36.158 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.156+0000 7f1b5b0a2640 1 Processor -- start 2023-12-08T08:17:36.158 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.156+0000 7f1b5b0a2640 1 -- start start 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b5b0a2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b54159d30 0x7f1b5406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b5b0a2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1b540b23f0 0x7f1b540ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b5b0a2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b541439b0 con 0x7f1b540b5ee0 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b5b0a2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5415e980 con 0x7f1b54159d30 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b5b0a2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5415e4f0 con 0x7f1b540b23f0 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b58e3e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1b54159d30 0x7f1b5406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b53fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1b540b5ee0 0x7f1b540b1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:33470/0 (socket says 172.21.15.50:33470) 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b53fff640 1 -- 172.21.15.50:0/3376640072 learned_addr learned my addr 172.21.15.50:0/3376640072 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b5963f640 1 --2- 172.21.15.50:0/3376640072 >> v2:172.21.15.170:3300/0 conn(0x7f1b540b23f0 0x7f1b540ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b58e3e640 1 -- 172.21.15.50:0/3376640072 >> v2:172.21.15.170:3300/0 conn(0x7f1b540b23f0 msgr2=0x7f1b540ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b58e3e640 1 --2- 172.21.15.50:0/3376640072 >> v2:172.21.15.170:3300/0 conn(0x7f1b540b23f0 0x7f1b540ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b58e3e640 1 -- 172.21.15.50:0/3376640072 >> v1:172.21.15.50:6789/0 conn(0x7f1b540b5ee0 legacy=0x7f1b540b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b537fe640 1 -- 172.21.15.50:0/3376640072 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354287284 0 0) 0x7f1b40001110 con 0x7f1b540b5ee0 2023-12-08T08:17:36.160 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.157+0000 7f1b58e3e640 1 -- 172.21.15.50:0/3376640072 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5415dbc0 con 0x7f1b54159d30 2023-12-08T08:17:36.162 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.158+0000 7f1b58e3e640 1 --2- 172.21.15.50:0/3376640072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b54159d30 0x7f1b5406e3f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b540b2b60 tx=0x7f1b4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac2bcaca2d9ddc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:36.162 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.158+0000 7f1b537fe640 1 -- 172.21.15.50:0/3376640072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48031830 con 0x7f1b54159d30 2023-12-08T08:17:36.162 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.158+0000 7f1b537fe640 1 -- 172.21.15.50:0/3376640072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48031990 con 0x7f1b54159d30 2023-12-08T08:17:36.162 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.158+0000 7f1b537fe640 1 -- 172.21.15.50:0/3376640072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48031d20 con 0x7f1b54159d30 2023-12-08T08:17:36.162 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.158+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3376640072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b54159d30 msgr2=0x7f1b5406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.162 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.159+0000 7f1b5b0a2640 1 --2- 172.21.15.50:0/3376640072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b54159d30 0x7f1b5406e3f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b540b2b60 tx=0x7f1b4802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.159+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3376640072 shutdown_connections 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.159+0000 7f1b5b0a2640 1 --2- 172.21.15.50:0/3376640072 >> v2:172.21.15.170:3300/0 conn(0x7f1b540b23f0 0x7f1b540ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.159+0000 7f1b5b0a2640 1 --2- 172.21.15.50:0/3376640072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b54159d30 0x7f1b5406e3f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.159+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3376640072 >> 172.21.15.50:0/3376640072 conn(0x7f1b54070ae0 msgr2=0x7f1b54070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.159+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3376640072 shutdown_connections 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.159+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3376640072 wait complete. 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.160+0000 7f1b5b0a2640 1 Processor -- start 2023-12-08T08:17:36.163 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.160+0000 7f1b5b0a2640 1 -- start start 2023-12-08T08:17:36.165 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5b0a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b540b23f0 0x7f1b540c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.165 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5b0a2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b540b5ee0 0x7f1b541576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.165 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5b0a2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b54159d30 0x7f1b54157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:36.165 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5b0a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540c6800 con 0x7f1b540b23f0 2023-12-08T08:17:36.165 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5b0a2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540c5bf0 con 0x7f1b540b5ee0 2023-12-08T08:17:36.165 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5b0a2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540c5ed0 con 0x7f1b54159d30 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b540b23f0 0x7f1b540c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b540b23f0 0x7f1b540c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:39490/0 (socket says 172.21.15.50:39490) 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 -- 172.21.15.50:0/3211298984 learned_addr learned my addr 172.21.15.50:0/3211298984 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5963f640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b54159d30 0x7f1b54157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b53fff640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b540b5ee0 0x7f1b541576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 -- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b54159d30 msgr2=0x7f1b54157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b54159d30 0x7f1b54157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 -- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b540b5ee0 msgr2=0x7f1b541576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b540b5ee0 0x7f1b541576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 -- 172.21.15.50:0/3211298984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48009400 con 0x7f1b540b23f0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b58e3e640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b540b23f0 0x7f1b540c5150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b48000c00 tx=0x7f1b480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b517fa640 1 -- 172.21.15.50:0/3211298984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4803a8f0 con 0x7f1b540b23f0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b517fa640 1 -- 172.21.15.50:0/3211298984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4803aa70 con 0x7f1b540b23f0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b540c61b0 con 0x7f1b540b23f0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.161+0000 7f1b517fa640 1 -- 172.21.15.50:0/3211298984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4803ae20 con 0x7f1b540b23f0 2023-12-08T08:17:36.166 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.162+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b541e70d0 con 0x7f1b540b23f0 2023-12-08T08:17:36.167 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.163+0000 7f1b517fa640 1 -- 172.21.15.50:0/3211298984 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 2) v1 ==== 44567+0+0 (secure 0 0 0) 0x7f1b4804d450 con 0x7f1b540b23f0 2023-12-08T08:17:36.167 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.163+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5404f090 con 0x7f1b540b23f0 2023-12-08T08:17:36.167 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.163+0000 7f1b517fa640 1 -- 172.21.15.50:0/3211298984 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1b4806b530 con 0x7f1b540b23f0 2023-12-08T08:17:36.167 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.165+0000 7f1b517fa640 1 -- 172.21.15.50:0/3211298984 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1b480433a0 con 0x7f1b540b23f0 2023-12-08T08:17:36.230 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.227+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b541e75f0 con 0x7f1b540b23f0 2023-12-08T08:17:36.230 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.228+0000 7f1b517fa640 1 -- 172.21.15.50:0/3211298984 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1b48035020 con 0x7f1b540b23f0 2023-12-08T08:17:36.230 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-08T08:17:36.231 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:17:35.015710+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:36.231 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.228+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b540b23f0 msgr2=0x7f1b540c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:36.231 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.228+0000 7f1b5b0a2640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b540b23f0 0x7f1b540c5150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1b48000c00 tx=0x7f1b480046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.231 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.229+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 shutdown_connections 2023-12-08T08:17:36.231 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.229+0000 7f1b5b0a2640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b54159d30 0x7f1b54157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.232 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.229+0000 7f1b5b0a2640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b540b5ee0 0x7f1b541576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.232 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.229+0000 7f1b5b0a2640 1 --2- 172.21.15.50:0/3211298984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1b540b23f0 0x7f1b540c5150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:36.232 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.229+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 >> 172.21.15.50:0/3211298984 conn(0x7f1b54070ae0 msgr2=0x7f1b540ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:36.232 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.229+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 shutdown_connections 2023-12-08T08:17:36.232 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:36.229+0000 7f1b5b0a2640 1 -- 172.21.15.50:0/3211298984 wait complete. 2023-12-08T08:17:36.240 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-08T08:17:36.248 INFO:tasks.ceph.mgr.y.smithi050.stderr:2023-12-08T08:17:36.246+0000 7faebfe32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-08T08:17:37.116 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:37.113+0000 7f31678d0640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-08T08:17:37.116 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-12-08T08:17:37.113+0000 7f31678d0640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-08T08:17:39.111 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-12-08T08:17:39.108+0000 7fcddfac7500 -1 osd.6 0 log_to_monitors true 2023-12-08T08:17:39.132 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-08T08:17:39.129+0000 7f0ed1016500 -1 osd.0 0 log_to_monitors true 2023-12-08T08:17:39.143 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-08T08:17:39.140+0000 7f5c2f9fe500 -1 osd.3 0 log_to_monitors true 2023-12-08T08:17:39.163 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-08T08:17:39.161+0000 7f9b0481a500 -1 osd.2 0 log_to_monitors true 2023-12-08T08:17:39.165 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-08T08:17:39.163+0000 7f085a416500 -1 osd.1 0 log_to_monitors true 2023-12-08T08:17:39.176 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-12-08T08:17:39.173+0000 7f3de6625500 -1 osd.5 0 log_to_monitors true 2023-12-08T08:17:39.185 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-12-08T08:17:39.183+0000 7fa3b6625500 -1 osd.7 0 log_to_monitors true 2023-12-08T08:17:39.185 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-12-08T08:17:39.183+0000 7f4bcd00c500 -1 osd.4 0 log_to_monitors true 2023-12-08T08:17:42.562 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-08T08:17:42.559+0000 7f9b0027d640 -1 osd.2 0 waiting for initial osdmap 2023-12-08T08:17:42.568 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-08T08:17:42.566+0000 7f0855d7e640 -1 osd.1 0 waiting for initial osdmap 2023-12-08T08:17:42.578 INFO:tasks.ceph.osd.1.smithi050.stderr:2023-12-08T08:17:42.576+0000 7f084dba5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:42.578 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-12-08T08:17:42.576+0000 7fa3b25b5640 -1 osd.7 0 waiting for initial osdmap 2023-12-08T08:17:42.582 INFO:tasks.ceph.osd.2.smithi050.stderr:2023-12-08T08:17:42.580+0000 7f9af80a4640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:42.587 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-12-08T08:17:42.584+0000 7f4bc88cc640 -1 osd.4 0 waiting for initial osdmap 2023-12-08T08:17:42.588 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-12-08T08:17:42.586+0000 7fa3aa3dc640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:42.593 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-12-08T08:17:42.591+0000 7f3de2dc9640 -1 osd.5 0 waiting for initial osdmap 2023-12-08T08:17:42.601 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-08T08:17:42.599+0000 7f5c2c1a0640 -1 osd.3 0 waiting for initial osdmap 2023-12-08T08:17:42.608 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-12-08T08:17:42.606+0000 7f4bc06f3640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:42.608 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-12-08T08:17:42.606+0000 7f3dda3dc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:42.613 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-12-08T08:17:42.611+0000 7fcddba55640 -1 osd.6 0 waiting for initial osdmap 2023-12-08T08:17:42.615 INFO:tasks.ceph.osd.3.smithi050.stderr:2023-12-08T08:17:42.613+0000 7f5c237b3640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:42.625 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-12-08T08:17:42.623+0000 7fcdd387c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:42.641 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-08T08:17:42.639+0000 7f0ecc9d4640 -1 osd.0 0 waiting for initial osdmap 2023-12-08T08:17:42.655 INFO:tasks.ceph.osd.0.smithi050.stderr:2023-12-08T08:17:42.653+0000 7f0ec47fb640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-08T08:17:43.046 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:43.142 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.140+0000 7f7e70c31640 1 Processor -- start 2023-12-08T08:17:43.143 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.140+0000 7f7e70c31640 1 -- start start 2023-12-08T08:17:43.144 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e70c31640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c140210 0x7f7e6c167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:43.144 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e70c31640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c0d23d0 con 0x7f7e6c0b4750 2023-12-08T08:17:43.144 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e70c31640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c0b74b0 con 0x7f7e6c0b4b30 2023-12-08T08:17:43.144 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e70c31640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c143840 con 0x7f7e6c140210 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e6a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7e6c0b4750 0x7f7e6c143130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58064/0 (socket says 172.21.15.50:58064) 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e6a59c640 1 -- 172.21.15.50:0/2434632830 learned_addr learned my addr 172.21.15.50:0/2434632830 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e6ad9d640 1 --2- 172.21.15.50:0/2434632830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c140210 0x7f7e6c167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e6959a640 1 -- 172.21.15.50:0/2434632830 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563429907 0 0) 0x7f7e6c0d23d0 con 0x7f7e6c0b4750 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.141+0000 7f7e6959a640 1 -- 172.21.15.50:0/2434632830 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e58003520 con 0x7f7e6c0b4750 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.142+0000 7f7e6959a640 1 -- 172.21.15.50:0/2434632830 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361809342 0 0) 0x7f7e6c0b74b0 con 0x7f7e6c0b4b30 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.142+0000 7f7e6959a640 1 -- 172.21.15.50:0/2434632830 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e6c0d23d0 con 0x7f7e6c0b4b30 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.142+0000 7f7e6ad9d640 1 -- 172.21.15.50:0/2434632830 >> v1:172.21.15.170:6789/0 conn(0x7f7e6c0b4b30 legacy=0x7f7e6c13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.142+0000 7f7e6ad9d640 1 -- 172.21.15.50:0/2434632830 >> v1:172.21.15.50:6789/0 conn(0x7f7e6c0b4750 legacy=0x7f7e6c143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.145 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.142+0000 7f7e6ad9d640 1 -- 172.21.15.50:0/2434632830 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0b7750 con 0x7f7e6c140210 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e6ad9d640 1 --2- 172.21.15.50:0/2434632830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c140210 0x7f7e6c167db0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009df0 tx=0x7f7e5c02bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=253cb67554eb4650 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e6959a640 1 -- 172.21.15.50:0/2434632830 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c02ccb0 con 0x7f7e6c140210 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e6959a640 1 -- 172.21.15.50:0/2434632830 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c02ce10 con 0x7f7e6c140210 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e6959a640 1 -- 172.21.15.50:0/2434632830 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c034660 con 0x7f7e6c140210 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e70c31640 1 -- 172.21.15.50:0/2434632830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c140210 msgr2=0x7f7e6c167db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e70c31640 1 --2- 172.21.15.50:0/2434632830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c140210 0x7f7e6c167db0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009df0 tx=0x7f7e5c02bf00 comp rx=0 tx=0).stop 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e70c31640 1 -- 172.21.15.50:0/2434632830 shutdown_connections 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e70c31640 1 --2- 172.21.15.50:0/2434632830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c140210 0x7f7e6c167db0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.147 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e70c31640 1 -- 172.21.15.50:0/2434632830 >> 172.21.15.50:0/2434632830 conn(0x7f7e6c071f40 msgr2=0x7f7e6c072320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:43.148 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e70c31640 1 -- 172.21.15.50:0/2434632830 shutdown_connections 2023-12-08T08:17:43.148 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.143+0000 7f7e70c31640 1 -- 172.21.15.50:0/2434632830 wait complete. 2023-12-08T08:17:43.148 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 Processor -- start 2023-12-08T08:17:43.148 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 -- start start 2023-12-08T08:17:43.150 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c0b4750 0x7f7e6c0d0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:43.150 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e6c0b4b30 0x7f7e6c0cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:43.150 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c140210 0x7f7e6c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c157270 con 0x7f7e6c140210 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c157e40 con 0x7f7e6c0b4b30 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.145+0000 7f7e70c31640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c1f3290 con 0x7f7e6c0b4750 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c140210 0x7f7e6c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c140210 0x7f7e6c156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40908/0 (socket says 172.21.15.50:40908) 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 -- 172.21.15.50:0/1059418336 learned_addr learned my addr 172.21.15.50:0/1059418336 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6a59c640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c0b4750 0x7f7e6c0d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e69d9b640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e6c0b4b30 0x7f7e6c0cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 -- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c0b4750 msgr2=0x7f7e6c0d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c0b4750 0x7f7e6c0d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 -- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e6c0b4b30 msgr2=0x7f7e6c0cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e6c0b4b30 0x7f7e6c0cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.151 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 -- 172.21.15.50:0/1059418336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009a70 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e6ad9d640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c140210 0x7f7e6c156d30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c02c510 tx=0x7f7e5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1059418336 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c03e610 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1059418336 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c03e770 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c1f3570 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1059418336 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c03eb20 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.146+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c1f3b30 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.147+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c0678e0 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.147+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1059418336 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f7e5c03b050 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.148+0000 7f7e62ffd640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e4c06adb0 0x7f7e4c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.148+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1059418336 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f7e5c0aaf30 con 0x7f7e6c140210 2023-12-08T08:17:43.152 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.148+0000 7f7e6a59c640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e4c06adb0 0x7f7e4c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:43.153 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.149+0000 7f7e6a59c640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e4c06adb0 0x7f7e4c06d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000f60 tx=0x7f7e64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:43.154 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.153+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1059418336 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e5c076e50 con 0x7f7e6c140210 2023-12-08T08:17:43.330 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.328+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e6c157fb0 con 0x7f7e6c140210 2023-12-08T08:17:43.331 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.329+0000 7f7e62ffd640 1 -- 172.21.15.50:0/1059418336 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7e6c157fb0 con 0x7f7e6c140210 2023-12-08T08:17:43.331 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-08T08:17:43.331 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":12,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:17:41.112231+0000","last_up_change":"0.000000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:43.333 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e4c06adb0 msgr2=0x7f7e4c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.333 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e4c06adb0 0x7f7e4c06d270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000f60 tx=0x7f7e64009040 comp rx=0 tx=0).stop 2023-12-08T08:17:43.333 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c140210 msgr2=0x7f7e6c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c140210 0x7f7e6c156d30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c02c510 tx=0x7f7e5c004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 shutdown_connections 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e4c06adb0 0x7f7e4c06d270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7e6c140210 0x7f7e6c156d30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e6c0b4b30 0x7f7e6c0cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 --2- 172.21.15.50:0/1059418336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e6c0b4750 0x7f7e6c0d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 >> 172.21.15.50:0/1059418336 conn(0x7f7e6c071f40 msgr2=0x7f7e6c0b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 shutdown_connections 2023-12-08T08:17:43.334 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:43.331+0000 7f7e70c31640 1 -- 172.21.15.50:0/1059418336 wait complete. 2023-12-08T08:17:43.343 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-08T08:17:50.150 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:50.254 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.251+0000 7fea9770f640 1 Processor -- start 2023-12-08T08:17:50.254 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.252+0000 7fea9770f640 1 -- start start 2023-12-08T08:17:50.255 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.252+0000 7fea9770f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea90156fa0 0x7fea9015a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.252+0000 7fea9770f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea9006e570 0x7fea9015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea9770f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9015aab0 con 0x7fea9006e110 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea9770f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9006c910 con 0x7fea9006e570 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea9770f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9006cbb0 con 0x7fea90156fa0 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea95cac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea9006e570 0x7fea9015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea94caa640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea9006e110 0x7fea9015d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56964/0 (socket says 172.21.15.50:56964) 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea95cac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea9006e570 0x7fea9015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35332/0 (socket says 172.21.15.50:35332) 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea94caa640 1 -- 172.21.15.50:0/2213199724 learned_addr learned my addr 172.21.15.50:0/2213199724 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea954ab640 1 --2- 172.21.15.50:0/2213199724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea90156fa0 0x7fea9015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea95cac640 1 -- 172.21.15.50:0/2213199724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea90156fa0 msgr2=0x7fea9015a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea95cac640 1 --2- 172.21.15.50:0/2213199724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea90156fa0 0x7fea9015a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea95cac640 1 -- 172.21.15.50:0/2213199724 >> v1:172.21.15.50:6789/0 conn(0x7fea9006e110 legacy=0x7fea9015d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea87fff640 1 -- 172.21.15.50:0/2213199724 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260450111 0 0) 0x7fea9015aab0 con 0x7fea9006e110 2023-12-08T08:17:50.256 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.253+0000 7fea95cac640 1 -- 172.21.15.50:0/2213199724 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9006ce90 con 0x7fea9006e570 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.254+0000 7fea95cac640 1 --2- 172.21.15.50:0/2213199724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9006e570 0x7fea9015d7f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea8800bfa0 tx=0x7fea8802e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344eb62f65fbb12f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.254+0000 7fea87fff640 1 -- 172.21.15.50:0/2213199724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8802ee50 con 0x7fea9006e570 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.254+0000 7fea87fff640 1 -- 172.21.15.50:0/2213199724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88032070 con 0x7fea9006e570 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.254+0000 7fea87fff640 1 -- 172.21.15.50:0/2213199724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88038620 con 0x7fea9006e570 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 -- 172.21.15.50:0/2213199724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9006e570 msgr2=0x7fea9015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 --2- 172.21.15.50:0/2213199724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9006e570 0x7fea9015d7f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea8800bfa0 tx=0x7fea8802e0a0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 -- 172.21.15.50:0/2213199724 shutdown_connections 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 --2- 172.21.15.50:0/2213199724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea9006e570 0x7fea9015d7f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 --2- 172.21.15.50:0/2213199724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea90156fa0 0x7fea9015a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 -- 172.21.15.50:0/2213199724 >> 172.21.15.50:0/2213199724 conn(0x7fea900b0db0 msgr2=0x7fea900b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 -- 172.21.15.50:0/2213199724 shutdown_connections 2023-12-08T08:17:50.258 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.255+0000 7fea9770f640 1 -- 172.21.15.50:0/2213199724 wait complete. 2023-12-08T08:17:50.261 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.256+0000 7fea9770f640 1 Processor -- start 2023-12-08T08:17:50.261 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.256+0000 7fea9770f640 1 -- start start 2023-12-08T08:17:50.261 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea9770f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea9006e110 0x7fea9014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.261 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea9770f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea9006e570 0x7fea9014ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.261 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea9770f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea90156fa0 0x7fea901f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea9770f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea901e2500 con 0x7fea90156fa0 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea9770f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea901f8440 con 0x7fea9006e570 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea9770f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea901f7b80 con 0x7fea9006e110 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea90156fa0 0x7fea901f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea90156fa0 0x7fea901f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35346/0 (socket says 172.21.15.50:35346) 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 -- 172.21.15.50:0/51041329 learned_addr learned my addr 172.21.15.50:0/51041329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea954ab640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea9006e110 0x7fea9014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea94caa640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea9006e570 0x7fea9014ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 -- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea9006e110 msgr2=0x7fea9014e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea9006e110 0x7fea9014e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 -- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea9006e570 msgr2=0x7fea9014ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea9006e570 0x7fea9014ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea95cac640 1 -- 172.21.15.50:0/51041329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8800bc80 con 0x7fea90156fa0 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.257+0000 7fea94caa640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea9006e570 0x7fea9014ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:50.262 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.258+0000 7fea95cac640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea90156fa0 0x7fea901f7240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea8803a040 tx=0x7fea88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.263 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.258+0000 7fea85ffb640 1 -- 172.21.15.50:0/51041329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88038ab0 con 0x7fea90156fa0 2023-12-08T08:17:50.263 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.258+0000 7fea85ffb640 1 -- 172.21.15.50:0/51041329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88038c30 con 0x7fea90156fa0 2023-12-08T08:17:50.263 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.258+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea901f7e60 con 0x7fea90156fa0 2023-12-08T08:17:50.263 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.258+0000 7fea85ffb640 1 -- 172.21.15.50:0/51041329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8800a440 con 0x7fea90156fa0 2023-12-08T08:17:50.263 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.258+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea901e2120 con 0x7fea90156fa0 2023-12-08T08:17:50.263 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.259+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea901e2640 con 0x7fea90156fa0 2023-12-08T08:17:50.264 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.260+0000 7fea85ffb640 1 -- 172.21.15.50:0/51041329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea8800a5a0 con 0x7fea90156fa0 2023-12-08T08:17:50.264 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.260+0000 7fea85ffb640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea7406ae40 0x7fea7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.264 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.260+0000 7fea85ffb640 1 -- 172.21.15.50:0/51041329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea880ac190 con 0x7fea90156fa0 2023-12-08T08:17:50.264 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.260+0000 7fea954ab640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea7406ae40 0x7fea7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.264 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.261+0000 7fea954ab640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea7406ae40 0x7fea7406d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009a30 tx=0x7fea8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.267 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.265+0000 7fea85ffb640 1 -- 172.21.15.50:0/51041329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea901e2640 con 0x7fea90156fa0 2023-12-08T08:17:50.444 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.442+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea901e2640 con 0x7fea90156fa0 2023-12-08T08:17:50.445 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.443+0000 7fea85ffb640 1 -- 172.21.15.50:0/51041329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fea901e2640 con 0x7fea90156fa0 2023-12-08T08:17:50.445 INFO:teuthology.misc.health.smithi050.stdout: 2023-12-08T08:17:50.445 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":16,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:17:46.576136+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:50.447 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.444+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea7406ae40 msgr2=0x7fea7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.447 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.444+0000 7fea9770f640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea7406ae40 0x7fea7406d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009a30 tx=0x7fea8c008040 comp rx=0 tx=0).stop 2023-12-08T08:17:50.447 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.444+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea90156fa0 msgr2=0x7fea901f7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.447 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.444+0000 7fea9770f640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea90156fa0 0x7fea901f7240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea8803a040 tx=0x7fea88004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:50.447 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 shutdown_connections 2023-12-08T08:17:50.448 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea7406ae40 0x7fea7406d300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.448 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea90156fa0 0x7fea901f7240 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.448 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea9006e570 0x7fea9014ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.448 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 --2- 172.21.15.50:0/51041329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea9006e110 0x7fea9014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.448 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 >> 172.21.15.50:0/51041329 conn(0x7fea900b0db0 msgr2=0x7fea90159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:50.448 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 shutdown_connections 2023-12-08T08:17:50.448 INFO:teuthology.misc.health.smithi050.stderr:2023-12-08T08:17:50.445+0000 7fea9770f640 1 -- 172.21.15.50:0/51041329 wait complete. 2023-12-08T08:17:50.456 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-08T08:17:50.457 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-08T08:17:50.457 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:17:50.457 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:17:50.459 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:17:50.460 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:17:50.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:17:50.462 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:17:50.462 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:17:50.462 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:17:50.465 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:17:50.465 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:17:50.465 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:17:50.468 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:17:50.468 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-08T08:17:50.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:50.542 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-08T08:17:50.542 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-08T08:17:50.551 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2023-12-08T08:17:50.551 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2023-12-08T08:17:50.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.577+0000 7f6c5e78a640 1 Processor -- start 2023-12-08T08:17:50.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.577+0000 7f6c5e78a640 1 -- start start 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c5e78a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c581608a0 0x7f6c580d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c5e78a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c580cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c5e78a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580d20b0 con 0x7f6c580b1d70 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c5e78a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c580d0620 con 0x7f6c581608a0 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c5e78a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580d1b80 con 0x7f6c580b0cf0 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c57fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c581608a0 0x7f6c580d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c57fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c581608a0 0x7f6c580d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35396/0 (socket says 172.21.15.50:35396) 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.578+0000 7f6c57fff640 1 -- 172.21.15.50:0/1565475976 learned_addr learned my addr 172.21.15.50:0/1565475976 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.579+0000 7f6c57fff640 1 -- 172.21.15.50:0/1565475976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 msgr2=0x7f6c580cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.579+0000 7f6c5cd27640 1 --2- 172.21.15.50:0/1565475976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c580cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.579+0000 7f6c57fff640 1 --2- 172.21.15.50:0/1565475976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c580cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.579+0000 7f6c57fff640 1 -- 172.21.15.50:0/1565475976 >> v1:172.21.15.170:6789/0 conn(0x7f6c580b1d70 legacy=0x7f6c580d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:50.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.579+0000 7f6c57fff640 1 -- 172.21.15.50:0/1565475976 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580d1dd0 con 0x7f6c581608a0 2023-12-08T08:17:50.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.579+0000 7f6c5cd27640 1 --2- 172.21.15.50:0/1565475976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c580cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:50.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.579+0000 7f6c57fff640 1 --2- 172.21.15.50:0/1565475976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580d0f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009870 tx=0x7f6c4c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed3348b9cf35357 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c56ffd640 1 -- 172.21.15.50:0/1565475976 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0317c0 con 0x7f6c581608a0 2023-12-08T08:17:50.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c56ffd640 1 -- 172.21.15.50:0/1565475976 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c031920 con 0x7f6c581608a0 2023-12-08T08:17:50.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c56ffd640 1 -- 172.21.15.50:0/1565475976 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c031cb0 con 0x7f6c581608a0 2023-12-08T08:17:50.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 -- 172.21.15.50:0/1565475976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 msgr2=0x7f6c580d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/1565475976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580d0f30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009870 tx=0x7f6c4c02b860 comp rx=0 tx=0).stop 2023-12-08T08:17:50.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 -- 172.21.15.50:0/1565475976 shutdown_connections 2023-12-08T08:17:50.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/1565475976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c580cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/1565475976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580d0f30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 -- 172.21.15.50:0/1565475976 >> 172.21.15.50:0/1565475976 conn(0x7f6c580d3030 msgr2=0x7f6c580d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:50.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 -- 172.21.15.50:0/1565475976 shutdown_connections 2023-12-08T08:17:50.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.580+0000 7f6c5e78a640 1 -- 172.21.15.50:0/1565475976 wait complete. 2023-12-08T08:17:50.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.582+0000 7f6c5e78a640 1 Processor -- start 2023-12-08T08:17:50.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.582+0000 7f6c5e78a640 1 -- start start 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5e78a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c581f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5e78a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c580b1d70 0x7f6c580b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5e78a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5e78a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581f7160 con 0x7f6c581608a0 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5e78a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580c6e90 con 0x7f6c580b1d70 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5e78a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580c7170 con 0x7f6c580b0cf0 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c57fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c581f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35398/0 (socket says 172.21.15.50:35398) 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 -- 172.21.15.50:0/3699799633 learned_addr learned my addr 172.21.15.50:0/3699799633 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c577fe640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c580b1d70 0x7f6c580b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 -- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 msgr2=0x7f6c581f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c581f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 -- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c580b1d70 msgr2=0x7f6c580b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c580b1d70 0x7f6c580b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 -- 172.21.15.50:0/3699799633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0094d0 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c57fff640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c581f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5cd27640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580b5fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000cea0 tx=0x7f6c5000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c54ff9640 1 -- 172.21.15.50:0/3699799633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50003b90 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c54ff9640 1 -- 172.21.15.50:0/3699799633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50003d10 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c54ff9640 1 -- 172.21.15.50:0/3699799633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50004260 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.583+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c580c7450 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.584+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c580c7a10 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.584+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58067430 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.585+0000 7f6c54ff9640 1 -- 172.21.15.50:0/3699799633 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c500043c0 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.585+0000 7f6c54ff9640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.586+0000 7f6c54ff9640 1 -- 172.21.15.50:0/3699799633 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6c50089b50 con 0x7f6c581608a0 2023-12-08T08:17:50.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.586+0000 7f6c57fff640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.586+0000 7f6c57fff640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c036000 tx=0x7f6c4c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.590+0000 7f6c54ff9640 1 -- 172.21.15.50:0/3699799633 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c50054ff0 con 0x7f6c581608a0 2023-12-08T08:17:50.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.767+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c5806b770 con 0x7f6c581608a0 2023-12-08T08:17:50.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.767+0000 7f6c54ff9640 1 -- 172.21.15.50:0/3699799633 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f6c50058610 con 0x7f6c581608a0 2023-12-08T08:17:50.771 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:17:50.771 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:17:46.576136+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 msgr2=0x7f6c4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c036000 tx=0x7f6c4c03d040 comp rx=0 tx=0).stop 2023-12-08T08:17:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 msgr2=0x7f6c580b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580b5fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000cea0 tx=0x7f6c5000cf90 comp rx=0 tx=0).stop 2023-12-08T08:17:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 shutdown_connections 2023-12-08T08:17:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c581608a0 0x7f6c580b5fe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c580b1d70 0x7f6c580b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 --2- 172.21.15.50:0/3699799633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c580b0cf0 0x7f6c581f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 >> 172.21.15.50:0/3699799633 conn(0x7f6c580d3030 msgr2=0x7f6c580ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 shutdown_connections 2023-12-08T08:17:50.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.769+0000 7f6c5e78a640 1 -- 172.21.15.50:0/3699799633 wait complete. 2023-12-08T08:17:50.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:50.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:50.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.890+0000 7ff6f2b76640 1 Processor -- start 2023-12-08T08:17:50.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.890+0000 7ff6f2b76640 1 -- start start 2023-12-08T08:17:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f2b76640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff6ec0caec0 0x7ff6ec15d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f2b76640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec15dbc0 0x7ff6ec06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f2b76640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec15e600 con 0x7ff6ec0caae0 2023-12-08T08:17:50.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f2b76640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec161c20 con 0x7ff6ec0caec0 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f2b76640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec15e040 con 0x7ff6ec15dbc0 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6ebfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff6ec0caec0 0x7ff6ec15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f0912640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff6ec0caae0 0x7ff6ec161510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:57572/0 (socket says 172.21.15.50:57572) 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6ebfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff6ec0caec0 0x7ff6ec15d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:49204/0 (socket says 172.21.15.50:49204) 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f0912640 1 -- 172.21.15.50:0/1526297661 learned_addr learned my addr 172.21.15.50:0/1526297661 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.891+0000 7ff6f1113640 1 --2- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec15dbc0 0x7ff6ec06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.892+0000 7ff6ebfff640 1 -- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec15dbc0 msgr2=0x7ff6ec06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.892+0000 7ff6ebfff640 1 --2- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec15dbc0 0x7ff6ec06a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.892+0000 7ff6ebfff640 1 -- 172.21.15.50:0/1526297661 >> v1:172.21.15.170:6789/0 conn(0x7ff6ec0caae0 legacy=0x7ff6ec161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.892+0000 7ff6ebfff640 1 -- 172.21.15.50:0/1526297661 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec15e320 con 0x7ff6ec0caec0 2023-12-08T08:17:50.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.892+0000 7ff6f1113640 1 --2- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec15dbc0 0x7ff6ec06a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.892+0000 7ff6ebfff640 1 --2- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec15d680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80097a0 tx=0x7ff6d802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=616a26377a3edd10 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6eb7fe640 1 -- 172.21.15.50:0/1526297661 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8031830 con 0x7ff6ec0caec0 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6eb7fe640 1 -- 172.21.15.50:0/1526297661 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8031990 con 0x7ff6ec0caec0 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6eb7fe640 1 -- 172.21.15.50:0/1526297661 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8031d20 con 0x7ff6ec0caec0 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 -- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec0caec0 msgr2=0x7ff6ec15d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec15d680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80097a0 tx=0x7ff6d802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 -- 172.21.15.50:0/1526297661 shutdown_connections 2023-12-08T08:17:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec15dbc0 0x7ff6ec06a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/1526297661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec15d680 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 -- 172.21.15.50:0/1526297661 >> 172.21.15.50:0/1526297661 conn(0x7ff6ec0cfcd0 msgr2=0x7ff6ec0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 -- 172.21.15.50:0/1526297661 shutdown_connections 2023-12-08T08:17:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.893+0000 7ff6f2b76640 1 -- 172.21.15.50:0/1526297661 wait complete. 2023-12-08T08:17:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.894+0000 7ff6f2b76640 1 Processor -- start 2023-12-08T08:17:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.894+0000 7ff6f2b76640 1 -- start start 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6f2b76640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec0caae0 0x7ff6ec1f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6f2b76640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6f2b76640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec15dbc0 0x7ff6ec0b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6f2b76640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec0c38a0 con 0x7ff6ec0caec0 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6f2b76640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec0c3b40 con 0x7ff6ec15dbc0 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6f2b76640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec0c3e20 con 0x7ff6ec0caae0 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec0b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35408/0 (socket says 172.21.15.50:35408) 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.895+0000 7ff6ebfff640 1 -- 172.21.15.50:0/2994064566 learned_addr learned my addr 172.21.15.50:0/2994064566 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6f0912640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec0caae0 0x7ff6ec1f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6f1113640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec15dbc0 0x7ff6ec0b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6ebfff640 1 -- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec0caae0 msgr2=0x7ff6ec1f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6ebfff640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec0caae0 0x7ff6ec1f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6ebfff640 1 -- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec15dbc0 msgr2=0x7ff6ec0b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6ebfff640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec15dbc0 0x7ff6ec0b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6ebfff640 1 -- 172.21.15.50:0/2994064566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4009a70 con 0x7ff6ec0caec0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6f0912640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec0caae0 0x7ff6ec1f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6f1113640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec15dbc0 0x7ff6ec0b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6ebfff640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec0b4170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802bee0 tx=0x7ff6d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6e97fa640 1 -- 172.21.15.50:0/2994064566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d803a6f0 con 0x7ff6ec0caec0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6e97fa640 1 -- 172.21.15.50:0/2994064566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d803a870 con 0x7ff6ec0caec0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6e97fa640 1 -- 172.21.15.50:0/2994064566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d803ac20 con 0x7ff6ec0caec0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d8009400 con 0x7ff6ec0caec0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.896+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec0c43e0 con 0x7ff6ec0caec0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.897+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec0c45d0 con 0x7ff6ec0caec0 2023-12-08T08:17:50.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.898+0000 7ff6e97fa640 1 -- 172.21.15.50:0/2994064566 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6d8030380 con 0x7ff6ec0caec0 2023-12-08T08:17:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.898+0000 7ff6e97fa640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff6d006ae40 0x7ff6d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.898+0000 7ff6e97fa640 1 -- 172.21.15.50:0/2994064566 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff6d80aaba0 con 0x7ff6ec0caec0 2023-12-08T08:17:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.898+0000 7ff6f0912640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff6d006ae40 0x7ff6d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.899+0000 7ff6f0912640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff6d006ae40 0x7ff6d006d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0007fd0 tx=0x7ff6e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:50.902+0000 7ff6e97fa640 1 -- 172.21.15.50:0/2994064566 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6d8076030 con 0x7ff6ec0caec0 2023-12-08T08:17:51.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.077+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6ec067ad0 con 0x7ff6ec0caec0 2023-12-08T08:17:51.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.077+0000 7ff6e97fa640 1 -- 172.21.15.50:0/2994064566 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6d8079650 con 0x7ff6ec0caec0 2023-12-08T08:17:51.081 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:17:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff6d006ae40 msgr2=0x7ff6d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff6d006ae40 0x7ff6d006d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0007fd0 tx=0x7ff6e0009040 comp rx=0 tx=0).stop 2023-12-08T08:17:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec0caec0 msgr2=0x7ff6ec0b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec0b4170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802bee0 tx=0x7ff6d80046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 shutdown_connections 2023-12-08T08:17:51.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff6d006ae40 0x7ff6d006d300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6ec0caec0 0x7ff6ec0b4170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6ec15dbc0 0x7ff6ec0b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 --2- 172.21.15.50:0/2994064566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6ec0caae0 0x7ff6ec1f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 >> 172.21.15.50:0/2994064566 conn(0x7ff6ec0cfcd0 msgr2=0x7ff6ec0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:51.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 shutdown_connections 2023-12-08T08:17:51.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.079+0000 7ff6f2b76640 1 -- 172.21.15.50:0/2994064566 wait complete. 2023-12-08T08:17:51.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:51.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.195+0000 7f0ce57de640 1 Processor -- start 2023-12-08T08:17:51.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.195+0000 7f0ce57de640 1 -- start start 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0ce57de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ce01608a0 0x7f0ce00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0ce57de640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce00b1d70 0x7f0ce00d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0ce57de640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0ce00afce0 0x7f0ce00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0ce57de640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00d0620 con 0x7f0ce01608a0 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0ce57de640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00d20b0 con 0x7f0ce00afce0 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0ce57de640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00d1dd0 con 0x7f0ce00b1d70 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ce01608a0 0x7f0ce00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:51.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0ce01608a0 0x7f0ce00d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35420/0 (socket says 172.21.15.50:35420) 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 -- 172.21.15.50:0/1719828901 learned_addr learned my addr 172.21.15.50:0/1719828901 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdf7fe640 1 --2- 172.21.15.50:0/1719828901 >> v2:172.21.15.170:3300/0 conn(0x7f0ce00afce0 0x7f0ce00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cde7fc640 1 --2- 172.21.15.50:0/1719828901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce00b1d70 0x7f0ce00d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 -- 172.21.15.50:0/1719828901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce00b1d70 msgr2=0x7f0ce00d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 --2- 172.21.15.50:0/1719828901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce00b1d70 0x7f0ce00d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 -- 172.21.15.50:0/1719828901 >> v2:172.21.15.170:3300/0 conn(0x7f0ce00afce0 msgr2=0x7f0ce00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 --2- 172.21.15.50:0/1719828901 >> v2:172.21.15.170:3300/0 conn(0x7f0ce00afce0 0x7f0ce00b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cdeffd640 1 -- 172.21.15.50:0/1719828901 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00cff60 con 0x7f0ce01608a0 2023-12-08T08:17:51.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.196+0000 7f0cde7fc640 1 --2- 172.21.15.50:0/1719828901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce00b1d70 0x7f0ce00d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:51.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.197+0000 7f0cdeffd640 1 --2- 172.21.15.50:0/1719828901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce01608a0 0x7f0ce00d0f30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b27c0 tx=0x7f0cd802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279b6259763ee64c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.197+0000 7f0cddffb640 1 -- 172.21.15.50:0/1719828901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80317e0 con 0x7f0ce01608a0 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.197+0000 7f0cddffb640 1 -- 172.21.15.50:0/1719828901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8031940 con 0x7f0ce01608a0 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.197+0000 7f0cddffb640 1 -- 172.21.15.50:0/1719828901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8031cd0 con 0x7f0ce01608a0 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 -- 172.21.15.50:0/1719828901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce01608a0 msgr2=0x7f0ce00d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 --2- 172.21.15.50:0/1719828901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce01608a0 0x7f0ce00d0f30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b27c0 tx=0x7f0cd802b880 comp rx=0 tx=0).stop 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 -- 172.21.15.50:0/1719828901 shutdown_connections 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 --2- 172.21.15.50:0/1719828901 >> v2:172.21.15.170:3300/0 conn(0x7f0ce00afce0 0x7f0ce00b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 --2- 172.21.15.50:0/1719828901 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce00b1d70 0x7f0ce00d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 --2- 172.21.15.50:0/1719828901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce01608a0 0x7f0ce00d0f30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 -- 172.21.15.50:0/1719828901 >> 172.21.15.50:0/1719828901 conn(0x7f0ce00d3030 msgr2=0x7f0ce00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 -- 172.21.15.50:0/1719828901 shutdown_connections 2023-12-08T08:17:51.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.198+0000 7f0ce57de640 1 -- 172.21.15.50:0/1719828901 wait complete. 2023-12-08T08:17:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.199+0000 7f0ce57de640 1 Processor -- start 2023-12-08T08:17:51.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.199+0000 7f0ce57de640 1 -- start start 2023-12-08T08:17:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0ce57de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce00afce0 0x7f0ce00c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:51.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0ce57de640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ce00b1d70 0x7f0ce014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0ce57de640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce01608a0 0x7f0ce00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0ce57de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c94d0 con 0x7f0ce00afce0 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0ce57de640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c8c30 con 0x7f0ce00b1d70 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0ce57de640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c8f10 con 0x7f0ce01608a0 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce00afce0 0x7f0ce00c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce00afce0 0x7f0ce00c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35430/0 (socket says 172.21.15.50:35430) 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 -- 172.21.15.50:0/749953393 learned_addr learned my addr 172.21.15.50:0/749953393 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdf7fe640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce01608a0 0x7f0ce00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cde7fc640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ce00b1d70 0x7f0ce014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 -- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce01608a0 msgr2=0x7f0ce00ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce01608a0 0x7f0ce00ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 -- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ce00b1d70 msgr2=0x7f0ce014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:51.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ce00b1d70 0x7f0ce014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.200+0000 7f0cdeffd640 1 -- 172.21.15.50:0/749953393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80094d0 con 0x7f0ce00afce0 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.201+0000 7f0cdeffd640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce00afce0 0x7f0ce00c8570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0cd802b8c0 tx=0x7f0cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.201+0000 7f0cd77fe640 1 -- 172.21.15.50:0/749953393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8032880 con 0x7f0ce00afce0 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.201+0000 7f0cd77fe640 1 -- 172.21.15.50:0/749953393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8032a00 con 0x7f0ce00afce0 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.201+0000 7f0cd77fe640 1 -- 172.21.15.50:0/749953393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8032db0 con 0x7f0ce00afce0 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.201+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce00c91f0 con 0x7f0ce00afce0 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.201+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce014fab0 con 0x7f0ce00afce0 2023-12-08T08:17:51.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.202+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00c9050 con 0x7f0ce00afce0 2023-12-08T08:17:51.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.202+0000 7f0cd77fe640 1 -- 172.21.15.50:0/749953393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0cd804e450 con 0x7f0ce00afce0 2023-12-08T08:17:51.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.203+0000 7f0cd77fe640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0cc006ae40 0x7f0cc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:51.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.203+0000 7f0cd77fe640 1 -- 172.21.15.50:0/749953393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cd80ab270 con 0x7f0ce00afce0 2023-12-08T08:17:51.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.203+0000 7f0cde7fc640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0cc006ae40 0x7f0cc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:51.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.203+0000 7f0cde7fc640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0cc006ae40 0x7f0cc006d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b0d00 tx=0x7f0cc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:51.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.207+0000 7f0cd77fe640 1 -- 172.21.15.50:0/749953393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ce00c9050 con 0x7f0ce00afce0 2023-12-08T08:17:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.418+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ce00c9050 con 0x7f0ce00afce0 2023-12-08T08:17:51.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.419+0000 7f0cd77fe640 1 -- 172.21.15.50:0/749953393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f0ce00c9050 con 0x7f0ce00afce0 2023-12-08T08:17:51.422 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:17:51.422 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-08T08:17:51.423 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 2 2023-12-08T08:17:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.420+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0cc006ae40 msgr2=0x7f0cc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.420+0000 7f0ce57de640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0cc006ae40 0x7f0cc006d300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00b0d00 tx=0x7f0cc8008040 comp rx=0 tx=0).stop 2023-12-08T08:17:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.420+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce00afce0 msgr2=0x7f0ce00c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.420+0000 7f0ce57de640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce00afce0 0x7f0ce00c8570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0cd802b8c0 tx=0x7f0cd80046c0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 shutdown_connections 2023-12-08T08:17:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0cc006ae40 0x7f0cc006d300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ce01608a0 0x7f0ce00ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ce00b1d70 0x7f0ce014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 --2- 172.21.15.50:0/749953393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0ce00afce0 0x7f0ce00c8570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 >> 172.21.15.50:0/749953393 conn(0x7f0ce00d3030 msgr2=0x7f0ce00b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 shutdown_connections 2023-12-08T08:17:51.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:51.421+0000 7f0ce57de640 1 -- 172.21.15.50:0/749953393 wait complete. 2023-12-08T08:17:53.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:17:53.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.551+0000 7feed75ce640 1 Processor -- start 2023-12-08T08:17:53.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.551+0000 7feed75ce640 1 -- start start 2023-12-08T08:17:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed75ce640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed75ce640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feed00b3bf0 0x7feed00b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed75ce640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00cdc20 con 0x7feed00b3340 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed75ce640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed00d11d0 con 0x7feed00b3bf0 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed75ce640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00d3a60 con 0x7feed00d1d00 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed4b69640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed536a640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7feed00b3340 0x7feed00d15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:57576/0 (socket says 172.21.15.50:57576) 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed536a640 1 -- 172.21.15.50:0/533793075 learned_addr learned my addr 172.21.15.50:0/533793075 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.552+0000 7feed5b6b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feed00b3bf0 0x7feed00b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.553+0000 7feec7fff640 1 -- 172.21.15.50:0/533793075 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794384760 0 0) 0x7feed00cdc20 con 0x7feed00b3340 2023-12-08T08:17:53.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.553+0000 7feec7fff640 1 -- 172.21.15.50:0/533793075 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feebc003520 con 0x7feed00b3340 2023-12-08T08:17:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.553+0000 7feed5b6b640 1 -- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 msgr2=0x7feed00d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.553+0000 7feed5b6b640 1 --2- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.553+0000 7feed5b6b640 1 -- 172.21.15.50:0/533793075 >> v1:172.21.15.170:6789/0 conn(0x7feed00b3340 legacy=0x7feed00d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.553+0000 7feed5b6b640 1 -- 172.21.15.50:0/533793075 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00d3d40 con 0x7feed00b3bf0 2023-12-08T08:17:53.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.553+0000 7feed4b69640 1 --2- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feed5b6b640 1 --2- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 0x7feed00b5e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feec8009d90 tx=0x7feec802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550dc580a20d367c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feec7fff640 1 -- 172.21.15.50:0/533793075 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec802cbc0 con 0x7feed00b3bf0 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feec7fff640 1 -- 172.21.15.50:0/533793075 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec802cd20 con 0x7feed00b3bf0 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feec7fff640 1 -- 172.21.15.50:0/533793075 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8034660 con 0x7feed00b3bf0 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feed75ce640 1 -- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 msgr2=0x7feed00b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feed75ce640 1 --2- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 0x7feed00b5e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feec8009d90 tx=0x7feec802be10 comp rx=0 tx=0).stop 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feed75ce640 1 -- 172.21.15.50:0/533793075 shutdown_connections 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feed75ce640 1 --2- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 0x7feed00b5e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feed75ce640 1 --2- 172.21.15.50:0/533793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.554+0000 7feed75ce640 1 -- 172.21.15.50:0/533793075 >> 172.21.15.50:0/533793075 conn(0x7feed009c2f0 msgr2=0x7feed00d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.555+0000 7feed75ce640 1 -- 172.21.15.50:0/533793075 shutdown_connections 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.555+0000 7feed75ce640 1 -- 172.21.15.50:0/533793075 wait complete. 2023-12-08T08:17:53.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 Processor -- start 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 -- start start 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed00b3340 0x7feed00c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 0x7feed015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00c9ef0 con 0x7feed00b3340 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00ca570 con 0x7feed00b3bf0 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.556+0000 7feed75ce640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00ca850 con 0x7feed00d1d00 2023-12-08T08:17:53.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed00b3340 0x7feed00c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed00b3340 0x7feed00c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35446/0 (socket says 172.21.15.50:35446) 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 -- 172.21.15.50:0/4052775390 learned_addr learned my addr 172.21.15.50:0/4052775390 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed4b69640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 0x7feed015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed5b6b640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 -- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 msgr2=0x7feed00b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 -- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 msgr2=0x7feed015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 0x7feed015d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 -- 172.21.15.50:0/4052775390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0009400 con 0x7feed00b3340 2023-12-08T08:17:53.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed536a640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed00b3340 0x7feed00c99b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c500 tx=0x7feecc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feec5ffb640 1 -- 172.21.15.50:0/4052775390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc005ce0 con 0x7feed00b3340 2023-12-08T08:17:53.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feec5ffb640 1 -- 172.21.15.50:0/4052775390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc005e40 con 0x7feed00b3340 2023-12-08T08:17:53.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feec5ffb640 1 -- 172.21.15.50:0/4052775390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc007330 con 0x7feed00b3340 2023-12-08T08:17:53.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.557+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec8009a70 con 0x7feed00b3340 2023-12-08T08:17:53.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.558+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed00cae10 con 0x7feed00b3340 2023-12-08T08:17:53.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.559+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00cb000 con 0x7feed00b3340 2023-12-08T08:17:53.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.559+0000 7feec5ffb640 1 -- 172.21.15.50:0/4052775390 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feecc007550 con 0x7feed00b3340 2023-12-08T08:17:53.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.559+0000 7feec5ffb640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feeb406ae40 0x7feeb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.560+0000 7feec5ffb640 1 -- 172.21.15.50:0/4052775390 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feecc088820 con 0x7feed00b3340 2023-12-08T08:17:53.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.560+0000 7feed4b69640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feeb406ae40 0x7feeb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.560+0000 7feed4b69640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feeb406ae40 0x7feeb406d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feed006cad0 tx=0x7feec0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.564+0000 7feec5ffb640 1 -- 172.21.15.50:0/4052775390 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feecc053e20 con 0x7feed00b3340 2023-12-08T08:17:53.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.778+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feed0067430 con 0x7feed00b3340 2023-12-08T08:17:53.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.778+0000 7feec5ffb640 1 -- 172.21.15.50:0/4052775390 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7feecc017020 con 0x7feed00b3340 2023-12-08T08:17:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:17:53.782 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-08T08:17:53.782 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feeb406ae40 msgr2=0x7feeb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feeb406ae40 0x7feeb406d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feed006cad0 tx=0x7feec0009190 comp rx=0 tx=0).stop 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed00b3340 msgr2=0x7feed00c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed00b3340 0x7feed00c99b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feecc00c500 tx=0x7feecc00c9c0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 shutdown_connections 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feeb406ae40 0x7feeb406d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feed00d1d00 0x7feed00b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed00b3bf0 0x7feed015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 --2- 172.21.15.50:0/4052775390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feed00b3340 0x7feed00c99b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 >> 172.21.15.50:0/4052775390 conn(0x7feed009c2f0 msgr2=0x7feed01605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 shutdown_connections 2023-12-08T08:17:53.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.780+0000 7feed75ce640 1 -- 172.21.15.50:0/4052775390 wait complete. 2023-12-08T08:17:53.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.899+0000 7f9d7f133640 1 Processor -- start 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.899+0000 7f9d7f133640 1 -- start start 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d7f133640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 0x7f9d780cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d7f133640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d780b66e0 con 0x7f9d780cfdb0 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d7f133640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7815d690 con 0x7f9d7815d2b0 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d7f133640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780d0240 con 0x7f9d780d3a90 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d7d6d0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9d780cfdb0 0x7f9d780b6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56980/0 (socket says 172.21.15.50:56980) 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d7d6d0640 1 -- 172.21.15.50:0/2754816407 learned_addr learned my addr 172.21.15.50:0/2754816407 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:53.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6ffff640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 0x7f9d780cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247579836 0 0) 0x7f9d780b66e0 con 0x7f9d780cfdb0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d60003520 con 0x7f9d780cfdb0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091218023 0 0) 0x7f9d7815d690 con 0x7f9d7815d2b0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d780b66e0 con 0x7f9d7815d2b0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2200864582 0 0) 0x7f9d60003520 con 0x7f9d780cfdb0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 msgr2=0x7f9d780cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 0x7f9d780cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 >> v1:172.21.15.170:6789/0 conn(0x7f9d7815d2b0 legacy=0x7f9d780ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780b5df0 con 0x7f9d780cfdb0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f9d700019f0 con 0x7f9d780cfdb0 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6ffff640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 0x7f9d780cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 >> v1:172.21.15.50:6789/0 conn(0x7f9d780cfdb0 legacy=0x7f9d780b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d60003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 0x7f9d60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780d0240 con 0x7f9d60003b30 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6000b9b0 con 0x7f9d600047c0 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.900+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6000bb70 con 0x7f9d780d3a90 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7cecf640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d60003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d6ffff640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7d6d0640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 0x7f9d60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7cecf640 1 -- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 msgr2=0x7f9d60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7cecf640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780d3a90 0x7f9d60005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7cecf640 1 -- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d600047c0 msgr2=0x7f9d60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7cecf640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7cecf640 1 -- 172.21.15.50:0/2754816407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68009400 con 0x7f9d60003b30 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d6ffff640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d600047c0 0x7f9d60004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.901+0000 7f9d7cecf640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d60003f30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d740018a0 tx=0x7f9d600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2305ade607a19db5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740052d0 con 0x7f9d60003b30 2023-12-08T08:17:53.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74005430 con 0x7f9d60003b30 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d6f7fe640 1 -- 172.21.15.50:0/2754816407 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74003810 con 0x7f9d60003b30 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d7f133640 1 -- 172.21.15.50:0/2754816407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 msgr2=0x7f9d60003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d7f133640 1 --2- 172.21.15.50:0/2754816407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d60003f30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d740018a0 tx=0x7f9d600057f0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d7d6d0640 1 -- 172.21.15.50:0/2754816407 reap_dead start 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d7f133640 1 -- 172.21.15.50:0/2754816407 shutdown_connections 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d7f133640 1 -- 172.21.15.50:0/2754816407 >> 172.21.15.50:0/2754816407 conn(0x7f9d7809c300 msgr2=0x7f9d780d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d7f133640 1 -- 172.21.15.50:0/2754816407 shutdown_connections 2023-12-08T08:17:53.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.902+0000 7f9d7f133640 1 -- 172.21.15.50:0/2754816407 wait complete. 2023-12-08T08:17:53.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.903+0000 7f9d7f133640 1 Processor -- start 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.903+0000 7f9d7f133640 1 -- start start 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7f133640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d7815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7f133640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780c8580 0x7f9d780cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7f133640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d780c95e0 0x7f9d780cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7f133640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7815a8a0 con 0x7f9d60003b30 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7f133640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780c74e0 con 0x7f9d780c95e0 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7f133640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780c77c0 con 0x7f9d780c8580 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7cecf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d7815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7cecf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d7815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35466/0 (socket says 172.21.15.50:35466) 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.904+0000 7f9d7cecf640 1 -- 172.21.15.50:0/1156429755 learned_addr learned my addr 172.21.15.50:0/1156429755 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d6ffff640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780c8580 0x7f9d780cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7d6d0640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d780c95e0 0x7f9d780cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7cecf640 1 -- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780c8580 msgr2=0x7f9d780cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7cecf640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780c8580 0x7f9d780cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7cecf640 1 -- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d780c95e0 msgr2=0x7f9d780cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7cecf640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d780c95e0 0x7f9d780cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7cecf640 1 -- 172.21.15.50:0/1156429755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780c7aa0 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7cecf640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d7815a360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d74005040 tx=0x7f9d740012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d6d7fa640 1 -- 172.21.15.50:0/1156429755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74007450 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d6d7fa640 1 -- 172.21.15.50:0/1156429755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740075b0 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d780c7d80 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d6d7fa640 1 -- 172.21.15.50:0/1156429755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740037f0 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.905+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7815ace0 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.906+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d780c7900 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.907+0000 7f9d6d7fa640 1 -- 172.21.15.50:0/1156429755 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d74003950 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.907+0000 7f9d6d7fa640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9d6406ae70 0x7f9d6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.907+0000 7f9d6d7fa640 1 -- 172.21.15.50:0/1156429755 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9d740aad70 con 0x7f9d60003b30 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.907+0000 7f9d6ffff640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9d6406ae70 0x7f9d6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:53.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.908+0000 7f9d6ffff640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9d6406ae70 0x7f9d6406d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d781f6500 tx=0x7f9d68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:53.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:53.911+0000 7f9d6d7fa640 1 -- 172.21.15.50:0/1156429755 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d780c7900 con 0x7f9d60003b30 2023-12-08T08:17:54.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.087+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d780c7900 con 0x7f9d60003b30 2023-12-08T08:17:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.088+0000 7f9d6d7fa640 1 -- 172.21.15.50:0/1156429755 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f9d780c7900 con 0x7f9d60003b30 2023-12-08T08:17:54.092 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:17:54.092 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:17:46.576136+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:17:54.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9d6406ae70 msgr2=0x7f9d6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9d6406ae70 0x7f9d6406d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d781f6500 tx=0x7f9d68008040 comp rx=0 tx=0).stop 2023-12-08T08:17:54.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 msgr2=0x7f9d7815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d7815a360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d74005040 tx=0x7f9d740012d0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 shutdown_connections 2023-12-08T08:17:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9d6406ae70 0x7f9d6406d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d780c95e0 0x7f9d780cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d780c8580 0x7f9d780cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 --2- 172.21.15.50:0/1156429755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d60003b30 0x7f9d7815a360 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 >> 172.21.15.50:0/1156429755 conn(0x7f9d7809c300 msgr2=0x7f9d780b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 shutdown_connections 2023-12-08T08:17:54.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.090+0000 7f9d7f133640 1 -- 172.21.15.50:0/1156429755 wait complete. 2023-12-08T08:17:54.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:17:54.105 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:17:54.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.211+0000 7fcfd330f640 1 Processor -- start 2023-12-08T08:17:54.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.211+0000 7fcfd330f640 1 -- start start 2023-12-08T08:17:54.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd330f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcfcc0cf570 0x7fcfcc0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd330f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfcc0b6c50 0x7fcfcc0b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd330f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0cfef0 con 0x7fcfcc0b8950 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd330f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc0b5f00 con 0x7fcfcc0b6c50 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd330f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc0b6170 con 0x7fcfcc0cf570 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd18ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfcc0b6c50 0x7fcfcc0b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd18ac640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcfcc0b6c50 0x7fcfcc0b70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35478/0 (socket says 172.21.15.50:35478) 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd18ac640 1 -- 172.21.15.50:0/4060330574 learned_addr learned my addr 172.21.15.50:0/4060330574 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd08aa640 1 --2- 172.21.15.50:0/4060330574 >> v2:172.21.15.170:3300/0 conn(0x7fcfcc0cf570 0x7fcfcc0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd18ac640 1 -- 172.21.15.50:0/4060330574 >> v2:172.21.15.170:3300/0 conn(0x7fcfcc0cf570 msgr2=0x7fcfcc0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd18ac640 1 --2- 172.21.15.50:0/4060330574 >> v2:172.21.15.170:3300/0 conn(0x7fcfcc0cf570 0x7fcfcc0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd18ac640 1 -- 172.21.15.50:0/4060330574 >> v1:172.21.15.170:6789/0 conn(0x7fcfcc0b8950 legacy=0x7fcfcc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.212+0000 7fcfd18ac640 1 -- 172.21.15.50:0/4060330574 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0b6450 con 0x7fcfcc0b6c50 2023-12-08T08:17:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.213+0000 7fcfd18ac640 1 --2- 172.21.15.50:0/4060330574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0b6c50 0x7fcfcc0b70a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc06a800 tx=0x7fcfc402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd851a2064f39cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.213+0000 7fcfc3fff640 1 -- 172.21.15.50:0/4060330574 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc402ca80 con 0x7fcfcc0b6c50 2023-12-08T08:17:54.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.213+0000 7fcfc3fff640 1 -- 172.21.15.50:0/4060330574 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc402cbe0 con 0x7fcfcc0b6c50 2023-12-08T08:17:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.213+0000 7fcfc3fff640 1 -- 172.21.15.50:0/4060330574 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40343f0 con 0x7fcfcc0b6c50 2023-12-08T08:17:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.213+0000 7fcfd330f640 1 -- 172.21.15.50:0/4060330574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0b6c50 msgr2=0x7fcfcc0b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.213+0000 7fcfd330f640 1 --2- 172.21.15.50:0/4060330574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0b6c50 0x7fcfcc0b70a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc06a800 tx=0x7fcfc402bee0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.214+0000 7fcfd330f640 1 -- 172.21.15.50:0/4060330574 shutdown_connections 2023-12-08T08:17:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.214+0000 7fcfd330f640 1 --2- 172.21.15.50:0/4060330574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0b6c50 0x7fcfcc0b70a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.214+0000 7fcfd330f640 1 --2- 172.21.15.50:0/4060330574 >> v2:172.21.15.170:3300/0 conn(0x7fcfcc0cf570 0x7fcfcc0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.214+0000 7fcfd330f640 1 -- 172.21.15.50:0/4060330574 >> 172.21.15.50:0/4060330574 conn(0x7fcfcc0d3010 msgr2=0x7fcfcc0d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.214+0000 7fcfd330f640 1 -- 172.21.15.50:0/4060330574 shutdown_connections 2023-12-08T08:17:54.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.214+0000 7fcfd330f640 1 -- 172.21.15.50:0/4060330574 wait complete. 2023-12-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.215+0000 7fcfd330f640 1 Processor -- start 2023-12-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.215+0000 7fcfd330f640 1 -- start start 2023-12-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.215+0000 7fcfd330f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfcc0b6c50 0x7fcfcc15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.215+0000 7fcfd330f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfcc0b8950 0x7fcfcc0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd330f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0cf570 0x7fcfcc0b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd330f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc15efd0 con 0x7fcfcc0cf570 2023-12-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd330f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0cb260 con 0x7fcfcc0b8950 2023-12-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd330f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0cb540 con 0x7fcfcc0b6c50 2023-12-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0cf570 0x7fcfcc0b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0cf570 0x7fcfcc0b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35490/0 (socket says 172.21.15.50:35490) 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 -- 172.21.15.50:0/3308781886 learned_addr learned my addr 172.21.15.50:0/3308781886 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd08aa640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfcc0b8950 0x7fcfcc0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd10ab640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfcc0b6c50 0x7fcfcc15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 -- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfcc0b6c50 msgr2=0x7fcfcc15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfcc0b6c50 0x7fcfcc15ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 -- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfcc0b8950 msgr2=0x7fcfcc0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfcc0b8950 0x7fcfcc0cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 -- 172.21.15.50:0/3308781886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4009b30 con 0x7fcfcc0cf570 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd08aa640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfcc0b8950 0x7fcfcc0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd18ac640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0cf570 0x7fcfcc0b06b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4036040 tx=0x7fcfc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfc1ffb640 1 -- 172.21.15.50:0/3308781886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4009510 con 0x7fcfcc0cf570 2023-12-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfc1ffb640 1 -- 172.21.15.50:0/3308781886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc403e450 con 0x7fcfcc0cf570 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc0cb820 con 0x7fcfcc0cf570 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfc1ffb640 1 -- 172.21.15.50:0/3308781886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc403e800 con 0x7fcfcc0cf570 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.216+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc0cbde0 con 0x7fcfcc0cf570 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.218+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc08b150 con 0x7fcfcc0cf570 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.218+0000 7fcfc1ffb640 1 -- 172.21.15.50:0/3308781886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfc402cd50 con 0x7fcfcc0cf570 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.218+0000 7fcfc1ffb640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcfb006ae40 0x7fcfb006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.218+0000 7fcfc1ffb640 1 -- 172.21.15.50:0/3308781886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcfc40abca0 con 0x7fcfcc0cf570 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.218+0000 7fcfd10ab640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcfb006ae40 0x7fcfb006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.219+0000 7fcfd10ab640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcfb006ae40 0x7fcfb006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000f60 tx=0x7fcfc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.222+0000 7fcfc1ffb640 1 -- 172.21.15.50:0/3308781886 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfc4077130 con 0x7fcfcc0cf570 2023-12-08T08:17:54.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:54.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:17:54.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.398+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfcc0cc000 con 0x7fcfcc0cf570 2023-12-08T08:17:54.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.398+0000 7fcfc1ffb640 1 -- 172.21.15.50:0/3308781886 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfc407a750 con 0x7fcfcc0cf570 2023-12-08T08:17:54.402 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:17:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcfb006ae40 msgr2=0x7fcfb006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcfb006ae40 0x7fcfb006d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000f60 tx=0x7fcfc8009040 comp rx=0 tx=0).stop 2023-12-08T08:17:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0cf570 msgr2=0x7fcfcc0b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0cf570 0x7fcfcc0b06b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4036040 tx=0x7fcfc4004a40 comp rx=0 tx=0).stop 2023-12-08T08:17:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 shutdown_connections 2023-12-08T08:17:54.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcfb006ae40 0x7fcfb006d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfcc0cf570 0x7fcfcc0b06b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfcc0b8950 0x7fcfcc0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 --2- 172.21.15.50:0/3308781886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfcc0b6c50 0x7fcfcc15ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.400+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 >> 172.21.15.50:0/3308781886 conn(0x7fcfcc0d3010 msgr2=0x7fcfcc0d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.401+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 shutdown_connections 2023-12-08T08:17:54.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.401+0000 7fcfd330f640 1 -- 172.21.15.50:0/3308781886 wait complete. 2023-12-08T08:17:54.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:17:54.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.557+0000 7f0eb2656640 1 Processor -- start 2023-12-08T08:17:54.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.557+0000 7f0eb2656640 1 -- start start 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eb2656640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0eac160a00 0x7f0eac0d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eb2656640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eac0b1ea0 0x7f0eac0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eb2656640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0b28e0 con 0x7f0eac0cfe10 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eb2656640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac0d02a0 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eb2656640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac0b2610 con 0x7f0eac160a00 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eab7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0eac0b1ea0 0x7f0eac0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eb0bf3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0eac0cfe10 0x7f0eac0d0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56988/0 (socket says 172.21.15.50:56988) 2023-12-08T08:17:54.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.558+0000 7f0eb0bf3640 1 -- 172.21.15.50:0/365765540 learned_addr learned my addr 172.21.15.50:0/365765540 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.559+0000 7f0eab7fe640 1 -- 172.21.15.50:0/365765540 >> v2:172.21.15.170:3300/0 conn(0x7f0eac160a00 msgr2=0x7f0eac0d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.559+0000 7f0eab7fe640 1 --2- 172.21.15.50:0/365765540 >> v2:172.21.15.170:3300/0 conn(0x7f0eac160a00 0x7f0eac0d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.559+0000 7f0eab7fe640 1 -- 172.21.15.50:0/365765540 >> v1:172.21.15.50:6789/0 conn(0x7f0eac0cfe10 legacy=0x7f0eac0d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.559+0000 7f0eaaffd640 1 -- 172.21.15.50:0/365765540 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588001409 0 0) 0x7f0eac0b28e0 con 0x7f0eac0cfe10 2023-12-08T08:17:54.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.559+0000 7f0eab7fe640 1 -- 172.21.15.50:0/365765540 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0ce7c0 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.559+0000 7f0eab7fe640 1 --2- 172.21.15.50:0/365765540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0cf8d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0eac08d6b0 tx=0x7f0ea002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cf0736808bad72 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eaaffd640 1 -- 172.21.15.50:0/365765540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0031830 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eaaffd640 1 -- 172.21.15.50:0/365765540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0031990 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eaaffd640 1 -- 172.21.15.50:0/365765540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0031d20 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 -- 172.21.15.50:0/365765540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 msgr2=0x7f0eac0cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 --2- 172.21.15.50:0/365765540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0cf8d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0eac08d6b0 tx=0x7f0ea002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 -- 172.21.15.50:0/365765540 shutdown_connections 2023-12-08T08:17:54.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 --2- 172.21.15.50:0/365765540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0cf8d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 --2- 172.21.15.50:0/365765540 >> v2:172.21.15.170:3300/0 conn(0x7f0eac160a00 0x7f0eac0d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 -- 172.21.15.50:0/365765540 >> 172.21.15.50:0/365765540 conn(0x7f0eac09c300 msgr2=0x7f0eac0d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 -- 172.21.15.50:0/365765540 shutdown_connections 2023-12-08T08:17:54.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.560+0000 7f0eb2656640 1 -- 172.21.15.50:0/365765540 wait complete. 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.561+0000 7f0eb2656640 1 Processor -- start 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eb2656640 1 -- start start 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eb2656640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eb2656640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0eac0cfe10 0x7f0eac1f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eb2656640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0eac160a00 0x7f0eac15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eb2656640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1f3e10 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eb2656640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0b0350 con 0x7f0eac0cfe10 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eb2656640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0b0630 con 0x7f0eac160a00 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eabfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eabfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35514/0 (socket says 172.21.15.50:35514) 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.562+0000 7f0eabfff640 1 -- 172.21.15.50:0/2027084969 learned_addr learned my addr 172.21.15.50:0/2027084969 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:54.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eabfff640 1 -- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0eac160a00 msgr2=0x7f0eac15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eabfff640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0eac160a00 0x7f0eac15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eabfff640 1 -- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0eac0cfe10 msgr2=0x7f0eac1f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eabfff640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0eac0cfe10 0x7f0eac1f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eabfff640 1 -- 172.21.15.50:0/2027084969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009400 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eabfff640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0b13f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00b4a0 tx=0x7f0e9c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0ea8ff9640 1 -- 172.21.15.50:0/2027084969 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c010610 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0ea8ff9640 1 -- 172.21.15.50:0/2027084969 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c010770 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac0b0910 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0ea8ff9640 1 -- 172.21.15.50:0/2027084969 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c010b20 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.563+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0b0ed0 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.564+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac067ad0 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.564+0000 7f0ea8ff9640 1 -- 172.21.15.50:0/2027084969 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e9c010c80 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.565+0000 7f0ea8ff9640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0e9806ae40 0x7f0e9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.565+0000 7f0ea8ff9640 1 -- 172.21.15.50:0/2027084969 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e9c088f40 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.565+0000 7f0eab7fe640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0e9806ae40 0x7f0e9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.566+0000 7f0eab7fe640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0e9806ae40 0x7f0e9806d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0036000 tx=0x7f0ea0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.569+0000 7f0ea8ff9640 1 -- 172.21.15.50:0/2027084969 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e9c054330 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.747+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0eac0b32a0 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.748+0000 7f0ea8ff9640 1 -- 172.21.15.50:0/2027084969 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0e9c014090 con 0x7f0eac0b1ea0 2023-12-08T08:17:54.751 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:17:54.752 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-08T08:17:54.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:17:54.752 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-08T08:17:54.752 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-08T08:17:54.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:17:54.752 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-08T08:17:54.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0e9806ae40 msgr2=0x7f0e9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0e9806ae40 0x7f0e9806d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0036000 tx=0x7f0ea0030000 comp rx=0 tx=0).stop 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 msgr2=0x7f0eac0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0b13f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00b4a0 tx=0x7f0e9c00b960 comp rx=0 tx=0).stop 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 shutdown_connections 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0e9806ae40 0x7f0e9806d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0eac160a00 0x7f0eac15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0eac0cfe10 0x7f0eac1f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 --2- 172.21.15.50:0/2027084969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0eac0b1ea0 0x7f0eac0b13f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 >> 172.21.15.50:0/2027084969 conn(0x7f0eac09c300 msgr2=0x7f0eac0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 shutdown_connections 2023-12-08T08:17:54.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.750+0000 7f0eb2656640 1 -- 172.21.15.50:0/2027084969 wait complete. 2023-12-08T08:17:54.764 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:17:54.764 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:17:54.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.871+0000 7f595485d640 1 Processor -- start 2023-12-08T08:17:54.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.871+0000 7f595485d640 1 -- start start 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f595485d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f595015b160 0x7f595006e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f595485d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59500cfa40 0x7f59500cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f595485d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59500cbe30 con 0x7f59500cd620 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f595485d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595015b540 con 0x7f595015b160 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f595485d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59500cbb00 con 0x7f59500cfa40 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f594e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f595015b160 0x7f595006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f594e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f595015b160 0x7f595006e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35518/0 (socket says 172.21.15.50:35518) 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.872+0000 7f594e59c640 1 -- 172.21.15.50:0/2202203633 learned_addr learned my addr 172.21.15.50:0/2202203633 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.873+0000 7f594ed9d640 1 --2- 172.21.15.50:0/2202203633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59500cfa40 0x7f59500cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.873+0000 7f594e59c640 1 -- 172.21.15.50:0/2202203633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59500cfa40 msgr2=0x7f59500cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.873+0000 7f594e59c640 1 --2- 172.21.15.50:0/2202203633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59500cfa40 0x7f59500cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.873+0000 7f594e59c640 1 -- 172.21.15.50:0/2202203633 >> v1:172.21.15.170:6789/0 conn(0x7f59500cd620 legacy=0x7f59500cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.873+0000 7f594e59c640 1 -- 172.21.15.50:0/2202203633 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500ce0e0 con 0x7f595015b160 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.873+0000 7f594e59c640 1 --2- 172.21.15.50:0/2202203633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595015b160 0x7f595006e370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5948009870 tx=0x7f594802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1bae077612fe0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f594d59a640 1 -- 172.21.15.50:0/2202203633 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594802f840 con 0x7f595015b160 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f594d59a640 1 -- 172.21.15.50:0/2202203633 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594802f9a0 con 0x7f595015b160 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f594d59a640 1 -- 172.21.15.50:0/2202203633 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594802fd30 con 0x7f595015b160 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 -- 172.21.15.50:0/2202203633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595015b160 msgr2=0x7f595006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 --2- 172.21.15.50:0/2202203633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595015b160 0x7f595006e370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5948009870 tx=0x7f594802ba20 comp rx=0 tx=0).stop 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 -- 172.21.15.50:0/2202203633 shutdown_connections 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 --2- 172.21.15.50:0/2202203633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59500cfa40 0x7f59500cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 --2- 172.21.15.50:0/2202203633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f595015b160 0x7f595006e370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 -- 172.21.15.50:0/2202203633 >> 172.21.15.50:0/2202203633 conn(0x7f59500d0d50 msgr2=0x7f59500d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:54.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 -- 172.21.15.50:0/2202203633 shutdown_connections 2023-12-08T08:17:54.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.874+0000 7f595485d640 1 -- 172.21.15.50:0/2202203633 wait complete. 2023-12-08T08:17:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 Processor -- start 2023-12-08T08:17:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 -- start start 2023-12-08T08:17:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59500cd620 0x7f595006c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59500cfa40 0x7f5950148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f595015b160 0x7f5950149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c6790 con 0x7f59500cfa40 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c6a70 con 0x7f59500cd620 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f595485d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c6d50 con 0x7f595015b160 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f594dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59500cfa40 0x7f5950148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f594dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59500cfa40 0x7f5950148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35532/0 (socket says 172.21.15.50:35532) 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.876+0000 7f594dd9b640 1 -- 172.21.15.50:0/157975771 learned_addr learned my addr 172.21.15.50:0/157975771 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594ed9d640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f595015b160 0x7f5950149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594e59c640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59500cd620 0x7f595006c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594dd9b640 1 -- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f595015b160 msgr2=0x7f5950149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594dd9b640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f595015b160 0x7f5950149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594dd9b640 1 -- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59500cd620 msgr2=0x7f595006c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594dd9b640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59500cd620 0x7f595006c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594dd9b640 1 -- 172.21.15.50:0/157975771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480094d0 con 0x7f59500cfa40 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f594dd9b640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59500cfa40 0x7f5950148d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f594400c400 tx=0x7f594400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f593effd640 1 -- 172.21.15.50:0/157975771 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59440052d0 con 0x7f59500cfa40 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f593effd640 1 -- 172.21.15.50:0/157975771 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5944005430 con 0x7f59500cfa40 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f593effd640 1 -- 172.21.15.50:0/157975771 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944003830 con 0x7f59500cfa40 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59500c7030 con 0x7f59500cfa40 2023-12-08T08:17:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.877+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595006c780 con 0x7f59500cfa40 2023-12-08T08:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.878+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59500c7550 con 0x7f59500cfa40 2023-12-08T08:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.878+0000 7f593effd640 1 -- 172.21.15.50:0/157975771 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5944003990 con 0x7f59500cfa40 2023-12-08T08:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.879+0000 7f593effd640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f593006ae40 0x7f593006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.879+0000 7f593effd640 1 -- 172.21.15.50:0/157975771 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5944088790 con 0x7f59500cfa40 2023-12-08T08:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.879+0000 7f594e59c640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f593006ae40 0x7f593006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:54.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.880+0000 7f594e59c640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f593006ae40 0x7f593006d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5948036000 tx=0x7f5948008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:54.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:54.883+0000 7f593effd640 1 -- 172.21.15.50:0/157975771 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59500c7550 con 0x7f59500cfa40 2023-12-08T08:17:55.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.059+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f59500c7550 con 0x7f59500cfa40 2023-12-08T08:17:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.814+0000 7f593effd640 1 -- 172.21.15.50:0/157975771 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f59500c7550 con 0x7f59500cfa40 2023-12-08T08:17:55.818 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-08T08:17:55.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f593006ae40 msgr2=0x7f593006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f593006ae40 0x7f593006d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5948036000 tx=0x7f5948008030 comp rx=0 tx=0).stop 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59500cfa40 msgr2=0x7f5950148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59500cfa40 0x7f5950148d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f594400c400 tx=0x7f594400c8c0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 shutdown_connections 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f593006ae40 0x7f593006d300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59500cfa40 0x7f5950148d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f595015b160 0x7f5950149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 --2- 172.21.15.50:0/157975771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59500cd620 0x7f595006c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 >> 172.21.15.50:0/157975771 conn(0x7f59500d0d50 msgr2=0x7f5950157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 shutdown_connections 2023-12-08T08:17:55.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.817+0000 7f595485d640 1 -- 172.21.15.50:0/157975771 wait complete. 2023-12-08T08:17:55.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-08T08:17:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.960+0000 7f79a33a9640 1 Processor -- start 2023-12-08T08:17:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.960+0000 7f79a33a9640 1 -- start start 2023-12-08T08:17:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a33a9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f799c0d3ac0 0x7f799c0d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a33a9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a33a9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c0cdd00 con 0x7f799c0d14d0 2023-12-08T08:17:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a33a9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c0b48c0 con 0x7f799c0d3ac0 2023-12-08T08:17:55.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a33a9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0b45e0 con 0x7f799c0cea80 2023-12-08T08:17:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a1946640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a0944640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f799c0d3ac0 0x7f799c0d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a1145640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f799c0d14d0 0x7f799c0d18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:57620/0 (socket says 172.21.15.50:57620) 2023-12-08T08:17:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a1946640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:46540/0 (socket says 172.21.15.50:46540) 2023-12-08T08:17:55.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a1145640 1 -- 172.21.15.50:0/2777118016 learned_addr learned my addr 172.21.15.50:0/2777118016 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:55.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a0944640 1 -- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 msgr2=0x7f799c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:55.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a0944640 1 --2- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a0944640 1 -- 172.21.15.50:0/2777118016 >> v1:172.21.15.170:6789/0 conn(0x7f799c0d14d0 legacy=0x7f799c0d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f7993fff640 1 -- 172.21.15.50:0/2777118016 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792904417 0 0) 0x7f799c0cdd00 con 0x7f799c0d14d0 2023-12-08T08:17:55.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a0944640 1 -- 172.21.15.50:0/2777118016 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c0cdfa0 con 0x7f799c0d3ac0 2023-12-08T08:17:55.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a1946640 1 --2- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:17:55.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.961+0000 7f79a0944640 1 --2- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d3ac0 0x7f799c0d0e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097d0 tx=0x7f798c02b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ecefd0173713f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f7993fff640 1 -- 172.21.15.50:0/2777118016 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c031890 con 0x7f799c0d3ac0 2023-12-08T08:17:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f7993fff640 1 -- 172.21.15.50:0/2777118016 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c0319f0 con 0x7f799c0d3ac0 2023-12-08T08:17:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f7993fff640 1 -- 172.21.15.50:0/2777118016 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c031d80 con 0x7f799c0d3ac0 2023-12-08T08:17:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 -- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d3ac0 msgr2=0x7f799c0d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d3ac0 0x7f799c0d0e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097d0 tx=0x7f798c02b930 comp rx=0 tx=0).stop 2023-12-08T08:17:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 -- 172.21.15.50:0/2777118016 shutdown_connections 2023-12-08T08:17:55.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2777118016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d3ac0 0x7f799c0d0e80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 -- 172.21.15.50:0/2777118016 >> 172.21.15.50:0/2777118016 conn(0x7f799c0d2f10 msgr2=0x7f799c0d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 -- 172.21.15.50:0/2777118016 shutdown_connections 2023-12-08T08:17:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.962+0000 7f79a33a9640 1 -- 172.21.15.50:0/2777118016 wait complete. 2023-12-08T08:17:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.963+0000 7f79a33a9640 1 Processor -- start 2023-12-08T08:17:55.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.963+0000 7f79a33a9640 1 -- start start 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a33a9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a33a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d14d0 0x7f799c06b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a33a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c0d3ac0 0x7f799c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a33a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c8210 con 0x7f799c0d3ac0 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a33a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c84f0 con 0x7f799c0d14d0 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a33a9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c87d0 con 0x7f799c0cea80 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a1946640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c0d3ac0 0x7f799c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a1946640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c0d3ac0 0x7f799c06b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35542/0 (socket says 172.21.15.50:35542) 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a1946640 1 -- 172.21.15.50:0/2595167124 learned_addr learned my addr 172.21.15.50:0/2595167124 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a1145640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.964+0000 7f79a0944640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d14d0 0x7f799c06b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a1946640 1 -- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 msgr2=0x7f799c0c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a1946640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a1946640 1 -- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d14d0 msgr2=0x7f799c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a1946640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d14d0 0x7f799c06b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a1946640 1 -- 172.21.15.50:0/2595167124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994009a70 con 0x7f799c0d3ac0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a1946640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c0d3ac0 0x7f799c06b900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f799400efc0 tx=0x7f7994009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f7991ffb640 1 -- 172.21.15.50:0/2595167124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994009d70 con 0x7f799c0d3ac0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f7991ffb640 1 -- 172.21.15.50:0/2595167124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799400f040 con 0x7f799c0d3ac0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c009400 con 0x7f799c0d3ac0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f7991ffb640 1 -- 172.21.15.50:0/2595167124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994003990 con 0x7f799c0d3ac0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.965+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c0c8d90 con 0x7f799c0d3ac0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.966+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0b8a90 con 0x7f799c0d3ac0 2023-12-08T08:17:55.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.967+0000 7f7991ffb640 1 -- 172.21.15.50:0/2595167124 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79940144a0 con 0x7f799c0d3ac0 2023-12-08T08:17:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.967+0000 7f7991ffb640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f798006ae40 0x7f798006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.967+0000 7f7991ffb640 1 -- 172.21.15.50:0/2595167124 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7994089f20 con 0x7f799c0d3ac0 2023-12-08T08:17:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.967+0000 7f79a1145640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f798006ae40 0x7f798006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:55.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.968+0000 7f79a1145640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f798006ae40 0x7f798006d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7998000f60 tx=0x7f7998007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:55.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:55.972+0000 7f7991ffb640 1 -- 172.21.15.50:0/2595167124 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79940552f0 con 0x7f799c0d3ac0 2023-12-08T08:17:56.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.149+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f799c0c6390 con 0x7f799c0d3ac0 2023-12-08T08:17:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.817+0000 7f7991ffb640 1 -- 172.21.15.50:0/2595167124 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7994058910 con 0x7f799c0d3ac0 2023-12-08T08:17:56.820 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-08T08:17:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.821+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f798006ae40 msgr2=0x7f798006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.821+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f798006ae40 0x7f798006d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7998000f60 tx=0x7f7998007d50 comp rx=0 tx=0).stop 2023-12-08T08:17:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.821+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c0d3ac0 msgr2=0x7f799c06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.823 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.821+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c0d3ac0 0x7f799c06b900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f799400efc0 tx=0x7f7994009f90 comp rx=0 tx=0).stop 2023-12-08T08:17:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.822+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 shutdown_connections 2023-12-08T08:17:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.822+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f798006ae40 0x7f798006d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.822+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f799c0d3ac0 0x7f799c06b900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.822+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f799c0d14d0 0x7f799c06b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.822+0000 7f79a33a9640 1 --2- 172.21.15.50:0/2595167124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f799c0cea80 0x7f799c0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.822+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 >> 172.21.15.50:0/2595167124 conn(0x7f799c0d2f10 msgr2=0x7f799c0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.823+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 shutdown_connections 2023-12-08T08:17:56.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.823+0000 7f79a33a9640 1 -- 172.21.15.50:0/2595167124 wait complete. 2023-12-08T08:17:56.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:17:56.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.965+0000 7f6ddb417640 1 Processor -- start 2023-12-08T08:17:56.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.966+0000 7f6ddb417640 1 -- start start 2023-12-08T08:17:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.966+0000 7f6ddb417640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dd4160980 0x7f6dd40cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.966+0000 7f6ddb417640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6dd406c3b0 0x7f6dd40b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.966+0000 7f6ddb417640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40b1260 con 0x7f6dd406b6e0 2023-12-08T08:17:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.966+0000 7f6ddb417640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40d04f0 con 0x7f6dd4160980 2023-12-08T08:17:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.966+0000 7f6ddb417640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40b0930 con 0x7f6dd406c3b0 2023-12-08T08:17:56.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd91b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dd4160980 0x7f6dd40cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd91b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6dd4160980 0x7f6dd40cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35544/0 (socket says 172.21.15.50:35544) 2023-12-08T08:17:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd91b3640 1 -- 172.21.15.50:0/1545277426 learned_addr learned my addr 172.21.15.50:0/1545277426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd99b4640 1 --2- 172.21.15.50:0/1545277426 >> v2:172.21.15.170:3300/0 conn(0x7f6dd406c3b0 0x7f6dd40b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd91b3640 1 -- 172.21.15.50:0/1545277426 >> v2:172.21.15.170:3300/0 conn(0x7f6dd406c3b0 msgr2=0x7f6dd40b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd91b3640 1 --2- 172.21.15.50:0/1545277426 >> v2:172.21.15.170:3300/0 conn(0x7f6dd406c3b0 0x7f6dd40b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd91b3640 1 -- 172.21.15.50:0/1545277426 >> v1:172.21.15.170:6789/0 conn(0x7f6dd406b6e0 legacy=0x7f6dd406bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.967+0000 7f6dd91b3640 1 -- 172.21.15.50:0/1545277426 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40b0c10 con 0x7f6dd4160980 2023-12-08T08:17:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6dd91b3640 1 --2- 172.21.15.50:0/1545277426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd40cfac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4071500 tx=0x7f6dd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804e23dd12f2c409 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6dcbfff640 1 -- 172.21.15.50:0/1545277426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0030860 con 0x7f6dd4160980 2023-12-08T08:17:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6dcbfff640 1 -- 172.21.15.50:0/1545277426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd00309c0 con 0x7f6dd4160980 2023-12-08T08:17:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6dcbfff640 1 -- 172.21.15.50:0/1545277426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0030d50 con 0x7f6dd4160980 2023-12-08T08:17:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 -- 172.21.15.50:0/1545277426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 msgr2=0x7f6dd40cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 --2- 172.21.15.50:0/1545277426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd40cfac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4071500 tx=0x7f6dd002b9a0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 -- 172.21.15.50:0/1545277426 shutdown_connections 2023-12-08T08:17:56.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 --2- 172.21.15.50:0/1545277426 >> v2:172.21.15.170:3300/0 conn(0x7f6dd406c3b0 0x7f6dd40b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 --2- 172.21.15.50:0/1545277426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd40cfac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 -- 172.21.15.50:0/1545277426 >> 172.21.15.50:0/1545277426 conn(0x7f6dd40d0e30 msgr2=0x7f6dd40d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:56.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 -- 172.21.15.50:0/1545277426 shutdown_connections 2023-12-08T08:17:56.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.968+0000 7f6ddb417640 1 -- 172.21.15.50:0/1545277426 wait complete. 2023-12-08T08:17:56.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 Processor -- start 2023-12-08T08:17:56.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 -- start start 2023-12-08T08:17:56.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd406b6e0 0x7f6dd41f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd406c3b0 0x7f6dd41f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd41f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41f3880 con 0x7f6dd4160980 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41f6dc0 con 0x7f6dd406c3b0 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.970+0000 7f6ddb417640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41f6520 con 0x7f6dd406b6e0 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd41f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd41f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35552/0 (socket says 172.21.15.50:35552) 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 -- 172.21.15.50:0/2189062764 learned_addr learned my addr 172.21.15.50:0/2189062764 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd91b3640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd406b6e0 0x7f6dd41f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd89b2640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd406c3b0 0x7f6dd41f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 -- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd406b6e0 msgr2=0x7f6dd41f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd406b6e0 0x7f6dd41f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 -- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd406c3b0 msgr2=0x7f6dd41f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd406c3b0 0x7f6dd41f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:56.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 -- 172.21.15.50:0/2189062764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00094d0 con 0x7f6dd4160980 2023-12-08T08:17:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dd99b4640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd41f2060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc007de0 tx=0x7f6dcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dc9ffb640 1 -- 172.21.15.50:0/2189062764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc014620 con 0x7f6dd4160980 2023-12-08T08:17:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dc9ffb640 1 -- 172.21.15.50:0/2189062764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00ee90 con 0x7f6dd4160980 2023-12-08T08:17:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd41f6800 con 0x7f6dd4160980 2023-12-08T08:17:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6dc9ffb640 1 -- 172.21.15.50:0/2189062764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0149e0 con 0x7f6dd4160980 2023-12-08T08:17:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.971+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4146690 con 0x7f6dd4160980 2023-12-08T08:17:56.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.972+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd41464f0 con 0x7f6dd4160980 2023-12-08T08:17:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.973+0000 7f6dc9ffb640 1 -- 172.21.15.50:0/2189062764 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dcc014b40 con 0x7f6dd4160980 2023-12-08T08:17:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.973+0000 7f6dc9ffb640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6db806ae40 0x7f6db806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.974+0000 7f6dc9ffb640 1 -- 172.21.15.50:0/2189062764 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f6dcc089e90 con 0x7f6dd4160980 2023-12-08T08:17:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.974+0000 7f6dd91b3640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6db806ae40 0x7f6db806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:56.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.974+0000 7f6dd91b3640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6db806ae40 0x7f6db806d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0036000 tx=0x7f6dd0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:56.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:56.978+0000 7f6dc9ffb640 1 -- 172.21.15.50:0/2189062764 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6dd41464f0 con 0x7f6dd4160980 2023-12-08T08:17:57.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.191+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6dd41464f0 con 0x7f6dd4160980 2023-12-08T08:17:57.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.836+0000 7f6dc9ffb640 1 -- 172.21.15.50:0/2189062764 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6dd41464f0 con 0x7f6dd4160980 2023-12-08T08:17:57.839 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2023-12-08T08:17:57.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.843+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6db806ae40 msgr2=0x7f6db806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:57.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.843+0000 7f6ddb417640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6db806ae40 0x7f6db806d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0036000 tx=0x7f6dd0008030 comp rx=0 tx=0).stop 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.843+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 msgr2=0x7f6dd41f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.843+0000 7f6ddb417640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd41f2060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc007de0 tx=0x7f6dcc00e4b0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.846+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 shutdown_connections 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.846+0000 7f6ddb417640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6db806ae40 0x7f6db806d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.846+0000 7f6ddb417640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dd4160980 0x7f6dd41f2060 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.846+0000 7f6ddb417640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd406c3b0 0x7f6dd41f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.846+0000 7f6ddb417640 1 --2- 172.21.15.50:0/2189062764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd406b6e0 0x7f6dd41f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.846+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 >> 172.21.15.50:0/2189062764 conn(0x7f6dd40d0e30 msgr2=0x7f6dd4066400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:57.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.850+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 shutdown_connections 2023-12-08T08:17:57.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.850+0000 7f6ddb417640 1 -- 172.21.15.50:0/2189062764 wait complete. 2023-12-08T08:17:57.879 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-08T08:17:57.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-08T08:17:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.992+0000 7fee39a6b640 1 Processor -- start 2023-12-08T08:17:57.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.992+0000 7fee39a6b640 1 -- start start 2023-12-08T08:17:57.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee39a6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee340cfd30 0x7fee3406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee39a6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee3415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee39a6b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee340ce900 con 0x7fee340cf950 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee39a6b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee340cdae0 con 0x7fee340cfd30 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee39a6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3406bfd0 con 0x7fee3406c8f0 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee32ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee340cfd30 0x7fee3406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee32ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fee340cfd30 0x7fee3406c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35554/0 (socket says 172.21.15.50:35554) 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee32ffd640 1 -- 172.21.15.50:0/3056846121 learned_addr learned my addr 172.21.15.50:0/3056846121 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee33fff640 1 --2- 172.21.15.50:0/3056846121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee3415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee32ffd640 1 -- 172.21.15.50:0/3056846121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 msgr2=0x7fee3415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee32ffd640 1 --2- 172.21.15.50:0/3056846121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee3415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee32ffd640 1 -- 172.21.15.50:0/3056846121 >> v1:172.21.15.170:6789/0 conn(0x7fee340cf950 legacy=0x7fee340d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.993+0000 7fee32ffd640 1 -- 172.21.15.50:0/3056846121 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340cdcf0 con 0x7fee340cfd30 2023-12-08T08:17:57.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.994+0000 7fee32ffd640 1 --2- 172.21.15.50:0/3056846121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cfd30 0x7fee3406c3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee28009870 tx=0x7fee2802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac89cf7164ffc97b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.994+0000 7fee327fc640 1 -- 172.21.15.50:0/3056846121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28030840 con 0x7fee340cfd30 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.994+0000 7fee327fc640 1 -- 172.21.15.50:0/3056846121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee280309a0 con 0x7fee340cfd30 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.994+0000 7fee327fc640 1 -- 172.21.15.50:0/3056846121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28030d30 con 0x7fee340cfd30 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 -- 172.21.15.50:0/3056846121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cfd30 msgr2=0x7fee3406c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 --2- 172.21.15.50:0/3056846121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cfd30 0x7fee3406c3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee28009870 tx=0x7fee2802b980 comp rx=0 tx=0).stop 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 -- 172.21.15.50:0/3056846121 shutdown_connections 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 --2- 172.21.15.50:0/3056846121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee3415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 --2- 172.21.15.50:0/3056846121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cfd30 0x7fee3406c3b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 -- 172.21.15.50:0/3056846121 >> 172.21.15.50:0/3056846121 conn(0x7fee3409c2f0 msgr2=0x7fee340d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 -- 172.21.15.50:0/3056846121 shutdown_connections 2023-12-08T08:17:57.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.995+0000 7fee39a6b640 1 -- 172.21.15.50:0/3056846121 wait complete. 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.996+0000 7fee39a6b640 1 Processor -- start 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.996+0000 7fee39a6b640 1 -- start start 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee39a6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee340b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee39a6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cf950 0x7fee34157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee39a6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee340cfd30 0x7fee340b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee39a6b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee34155f90 con 0x7fee340cf950 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee39a6b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee34156270 con 0x7fee340cfd30 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee39a6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee34156550 con 0x7fee3406c8f0 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cf950 0x7fee34157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cf950 0x7fee34157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35556/0 (socket says 172.21.15.50:35556) 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 -- 172.21.15.50:0/148514325 learned_addr learned my addr 172.21.15.50:0/148514325 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee337fe640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee340b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee33fff640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee340cfd30 0x7fee340b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 -- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 msgr2=0x7fee340b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee340b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 -- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee340cfd30 msgr2=0x7fee340b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee340cfd30 0x7fee340b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 -- 172.21.15.50:0/148514325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280094d0 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.997+0000 7fee32ffd640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cf950 0x7fee34157030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee28000c00 tx=0x7fee28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.998+0000 7fee1bfff640 1 -- 172.21.15.50:0/148514325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28039a90 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.998+0000 7fee1bfff640 1 -- 172.21.15.50:0/148514325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28039bf0 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.998+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee34156830 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.998+0000 7fee1bfff640 1 -- 172.21.15.50:0/148514325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28043410 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.998+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee340b13e0 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.999+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee34156d50 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.999+0000 7fee1bfff640 1 -- 172.21.15.50:0/148514325 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee2804c3b0 con 0x7fee340cf950 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.999+0000 7fee1bfff640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fee2006ae40 0x7fee2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:57.999+0000 7fee1bfff640 1 -- 172.21.15.50:0/148514325 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee280ab9d0 con 0x7fee340cf950 2023-12-08T08:17:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.000+0000 7fee337fe640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fee2006ae40 0x7fee2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.000+0000 7fee337fe640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fee2006ae40 0x7fee2006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee24000f60 tx=0x7fee24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.004+0000 7fee1bfff640 1 -- 172.21.15.50:0/148514325 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee34156d50 con 0x7fee340cf950 2023-12-08T08:17:58.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.187+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fee34156d50 con 0x7fee340cf950 2023-12-08T08:17:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.852+0000 7fee1bfff640 1 -- 172.21.15.50:0/148514325 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fee34156d50 con 0x7fee340cf950 2023-12-08T08:17:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fee2006ae40 msgr2=0x7fee2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fee2006ae40 0x7fee2006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee24000f60 tx=0x7fee24009040 comp rx=0 tx=0).stop 2023-12-08T08:17:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cf950 msgr2=0x7fee34157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cf950 0x7fee34157030 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee28000c00 tx=0x7fee28004730 comp rx=0 tx=0).stop 2023-12-08T08:17:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 shutdown_connections 2023-12-08T08:17:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fee2006ae40 0x7fee2006d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fee340cf950 0x7fee34157030 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee340cfd30 0x7fee340b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 --2- 172.21.15.50:0/148514325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3406c8f0 0x7fee340b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 >> 172.21.15.50:0/148514325 conn(0x7fee3409c2f0 msgr2=0x7fee34161920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 shutdown_connections 2023-12-08T08:17:58.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.856+0000 7fee39a6b640 1 -- 172.21.15.50:0/148514325 wait complete. 2023-12-08T08:17:58.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:17:58.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.991+0000 7f50cfba9640 1 Processor -- start 2023-12-08T08:17:58.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.991+0000 7f50cfba9640 1 -- start start 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50cfba9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f50c806a4d0 0x7f50c806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50cfba9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c80af540 con 0x7f50c8071250 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50cfba9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c806adf0 con 0x7f50c80b4be0 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50cfba9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c80ae930 con 0x7f50c806a4d0 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50ce146640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f50c8071250 0x7f50c80716d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:56998/0 (socket says 172.21.15.50:56998) 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50ce146640 1 -- 172.21.15.50:0/919554686 learned_addr learned my addr 172.21.15.50:0/919554686 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50cd945640 1 --2- 172.21.15.50:0/919554686 >> v2:172.21.15.170:3300/0 conn(0x7f50c806a4d0 0x7f50c806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:58.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50cc943640 1 -- 172.21.15.50:0/919554686 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486071448 0 0) 0x7f50c80af540 con 0x7f50c8071250 2023-12-08T08:17:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.992+0000 7f50cc943640 1 -- 172.21.15.50:0/919554686 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b4003520 con 0x7f50c8071250 2023-12-08T08:17:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.993+0000 7f50cc943640 1 -- 172.21.15.50:0/919554686 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3491496477 0 0) 0x7f50b4003520 con 0x7f50c8071250 2023-12-08T08:17:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.993+0000 7f50cd945640 1 -- 172.21.15.50:0/919554686 >> v1:172.21.15.170:6789/0 conn(0x7f50c80b4be0 legacy=0x7f50c80acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.993+0000 7f50cd945640 1 -- 172.21.15.50:0/919554686 >> v1:172.21.15.50:6789/0 conn(0x7f50c8071250 legacy=0x7f50c80716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.993+0000 7f50cd945640 1 -- 172.21.15.50:0/919554686 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80aec10 con 0x7f50c806a4d0 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.993+0000 7f50cd945640 1 --2- 172.21.15.50:0/919554686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 0x7f50c806a8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50c40097a0 tx=0x7f50c402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ca5e05e69fb9e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cc943640 1 -- 172.21.15.50:0/919554686 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c402f050 con 0x7f50c806a4d0 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cc943640 1 -- 172.21.15.50:0/919554686 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4031500 con 0x7f50c806a4d0 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cc943640 1 -- 172.21.15.50:0/919554686 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00019f0 con 0x7f50c806a4d0 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cfba9640 1 -- 172.21.15.50:0/919554686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 msgr2=0x7f50c806a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cfba9640 1 --2- 172.21.15.50:0/919554686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 0x7f50c806a8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50c40097a0 tx=0x7f50c402b820 comp rx=0 tx=0).stop 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cfba9640 1 -- 172.21.15.50:0/919554686 shutdown_connections 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cfba9640 1 --2- 172.21.15.50:0/919554686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 0x7f50c806a8b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:58.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cfba9640 1 -- 172.21.15.50:0/919554686 >> 172.21.15.50:0/919554686 conn(0x7f50c80b1a70 msgr2=0x7f50c80b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:17:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cfba9640 1 -- 172.21.15.50:0/919554686 shutdown_connections 2023-12-08T08:17:58.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.994+0000 7f50cfba9640 1 -- 172.21.15.50:0/919554686 wait complete. 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.995+0000 7f50cfba9640 1 Processor -- start 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cfba9640 1 -- start start 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cfba9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 0x7f50c81f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cfba9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c8071250 0x7f50c814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cfba9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50c80b4be0 0x7f50c814c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cfba9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c814dbb0 con 0x7f50c8071250 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cfba9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81f6f40 con 0x7f50c806a4d0 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cfba9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c814d310 con 0x7f50c80b4be0 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cd144640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c8071250 0x7f50c814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cd144640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c8071250 0x7f50c814b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35572/0 (socket says 172.21.15.50:35572) 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.996+0000 7f50cd144640 1 -- 172.21.15.50:0/552656375 learned_addr learned my addr 172.21.15.50:0/552656375 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cd945640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 0x7f50c81f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50ce146640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50c80b4be0 0x7f50c814c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cd144640 1 -- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50c80b4be0 msgr2=0x7f50c814c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cd144640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50c80b4be0 0x7f50c814c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cd144640 1 -- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 msgr2=0x7f50c81f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cd144640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 0x7f50c81f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cd144640 1 -- 172.21.15.50:0/552656375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4009400 con 0x7f50c8071250 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50ce146640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50c80b4be0 0x7f50c814c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cd144640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c8071250 0x7f50c814b940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c3c0 tx=0x7f50b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50be7fc640 1 -- 172.21.15.50:0/552656375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b80052d0 con 0x7f50c8071250 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50be7fc640 1 -- 172.21.15.50:0/552656375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b8005450 con 0x7f50c8071250 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c814d5f0 con 0x7f50c8071250 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50be7fc640 1 -- 172.21.15.50:0/552656375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8003830 con 0x7f50c8071250 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.997+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c81f6200 con 0x7f50c8071250 2023-12-08T08:17:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.998+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c81f6040 con 0x7f50c8071250 2023-12-08T08:17:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.998+0000 7f50be7fc640 1 -- 172.21.15.50:0/552656375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50b8003990 con 0x7f50c8071250 2023-12-08T08:17:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.999+0000 7f50be7fc640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f50ac06ae40 0x7f50ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:17:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.999+0000 7f50be7fc640 1 -- 172.21.15.50:0/552656375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f50b8088b60 con 0x7f50c8071250 2023-12-08T08:17:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:58.999+0000 7f50cd945640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f50ac06ae40 0x7f50ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:17:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:59.000+0000 7f50cd945640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f50ac06ae40 0x7f50ac06d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50c4035000 tx=0x7f50c4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:17:59.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:59.003+0000 7f50be7fc640 1 -- 172.21.15.50:0/552656375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50b8053bc0 con 0x7f50c8071250 2023-12-08T08:17:59.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:17:59.185+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f50c8067ad0 con 0x7f50c8071250 2023-12-08T08:18:00.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.862+0000 7f50be7fc640 1 -- 172.21.15.50:0/552656375 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f50b8017100 con 0x7f50c8071250 2023-12-08T08:18:00.865 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' created 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f50ac06ae40 msgr2=0x7f50ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f50ac06ae40 0x7f50ac06d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50c4035000 tx=0x7f50c4008030 comp rx=0 tx=0).stop 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c8071250 msgr2=0x7f50c814b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c8071250 0x7f50c814b940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c3c0 tx=0x7f50b800c880 comp rx=0 tx=0).stop 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 shutdown_connections 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f50ac06ae40 0x7f50ac06d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50c8071250 0x7f50c814b940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50c80b4be0 0x7f50c814c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 --2- 172.21.15.50:0/552656375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50c806a4d0 0x7f50c81f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 >> 172.21.15.50:0/552656375 conn(0x7f50c80b1a70 msgr2=0x7f50c80b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:00.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.867+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 shutdown_connections 2023-12-08T08:18:00.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:00.868+0000 7f50cfba9640 1 -- 172.21.15.50:0/552656375 wait complete. 2023-12-08T08:18:00.889 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-08T08:18:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.002+0000 7fe64d3e5640 1 Processor -- start 2023-12-08T08:18:01.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.003+0000 7fe64d3e5640 1 -- start start 2023-12-08T08:18:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.003+0000 7fe64d3e5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe648159750 0x7fe648070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.003+0000 7fe64d3e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64806d810 0x7fe64806c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.003+0000 7fe64d3e5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480b1cf0 con 0x7fe64806cf30 2023-12-08T08:18:01.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.003+0000 7fe64d3e5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64806d3a0 con 0x7fe648159750 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.003+0000 7fe64d3e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe648071050 con 0x7fe64806d810 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.003+0000 7fe646ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe648159750 0x7fe648070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.004+0000 7fe646ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe648159750 0x7fe648070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49358/0 (socket says 172.21.15.50:49358) 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.004+0000 7fe646ffd640 1 -- 172.21.15.50:0/3038717878 learned_addr learned my addr 172.21.15.50:0/3038717878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.004+0000 7fe6467fc640 1 --2- 172.21.15.50:0/3038717878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64806d810 0x7fe64806c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.004+0000 7fe646ffd640 1 -- 172.21.15.50:0/3038717878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64806d810 msgr2=0x7fe64806c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.004+0000 7fe646ffd640 1 --2- 172.21.15.50:0/3038717878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64806d810 0x7fe64806c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.004+0000 7fe646ffd640 1 -- 172.21.15.50:0/3038717878 >> v1:172.21.15.170:6789/0 conn(0x7fe64806cf30 legacy=0x7fe64815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.004+0000 7fe646ffd640 1 -- 172.21.15.50:0/3038717878 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480715d0 con 0x7fe648159750 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe646ffd640 1 --2- 172.21.15.50:0/3038717878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe648159750 0x7fe648070b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe64000bb40 tx=0x7fe64002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c154040fe1af9d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe645ffb640 1 -- 172.21.15.50:0/3038717878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640036440 con 0x7fe648159750 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe645ffb640 1 -- 172.21.15.50:0/3038717878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6400365a0 con 0x7fe648159750 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe645ffb640 1 -- 172.21.15.50:0/3038717878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640036930 con 0x7fe648159750 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 -- 172.21.15.50:0/3038717878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe648159750 msgr2=0x7fe648070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/3038717878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe648159750 0x7fe648070b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe64000bb40 tx=0x7fe64002e150 comp rx=0 tx=0).stop 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 -- 172.21.15.50:0/3038717878 shutdown_connections 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/3038717878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64806d810 0x7fe64806c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/3038717878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe648159750 0x7fe648070b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 -- 172.21.15.50:0/3038717878 >> 172.21.15.50:0/3038717878 conn(0x7fe6480ceba0 msgr2=0x7fe6480cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:01.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 -- 172.21.15.50:0/3038717878 shutdown_connections 2023-12-08T08:18:01.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.005+0000 7fe64d3e5640 1 -- 172.21.15.50:0/3038717878 wait complete. 2023-12-08T08:18:01.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 Processor -- start 2023-12-08T08:18:01.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 -- start start 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64806cf30 0x7fe6481f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64806d810 0x7fe64813b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe648159750 0x7fe648154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64814e270 con 0x7fe64806cf30 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64814e550 con 0x7fe64806d810 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.007+0000 7fe64d3e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64814e830 con 0x7fe648159750 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64806cf30 0x7fe6481f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64806cf30 0x7fe6481f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49374/0 (socket says 172.21.15.50:49374) 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 -- 172.21.15.50:0/4148761979 learned_addr learned my addr 172.21.15.50:0/4148761979 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:01.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe6467fc640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64806d810 0x7fe64813b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe6477fe640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe648159750 0x7fe648154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 -- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe648159750 msgr2=0x7fe648154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe648159750 0x7fe648154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 -- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64806d810 msgr2=0x7fe64813b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64806d810 0x7fe64813b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 -- 172.21.15.50:0/4148761979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64000b770 con 0x7fe64806cf30 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe6467fc640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64806d810 0x7fe64813b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe646ffd640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64806cf30 0x7fe6481f2a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe64000b2c0 tx=0x7fe6400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe63f7fe640 1 -- 172.21.15.50:0/4148761979 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640036440 con 0x7fe64806cf30 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe63f7fe640 1 -- 172.21.15.50:0/4148761979 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe640034ba0 con 0x7fe64806cf30 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64814eb10 con 0x7fe64806cf30 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe63f7fe640 1 -- 172.21.15.50:0/4148761979 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640041460 con 0x7fe64806cf30 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.008+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe648154b90 con 0x7fe64806cf30 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.009+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe648067540 con 0x7fe64806cf30 2023-12-08T08:18:01.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.010+0000 7fe63f7fe640 1 -- 172.21.15.50:0/4148761979 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe64004a3b0 con 0x7fe64806cf30 2023-12-08T08:18:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.010+0000 7fe63f7fe640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe62806ae40 0x7fe62806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.010+0000 7fe63f7fe640 1 -- 172.21.15.50:0/4148761979 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fe6400abf10 con 0x7fe64806cf30 2023-12-08T08:18:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.010+0000 7fe6467fc640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe62806ae40 0x7fe62806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:01.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.011+0000 7fe6467fc640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe62806ae40 0x7fe62806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6481e47f0 tx=0x7fe630008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:01.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.015+0000 7fe63f7fe640 1 -- 172.21.15.50:0/4148761979 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe640076cf0 con 0x7fe64806cf30 2023-12-08T08:18:01.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.192+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fe6480cae60 con 0x7fe64806cf30 2023-12-08T08:18:01.556 INFO:tasks.ceph.mds.d.smithi170.stderr:2023-12-08T08:18:01.554+0000 7fcd08001640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:18:01.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.864+0000 7fe63f7fe640 1 -- 172.21.15.50:0/4148761979 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe64003b0c0 con 0x7fe64806cf30 2023-12-08T08:18:01.867 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 allow_ec_overwrites to true 2023-12-08T08:18:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.868+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe62806ae40 msgr2=0x7fe62806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.868+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe62806ae40 0x7fe62806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6481e47f0 tx=0x7fe630008040 comp rx=0 tx=0).stop 2023-12-08T08:18:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.868+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64806cf30 msgr2=0x7fe6481f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:01.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.868+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64806cf30 0x7fe6481f2a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe64000b2c0 tx=0x7fe6400046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.869+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 shutdown_connections 2023-12-08T08:18:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.869+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe62806ae40 0x7fe62806d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.869+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe648159750 0x7fe648154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.869+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64806d810 0x7fe64813b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.869+0000 7fe64d3e5640 1 --2- 172.21.15.50:0/4148761979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64806cf30 0x7fe6481f2a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:01.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.869+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 >> 172.21.15.50:0/4148761979 conn(0x7fe6480ceba0 msgr2=0x7fe6480cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:01.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.871+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 shutdown_connections 2023-12-08T08:18:01.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:01.873+0000 7fe64d3e5640 1 -- 172.21.15.50:0/4148761979 wait complete. 2023-12-08T08:18:01.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-08T08:18:02.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.016+0000 7fd05de9b640 1 Processor -- start 2023-12-08T08:18:02.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.016+0000 7fd05de9b640 1 -- start start 2023-12-08T08:18:02.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd05de9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd0580d1ca0 0x7fd0580b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd05de9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580d3fc0 con 0x7fd0580d18c0 2023-12-08T08:18:02.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd05de9b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580d0ff0 con 0x7fd0580d3b90 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd05de9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0580d04d0 con 0x7fd0580d1ca0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd0577fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd0580d18c0 0x7fd0580afc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39166/0 (socket says 172.21.15.50:39166) 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd0577fe640 1 -- 172.21.15.50:0/371797824 learned_addr learned my addr 172.21.15.50:0/371797824 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd056ffd640 1 --2- 172.21.15.50:0/371797824 >> v2:172.21.15.50:3300/0 conn(0x7fd0580d1ca0 0x7fd0580b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd0567fc640 1 -- 172.21.15.50:0/371797824 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269422055 0 0) 0x7fd0580d3fc0 con 0x7fd0580d18c0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.017+0000 7fd0567fc640 1 -- 172.21.15.50:0/371797824 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd040003520 con 0x7fd0580d18c0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.018+0000 7fd056ffd640 1 -- 172.21.15.50:0/371797824 >> v1:172.21.15.170:6789/0 conn(0x7fd0580d3b90 legacy=0x7fd0580ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.018+0000 7fd056ffd640 1 -- 172.21.15.50:0/371797824 >> v1:172.21.15.50:6789/0 conn(0x7fd0580d18c0 legacy=0x7fd0580afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.018+0000 7fd056ffd640 1 -- 172.21.15.50:0/371797824 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580d1290 con 0x7fd0580d1ca0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.018+0000 7fd056ffd640 1 --2- 172.21.15.50:0/371797824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d1ca0 0x7fd0580b2030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0097a0 tx=0x7fd04c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f36512ab13d8da2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.018+0000 7fd0567fc640 1 -- 172.21.15.50:0/371797824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c031830 con 0x7fd0580d1ca0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.018+0000 7fd0567fc640 1 -- 172.21.15.50:0/371797824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c031990 con 0x7fd0580d1ca0 2023-12-08T08:18:02.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.018+0000 7fd0567fc640 1 -- 172.21.15.50:0/371797824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c031d20 con 0x7fd0580d1ca0 2023-12-08T08:18:02.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.019+0000 7fd05de9b640 1 -- 172.21.15.50:0/371797824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d1ca0 msgr2=0x7fd0580b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.019+0000 7fd05de9b640 1 --2- 172.21.15.50:0/371797824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d1ca0 0x7fd0580b2030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0097a0 tx=0x7fd04c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.019+0000 7fd05de9b640 1 -- 172.21.15.50:0/371797824 shutdown_connections 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.019+0000 7fd05de9b640 1 --2- 172.21.15.50:0/371797824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d1ca0 0x7fd0580b2030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.019+0000 7fd05de9b640 1 -- 172.21.15.50:0/371797824 >> 172.21.15.50:0/371797824 conn(0x7fd0580d3070 msgr2=0x7fd0580d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.019+0000 7fd05de9b640 1 -- 172.21.15.50:0/371797824 shutdown_connections 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.019+0000 7fd05de9b640 1 -- 172.21.15.50:0/371797824 wait complete. 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.020+0000 7fd05de9b640 1 Processor -- start 2023-12-08T08:18:02.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.020+0000 7fd05de9b640 1 -- start start 2023-12-08T08:18:02.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd05de9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0580d18c0 0x7fd0581513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd05de9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0580d1ca0 0x7fd0580b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd05de9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d3b90 0x7fd0581f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd05de9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05815d2f0 con 0x7fd0580d3b90 2023-12-08T08:18:02.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd05de9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580b3b40 con 0x7fd0580d18c0 2023-12-08T08:18:02.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd05de9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580b3e20 con 0x7fd0580d1ca0 2023-12-08T08:18:02.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd057fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d3b90 0x7fd0581f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd057fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d3b90 0x7fd0581f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49392/0 (socket says 172.21.15.50:49392) 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd057fff640 1 -- 172.21.15.50:0/131641446 learned_addr learned my addr 172.21.15.50:0/131641446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd0577fe640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0580d18c0 0x7fd0581513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.021+0000 7fd056ffd640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0580d1ca0 0x7fd0580b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd057fff640 1 -- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0580d1ca0 msgr2=0x7fd0580b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd057fff640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0580d1ca0 0x7fd0580b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd057fff640 1 -- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0580d18c0 msgr2=0x7fd0581513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd057fff640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0580d18c0 0x7fd0581513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd057fff640 1 -- 172.21.15.50:0/131641446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c009400 con 0x7fd0580d3b90 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd056ffd640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0580d1ca0 0x7fd0580b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd057fff640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d3b90 0x7fd0581f2e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c7a0 tx=0x7fd05000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd03ffff640 1 -- 172.21.15.50:0/131641446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050003b70 con 0x7fd0580d3b90 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd03ffff640 1 -- 172.21.15.50:0/131641446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd050003cf0 con 0x7fd0580d3b90 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0580b4100 con 0x7fd0580d3b90 2023-12-08T08:18:02.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd03ffff640 1 -- 172.21.15.50:0/131641446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd050003ea0 con 0x7fd0580d3b90 2023-12-08T08:18:02.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.022+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05815ad80 con 0x7fd0580d3b90 2023-12-08T08:18:02.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.023+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0580b4620 con 0x7fd0580d3b90 2023-12-08T08:18:02.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.023+0000 7fd03ffff640 1 -- 172.21.15.50:0/131641446 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd05000aa90 con 0x7fd0580d3b90 2023-12-08T08:18:02.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.024+0000 7fd03ffff640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd04406ae40 0x7fd04406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:02.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.024+0000 7fd03ffff640 1 -- 172.21.15.50:0/131641446 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fd050089680 con 0x7fd0580d3b90 2023-12-08T08:18:02.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.024+0000 7fd0577fe640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd04406ae40 0x7fd04406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:02.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.025+0000 7fd0577fe640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd04406ae40 0x7fd04406d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd0480011e0 tx=0x7fd048007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:02.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.028+0000 7fd03ffff640 1 -- 172.21.15.50:0/131641446 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd050054470 con 0x7fd0580d3b90 2023-12-08T08:18:02.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.241+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fd0580b7790 con 0x7fd0580d3b90 2023-12-08T08:18:02.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.880+0000 7fd03ffff640 1 -- 172.21.15.50:0/131641446 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fd050057a90 con 0x7fd0580d3b90 2023-12-08T08:18:02.883 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 4 to fsmap 2023-12-08T08:18:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd04406ae40 msgr2=0x7fd04406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd04406ae40 0x7fd04406d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd0480011e0 tx=0x7fd048007d30 comp rx=0 tx=0).stop 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d3b90 msgr2=0x7fd0581f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d3b90 0x7fd0581f2e60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c7a0 tx=0x7fd05000cc60 comp rx=0 tx=0).stop 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 shutdown_connections 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd04406ae40 0x7fd04406d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd0580d3b90 0x7fd0581f2e60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0580d1ca0 0x7fd0580b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 --2- 172.21.15.50:0/131641446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0580d18c0 0x7fd0581513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 >> 172.21.15.50:0/131641446 conn(0x7fd0580d3070 msgr2=0x7fd0580b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 shutdown_connections 2023-12-08T08:18:02.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:02.883+0000 7fd05de9b640 1 -- 172.21.15.50:0/131641446 wait complete. 2023-12-08T08:18:02.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.009+0000 7f8bba583640 1 Processor -- start 2023-12-08T08:18:03.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.009+0000 7f8bba583640 1 -- start start 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bba583640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bb415d580 0x7f8bb40d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bba583640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8bb40d3ad0 0x7f8bb415f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bba583640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb415ee90 con 0x7f8bb415f6c0 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bba583640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb40d0fe0 con 0x7f8bb415d580 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bba583640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb40d1280 con 0x7f8bb40d3ad0 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bb415d580 0x7f8bb40d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb8b20640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8bb415f6c0 0x7f8bb40b23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39182/0 (socket says 172.21.15.50:39182) 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb8b20640 1 -- 172.21.15.50:0/1968758830 learned_addr learned my addr 172.21.15.50:0/1968758830 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb37fe640 1 --2- 172.21.15.50:0/1968758830 >> v2:172.21.15.170:3300/0 conn(0x7f8bb40d3ad0 0x7f8bb415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb3fff640 1 -- 172.21.15.50:0/1968758830 >> v2:172.21.15.170:3300/0 conn(0x7f8bb40d3ad0 msgr2=0x7f8bb415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb3fff640 1 --2- 172.21.15.50:0/1968758830 >> v2:172.21.15.170:3300/0 conn(0x7f8bb40d3ad0 0x7f8bb415f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb3fff640 1 -- 172.21.15.50:0/1968758830 >> v1:172.21.15.50:6789/0 conn(0x7f8bb415f6c0 legacy=0x7f8bb40b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb2ffd640 1 -- 172.21.15.50:0/1968758830 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246091254 0 0) 0x7f8bb415ee90 con 0x7f8bb415f6c0 2023-12-08T08:18:03.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.010+0000 7f8bb3fff640 1 -- 172.21.15.50:0/1968758830 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40d1560 con 0x7f8bb415d580 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.011+0000 7f8bb3fff640 1 --2- 172.21.15.50:0/1968758830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb40d1d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0097a0 tx=0x7f8b9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c280be501aaf3e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.011+0000 7f8bb2ffd640 1 -- 172.21.15.50:0/1968758830 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c02e070 con 0x7f8bb415d580 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.011+0000 7f8bb2ffd640 1 -- 172.21.15.50:0/1968758830 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c0315a0 con 0x7f8bb415d580 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.011+0000 7f8bb2ffd640 1 -- 172.21.15.50:0/1968758830 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c031930 con 0x7f8bb415d580 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 -- 172.21.15.50:0/1968758830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 msgr2=0x7f8bb40d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 --2- 172.21.15.50:0/1968758830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb40d1d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0097a0 tx=0x7f8b9c02b840 comp rx=0 tx=0).stop 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 -- 172.21.15.50:0/1968758830 shutdown_connections 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 --2- 172.21.15.50:0/1968758830 >> v2:172.21.15.170:3300/0 conn(0x7f8bb40d3ad0 0x7f8bb415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 --2- 172.21.15.50:0/1968758830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb40d1d60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 -- 172.21.15.50:0/1968758830 >> 172.21.15.50:0/1968758830 conn(0x7f8bb40d2fb0 msgr2=0x7f8bb40d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 -- 172.21.15.50:0/1968758830 shutdown_connections 2023-12-08T08:18:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.012+0000 7f8bba583640 1 -- 172.21.15.50:0/1968758830 wait complete. 2023-12-08T08:18:03.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.013+0000 7f8bba583640 1 Processor -- start 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.013+0000 7f8bba583640 1 -- start start 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bba583640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb40d3ad0 0x7f8bb40cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bba583640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb41f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bba583640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb415f6c0 0x7f8bb4159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bba583640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41f3b40 con 0x7f8bb415d580 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bba583640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40b7300 con 0x7f8bb40d3ad0 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bba583640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb41595a0 con 0x7f8bb415f6c0 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb41f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb41f3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49404/0 (socket says 172.21.15.50:49404) 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 -- 172.21.15.50:0/1620938067 learned_addr learned my addr 172.21.15.50:0/1620938067 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb8b20640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb415f6c0 0x7f8bb4159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb3fff640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb40d3ad0 0x7f8bb40cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 -- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb415f6c0 msgr2=0x7f8bb4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb415f6c0 0x7f8bb4159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 -- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb40d3ad0 msgr2=0x7f8bb40cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb40d3ad0 0x7f8bb40cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 -- 172.21.15.50:0/1620938067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c009400 con 0x7f8bb415d580 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb3fff640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb40d3ad0 0x7f8bb40cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb37fe640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb41f3600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400d800 tx=0x7f8ba400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.014+0000 7f8bb0ff9640 1 -- 172.21.15.50:0/1620938067 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400b6c0 con 0x7f8bb415d580 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.015+0000 7f8bb0ff9640 1 -- 172.21.15.50:0/1620938067 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba400b820 con 0x7f8bb415d580 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.015+0000 7f8bb0ff9640 1 -- 172.21.15.50:0/1620938067 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400bbb0 con 0x7f8bb415d580 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.015+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40caa90 con 0x7f8bb415d580 2023-12-08T08:18:03.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.015+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb40b75a0 con 0x7f8bb415d580 2023-12-08T08:18:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.016+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb40d09d0 con 0x7f8bb415d580 2023-12-08T08:18:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.016+0000 7f8bb0ff9640 1 -- 172.21.15.50:0/1620938067 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ba400bd10 con 0x7f8bb415d580 2023-12-08T08:18:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.016+0000 7f8bb0ff9640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8b9406ae40 0x7f8b9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.017+0000 7f8bb0ff9640 1 -- 172.21.15.50:0/1620938067 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ba4089e60 con 0x7f8bb415d580 2023-12-08T08:18:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.017+0000 7f8bb3fff640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8b9406ae40 0x7f8b9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.017+0000 7f8bb3fff640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8b9406ae40 0x7f8b9406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c036000 tx=0x7f8b9c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.021+0000 7f8bb0ff9640 1 -- 172.21.15.50:0/1620938067 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ba4054c20 con 0x7f8bb415d580 2023-12-08T08:18:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.234+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bb4067430 con 0x7f8bb415d580 2023-12-08T08:18:03.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.234+0000 7f8bb0ff9640 1 -- 172.21.15.50:0/1620938067 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f8ba4058240 con 0x7f8bb415d580 2023-12-08T08:18:03.237 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:03.237 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:02.243281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-08T08:18:03.237 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8b9406ae40 msgr2=0x7f8b9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8b9406ae40 0x7f8b9406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c036000 tx=0x7f8b9c03d040 comp rx=0 tx=0).stop 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 msgr2=0x7f8bb41f3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb41f3600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400d800 tx=0x7f8ba400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 shutdown_connections 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8b9406ae40 0x7f8b9406d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bb415d580 0x7f8bb41f3600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bb415f6c0 0x7f8bb4159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 --2- 172.21.15.50:0/1620938067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb40d3ad0 0x7f8bb40cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 >> 172.21.15.50:0/1620938067 conn(0x7f8bb40d2fb0 msgr2=0x7f8bb415b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 shutdown_connections 2023-12-08T08:18:03.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.236+0000 7f8bba583640 1 -- 172.21.15.50:0/1620938067 wait complete. 2023-12-08T08:18:03.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.352+0000 7f7331e1e640 1 Processor -- start 2023-12-08T08:18:03.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.352+0000 7f7331e1e640 1 -- start start 2023-12-08T08:18:03.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.353+0000 7f7331e1e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 0x7f732c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.353+0000 7f7331e1e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c15d700 con 0x7f732c071f20 2023-12-08T08:18:03.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.353+0000 7f7331e1e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c15d9c0 con 0x7f732c157950 2023-12-08T08:18:03.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.353+0000 7f7331e1e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c15dca0 con 0x7f732c06abe0 2023-12-08T08:18:03.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.353+0000 7f732bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f732c071f20 0x7f732c072390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39192/0 (socket says 172.21.15.50:39192) 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.353+0000 7f732bfff640 1 -- 172.21.15.50:0/3243590557 learned_addr learned my addr 172.21.15.50:0/3243590557 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602026130 0 0) 0x7f732c15d700 con 0x7f732c071f20 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7314003520 con 0x7f732c071f20 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732affd640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 0x7f732c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3622857845 0 0) 0x7f7314003520 con 0x7f732c071f20 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 msgr2=0x7f732c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 0x7f732c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 >> v1:172.21.15.170:6789/0 conn(0x7f732c157950 legacy=0x7f732c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c15df80 con 0x7f732c071f20 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f73240019f0 con 0x7f732c071f20 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 >> v1:172.21.15.50:6789/0 conn(0x7f732c071f20 legacy=0x7f732c072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73140039a0 0x7f7314003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73140047c0 0x7f7314004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 0x7f7314005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c15dca0 con 0x7f73140039a0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731400bb70 con 0x7f73140047c0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731400bd30 con 0x7f732c06abe0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732b7fe640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73140039a0 0x7f7314003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732affd640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73140047c0 0x7f7314004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732bfff640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 0x7f7314005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732b7fe640 1 -- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 msgr2=0x7f7314005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732b7fe640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732c06abe0 0x7f7314005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732b7fe640 1 -- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73140047c0 msgr2=0x7f7314004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732b7fe640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73140047c0 0x7f7314004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732b7fe640 1 -- 172.21.15.50:0/3243590557 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314003520 con 0x7f73140039a0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.354+0000 7f732affd640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73140047c0 0x7f7314004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.355+0000 7f732b7fe640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73140039a0 0x7f7314003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f731c001750 tx=0x7f73140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c93385b9865bd8f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.355+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0052d0 con 0x7f73140039a0 2023-12-08T08:18:03.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.355+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c02e050 con 0x7f73140039a0 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.355+0000 7f732a7fc640 1 -- 172.21.15.50:0/3243590557 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0035f0 con 0x7f73140039a0 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.356+0000 7f7331e1e640 1 -- 172.21.15.50:0/3243590557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73140039a0 msgr2=0x7f7314003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.356+0000 7f7331e1e640 1 --2- 172.21.15.50:0/3243590557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73140039a0 0x7f7314003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f731c001750 tx=0x7f73140057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.356+0000 7f732bfff640 1 -- 172.21.15.50:0/3243590557 reap_dead start 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.356+0000 7f7331e1e640 1 -- 172.21.15.50:0/3243590557 shutdown_connections 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.356+0000 7f7331e1e640 1 -- 172.21.15.50:0/3243590557 >> 172.21.15.50:0/3243590557 conn(0x7f732c0cff90 msgr2=0x7f732c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.356+0000 7f7331e1e640 1 -- 172.21.15.50:0/3243590557 shutdown_connections 2023-12-08T08:18:03.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.356+0000 7f7331e1e640 1 -- 172.21.15.50:0/3243590557 wait complete. 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.357+0000 7f7331e1e640 1 Processor -- start 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.357+0000 7f7331e1e640 1 -- start start 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f7331e1e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73140039a0 0x7f732c149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f7331e1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c14b350 0x7f732c14b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f7331e1e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732c14fe90 0x7f732c150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f7331e1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c14bcf0 con 0x7f732c14b350 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f7331e1e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c149c60 con 0x7f732c14fe90 2023-12-08T08:18:03.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f7331e1e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c14bf30 con 0x7f73140039a0 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c14b350 0x7f732c14b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c14b350 0x7f732c14b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49410/0 (socket says 172.21.15.50:49410) 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 -- 172.21.15.50:0/815059482 learned_addr learned my addr 172.21.15.50:0/815059482 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732b7fe640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73140039a0 0x7f732c149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732bfff640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732c14fe90 0x7f732c150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 -- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73140039a0 msgr2=0x7f732c149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73140039a0 0x7f732c149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 -- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732c14fe90 msgr2=0x7f732c150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732c14fe90 0x7f732c150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 -- 172.21.15.50:0/815059482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c14c210 con 0x7f732c14b350 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732bfff640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732c14fe90 0x7f732c150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732b7fe640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73140039a0 0x7f732c149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.358+0000 7f732affd640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c14b350 0x7f732c14b7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73200116d0 tx=0x7f7320011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.359+0000 7f7313fff640 1 -- 172.21.15.50:0/815059482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000f9c0 con 0x7f732c14b350 2023-12-08T08:18:03.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.359+0000 7f7313fff640 1 -- 172.21.15.50:0/815059482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000fb20 con 0x7f732c14b350 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.359+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c14c4f0 con 0x7f732c14b350 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.359+0000 7f7313fff640 1 -- 172.21.15.50:0/815059482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000fed0 con 0x7f732c14b350 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.359+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c14cab0 con 0x7f732c14b350 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.360+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c067ad0 con 0x7f732c14b350 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.360+0000 7f7313fff640 1 -- 172.21.15.50:0/815059482 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7320015460 con 0x7f732c14b350 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.360+0000 7f7313fff640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f731806ae40 0x7f731806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.361+0000 7f7313fff640 1 -- 172.21.15.50:0/815059482 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f732008a0b0 con 0x7f732c14b350 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.361+0000 7f732b7fe640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f731806ae40 0x7f731806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.361+0000 7f732b7fe640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f731806ae40 0x7f731806d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f731c033000 tx=0x7f731c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.365+0000 7f7313fff640 1 -- 172.21.15.50:0/815059482 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7320054f00 con 0x7f732c14b350 2023-12-08T08:18:03.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.540+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f732c0af9d0 con 0x7f732c14b350 2023-12-08T08:18:03.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.541+0000 7f7313fff640 1 -- 172.21.15.50:0/815059482 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f7320058520 con 0x7f732c14b350 2023-12-08T08:18:03.544 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:03.544 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:03.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f731806ae40 msgr2=0x7f731806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f731806ae40 0x7f731806d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f731c033000 tx=0x7f731c009030 comp rx=0 tx=0).stop 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c14b350 msgr2=0x7f732c14b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c14b350 0x7f732c14b7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73200116d0 tx=0x7f7320011b90 comp rx=0 tx=0).stop 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 shutdown_connections 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f731806ae40 0x7f731806d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f732c14b350 0x7f732c14b7b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732c14fe90 0x7f732c150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 --2- 172.21.15.50:0/815059482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73140039a0 0x7f732c149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 >> 172.21.15.50:0/815059482 conn(0x7f732c0cff90 msgr2=0x7f732c06a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 shutdown_connections 2023-12-08T08:18:03.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.543+0000 7f7331e1e640 1 -- 172.21.15.50:0/815059482 wait complete. 2023-12-08T08:18:03.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.663+0000 7f91eeb33640 1 Processor -- start 2023-12-08T08:18:03.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.663+0000 7f91eeb33640 1 -- start start 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91eeb33640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f91e80d1d00 0x7f91e80d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91eeb33640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91e80b3bf0 0x7f91e80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91eeb33640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80cdc20 con 0x7f91e80b3340 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91eeb33640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80d11d0 con 0x7f91e80b3bf0 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91eeb33640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80d3a60 con 0x7f91e80d1d00 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91ed0d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91e80b3bf0 0x7f91e80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91ed0d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91e80b3bf0 0x7f91e80b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49424/0 (socket says 172.21.15.50:49424) 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91ed0d0640 1 -- 172.21.15.50:0/2256400732 learned_addr learned my addr 172.21.15.50:0/2256400732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:03.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.664+0000 7f91e7fff640 1 --2- 172.21.15.50:0/2256400732 >> v2:172.21.15.170:3300/0 conn(0x7f91e80d1d00 0x7f91e80d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.665+0000 7f91ed0d0640 1 -- 172.21.15.50:0/2256400732 >> v2:172.21.15.170:3300/0 conn(0x7f91e80d1d00 msgr2=0x7f91e80d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.665+0000 7f91ed0d0640 1 --2- 172.21.15.50:0/2256400732 >> v2:172.21.15.170:3300/0 conn(0x7f91e80d1d00 0x7f91e80d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.665+0000 7f91ed0d0640 1 -- 172.21.15.50:0/2256400732 >> v1:172.21.15.170:6789/0 conn(0x7f91e80b3340 legacy=0x7f91e80d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.665+0000 7f91ed0d0640 1 -- 172.21.15.50:0/2256400732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80d3d40 con 0x7f91e80b3bf0 2023-12-08T08:18:03.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.665+0000 7f91e7fff640 1 --2- 172.21.15.50:0/2256400732 >> v2:172.21.15.170:3300/0 conn(0x7f91e80d1d00 0x7f91e80d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.665+0000 7f91ed0d0640 1 --2- 172.21.15.50:0/2256400732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80b5e40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91e80b4540 tx=0x7f91d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e31a925240190f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91e77fe640 1 -- 172.21.15.50:0/2256400732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0031870 con 0x7f91e80b3bf0 2023-12-08T08:18:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91e77fe640 1 -- 172.21.15.50:0/2256400732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d00319d0 con 0x7f91e80b3bf0 2023-12-08T08:18:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91e77fe640 1 -- 172.21.15.50:0/2256400732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0031d60 con 0x7f91e80b3bf0 2023-12-08T08:18:03.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 -- 172.21.15.50:0/2256400732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 msgr2=0x7f91e80b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2256400732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80b5e40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91e80b4540 tx=0x7f91d002b910 comp rx=0 tx=0).stop 2023-12-08T08:18:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 -- 172.21.15.50:0/2256400732 shutdown_connections 2023-12-08T08:18:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2256400732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80b5e40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2256400732 >> v2:172.21.15.170:3300/0 conn(0x7f91e80d1d00 0x7f91e80d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 -- 172.21.15.50:0/2256400732 >> 172.21.15.50:0/2256400732 conn(0x7f91e809c2f0 msgr2=0x7f91e80d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 -- 172.21.15.50:0/2256400732 shutdown_connections 2023-12-08T08:18:03.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.666+0000 7f91eeb33640 1 -- 172.21.15.50:0/2256400732 wait complete. 2023-12-08T08:18:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.667+0000 7f91eeb33640 1 Processor -- start 2023-12-08T08:18:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.667+0000 7f91eeb33640 1 -- start start 2023-12-08T08:18:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91eeb33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91e80b3340 0x7f91e80cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91eeb33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91eeb33640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91e80d1d00 0x7f91e80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91eeb33640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80c7c30 con 0x7f91e80b3bf0 2023-12-08T08:18:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91eeb33640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80b0c30 con 0x7f91e80b3340 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91eeb33640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80c7950 con 0x7f91e80d1d00 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49440/0 (socket says 172.21.15.50:49440) 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.668+0000 7f91e7fff640 1 -- 172.21.15.50:0/2434630672 learned_addr learned my addr 172.21.15.50:0/2434630672 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e7fff640 1 -- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91e80d1d00 msgr2=0x7f91e80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91ec8cf640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91e80b3340 0x7f91e80cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91ed0d0640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91e80d1d00 0x7f91e80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e7fff640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91e80d1d00 0x7f91e80c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e7fff640 1 -- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91e80b3340 msgr2=0x7f91e80cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e7fff640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91e80b3340 0x7f91e80cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e7fff640 1 -- 172.21.15.50:0/2434630672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00094d0 con 0x7f91e80b3bf0 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91ec8cf640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91e80b3340 0x7f91e80cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e7fff640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80cca30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d7d0 tx=0x7f91d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e57fa640 1 -- 172.21.15.50:0/2434630672 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800b6c0 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e57fa640 1 -- 172.21.15.50:0/2434630672 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d800b820 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e80b0e40 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91e57fa640 1 -- 172.21.15.50:0/2434630672 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d800bbd0 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.669+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e80b1400 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.670+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e80b1590 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.671+0000 7f91e57fa640 1 -- 172.21.15.50:0/2434630672 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91d800bd30 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.671+0000 7f91e57fa640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f91c806ae40 0x7f91c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.671+0000 7f91e57fa640 1 -- 172.21.15.50:0/2434630672 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91d8089dd0 con 0x7f91e80b3bf0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.671+0000 7f91ec8cf640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f91c806ae40 0x7f91c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.672+0000 7f91ec8cf640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f91c806ae40 0x7f91c806d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91e00012e0 tx=0x7f91e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.675+0000 7f91e57fa640 1 -- 172.21.15.50:0/2434630672 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91d8054b90 con 0x7f91e80b3bf0 2023-12-08T08:18:03.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.853+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e80b6680 con 0x7f91e80b3bf0 2023-12-08T08:18:03.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.854+0000 7f91e57fa640 1 -- 172.21.15.50:0/2434630672 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f91d80581b0 con 0x7f91e80b3bf0 2023-12-08T08:18:03.856 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:03.857 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f91c806ae40 msgr2=0x7f91c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f91c806ae40 0x7f91c806d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91e00012e0 tx=0x7f91e0009040 comp rx=0 tx=0).stop 2023-12-08T08:18:03.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 msgr2=0x7f91e80cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80cca30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d7d0 tx=0x7f91d800dc90 comp rx=0 tx=0).stop 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 shutdown_connections 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f91c806ae40 0x7f91c806d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91e80b3bf0 0x7f91e80cca30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91e80d1d00 0x7f91e80c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 --2- 172.21.15.50:0/2434630672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91e80b3340 0x7f91e80cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 >> 172.21.15.50:0/2434630672 conn(0x7f91e809c2f0 msgr2=0x7f91e80b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 shutdown_connections 2023-12-08T08:18:03.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.856+0000 7f91eeb33640 1 -- 172.21.15.50:0/2434630672 wait complete. 2023-12-08T08:18:03.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:03.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.988+0000 7f067b417640 1 Processor -- start 2023-12-08T08:18:03.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.988+0000 7f067b417640 1 -- start start 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f067b417640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f067415d3e0 0x7f067406b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f067b417640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06740d0930 0x7f06740d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f067b417640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06740d12c0 con 0x7f06740cd600 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f067b417640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067406c8e0 con 0x7f06740d0930 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f067b417640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06740cf920 con 0x7f067415d3e0 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f06789b2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06740d0930 0x7f06740d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f06789b2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06740d0930 0x7f06740d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49456/0 (socket says 172.21.15.50:49456) 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f06789b2640 1 -- 172.21.15.50:0/1443235875 learned_addr learned my addr 172.21.15.50:0/1443235875 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:03.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.989+0000 7f06791b3640 1 --2- 172.21.15.50:0/1443235875 >> v2:172.21.15.170:3300/0 conn(0x7f067415d3e0 0x7f067406b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.990+0000 7f06789b2640 1 -- 172.21.15.50:0/1443235875 >> v2:172.21.15.170:3300/0 conn(0x7f067415d3e0 msgr2=0x7f067406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:03.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.990+0000 7f06789b2640 1 --2- 172.21.15.50:0/1443235875 >> v2:172.21.15.170:3300/0 conn(0x7f067415d3e0 0x7f067406b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.990+0000 7f06789b2640 1 -- 172.21.15.50:0/1443235875 >> v1:172.21.15.170:6789/0 conn(0x7f06740cd600 legacy=0x7f06740cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.990+0000 7f06789b2640 1 -- 172.21.15.50:0/1443235875 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740cfea0 con 0x7f06740d0930 2023-12-08T08:18:03.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.990+0000 7f06791b3640 1 --2- 172.21.15.50:0/1443235875 >> v2:172.21.15.170:3300/0 conn(0x7f067415d3e0 0x7f067406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.990+0000 7f06789b2640 1 --2- 172.21.15.50:0/1443235875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06740d0930 0x7f06740d0d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06740d19d0 tx=0x7f066802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d17e3bec273021e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.990+0000 7f0673fff640 1 -- 172.21.15.50:0/1443235875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066802f850 con 0x7f06740d0930 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f0673fff640 1 -- 172.21.15.50:0/1443235875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066802f9b0 con 0x7f06740d0930 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f0673fff640 1 -- 172.21.15.50:0/1443235875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066802fd40 con 0x7f06740d0930 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 -- 172.21.15.50:0/1443235875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06740d0930 msgr2=0x7f06740d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 --2- 172.21.15.50:0/1443235875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06740d0930 0x7f06740d0d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06740d19d0 tx=0x7f066802ba30 comp rx=0 tx=0).stop 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 -- 172.21.15.50:0/1443235875 shutdown_connections 2023-12-08T08:18:03.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 --2- 172.21.15.50:0/1443235875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06740d0930 0x7f06740d0d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 --2- 172.21.15.50:0/1443235875 >> v2:172.21.15.170:3300/0 conn(0x7f067415d3e0 0x7f067406b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 -- 172.21.15.50:0/1443235875 >> 172.21.15.50:0/1443235875 conn(0x7f0674099a10 msgr2=0x7f0674099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 -- 172.21.15.50:0/1443235875 shutdown_connections 2023-12-08T08:18:03.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.991+0000 7f067b417640 1 -- 172.21.15.50:0/1443235875 wait complete. 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.992+0000 7f067b417640 1 Processor -- start 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.992+0000 7f067b417640 1 -- start start 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f067b417640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06740cd600 0x7f0674151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f067b417640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06740d0930 0x7f06740c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f067b417640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067415d3e0 0x7f06740c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f067b417640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06740ca110 con 0x7f067415d3e0 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f067b417640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06740ca370 con 0x7f06740d0930 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f067b417640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067415d9e0 con 0x7f06740cd600 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f06799b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067415d3e0 0x7f06740c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f06789b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06740d0930 0x7f06740c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f06791b3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06740cd600 0x7f0674151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:03.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f06799b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067415d3e0 0x7f06740c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49460/0 (socket says 172.21.15.50:49460) 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.993+0000 7f06799b4640 1 -- 172.21.15.50:0/1849587631 learned_addr learned my addr 172.21.15.50:0/1849587631 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f06799b4640 1 -- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06740cd600 msgr2=0x7f0674151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f06799b4640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06740cd600 0x7f0674151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f06799b4640 1 -- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06740d0930 msgr2=0x7f06740c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f06799b4640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06740d0930 0x7f06740c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f06799b4640 1 -- 172.21.15.50:0/1849587631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680094d0 con 0x7f067415d3e0 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f06799b4640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067415d3e0 0x7f06740c9bd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f066c001eb0 tx=0x7f066c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f0671ffb640 1 -- 172.21.15.50:0/1849587631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c0052d0 con 0x7f067415d3e0 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f0671ffb640 1 -- 172.21.15.50:0/1849587631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c005430 con 0x7f067415d3e0 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067415dcc0 con 0x7f067415d3e0 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f0671ffb640 1 -- 172.21.15.50:0/1849587631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c003810 con 0x7f067415d3e0 2023-12-08T08:18:03.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.994+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067415e280 con 0x7f067415d3e0 2023-12-08T08:18:03.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.995+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0674067ad0 con 0x7f067415d3e0 2023-12-08T08:18:03.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.996+0000 7f0671ffb640 1 -- 172.21.15.50:0/1849587631 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f066c003970 con 0x7f067415d3e0 2023-12-08T08:18:03.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.996+0000 7f0671ffb640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f066006ae40 0x7f066006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.996+0000 7f0671ffb640 1 -- 172.21.15.50:0/1849587631 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f066c088d10 con 0x7f067415d3e0 2023-12-08T08:18:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.996+0000 7f06791b3640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f066006ae40 0x7f066006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:03.997+0000 7f06791b3640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f066006ae40 0x7f066006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0664009fd0 tx=0x7f06640097f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:04.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.000+0000 7f0671ffb640 1 -- 172.21.15.50:0/1849587631 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f066c053b00 con 0x7f067415d3e0 2023-12-08T08:18:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.215+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06740d12c0 con 0x7f067415d3e0 2023-12-08T08:18:04.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.216+0000 7f0671ffb640 1 -- 172.21.15.50:0/1849587631 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f06740d12c0 con 0x7f067415d3e0 2023-12-08T08:18:04.218 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:04.219 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:02.243281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-08T08:18:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 7 2023-12-08T08:18:04.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f066006ae40 msgr2=0x7f066006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f066006ae40 0x7f066006d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0664009fd0 tx=0x7f06640097f0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067415d3e0 msgr2=0x7f06740c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067415d3e0 0x7f06740c9bd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f066c001eb0 tx=0x7f066c00c890 comp rx=0 tx=0).stop 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 shutdown_connections 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f066006ae40 0x7f066006d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f067415d3e0 0x7f06740c9bd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06740d0930 0x7f06740c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 --2- 172.21.15.50:0/1849587631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06740cd600 0x7f0674151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 >> 172.21.15.50:0/1849587631 conn(0x7f0674099a10 msgr2=0x7f06740cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 shutdown_connections 2023-12-08T08:18:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.218+0000 7f067b417640 1 -- 172.21.15.50:0/1849587631 wait complete. 2023-12-08T08:18:04.231 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.334+0000 7f33847a9640 1 Processor -- start 2023-12-08T08:18:04.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.335+0000 7f33847a9640 1 -- start start 2023-12-08T08:18:04.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.335+0000 7f33847a9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f337c0d1d60 0x7f337c0d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.335+0000 7f33847a9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c15ee90 con 0x7f337c15d580 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.335+0000 7f33847a9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c0d0fe0 con 0x7f337c15f890 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.335+0000 7f33847a9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0d1280 con 0x7f337c0d1d60 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3382545640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f337c15d580 0x7f337c15f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39194/0 (socket says 172.21.15.50:39194) 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3382545640 1 -- 172.21.15.50:0/2307017653 learned_addr learned my addr 172.21.15.50:0/2307017653 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381d44640 1 --2- 172.21.15.50:0/2307017653 >> v2:172.21.15.170:3300/0 conn(0x7f337c0d1d60 0x7f337c0d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492000749 0 0) 0x7f337c15ee90 con 0x7f337c15d580 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3364003520 con 0x7f337c15d580 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254930553 0 0) 0x7f3364003520 con 0x7f337c15d580 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 >> v2:172.21.15.170:3300/0 conn(0x7f337c0d1d60 msgr2=0x7f337c0d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 --2- 172.21.15.50:0/2307017653 >> v2:172.21.15.170:3300/0 conn(0x7f337c0d1d60 0x7f337c0d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 >> v1:172.21.15.170:6789/0 conn(0x7f337c15f890 legacy=0x7f337c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0d1560 con 0x7f337c15d580 2023-12-08T08:18:04.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f3374001670 con 0x7f337c15d580 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 >> v1:172.21.15.50:6789/0 conn(0x7f337c15d580 legacy=0x7f337c15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640039a0 0x7f3364003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33640047c0 0x7f3364004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33640051d0 0x7f336400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0d1280 con 0x7f33640047c0 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336400c100 con 0x7f33640039a0 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336400c2c0 con 0x7f33640051d0 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3381d44640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33640047c0 0x7f3364004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3382545640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640039a0 0x7f3364003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.336+0000 7f3382d46640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33640051d0 0x7f336400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381d44640 1 -- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33640051d0 msgr2=0x7f336400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381d44640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33640051d0 0x7f336400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381d44640 1 -- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640039a0 msgr2=0x7f3364003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:04.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381d44640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640039a0 0x7f3364003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381d44640 1 -- 172.21.15.50:0/2307017653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3364003520 con 0x7f33640047c0 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3382d46640 1 -- 172.21.15.50:0/2307017653 reap_dead start 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381d44640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33640047c0 0x7f3364004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3370009ac0 tx=0x7f33640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582a32e2943dfe01 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337002c6b0 con 0x7f33640047c0 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337002c810 con 0x7f33640047c0 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.337+0000 7f3381543640 1 -- 172.21.15.50:0/2307017653 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337002cba0 con 0x7f33640047c0 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.338+0000 7f33847a9640 1 -- 172.21.15.50:0/2307017653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33640047c0 msgr2=0x7f3364004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.338+0000 7f33847a9640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33640047c0 0x7f3364004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3370009ac0 tx=0x7f33640057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.338+0000 7f33847a9640 1 -- 172.21.15.50:0/2307017653 shutdown_connections 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.338+0000 7f33847a9640 1 --2- 172.21.15.50:0/2307017653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33640047c0 0x7f3364004c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.338+0000 7f33847a9640 1 -- 172.21.15.50:0/2307017653 >> 172.21.15.50:0/2307017653 conn(0x7f337c0d2fb0 msgr2=0x7f337c0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.338+0000 7f33847a9640 1 -- 172.21.15.50:0/2307017653 shutdown_connections 2023-12-08T08:18:04.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.338+0000 7f33847a9640 1 -- 172.21.15.50:0/2307017653 wait complete. 2023-12-08T08:18:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.339+0000 7f33847a9640 1 Processor -- start 2023-12-08T08:18:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.339+0000 7f33847a9640 1 -- start start 2023-12-08T08:18:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f33847a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640047c0 0x7f337c1f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f33847a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f337c0b8690 0x7f337c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f33847a9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f337c0b8b10 0x7f337c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f33847a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0ca080 con 0x7f337c0b8690 2023-12-08T08:18:04.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f33847a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0ca360 con 0x7f33640047c0 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f33847a9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0c82f0 con 0x7f337c0b8b10 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f337c0b8690 0x7f337c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f337c0b8690 0x7f337c0c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49474/0 (socket says 172.21.15.50:49474) 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 -- 172.21.15.50:0/4112450975 learned_addr learned my addr 172.21.15.50:0/4112450975 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3382545640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640047c0 0x7f337c1f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3382d46640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f337c0b8b10 0x7f337c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 -- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f337c0b8b10 msgr2=0x7f337c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f337c0b8b10 0x7f337c0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 -- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640047c0 msgr2=0x7f337c1f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640047c0 0x7f337c1f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.340+0000 7f3381d44640 1 -- 172.21.15.50:0/4112450975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0b7860 con 0x7f337c0b8690 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.341+0000 7f3381d44640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f337c0b8690 0x7f337c0c8a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f337002c250 tx=0x7f3370004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.341+0000 7f337affd640 1 -- 172.21.15.50:0/4112450975 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370003810 con 0x7f337c0b8690 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.341+0000 7f337affd640 1 -- 172.21.15.50:0/4112450975 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3370003970 con 0x7f337c0b8690 2023-12-08T08:18:04.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.341+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c0b7b40 con 0x7f337c0b8690 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.341+0000 7f337affd640 1 -- 172.21.15.50:0/4112450975 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370003d00 con 0x7f337c0b8690 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.341+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c1f29c0 con 0x7f337c0b8690 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.342+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c0b8060 con 0x7f337c0b8690 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.342+0000 7f337affd640 1 -- 172.21.15.50:0/4112450975 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3370034440 con 0x7f337c0b8690 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.343+0000 7f337affd640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f336806ae70 0x7f336806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.343+0000 7f337affd640 1 -- 172.21.15.50:0/4112450975 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33700abb10 con 0x7f337c0b8690 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.343+0000 7f3382545640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f336806ae70 0x7f336806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:04.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.343+0000 7f3382545640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f336806ae70 0x7f336806d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3374007d20 tx=0x7f3374009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:04.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.347+0000 7f337affd640 1 -- 172.21.15.50:0/4112450975 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3370076a10 con 0x7f337c0b8690 2023-12-08T08:18:04.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.523+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f337c0d09d0 con 0x7f337c0b8690 2023-12-08T08:18:04.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.524+0000 7f337affd640 1 -- 172.21.15.50:0/4112450975 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f337004c090 con 0x7f337c0b8690 2023-12-08T08:18:04.527 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:04.527 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f336806ae70 msgr2=0x7f336806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f336806ae70 0x7f336806d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3374007d20 tx=0x7f3374009040 comp rx=0 tx=0).stop 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f337c0b8690 msgr2=0x7f337c0c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f337c0b8690 0x7f337c0c8a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f337002c250 tx=0x7f3370004730 comp rx=0 tx=0).stop 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 shutdown_connections 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f336806ae70 0x7f336806d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f337c0b8690 0x7f337c0c8a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f337c0b8b10 0x7f337c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 --2- 172.21.15.50:0/4112450975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33640047c0 0x7f337c1f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 >> 172.21.15.50:0/4112450975 conn(0x7f337c0d2fb0 msgr2=0x7f337c15f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 shutdown_connections 2023-12-08T08:18:04.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:04.526+0000 7f33847a9640 1 -- 172.21.15.50:0/4112450975 wait complete. 2023-12-08T08:18:04.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:17:57.193015+0000', 'modified': '2023-12-08T08:18:02.243281+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6837/728540036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6835', 'nonce': 728540036}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 728540036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-08T08:18:04.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:18:04.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-08T08:18:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.050+0000 7fc619141640 1 Processor -- start 2023-12-08T08:18:05.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.050+0000 7fc619141640 1 -- start start 2023-12-08T08:18:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc619141640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6140b0cf0 0x7fc6140d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc619141640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc6140b1d70 0x7fc6140cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc619141640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6140d20b0 con 0x7fc6141608a0 2023-12-08T08:18:05.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc619141640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6140d0620 con 0x7fc6140b1d70 2023-12-08T08:18:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc619141640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140d1b80 con 0x7fc6140b0cf0 2023-12-08T08:18:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc61359e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc6140b1d70 0x7fc6140cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc60a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6140b0cf0 0x7fc6140d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc612d9d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc6141608a0 0x7fc6140d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:54210/0 (socket says 172.21.15.50:54210) 2023-12-08T08:18:05.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc612d9d640 1 -- 172.21.15.50:0/3722237423 learned_addr learned my addr 172.21.15.50:0/3722237423 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc60a59c640 1 -- 172.21.15.50:0/3722237423 >> v2:172.21.15.170:3300/0 conn(0x7fc6140b1d70 msgr2=0x7fc6140cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc60a59c640 1 --2- 172.21.15.50:0/3722237423 >> v2:172.21.15.170:3300/0 conn(0x7fc6140b1d70 0x7fc6140cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.051+0000 7fc60a59c640 1 -- 172.21.15.50:0/3722237423 >> v1:172.21.15.170:6789/0 conn(0x7fc6141608a0 legacy=0x7fc6140d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.052+0000 7fc60a59c640 1 -- 172.21.15.50:0/3722237423 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140d1dd0 con 0x7fc6140b0cf0 2023-12-08T08:18:05.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.052+0000 7fc61359e640 1 --2- 172.21.15.50:0/3722237423 >> v2:172.21.15.170:3300/0 conn(0x7fc6140b1d70 0x7fc6140cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.052+0000 7fc60a59c640 1 --2- 172.21.15.50:0/3722237423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6140b0cf0 0x7fc6140d1640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0097a0 tx=0x7fc5fc02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45780a2301e424f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.052+0000 7fc61259c640 1 -- 172.21.15.50:0/3722237423 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc02e070 con 0x7fc6140b0cf0 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.052+0000 7fc61259c640 1 -- 172.21.15.50:0/3722237423 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0315a0 con 0x7fc6140b0cf0 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc61259c640 1 -- 172.21.15.50:0/3722237423 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc031930 con 0x7fc6140b0cf0 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 -- 172.21.15.50:0/3722237423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6140b0cf0 msgr2=0x7fc6140d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 --2- 172.21.15.50:0/3722237423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6140b0cf0 0x7fc6140d1640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0097a0 tx=0x7fc5fc02b840 comp rx=0 tx=0).stop 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 -- 172.21.15.50:0/3722237423 shutdown_connections 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 --2- 172.21.15.50:0/3722237423 >> v2:172.21.15.170:3300/0 conn(0x7fc6140b1d70 0x7fc6140cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 --2- 172.21.15.50:0/3722237423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6140b0cf0 0x7fc6140d1640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 -- 172.21.15.50:0/3722237423 >> 172.21.15.50:0/3722237423 conn(0x7fc6140d3030 msgr2=0x7fc6140d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 -- 172.21.15.50:0/3722237423 shutdown_connections 2023-12-08T08:18:05.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.053+0000 7fc619141640 1 -- 172.21.15.50:0/3722237423 wait complete. 2023-12-08T08:18:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.054+0000 7fc619141640 1 Processor -- start 2023-12-08T08:18:05.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.054+0000 7fc619141640 1 -- start start 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc619141640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b0cf0 0x7fc6140a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc619141640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6140b1d70 0x7fc6140cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc619141640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6141608a0 0x7fc6140cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc619141640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140c79e0 con 0x7fc6140b0cf0 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc619141640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140c6b10 con 0x7fc6140b1d70 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc619141640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6140c6d60 con 0x7fc6141608a0 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc612d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b0cf0 0x7fc6140a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc612d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b0cf0 0x7fc6140a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49482/0 (socket says 172.21.15.50:49482) 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.055+0000 7fc612d9d640 1 -- 172.21.15.50:0/2678948505 learned_addr learned my addr 172.21.15.50:0/2678948505 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc60a59c640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6140b1d70 0x7fc6140cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc61359e640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6141608a0 0x7fc6140cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc612d9d640 1 -- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6141608a0 msgr2=0x7fc6140cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc612d9d640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6141608a0 0x7fc6140cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc612d9d640 1 -- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6140b1d70 msgr2=0x7fc6140cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc612d9d640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6140b1d70 0x7fc6140cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc612d9d640 1 -- 172.21.15.50:0/2678948505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c009a70 con 0x7fc6140b0cf0 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc61359e640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6141608a0 0x7fc6140cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc612d9d640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b0cf0 0x7fc6140a0450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c480 tx=0x7fc60400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc60bfff640 1 -- 172.21.15.50:0/2678948505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604005ce0 con 0x7fc6140b0cf0 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc60bfff640 1 -- 172.21.15.50:0/2678948505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604005e40 con 0x7fc6140b0cf0 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc009400 con 0x7fc6140b0cf0 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc60bfff640 1 -- 172.21.15.50:0/2678948505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040072f0 con 0x7fc6140b0cf0 2023-12-08T08:18:05.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.056+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6140c7320 con 0x7fc6140b0cf0 2023-12-08T08:18:05.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.058+0000 7fc60bfff640 1 -- 172.21.15.50:0/2678948505 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc604007450 con 0x7fc6140b0cf0 2023-12-08T08:18:05.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.058+0000 7fc60bfff640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc5f406ae40 0x7fc5f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.058+0000 7fc60bfff640 1 -- 172.21.15.50:0/2678948505 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc604088d00 con 0x7fc6140b0cf0 2023-12-08T08:18:05.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.058+0000 7fc60a59c640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc5f406ae40 0x7fc5f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.059+0000 7fc60a59c640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc5f406ae40 0x7fc5f406d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc036000 tx=0x7fc5fc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.059+0000 7fc61bdaa740 1 Processor -- start 2023-12-08T08:18:05.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.059+0000 7fc61bdaa740 1 -- start start 2023-12-08T08:18:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21bcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21ea030 0x5556f21ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21bd130 0x5556f21ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f217d980 con 0x5556f21bd130 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f212fb90 con 0x5556f21e9c50 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556f212d280 con 0x5556f21ea030 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21bd130 0x5556f21ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21bd130 0x5556f21ecf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49498/0 (socket says 172.21.15.50:49498) 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 -- 172.21.15.50:0/298397153 learned_addr learned my addr 172.21.15.50:0/298397153 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc612d9d640 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21bcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc60a59c640 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21ea030 0x5556f21ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 -- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21ea030 msgr2=0x5556f21ec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21ea030 0x5556f21ec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 -- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 msgr2=0x5556f21bcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21bcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc61359e640 1 -- 172.21.15.50:0/298397153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556f20ee500 con 0x5556f21bd130 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.060+0000 7fc612d9d640 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21bcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.061+0000 7fc61359e640 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21bd130 0x5556f21ecf20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007770 tx=0x7fc60c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d77fa11e9a9349 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.061+0000 7fc608d99640 1 -- 172.21.15.50:0/298397153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00e050 con 0x5556f21bd130 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.061+0000 7fc608d99640 1 -- 172.21.15.50:0/298397153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00f040 con 0x5556f21bd130 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.061+0000 7fc608d99640 1 -- 172.21.15.50:0/298397153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c010ba0 con 0x5556f21bd130 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.061+0000 7fc61bdaa740 1 -- 172.21.15.50:0/298397153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21bd130 msgr2=0x5556f21ecf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.061+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21bd130 0x5556f21ecf20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007770 tx=0x7fc60c009750 comp rx=0 tx=0).stop 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 -- 172.21.15.50:0/298397153 shutdown_connections 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21bd130 0x5556f21ecf20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21ea030 0x5556f21ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/298397153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21bcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 -- 172.21.15.50:0/298397153 >> 172.21.15.50:0/298397153 conn(0x5556f21bee60 msgr2=0x5556f22079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 -- 172.21.15.50:0/298397153 shutdown_connections 2023-12-08T08:18:05.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 -- 172.21.15.50:0/298397153 wait complete. 2023-12-08T08:18:05.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 -- start start 2023-12-08T08:18:05.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.062+0000 7fc61bdaa740 1 Processor -- start 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f2200a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21e7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f2128b70 con 0x5556f22085f0 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f20e2e00 con 0x5556f21ea030 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556f20e2aa0 con 0x5556f21e9c50 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61bdaa740 10 client.0 _ll_register_callbacks cb 0x5556f1e3aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49512/0 (socket says 172.21.15.50:49512) 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61359e640 1 -- 172.21.15.50:0/336336774 learned_addr learned my addr 172.21.15.50:0/336336774 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc612d9d640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f2200a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc60a59c640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61359e640 1 -- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 msgr2=0x5556f2200a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.063+0000 7fc61359e640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f2200a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61359e640 1 -- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 msgr2=0x5556f21e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61359e640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61359e640 1 -- 172.21.15.50:0/336336774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c0073f0 con 0x5556f22085f0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc60a59c640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61359e640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21e7140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc60c000f80 tx=0x7fc60c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfbe7fec88af948 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/336336774 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c015850 con 0x5556f22085f0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/336336774 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc60c010e80 con 0x5556f22085f0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5556f2121b50 con 0x5556f22085f0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/336336774 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc60c00e020 con 0x5556f22085f0 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 10 client.4416 fetch_fsmap learned FSMap version 7 2023-12-08T08:18:05.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5556f21271f0 con 0x5556f22085f0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/336336774 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556f2121b50 con 0x5556f22085f0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/336336774 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc60c0159b0 con 0x5556f22085f0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 10 client.4416 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 20 client.4416 populate_metadata read hostname 'smithi050' 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f21ee4c0 0x5556f21ff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 4 client.4416 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.064+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 --> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5556f2121870 con 0x5556f21ee4c0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.065+0000 7fc612d9d640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f21ee4c0 0x5556f21ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.065+0000 7fc5f1ffb640 10 client.4416 ms_handle_connect on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.065+0000 7fc612d9d640 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f21ee4c0 0x5556f21ff460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48d6dd13013f7bc server_cookie=dc1afbe1eeb4e797 in_seq=0 out_seq=0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/336336774 <== mds.0 v2:172.21.15.170:6835/728540036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5556f2121870 con 0x5556f21ee4c0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc5f1ffb640 10 client.4416 handle_command_reply: tid=0 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 client.4416 shutdown 2023-12-08T08:18:05.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 msgr2=0x5556f21e7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21e7140 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc60c000f80 tx=0x7fc60c004ab0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 shutdown_connections 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f21ee4c0 0x5556f21ff460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21e7140 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/336336774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f2200a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc5f1ffb640 0 client.4416 ms_handle_reset on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 >> 172.21.15.50:0/336336774 conn(0x5556f21bd130 msgr2=0x5556f220aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 shutdown_connections 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 1 -- 172.21.15.50:0/336336774 wait complete. 2023-12-08T08:18:05.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.066+0000 7fc61bdaa740 20 client.4416 trim_cache size 0 max 16384 2023-12-08T08:18:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 Processor -- start 2023-12-08T08:18:05.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 -- start start 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f21bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f20a8270 con 0x5556f22085f0 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f21b8810 con 0x5556f21ea030 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556f21c3360 con 0x5556f21e9c50 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.082+0000 7fc61359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21c0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49524/0 (socket says 172.21.15.50:49524) 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 -- 172.21.15.50:0/1564877246 learned_addr learned my addr 172.21.15.50:0/1564877246 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc60a59c640 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc612d9d640 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f21bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 -- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 msgr2=0x5556f21bbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f21bbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 -- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 msgr2=0x5556f21e5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 -- 172.21.15.50:0/1564877246 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556f21bcf10 con 0x5556f22085f0 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc612d9d640 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f21bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61359e640 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21c0750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00afe0 tx=0x7fc60c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cde5cf9820f2bd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc60959a640 1 -- 172.21.15.50:0/1564877246 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00e040 con 0x5556f22085f0 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc60959a640 1 -- 172.21.15.50:0/1564877246 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c009030 con 0x5556f22085f0 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc60959a640 1 -- 172.21.15.50:0/1564877246 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c010ee0 con 0x5556f22085f0 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.083+0000 7fc61bdaa740 1 -- 172.21.15.50:0/1564877246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 msgr2=0x5556f21c0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21c0750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00afe0 tx=0x7fc60c021040 comp rx=0 tx=0).stop 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 -- 172.21.15.50:0/1564877246 shutdown_connections 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f22085f0 0x5556f21c0750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21ea030 0x5556f21e5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/1564877246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f21e9c50 0x5556f21bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 -- 172.21.15.50:0/1564877246 >> 172.21.15.50:0/1564877246 conn(0x5556f21bd130 msgr2=0x5556f21f0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 -- 172.21.15.50:0/1564877246 shutdown_connections 2023-12-08T08:18:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 -- 172.21.15.50:0/1564877246 wait complete. 2023-12-08T08:18:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 -- start start 2023-12-08T08:18:05.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.084+0000 7fc61bdaa740 1 Processor -- start 2023-12-08T08:18:05.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21ea030 0x5556f21e1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61bdaa740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f22085f0 0x5556f2208fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f22165d0 con 0x5556f21ea030 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556f21c1de0 con 0x5556f21e9c50 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61bdaa740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556f21e0980 con 0x5556f22085f0 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61bdaa740 10 client.0 _ll_register_callbacks cb 0x7fc60c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21ea030 0x5556f21e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21ea030 0x5556f21e1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49538/0 (socket says 172.21.15.50:49538) 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 -- 172.21.15.50:0/318462444 learned_addr learned my addr 172.21.15.50:0/318462444 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc612d9d640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc61359e640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f22085f0 0x5556f2208fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 -- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f22085f0 msgr2=0x5556f2208fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f22085f0 0x5556f2208fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 -- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 msgr2=0x5556f21e11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21e11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc60a59c640 1 -- 172.21.15.50:0/318462444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556f21271f0 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.085+0000 7fc612d9d640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21e11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc60a59c640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21ea030 0x5556f21e1710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc02be50 tx=0x7fc5fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3d5c8a2618b1aa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/318462444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc04b040 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/318462444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5fc040070 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc60c00f040 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/318462444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5fc032e60 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 10 client.4422 fetch_fsmap learned FSMap version 7 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5556f20c4d00 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/318462444 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00f040 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/318462444 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc5fc045ce0 con 0x5556f21ea030 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 10 client.4422 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 20 client.4422 populate_metadata read hostname 'smithi050' 2023-12-08T08:18:05.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f2209520 0x5556f21ff320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 4 client.4422 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 --> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5556f1e296c0 con 0x5556f2209520 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.086+0000 7fc612d9d640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f2209520 0x5556f21ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc612d9d640 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f2209520 0x5556f21ff320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c57760572ae5368 server_cookie=cc8fcf84b8c62c1e in_seq=0 out_seq=0 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc5f1ffb640 10 client.4422 ms_handle_connect on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc5f1ffb640 1 -- 172.21.15.50:0/318462444 <== mds.0 v2:172.21.15.170:6835/728540036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5556f1e296c0 con 0x5556f2209520 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc5f1ffb640 10 client.4422 handle_command_reply: tid=0 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 client.4422 shutdown 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21ea030 msgr2=0x5556f21e1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21ea030 0x5556f21e1710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc02be50 tx=0x7fc5fc004730 comp rx=0 tx=0).stop 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 shutdown_connections 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x5556f2209520 0x5556f21ff320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5556f21ea030 0x5556f21e1710 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5556f22085f0 0x5556f2208fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 --2- 172.21.15.50:0/318462444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5556f21e9c50 0x5556f21e11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 >> 172.21.15.50:0/318462444 conn(0x5556f21bd130 msgr2=0x5556f21bc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc5f1ffb640 0 client.4422 ms_handle_reset on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 shutdown_connections 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 1 -- 172.21.15.50:0/318462444 wait complete. 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.087+0000 7fc61bdaa740 20 client.4422 trim_cache size 0 max 16384 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "e65cfade-ffb6-4f9a-b644-0a4f3f758761", 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4285, 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-08T08:18:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-08T08:18:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 7.2497363569999997, 2023-12-08T08:18:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 7, 2023-12-08T08:18:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 24, 2023-12-08T08:18:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 24, 2023-12-08T08:18:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 14.535903748999999 2023-12-08T08:18:05.097 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc5f406ae40 msgr2=0x7fc5f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc5f406ae40 0x7fc5f406d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc036000 tx=0x7fc5fc03d040 comp rx=0 tx=0).stop 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b0cf0 msgr2=0x7fc6140a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b0cf0 0x7fc6140a0450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c480 tx=0x7fc60400c940 comp rx=0 tx=0).stop 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 shutdown_connections 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc5f406ae40 0x7fc5f406d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6141608a0 0x7fc6140cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6140b1d70 0x7fc6140cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 --2- 172.21.15.50:0/2678948505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6140b0cf0 0x7fc6140a0450 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 >> 172.21.15.50:0/2678948505 conn(0x7fc6140d3030 msgr2=0x7fc6140ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 shutdown_connections 2023-12-08T08:18:05.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.088+0000 7fc619141640 1 -- 172.21.15.50:0/2678948505 wait complete. 2023-12-08T08:18:05.100 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:18:05.101 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:05.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:18:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.205+0000 7efc3339e640 1 Processor -- start 2023-12-08T08:18:05.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.205+0000 7efc3339e640 1 -- start start 2023-12-08T08:18:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc3339e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c15d170 0x7efc2c0d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc3339e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc2c0d3ab0 0x7efc2c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc3339e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0d0a30 con 0x7efc2c0d1960 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc3339e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0d1df0 con 0x7efc2c0d3ab0 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc3339e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c06b380 con 0x7efc2c15d170 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc31b9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efc2c0d3ab0 0x7efc2c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc32b9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7efc2c0d1960 0x7efc2c0cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39196/0 (socket says 172.21.15.50:39196) 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc32b9d640 1 -- 172.21.15.50:0/3006533014 learned_addr learned my addr 172.21.15.50:0/3006533014 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc3239c640 1 --2- 172.21.15.50:0/3006533014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c15d170 0x7efc2c0d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc31b9b640 1 -- 172.21.15.50:0/3006533014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c15d170 msgr2=0x7efc2c0d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc31b9b640 1 --2- 172.21.15.50:0/3006533014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c15d170 0x7efc2c0d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc31b9b640 1 -- 172.21.15.50:0/3006533014 >> v1:172.21.15.50:6789/0 conn(0x7efc2c0d1960 legacy=0x7efc2c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.206+0000 7efc31b9b640 1 -- 172.21.15.50:0/3006533014 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0ced80 con 0x7efc2c0d3ab0 2023-12-08T08:18:05.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.207+0000 7efc31b9b640 1 --2- 172.21.15.50:0/3006533014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c0d3ab0 0x7efc2c0d1420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0097a0 tx=0x7efc1c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfae263905e94aee server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.207+0000 7efc3139a640 1 -- 172.21.15.50:0/3006533014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c02f050 con 0x7efc2c0d3ab0 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.207+0000 7efc3139a640 1 -- 172.21.15.50:0/3006533014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c031700 con 0x7efc2c0d3ab0 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.207+0000 7efc3139a640 1 -- 172.21.15.50:0/3006533014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c031a90 con 0x7efc2c0d3ab0 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 -- 172.21.15.50:0/3006533014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c0d3ab0 msgr2=0x7efc2c0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 --2- 172.21.15.50:0/3006533014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c0d3ab0 0x7efc2c0d1420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0097a0 tx=0x7efc1c02b7a0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 -- 172.21.15.50:0/3006533014 shutdown_connections 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 --2- 172.21.15.50:0/3006533014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c0d3ab0 0x7efc2c0d1420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 --2- 172.21.15.50:0/3006533014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c15d170 0x7efc2c0d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 -- 172.21.15.50:0/3006533014 >> 172.21.15.50:0/3006533014 conn(0x7efc2c09c1d0 msgr2=0x7efc2c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 -- 172.21.15.50:0/3006533014 shutdown_connections 2023-12-08T08:18:05.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.208+0000 7efc3339e640 1 -- 172.21.15.50:0/3006533014 wait complete. 2023-12-08T08:18:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.209+0000 7efc3339e640 1 Processor -- start 2023-12-08T08:18:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.209+0000 7efc3339e640 1 -- start start 2023-12-08T08:18:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c0d1960 0x7efc2c0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc2c0d3ab0 0x7efc2c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c15d170 0x7efc2c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0b5000 con 0x7efc2c15d170 2023-12-08T08:18:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1f2950 con 0x7efc2c0d3ab0 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0cad10 con 0x7efc2c0d1960 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c15d170 0x7efc2c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c15d170 0x7efc2c0c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49562/0 (socket says 172.21.15.50:49562) 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 -- 172.21.15.50:0/1285314854 learned_addr learned my addr 172.21.15.50:0/1285314854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 -- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c0d1960 msgr2=0x7efc2c0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c0d1960 0x7efc2c0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 -- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc2c0d3ab0 msgr2=0x7efc2c146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc2c0d3ab0 0x7efc2c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 -- 172.21.15.50:0/1285314854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c009400 con 0x7efc2c15d170 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc32b9d640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c15d170 0x7efc2c0c66e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc2400cbf0 tx=0x7efc2400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc22ffd640 1 -- 172.21.15.50:0/1285314854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400ad40 con 0x7efc2c15d170 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc22ffd640 1 -- 172.21.15.50:0/1285314854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24012400 con 0x7efc2c15d170 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c0c8790 con 0x7efc2c15d170 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc22ffd640 1 -- 172.21.15.50:0/1285314854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400aea0 con 0x7efc2c15d170 2023-12-08T08:18:05.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.210+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c0c8d50 con 0x7efc2c15d170 2023-12-08T08:18:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.211+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0c8f40 con 0x7efc2c15d170 2023-12-08T08:18:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.212+0000 7efc22ffd640 1 -- 172.21.15.50:0/1285314854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc24007070 con 0x7efc2c15d170 2023-12-08T08:18:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.212+0000 7efc22ffd640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efc1006ae40 0x7efc1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.212+0000 7efc22ffd640 1 -- 172.21.15.50:0/1285314854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc240898a0 con 0x7efc2c15d170 2023-12-08T08:18:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.212+0000 7efc3239c640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efc1006ae40 0x7efc1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.213+0000 7efc3239c640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efc1006ae40 0x7efc1006d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc28006fd0 tx=0x7efc28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:05.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.216+0000 7efc22ffd640 1 -- 172.21.15.50:0/1285314854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc24058110 con 0x7efc2c15d170 2023-12-08T08:18:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.430+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc2c0673c0 con 0x7efc2c15d170 2023-12-08T08:18:05.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.430+0000 7efc22ffd640 1 -- 172.21.15.50:0/1285314854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7efc24017020 con 0x7efc2c15d170 2023-12-08T08:18:05.433 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:18:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efc1006ae40 msgr2=0x7efc1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efc1006ae40 0x7efc1006d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc28006fd0 tx=0x7efc28008040 comp rx=0 tx=0).stop 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c15d170 msgr2=0x7efc2c0c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c15d170 0x7efc2c0c66e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc2400cbf0 tx=0x7efc2400a430 comp rx=0 tx=0).stop 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 shutdown_connections 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efc1006ae40 0x7efc1006d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efc2c15d170 0x7efc2c0c66e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc2c0d3ab0 0x7efc2c146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 --2- 172.21.15.50:0/1285314854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efc2c0d1960 0x7efc2c0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 >> 172.21.15.50:0/1285314854 conn(0x7efc2c09c1d0 msgr2=0x7efc2c0ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 shutdown_connections 2023-12-08T08:18:05.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:05.432+0000 7efc3339e640 1 -- 172.21.15.50:0/1285314854 wait complete. 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:18:05.445 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-08T08:18:05.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:05.446 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:05.461 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42488sec preferred_lft 42488sec 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:05.462 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:18:05.463 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:18:05.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:05.463 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:05.463 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:05.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:18:05.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-12-08T08:18:05.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-12-08T08:18:05.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:18:05.464 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:05.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:05.629 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:18:05.660 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:18:05.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:05.662 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:18:05.727 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:18:05.727 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:18:05.727 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:18:05.727 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:18:05.727 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:18:05.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:05.728 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:05.728 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:05.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:18:05.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:18:05.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:18:05.728 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:05.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:05.990 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:18:06.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:06.006 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-12-08T08:18:06.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:06.062 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:06.062 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:06.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:18:06.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-08T08:18:06.062 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:06.154 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-08T08:18:06.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-08T08:18:06.155 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:06.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:06.276 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:06.276 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:06.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:18:06.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:18:06.276 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:06.326 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-08T08:18:06.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:06.326 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:06.342 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-08T08:18:06.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:06.342 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:06.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:18:06.470 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:18:06.527 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:06.528 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:18:06.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:06.529 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:18:06.582 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:18:06.582 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-08T08:18:06.624 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:18:06.655 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:18:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:18:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:18:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:18:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:18:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:18:06.712 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:18:06.713 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:18:06.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:06.715 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:18:06.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:2023-12-08T08:18:06.729+0000 7f672243a480 -1 init, newargv = 0x55f527864260 newargc=15 2023-12-08T08:18:06.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[95637]: starting ceph client 2023-12-08T08:18:06.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[95637]: starting fuse 2023-12-08T08:18:06.747 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:18:06.748 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:18:06.748 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:18:06.749 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:18:06.750 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:18:06.750 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:18:06.750 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:18:06.750 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:06.750 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.admin")) 2023-12-08T08:18:06.750 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:18:06.873 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.admin.95637.asok 2023-12-08T08:18:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:18:06.884 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.95637.asok 2023-12-08T08:18:06.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:06.884 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.95637.asok status 2023-12-08T08:18:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:18:07.028 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "admin", 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "95637", 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4437, 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:18:07.029 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4437 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 79591050 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 79591050 2023-12-08T08:18:07.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4437 192.168.0.1:0/79591050", 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/79591050", 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 7, 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 24, 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:18:07.031 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:18:07.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:07.037 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:18:07.037 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:07.053 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:18:07.053 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:07.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:07.053 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:07.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:07.126 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-08T08:18:07.197 INFO:teuthology.orchestra.run.smithi050.stdout:# file: . 2023-12-08T08:18:07.197 INFO:teuthology.orchestra.run.smithi050.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-08T08:18:07.198 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:07.198 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:07.198 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:07.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:07.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.398+0000 7f628ad41640 1 Processor -- start 2023-12-08T08:18:07.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.398+0000 7f628ad41640 1 -- start start 2023-12-08T08:18:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.398+0000 7f628ad41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.398+0000 7f628ad41640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840d20b0 con 0x7f62840b1d70 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.398+0000 7f628ad41640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62840d1b80 con 0x7f62841608a0 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.398+0000 7f628ad41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840d0620 con 0x7f62840b0cf0 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f62892de640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f62840b1d70 0x7f62840cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39210/0 (socket says 172.21.15.50:39210) 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f62892de640 1 -- 172.21.15.50:0/2219332643 learned_addr learned my addr 172.21.15.50:0/2219332643 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f6283fff640 1 --2- 172.21.15.50:0/2219332643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220315833 0 0) 0x7f62840d20b0 con 0x7f62840b1d70 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f626c003520 con 0x7f62840b1d70 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573924732 0 0) 0x7f62840d1b80 con 0x7f62841608a0 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62840d20b0 con 0x7f62841608a0 2023-12-08T08:18:07.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2674980716 0 0) 0x7f626c003520 con 0x7f62840b1d70 2023-12-08T08:18:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f6283fff640 1 -- 172.21.15.50:0/2219332643 >> v1:172.21.15.170:6789/0 conn(0x7f62841608a0 legacy=0x7f62840d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f6283fff640 1 -- 172.21.15.50:0/2219332643 >> v1:172.21.15.50:6789/0 conn(0x7f62840b1d70 legacy=0x7f62840cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.399+0000 7f6283fff640 1 -- 172.21.15.50:0/2219332643 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840d1dd0 con 0x7f62840b0cf0 2023-12-08T08:18:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.400+0000 7f6283fff640 1 --2- 172.21.15.50:0/2219332643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840d1640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62780097d0 tx=0x7f627802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=910623640fe4c735 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.400+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274001670 con 0x7f62840b0cf0 2023-12-08T08:18:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.400+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627802e050 con 0x7f62840b0cf0 2023-12-08T08:18:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.400+0000 7f62837fe640 1 -- 172.21.15.50:0/2219332643 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278030710 con 0x7f62840b0cf0 2023-12-08T08:18:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.401+0000 7f628ad41640 1 -- 172.21.15.50:0/2219332643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 msgr2=0x7f62840d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.401+0000 7f628ad41640 1 --2- 172.21.15.50:0/2219332643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840d1640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62780097d0 tx=0x7f627802b770 comp rx=0 tx=0).stop 2023-12-08T08:18:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.401+0000 7f628ad41640 1 -- 172.21.15.50:0/2219332643 shutdown_connections 2023-12-08T08:18:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.401+0000 7f628ad41640 1 --2- 172.21.15.50:0/2219332643 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840d1640 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.401+0000 7f628ad41640 1 -- 172.21.15.50:0/2219332643 >> 172.21.15.50:0/2219332643 conn(0x7f62840d3030 msgr2=0x7f62840d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.401+0000 7f628ad41640 1 -- 172.21.15.50:0/2219332643 shutdown_connections 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.401+0000 7f628ad41640 1 -- 172.21.15.50:0/2219332643 wait complete. 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.402+0000 7f628ad41640 1 Processor -- start 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.402+0000 7f628ad41640 1 -- start start 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f628ad41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f628ad41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62840b1d70 0x7f62840c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f628ad41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62841608a0 0x7f62840c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f628ad41640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840b60e0 con 0x7f62840b1d70 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f628ad41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62840c8010 con 0x7f62841608a0 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f628ad41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62840c7a50 con 0x7f62840b0cf0 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62840b1d70 0x7f62840c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62840b1d70 0x7f62840c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49576/0 (socket says 172.21.15.50:49576) 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 -- 172.21.15.50:0/988510583 learned_addr learned my addr 172.21.15.50:0/988510583 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6288add640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f62892de640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62841608a0 0x7f62840c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 -- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 msgr2=0x7f62840cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 -- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62841608a0 msgr2=0x7f62840c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62841608a0 0x7f62840c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.403+0000 7f6283fff640 1 -- 172.21.15.50:0/988510583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009400 con 0x7f62840b1d70 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.404+0000 7f6283fff640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62840b1d70 0x7f62840c83a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6278000c00 tx=0x7f62780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.404+0000 7f62817fa640 1 -- 172.21.15.50:0/988510583 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278006e10 con 0x7f62840b1d70 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.404+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62840c7d30 con 0x7f62840b1d70 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.404+0000 7f62817fa640 1 -- 172.21.15.50:0/988510583 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627803c620 con 0x7f62840b1d70 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.404+0000 7f62817fa640 1 -- 172.21.15.50:0/988510583 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627803c9f0 con 0x7f62840b1d70 2023-12-08T08:18:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.404+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62840ca480 con 0x7f62840b1d70 2023-12-08T08:18:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.405+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6284067430 con 0x7f62840b1d70 2023-12-08T08:18:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.405+0000 7f62817fa640 1 -- 172.21.15.50:0/988510583 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6278039070 con 0x7f62840b1d70 2023-12-08T08:18:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.406+0000 7f62817fa640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f627006ae40 0x7f627006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.406+0000 7f62817fa640 1 -- 172.21.15.50:0/988510583 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62780aae10 con 0x7f62840b1d70 2023-12-08T08:18:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.406+0000 7f6288add640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f627006ae40 0x7f627006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.407+0000 7f6288add640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f627006ae40 0x7f627006d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f627c001560 tx=0x7f627c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.410+0000 7f62817fa640 1 -- 172.21.15.50:0/988510583 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6278075c80 con 0x7f62840b1d70 2023-12-08T08:18:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.590+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62840b22f0 con 0x7f62840b1d70 2023-12-08T08:18:07.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.591+0000 7f62817fa640 1 -- 172.21.15.50:0/988510583 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f627804a090 con 0x7f62840b1d70 2023-12-08T08:18:07.594 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:07.594 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.593+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f627006ae40 msgr2=0x7f627006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.593+0000 7f628ad41640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f627006ae40 0x7f627006d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f627c001560 tx=0x7f627c009040 comp rx=0 tx=0).stop 2023-12-08T08:18:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.593+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62840b1d70 msgr2=0x7f62840c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.593+0000 7f628ad41640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62840b1d70 0x7f62840c83a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6278000c00 tx=0x7f62780046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 shutdown_connections 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f627006ae40 0x7f627006d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62840b1d70 0x7f62840c83a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62841608a0 0x7f62840c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 --2- 172.21.15.50:0/988510583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62840b0cf0 0x7f62840cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 >> 172.21.15.50:0/988510583 conn(0x7f62840d3030 msgr2=0x7f62840ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 shutdown_connections 2023-12-08T08:18:07.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.594+0000 7f628ad41640 1 -- 172.21.15.50:0/988510583 wait complete. 2023-12-08T08:18:07.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:07.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.714+0000 7f1761b39640 1 Processor -- start 2023-12-08T08:18:07.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.714+0000 7f1761b39640 1 -- start start 2023-12-08T08:18:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.715+0000 7f1761b39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c0b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.715+0000 7f1761b39640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c0ceba0 con 0x7f175c15e6a0 2023-12-08T08:18:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.715+0000 7f1761b39640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c0cee80 con 0x7f175c0d1950 2023-12-08T08:18:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.715+0000 7f1761b39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0cbcb0 con 0x7f175c0b3c80 2023-12-08T08:18:07.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.715+0000 7f175b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f175c15e6a0 0x7f175c0ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39216/0 (socket says 172.21.15.50:39216) 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.715+0000 7f175b7fe640 1 -- 172.21.15.50:0/215182665 learned_addr learned my addr 172.21.15.50:0/215182665 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175bfff640 1 --2- 172.21.15.50:0/215182665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c0b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541569749 0 0) 0x7f175c0ceba0 con 0x7f175c15e6a0 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1744003520 con 0x7f175c15e6a0 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693708400 0 0) 0x7f175c0cee80 con 0x7f175c0d1950 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f175c0ceba0 con 0x7f175c0d1950 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2449997561 0 0) 0x7f1744003520 con 0x7f175c15e6a0 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175bfff640 1 -- 172.21.15.50:0/215182665 >> v1:172.21.15.170:6789/0 conn(0x7f175c0d1950 legacy=0x7f175c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175bfff640 1 -- 172.21.15.50:0/215182665 >> v1:172.21.15.50:6789/0 conn(0x7f175c15e6a0 legacy=0x7f175c0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.716+0000 7f175bfff640 1 -- 172.21.15.50:0/215182665 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0cbf90 con 0x7f175c0b3c80 2023-12-08T08:18:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f175bfff640 1 --2- 172.21.15.50:0/215182665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c0b4110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1754009dc0 tx=0x7f175402bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e788cb6deda7d76e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c001670 con 0x7f175c0b3c80 2023-12-08T08:18:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175402c910 con 0x7f175c0b3c80 2023-12-08T08:18:07.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f175a7fc640 1 -- 172.21.15.50:0/215182665 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175402cca0 con 0x7f175c0b3c80 2023-12-08T08:18:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f1761b39640 1 -- 172.21.15.50:0/215182665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 msgr2=0x7f175c0b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f1761b39640 1 --2- 172.21.15.50:0/215182665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c0b4110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1754009dc0 tx=0x7f175402bde0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f1761b39640 1 -- 172.21.15.50:0/215182665 shutdown_connections 2023-12-08T08:18:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f1761b39640 1 --2- 172.21.15.50:0/215182665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c0b4110 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f1761b39640 1 -- 172.21.15.50:0/215182665 >> 172.21.15.50:0/215182665 conn(0x7f175c0d0e30 msgr2=0x7f175c0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.717+0000 7f1761b39640 1 -- 172.21.15.50:0/215182665 shutdown_connections 2023-12-08T08:18:07.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.718+0000 7f1761b39640 1 -- 172.21.15.50:0/215182665 wait complete. 2023-12-08T08:18:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.719+0000 7f1761b39640 1 Processor -- start 2023-12-08T08:18:07.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.719+0000 7f1761b39640 1 -- start start 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1761b39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1761b39640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175c0d1950 0x7f175c0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1761b39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e6a0 0x7f175c0b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1761b39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c150a50 con 0x7f175c15e6a0 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1761b39640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c151430 con 0x7f175c0d1950 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1761b39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0c5b20 con 0x7f175c0b3c80 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e6a0 0x7f175c0b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e6a0 0x7f175c0b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49582/0 (socket says 172.21.15.50:49582) 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 -- 172.21.15.50:0/2973145955 learned_addr learned my addr 172.21.15.50:0/2973145955 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175b7fe640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175affd640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175c0d1950 0x7f175c0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 -- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 msgr2=0x7f175c14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 -- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175c0d1950 msgr2=0x7f175c0c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175c0d1950 0x7f175c0c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 -- 172.21.15.50:0/2973145955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754009a70 con 0x7f175c15e6a0 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175b7fe640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f175bfff640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e6a0 0x7f175c0b5140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1754009ee0 tx=0x7f1754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1743fff640 1 -- 172.21.15.50:0/2973145955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754034e50 con 0x7f175c15e6a0 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1743fff640 1 -- 172.21.15.50:0/2973145955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1754009450 con 0x7f175c15e6a0 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.720+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c150fa0 con 0x7f175c15e6a0 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.721+0000 7f1743fff640 1 -- 172.21.15.50:0/2973145955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754040690 con 0x7f175c15e6a0 2023-12-08T08:18:07.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.721+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c0c5560 con 0x7f175c15e6a0 2023-12-08T08:18:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.722+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c0ce850 con 0x7f175c15e6a0 2023-12-08T08:18:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.722+0000 7f1743fff640 1 -- 172.21.15.50:0/2973145955 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17540407f0 con 0x7f175c15e6a0 2023-12-08T08:18:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.723+0000 7f1743fff640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f174806ae40 0x7f174806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.723+0000 7f1743fff640 1 -- 172.21.15.50:0/2973145955 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17540ac2d0 con 0x7f175c15e6a0 2023-12-08T08:18:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.723+0000 7f175b7fe640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f174806ae40 0x7f174806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:07.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.723+0000 7f175b7fe640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f174806ae40 0x7f174806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f174c000f60 tx=0x7f174c0016b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:07.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.727+0000 7f1743fff640 1 -- 172.21.15.50:0/2973145955 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17540770b0 con 0x7f175c15e6a0 2023-12-08T08:18:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.900+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f175c151130 con 0x7f175c15e6a0 2023-12-08T08:18:07.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.901+0000 7f1743fff640 1 -- 172.21.15.50:0/2973145955 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f175407a6d0 con 0x7f175c15e6a0 2023-12-08T08:18:07.903 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f174806ae40 msgr2=0x7f174806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f174806ae40 0x7f174806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f174c000f60 tx=0x7f174c0016b0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e6a0 msgr2=0x7f175c0b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e6a0 0x7f175c0b5140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1754009ee0 tx=0x7f1754004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 shutdown_connections 2023-12-08T08:18:07.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f174806ae40 0x7f174806d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f175c15e6a0 0x7f175c0b5140 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f175c0d1950 0x7f175c0c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 --2- 172.21.15.50:0/2973145955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f175c0b3c80 0x7f175c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 >> 172.21.15.50:0/2973145955 conn(0x7f175c0d0e30 msgr2=0x7f175c0cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 shutdown_connections 2023-12-08T08:18:07.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:07.903+0000 7f1761b39640 1 -- 172.21.15.50:0/2973145955 wait complete. 2023-12-08T08:18:07.915 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:08.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.022+0000 7f11aa797640 1 Processor -- start 2023-12-08T08:18:08.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.022+0000 7f11aa797640 1 -- start start 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11aa797640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11a40d1950 0x7f11a40cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11aa797640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f11a40cc9f0 0x7f11a40b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11aa797640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a40ceba0 con 0x7f11a415e6a0 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11aa797640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a40cee80 con 0x7f11a40d1950 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11aa797640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a40cbcb0 con 0x7f11a40cc9f0 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11a37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11a40d1950 0x7f11a40cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11a37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11a40d1950 0x7f11a40cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49586/0 (socket says 172.21.15.50:49586) 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.023+0000 7f11a37fe640 1 -- 172.21.15.50:0/3221744731 learned_addr learned my addr 172.21.15.50:0/3221744731 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.024+0000 7f11a8d34640 1 --2- 172.21.15.50:0/3221744731 >> v2:172.21.15.170:3300/0 conn(0x7f11a40cc9f0 0x7f11a40b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.024+0000 7f11a37fe640 1 -- 172.21.15.50:0/3221744731 >> v2:172.21.15.170:3300/0 conn(0x7f11a40cc9f0 msgr2=0x7f11a40b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.024+0000 7f11a37fe640 1 --2- 172.21.15.50:0/3221744731 >> v2:172.21.15.170:3300/0 conn(0x7f11a40cc9f0 0x7f11a40b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.024+0000 7f11a37fe640 1 -- 172.21.15.50:0/3221744731 >> v1:172.21.15.170:6789/0 conn(0x7f11a415e6a0 legacy=0x7f11a40ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.024+0000 7f11a37fe640 1 -- 172.21.15.50:0/3221744731 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a40cbf90 con 0x7f11a40d1950 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11a37fe640 1 --2- 172.21.15.50:0/3221744731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a40cc4b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11a4072690 tx=0x7f119802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7162d39758d96cd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11a2ffd640 1 -- 172.21.15.50:0/3221744731 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198030860 con 0x7f11a40d1950 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11a2ffd640 1 -- 172.21.15.50:0/3221744731 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11980309c0 con 0x7f11a40d1950 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11a2ffd640 1 -- 172.21.15.50:0/3221744731 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198030d50 con 0x7f11a40d1950 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 -- 172.21.15.50:0/3221744731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 msgr2=0x7f11a40cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 --2- 172.21.15.50:0/3221744731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a40cc4b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11a4072690 tx=0x7f119802b9a0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 -- 172.21.15.50:0/3221744731 shutdown_connections 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 --2- 172.21.15.50:0/3221744731 >> v2:172.21.15.170:3300/0 conn(0x7f11a40cc9f0 0x7f11a40b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 --2- 172.21.15.50:0/3221744731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a40cc4b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 -- 172.21.15.50:0/3221744731 >> 172.21.15.50:0/3221744731 conn(0x7f11a40d0e30 msgr2=0x7f11a40d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 -- 172.21.15.50:0/3221744731 shutdown_connections 2023-12-08T08:18:08.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.025+0000 7f11aa797640 1 -- 172.21.15.50:0/3221744731 wait complete. 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.026+0000 7f11aa797640 1 Processor -- start 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11aa797640 1 -- start start 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11aa797640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11a40cc9f0 0x7f11a41f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11aa797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a4154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11aa797640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11a415e6a0 0x7f11a40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11aa797640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a41f4210 con 0x7f11a40d1950 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11aa797640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a406d660 con 0x7f11a40cc9f0 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11aa797640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a41f7580 con 0x7f11a415e6a0 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a4154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11a37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a4154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49588/0 (socket says 172.21.15.50:49588) 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.027+0000 7f11a37fe640 1 -- 172.21.15.50:0/971871812 learned_addr learned my addr 172.21.15.50:0/971871812 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a3fff640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11a40cc9f0 0x7f11a41f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a8d34640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11a415e6a0 0x7f11a40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a37fe640 1 -- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11a415e6a0 msgr2=0x7f11a40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a37fe640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11a415e6a0 0x7f11a40ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a37fe640 1 -- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11a40cc9f0 msgr2=0x7f11a41f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a37fe640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11a40cc9f0 0x7f11a41f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a37fe640 1 -- 172.21.15.50:0/971871812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980094d0 con 0x7f11a40d1950 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a37fe640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a4154590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a0ff9640 1 -- 172.21.15.50:0/971871812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198039d60 con 0x7f11a40d1950 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a0ff9640 1 -- 172.21.15.50:0/971871812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198043400 con 0x7f11a40d1950 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a41f6970 con 0x7f11a40d1950 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11a0ff9640 1 -- 172.21.15.50:0/971871812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980437b0 con 0x7f11a40d1950 2023-12-08T08:18:08.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.028+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a41f6f30 con 0x7f11a40d1950 2023-12-08T08:18:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.029+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a41f76f0 con 0x7f11a40d1950 2023-12-08T08:18:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.030+0000 7f11a0ff9640 1 -- 172.21.15.50:0/971871812 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1198043910 con 0x7f11a40d1950 2023-12-08T08:18:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.030+0000 7f11a0ff9640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f119006ae40 0x7f119006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.030+0000 7f11a0ff9640 1 -- 172.21.15.50:0/971871812 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f119803e070 con 0x7f11a40d1950 2023-12-08T08:18:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.031+0000 7f11a3fff640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f119006ae40 0x7f119006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.031+0000 7f11a3fff640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f119006ae40 0x7f119006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11a406d2a0 tx=0x7f1194009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.034+0000 7f11a0ff9640 1 -- 172.21.15.50:0/971871812 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1198077940 con 0x7f11a40d1950 2023-12-08T08:18:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.209+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11a4067ad0 con 0x7f11a40d1950 2023-12-08T08:18:08.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.210+0000 7f11a0ff9640 1 -- 172.21.15.50:0/971871812 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f119807af60 con 0x7f11a40d1950 2023-12-08T08:18:08.212 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:08.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f119006ae40 msgr2=0x7f119006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f119006ae40 0x7f119006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11a406d2a0 tx=0x7f1194009040 comp rx=0 tx=0).stop 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 msgr2=0x7f11a4154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a4154590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1198000c00 tx=0x7f1198004730 comp rx=0 tx=0).stop 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 shutdown_connections 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f119006ae40 0x7f119006d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11a40d1950 0x7f11a4154590 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11a415e6a0 0x7f11a40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 --2- 172.21.15.50:0/971871812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11a40cc9f0 0x7f11a41f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 >> 172.21.15.50:0/971871812 conn(0x7f11a40d0e30 msgr2=0x7f11a406e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 shutdown_connections 2023-12-08T08:18:08.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.212+0000 7f11aa797640 1 -- 172.21.15.50:0/971871812 wait complete. 2023-12-08T08:18:08.224 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.331+0000 7f6b265e5640 1 Processor -- start 2023-12-08T08:18:08.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.331+0000 7f6b265e5640 1 -- start start 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b265e5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6b200cf570 0x7f6b200cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b265e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200b6c50 0x7f6b200b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b265e5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b200cfef0 con 0x7f6b200b8950 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b265e5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b200b5f00 con 0x7f6b200cf570 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b265e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200b6170 con 0x7f6b200b6c50 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b1ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6b200b8950 0x7f6b200ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39220/0 (socket says 172.21.15.50:39220) 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b1ffff640 1 -- 172.21.15.50:0/3637099383 learned_addr learned my addr 172.21.15.50:0/3637099383 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b1f7fe640 1 --2- 172.21.15.50:0/3637099383 >> v2:172.21.15.50:3300/0 conn(0x7f6b200cf570 0x7f6b200cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b24b82640 1 --2- 172.21.15.50:0/3637099383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200b6c50 0x7f6b200b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b1f7fe640 1 -- 172.21.15.50:0/3637099383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200b6c50 msgr2=0x7f6b200b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b1f7fe640 1 --2- 172.21.15.50:0/3637099383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200b6c50 0x7f6b200b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.332+0000 7f6b1f7fe640 1 -- 172.21.15.50:0/3637099383 >> v1:172.21.15.50:6789/0 conn(0x7f6b200b8950 legacy=0x7f6b200ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.333+0000 7f6b1effd640 1 -- 172.21.15.50:0/3637099383 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479828525 0 0) 0x7f6b200cfef0 con 0x7f6b200b8950 2023-12-08T08:18:08.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.333+0000 7f6b1f7fe640 1 -- 172.21.15.50:0/3637099383 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200b6450 con 0x7f6b200cf570 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.333+0000 7f6b1f7fe640 1 --2- 172.21.15.50:0/3637099383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200cf570 0x7f6b200cf9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b100097a0 tx=0x7f6b1002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353254d321f537db server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.333+0000 7f6b1effd640 1 -- 172.21.15.50:0/3637099383 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1002e070 con 0x7f6b200cf570 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.333+0000 7f6b1effd640 1 -- 172.21.15.50:0/3637099383 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b100315a0 con 0x7f6b200cf570 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.333+0000 7f6b1effd640 1 -- 172.21.15.50:0/3637099383 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10031930 con 0x7f6b200cf570 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 -- 172.21.15.50:0/3637099383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200cf570 msgr2=0x7f6b200cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 --2- 172.21.15.50:0/3637099383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200cf570 0x7f6b200cf9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b100097a0 tx=0x7f6b1002b840 comp rx=0 tx=0).stop 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 -- 172.21.15.50:0/3637099383 shutdown_connections 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 --2- 172.21.15.50:0/3637099383 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200b6c50 0x7f6b200b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 --2- 172.21.15.50:0/3637099383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200cf570 0x7f6b200cf9b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 -- 172.21.15.50:0/3637099383 >> 172.21.15.50:0/3637099383 conn(0x7f6b200d3010 msgr2=0x7f6b200d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 -- 172.21.15.50:0/3637099383 shutdown_connections 2023-12-08T08:18:08.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.334+0000 7f6b265e5640 1 -- 172.21.15.50:0/3637099383 wait complete. 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.335+0000 7f6b265e5640 1 Processor -- start 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.335+0000 7f6b265e5640 1 -- start start 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b265e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200b6c50 0x7f6b201f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b265e5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b200b8950 0x7f6b200ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b265e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200cf570 0x7f6b20155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b265e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b201551f0 con 0x7f6b200b6c50 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b265e5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20156e90 con 0x7f6b200b8950 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b265e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b201545e0 con 0x7f6b200cf570 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b1ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200b6c50 0x7f6b201f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b1ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200b6c50 0x7f6b201f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49600/0 (socket says 172.21.15.50:49600) 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b1ffff640 1 -- 172.21.15.50:0/2270720015 learned_addr learned my addr 172.21.15.50:0/2270720015 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b1f7fe640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b200b8950 0x7f6b200ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.336+0000 7f6b24b82640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200cf570 0x7f6b20155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1ffff640 1 -- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200cf570 msgr2=0x7f6b20155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1ffff640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200cf570 0x7f6b20155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1ffff640 1 -- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b200b8950 msgr2=0x7f6b200ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1ffff640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b200b8950 0x7f6b200ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1ffff640 1 -- 172.21.15.50:0/2270720015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10009400 con 0x7f6b200b6c50 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1ffff640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200b6c50 0x7f6b201f5d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400c4d0 tx=0x7f6b1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1cff9640 1 -- 172.21.15.50:0/2270720015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b140074e0 con 0x7f6b200b6c50 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1cff9640 1 -- 172.21.15.50:0/2270720015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b14007660 con 0x7f6b200b6c50 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b201548c0 con 0x7f6b200b6c50 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b1cff9640 1 -- 172.21.15.50:0/2270720015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14004a20 con 0x7f6b200b6c50 2023-12-08T08:18:08.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.337+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b20154e80 con 0x7f6b200b6c50 2023-12-08T08:18:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.338+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2008b150 con 0x7f6b200b6c50 2023-12-08T08:18:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.338+0000 7f6b1cff9640 1 -- 172.21.15.50:0/2270720015 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b14004b80 con 0x7f6b200b6c50 2023-12-08T08:18:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.339+0000 7f6b1cff9640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6b0c06ae40 0x7f6b0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.339+0000 7f6b1cff9640 1 -- 172.21.15.50:0/2270720015 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b14088cf0 con 0x7f6b200b6c50 2023-12-08T08:18:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.339+0000 7f6b1f7fe640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6b0c06ae40 0x7f6b0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.340+0000 7f6b1f7fe640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6b0c06ae40 0x7f6b0c06d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b10036000 tx=0x7f6b1003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.343+0000 7f6b1cff9640 1 -- 172.21.15.50:0/2270720015 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b1408d070 con 0x7f6b200b6c50 2023-12-08T08:18:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.518+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b20067430 con 0x7f6b200b6c50 2023-12-08T08:18:08.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.519+0000 7f6b1cff9640 1 -- 172.21.15.50:0/2270720015 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b14018020 con 0x7f6b200b6c50 2023-12-08T08:18:08.521 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6b0c06ae40 msgr2=0x7f6b0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6b0c06ae40 0x7f6b0c06d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b10036000 tx=0x7f6b1003d040 comp rx=0 tx=0).stop 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200b6c50 msgr2=0x7f6b201f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200b6c50 0x7f6b201f5d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400c4d0 tx=0x7f6b1400c990 comp rx=0 tx=0).stop 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 shutdown_connections 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6b0c06ae40 0x7f6b0c06d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6b200cf570 0x7f6b20155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b200b8950 0x7f6b200ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 --2- 172.21.15.50:0/2270720015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6b200b6c50 0x7f6b201f5d40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 >> 172.21.15.50:0/2270720015 conn(0x7f6b200d3010 msgr2=0x7f6b200d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 shutdown_connections 2023-12-08T08:18:08.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.521+0000 7f6b265e5640 1 -- 172.21.15.50:0/2270720015 wait complete. 2023-12-08T08:18:08.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:08.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.640+0000 7fb4240d4640 1 Processor -- start 2023-12-08T08:18:08.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.641+0000 7fb4240d4640 1 -- start start 2023-12-08T08:18:08.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.641+0000 7fb4240d4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb41c06d7d0 0x7fb41c164d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.641+0000 7fb4240d4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c0b2b60 con 0x7fb41c157a20 2023-12-08T08:18:08.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.641+0000 7fb4240d4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c15e7f0 con 0x7fb41c0cb370 2023-12-08T08:18:08.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.641+0000 7fb4240d4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41c157e00 con 0x7fb41c06d7d0 2023-12-08T08:18:08.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.641+0000 7fb422671640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb41c06d7d0 0x7fb41c164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.642+0000 7fb421e70640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb41c157a20 0x7fb41c15d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39228/0 (socket says 172.21.15.50:39228) 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.642+0000 7fb422671640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb41c06d7d0 0x7fb41c164d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49612/0 (socket says 172.21.15.50:49612) 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.642+0000 7fb421e70640 1 -- 172.21.15.50:0/140958843 learned_addr learned my addr 172.21.15.50:0/140958843 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.642+0000 7fb422671640 1 -- 172.21.15.50:0/140958843 >> v1:172.21.15.170:6789/0 conn(0x7fb41c0cb370 legacy=0x7fb41c15e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.642+0000 7fb422671640 1 -- 172.21.15.50:0/140958843 >> v1:172.21.15.50:6789/0 conn(0x7fb41c157a20 legacy=0x7fb41c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.642+0000 7fb422671640 1 -- 172.21.15.50:0/140958843 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c06dd20 con 0x7fb41c06d7d0 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb422671640 1 --2- 172.21.15.50:0/140958843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c06d7d0 0x7fb41c164d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0097a0 tx=0x7fb40c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c25590d7f5e6765 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb420e6e640 1 -- 172.21.15.50:0/140958843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c031830 con 0x7fb41c06d7d0 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb420e6e640 1 -- 172.21.15.50:0/140958843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c031990 con 0x7fb41c06d7d0 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb420e6e640 1 -- 172.21.15.50:0/140958843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c031d20 con 0x7fb41c06d7d0 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb4240d4640 1 -- 172.21.15.50:0/140958843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c06d7d0 msgr2=0x7fb41c164d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb4240d4640 1 --2- 172.21.15.50:0/140958843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c06d7d0 0x7fb41c164d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0097a0 tx=0x7fb40c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb4240d4640 1 -- 172.21.15.50:0/140958843 shutdown_connections 2023-12-08T08:18:08.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb4240d4640 1 --2- 172.21.15.50:0/140958843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c06d7d0 0x7fb41c164d60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb4240d4640 1 -- 172.21.15.50:0/140958843 >> 172.21.15.50:0/140958843 conn(0x7fb41c0b0850 msgr2=0x7fb41c0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb4240d4640 1 -- 172.21.15.50:0/140958843 shutdown_connections 2023-12-08T08:18:08.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.643+0000 7fb4240d4640 1 -- 172.21.15.50:0/140958843 wait complete. 2023-12-08T08:18:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 Processor -- start 2023-12-08T08:18:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 -- start start 2023-12-08T08:18:08.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb41c06d7d0 0x7fb41c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c0cb370 0x7fb41c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb41c157a20 0x7fb41c0af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c15d820 con 0x7fb41c0cb370 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c15d210 con 0x7fb41c06d7d0 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb4240d4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c156d70 con 0x7fb41c157a20 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb42166f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c0cb370 0x7fb41c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb42166f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c0cb370 0x7fb41c151ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49620/0 (socket says 172.21.15.50:49620) 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.645+0000 7fb42166f640 1 -- 172.21.15.50:0/834738299 learned_addr learned my addr 172.21.15.50:0/834738299 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb421e70640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb41c06d7d0 0x7fb41c15b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb42166f640 1 -- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb41c157a20 msgr2=0x7fb41c0af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb42166f640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb41c157a20 0x7fb41c0af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb42166f640 1 -- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb41c06d7d0 msgr2=0x7fb41c15b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb42166f640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb41c06d7d0 0x7fb41c15b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb42166f640 1 -- 172.21.15.50:0/834738299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c009400 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb42166f640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c0cb370 0x7fb41c151ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c430 tx=0x7fb41000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb41a7fc640 1 -- 172.21.15.50:0/834738299 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410011790 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb41a7fc640 1 -- 172.21.15.50:0/834738299 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4100118f0 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c157050 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb41a7fc640 1 -- 172.21.15.50:0/834738299 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410011ce0 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.646+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c152000 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.647+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c157290 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.647+0000 7fb41a7fc640 1 -- 172.21.15.50:0/834738299 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb41001c460 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.648+0000 7fb41a7fc640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb40806ae70 0x7fb40806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.648+0000 7fb41a7fc640 1 -- 172.21.15.50:0/834738299 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb410089800 con 0x7fb41c0cb370 2023-12-08T08:18:08.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.648+0000 7fb421e70640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb40806ae70 0x7fb40806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.648+0000 7fb421e70640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb40806ae70 0x7fb40806d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb414005c00 tx=0x7fb414009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.652+0000 7fb41a7fc640 1 -- 172.21.15.50:0/834738299 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb41c157290 con 0x7fb41c0cb370 2023-12-08T08:18:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.831+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb41c157290 con 0x7fb41c0cb370 2023-12-08T08:18:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.832+0000 7fb41a7fc640 1 -- 172.21.15.50:0/834738299 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb41c157290 con 0x7fb41c0cb370 2023-12-08T08:18:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb40806ae70 msgr2=0x7fb40806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb40806ae70 0x7fb40806d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb414005c00 tx=0x7fb414009040 comp rx=0 tx=0).stop 2023-12-08T08:18:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c0cb370 msgr2=0x7fb41c151ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c0cb370 0x7fb41c151ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb41000c430 tx=0x7fb41000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 shutdown_connections 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb40806ae70 0x7fb40806d330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb41c0cb370 0x7fb41c151ac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb41c157a20 0x7fb41c0af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 --2- 172.21.15.50:0/834738299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb41c06d7d0 0x7fb41c15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 >> 172.21.15.50:0/834738299 conn(0x7fb41c0b0850 msgr2=0x7fb41c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 shutdown_connections 2023-12-08T08:18:08.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.834+0000 7fb4240d4640 1 -- 172.21.15.50:0/834738299 wait complete. 2023-12-08T08:18:08.847 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:08.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.952+0000 7f8239f83640 1 Processor -- start 2023-12-08T08:18:08.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.952+0000 7f8239f83640 1 -- start start 2023-12-08T08:18:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f8239f83640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f82340b3340 0x7f82340d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f8239f83640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82340cdc20 con 0x7f82340d1d00 2023-12-08T08:18:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f8239f83640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82340d11d0 con 0x7f82340b3bf0 2023-12-08T08:18:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f8239f83640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82340d3a60 con 0x7f82340b3340 2023-12-08T08:18:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f8233fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f82340d1d00 0x7f82340ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39232/0 (socket says 172.21.15.50:39232) 2023-12-08T08:18:08.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f8233fff640 1 -- 172.21.15.50:0/1776237060 learned_addr learned my addr 172.21.15.50:0/1776237060 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428073330 0 0) 0x7f82340cdc20 con 0x7f82340d1d00 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f821c003520 con 0x7f82340d1d00 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.953+0000 7f82337fe640 1 --2- 172.21.15.50:0/1776237060 >> v2:172.21.15.170:3300/0 conn(0x7f82340b3340 0x7f82340d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 772570268 0 0) 0x7f821c003520 con 0x7f82340d1d00 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 >> v2:172.21.15.170:3300/0 conn(0x7f82340b3340 msgr2=0x7f82340d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 --2- 172.21.15.50:0/1776237060 >> v2:172.21.15.170:3300/0 conn(0x7f82340b3340 0x7f82340d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 >> v1:172.21.15.170:6789/0 conn(0x7f82340b3bf0 legacy=0x7f82340d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340d3d40 con 0x7f82340d1d00 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f822c0019f0 con 0x7f82340d1d00 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 >> v1:172.21.15.50:6789/0 conn(0x7f82340d1d00 legacy=0x7f82340ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f821c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f821c005180 0x7f821c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340d3a60 con 0x7f821c003970 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c00c120 con 0x7f821c005180 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c00c2e0 con 0x7f821c0047c0 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82337fe640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f821c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f8232ffd640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f8233fff640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f821c005180 0x7f821c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82337fe640 1 -- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f821c0047c0 msgr2=0x7f821c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82337fe640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82337fe640 1 -- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f821c005180 msgr2=0x7f821c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82337fe640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f821c005180 0x7f821c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f82337fe640 1 -- 172.21.15.50:0/1776237060 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c003520 con 0x7f821c003970 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f8232ffd640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f8233fff640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f821c005180 0x7f821c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.954+0000 7f8233fff640 1 -- 172.21.15.50:0/1776237060 reap_dead start 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.955+0000 7f82337fe640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f821c003d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8224009ac0 tx=0x7f821c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d3fbcd5d22d5f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.955+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822402c6b0 con 0x7f821c003970 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.955+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822402c810 con 0x7f821c003970 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.955+0000 7f82327fc640 1 -- 172.21.15.50:0/1776237060 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822402cba0 con 0x7f821c003970 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.956+0000 7f8239f83640 1 -- 172.21.15.50:0/1776237060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 msgr2=0x7f821c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.956+0000 7f8239f83640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f821c003d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8224009ac0 tx=0x7f821c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.956+0000 7f8239f83640 1 -- 172.21.15.50:0/1776237060 shutdown_connections 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.956+0000 7f8239f83640 1 --2- 172.21.15.50:0/1776237060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f821c003d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.956+0000 7f8239f83640 1 -- 172.21.15.50:0/1776237060 >> 172.21.15.50:0/1776237060 conn(0x7f823409c2f0 msgr2=0x7f82340d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.956+0000 7f8239f83640 1 -- 172.21.15.50:0/1776237060 shutdown_connections 2023-12-08T08:18:08.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.956+0000 7f8239f83640 1 -- 172.21.15.50:0/1776237060 wait complete. 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.957+0000 7f8239f83640 1 Processor -- start 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.957+0000 7f8239f83640 1 -- start start 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f823415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f823415e780 0x7f823415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82340b7780 0x7f82340b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823415afd0 con 0x7f821c003970 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823415f140 con 0x7f82340b7780 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82340b8140 con 0x7f823415e780 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f823415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f823415a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49638/0 (socket says 172.21.15.50:49638) 2023-12-08T08:18:08.964 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 -- 172.21.15.50:0/3660171187 learned_addr learned my addr 172.21.15.50:0/3660171187 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8233fff640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82340b7780 0x7f82340b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8232ffd640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f823415e780 0x7f823415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 -- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f823415e780 msgr2=0x7f823415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f823415e780 0x7f823415ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 -- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82340b7780 msgr2=0x7f82340b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82340b7780 0x7f82340b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 -- 172.21.15.50:0/3660171187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823415ac70 con 0x7f821c003970 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8233fff640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82340b7780 0x7f82340b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8232ffd640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f823415e780 0x7f823415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f82337fe640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f823415a730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8224037040 tx=0x7f8224004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f821bfff640 1 -- 172.21.15.50:0/3660171187 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224003810 con 0x7f821c003970 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f821bfff640 1 -- 172.21.15.50:0/3660171187 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224003970 con 0x7f821c003970 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340b5f70 con 0x7f821c003970 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f821bfff640 1 -- 172.21.15.50:0/3660171187 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224003d00 con 0x7f821c003970 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.958+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82340b8640 con 0x7f821c003970 2023-12-08T08:18:08.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.960+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823415b240 con 0x7f821c003970 2023-12-08T08:18:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.960+0000 7f821bfff640 1 -- 172.21.15.50:0/3660171187 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8224034440 con 0x7f821c003970 2023-12-08T08:18:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.960+0000 7f821bfff640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f822006ae70 0x7f822006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.961+0000 7f821bfff640 1 -- 172.21.15.50:0/3660171187 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82240ab9a0 con 0x7f821c003970 2023-12-08T08:18:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.961+0000 7f8232ffd640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f822006ae70 0x7f822006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:08.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.961+0000 7f8232ffd640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f822006ae70 0x7f822006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f8228009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:08.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:08.965+0000 7f821bfff640 1 -- 172.21.15.50:0/3660171187 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82240769c0 con 0x7f821c003970 2023-12-08T08:18:09.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.157+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8234067430 con 0x7f821c003970 2023-12-08T08:18:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.157+0000 7f821bfff640 1 -- 172.21.15.50:0/3660171187 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8224079fe0 con 0x7f821c003970 2023-12-08T08:18:09.160 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f822006ae70 msgr2=0x7f822006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f822006ae70 0x7f822006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f8228009040 comp rx=0 tx=0).stop 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 msgr2=0x7f823415a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f823415a730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8224037040 tx=0x7f8224004730 comp rx=0 tx=0).stop 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 shutdown_connections 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f822006ae70 0x7f822006d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82340b7780 0x7f82340b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f823415e780 0x7f823415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 --2- 172.21.15.50:0/3660171187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f821c003970 0x7f823415a730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 >> 172.21.15.50:0/3660171187 conn(0x7f823409c2f0 msgr2=0x7f82340ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 shutdown_connections 2023-12-08T08:18:09.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.159+0000 7f8239f83640 1 -- 172.21.15.50:0/3660171187 wait complete. 2023-12-08T08:18:09.172 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:09.172 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:09.188 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:09.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.332+0000 7f3c90f39640 1 Processor -- start 2023-12-08T08:18:09.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.332+0000 7f3c90f39640 1 -- start start 2023-12-08T08:18:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.332+0000 7f3c90f39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 0x7f3c8c0d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.332+0000 7f3c90f39640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c15ee90 con 0x7f3c8c0d3ad0 2023-12-08T08:18:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.332+0000 7f3c90f39640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c0d0fe0 con 0x7f3c8c15f890 2023-12-08T08:18:09.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.332+0000 7f3c90f39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0d1280 con 0x7f3c8c15d580 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c81d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c8c0d3ad0 0x7f3c8c15f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39244/0 (socket says 172.21.15.50:39244) 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c81d9b640 1 -- 172.21.15.50:0/1781467873 learned_addr learned my addr 172.21.15.50:0/1781467873 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c8a59c640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 0x7f3c8c0d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412495353 0 0) 0x7f3c8c15ee90 con 0x7f3c8c0d3ad0 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c78003520 con 0x7f3c8c0d3ad0 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4114222461 0 0) 0x7f3c78003520 con 0x7f3c8c0d3ad0 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 msgr2=0x7f3c8c0d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 0x7f3c8c0d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 >> v1:172.21.15.170:6789/0 conn(0x7f3c8c15f890 legacy=0x7f3c8c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0d1560 con 0x7f3c8c0d3ad0 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f3c74001670 con 0x7f3c8c0d3ad0 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c8a59c640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 0x7f3c8c0d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:09.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 >> v1:172.21.15.50:6789/0 conn(0x7f3c8c0d3ad0 legacy=0x7f3c8c15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780039a0 0x7f3c78003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 0x7f3c780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c78004d00 0x7f3c78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0d1280 con 0x7f3c78004d00 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7800b9d0 con 0x7f3c780039a0 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7800bb90 con 0x7f3c8c15d580 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.333+0000 7f3c8ad9d640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c78004d00 0x7f3c78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.334+0000 7f3c81d9b640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 0x7f3c780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.334+0000 7f3c8a59c640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780039a0 0x7f3c78003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.334+0000 7f3c8ad9d640 1 -- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 msgr2=0x7f3c780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.334+0000 7f3c8ad9d640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c8c15d580 0x7f3c780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.334+0000 7f3c8ad9d640 1 -- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780039a0 msgr2=0x7f3c78003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.334+0000 7f3c8ad9d640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c780039a0 0x7f3c78003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.334+0000 7f3c8ad9d640 1 -- 172.21.15.50:0/1781467873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009400 con 0x7f3c78004d00 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c8ad9d640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c78004d00 0x7f3c78005180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001f60 tx=0x7f3c780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e2f0aa2ac1eccf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8402d6f0 con 0x7f3c78004d00 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8402d870 con 0x7f3c78004d00 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c89d9b640 1 -- 172.21.15.50:0/1781467873 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8402dc20 con 0x7f3c78004d00 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c90f39640 1 -- 172.21.15.50:0/1781467873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c78004d00 msgr2=0x7f3c78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c90f39640 1 --2- 172.21.15.50:0/1781467873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c78004d00 0x7f3c78005180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001f60 tx=0x7f3c780057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c8ad9d640 1 -- 172.21.15.50:0/1781467873 reap_dead start 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c90f39640 1 -- 172.21.15.50:0/1781467873 shutdown_connections 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c90f39640 1 -- 172.21.15.50:0/1781467873 >> 172.21.15.50:0/1781467873 conn(0x7f3c8c0d2fb0 msgr2=0x7f3c8c0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c90f39640 1 -- 172.21.15.50:0/1781467873 shutdown_connections 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.335+0000 7f3c90f39640 1 -- 172.21.15.50:0/1781467873 wait complete. 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.337+0000 7f3c90f39640 1 Processor -- start 2023-12-08T08:18:09.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.337+0000 7f3c90f39640 1 -- start start 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.337+0000 7f3c90f39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c78004d00 0x7f3c8c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.337+0000 7f3c90f39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8c156e10 0x7f3c8c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.337+0000 7f3c90f39640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c8c06b890 0x7f3c8c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c90f39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c06c250 con 0x7f3c8c156e10 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c90f39640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0cae40 con 0x7f3c8c06b890 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c90f39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c0ca9b0 con 0x7f3c78004d00 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8c156e10 0x7f3c8c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8c156e10 0x7f3c8c157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49646/0 (socket says 172.21.15.50:49646) 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 -- 172.21.15.50:0/3488874106 learned_addr learned my addr 172.21.15.50:0/3488874106 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c8a59c640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c78004d00 0x7f3c8c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c8ad9d640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c8c06b890 0x7f3c8c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 -- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c78004d00 msgr2=0x7f3c8c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c78004d00 0x7f3c8c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 -- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c8c06b890 msgr2=0x7f3c8c06bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c8c06b890 0x7f3c8c06bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 -- 172.21.15.50:0/3488874106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0ccf70 con 0x7f3c8c156e10 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c81d9b640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8c156e10 0x7f3c8c157450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c740072c0 tx=0x7f3c74007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c837fe640 1 -- 172.21.15.50:0/3488874106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400f960 con 0x7f3c8c156e10 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c837fe640 1 -- 172.21.15.50:0/3488874106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400fae0 con 0x7f3c8c156e10 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c15ad60 con 0x7f3c8c156e10 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c837fe640 1 -- 172.21.15.50:0/3488874106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400fe90 con 0x7f3c8c156e10 2023-12-08T08:18:09.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.338+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c0ca360 con 0x7f3c8c156e10 2023-12-08T08:18:09.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.339+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c0d09d0 con 0x7f3c8c156e10 2023-12-08T08:18:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.340+0000 7f3c837fe640 1 -- 172.21.15.50:0/3488874106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c7401d460 con 0x7f3c8c156e10 2023-12-08T08:18:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.340+0000 7f3c837fe640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c6c06ae40 0x7f3c6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.341+0000 7f3c837fe640 1 -- 172.21.15.50:0/3488874106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c740899e0 con 0x7f3c8c156e10 2023-12-08T08:18:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.341+0000 7f3c8a59c640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c6c06ae40 0x7f3c6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.341+0000 7f3c8a59c640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c6c06ae40 0x7f3c6c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009d40 tx=0x7f3c7c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.345+0000 7f3c837fe640 1 -- 172.21.15.50:0/3488874106 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c74054850 con 0x7f3c8c156e10 2023-12-08T08:18:09.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.520+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c8c067430 con 0x7f3c8c156e10 2023-12-08T08:18:09.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.521+0000 7f3c837fe640 1 -- 172.21.15.50:0/3488874106 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f3c74057e70 con 0x7f3c8c156e10 2023-12-08T08:18:09.524 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:09.524 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c6c06ae40 msgr2=0x7f3c6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c6c06ae40 0x7f3c6c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009d40 tx=0x7f3c7c009190 comp rx=0 tx=0).stop 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8c156e10 msgr2=0x7f3c8c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8c156e10 0x7f3c8c157450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c740072c0 tx=0x7f3c74007780 comp rx=0 tx=0).stop 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 shutdown_connections 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c6c06ae40 0x7f3c6c06d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c8c156e10 0x7f3c8c157450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c8c06b890 0x7f3c8c06bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 --2- 172.21.15.50:0/3488874106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c78004d00 0x7f3c8c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 >> 172.21.15.50:0/3488874106 conn(0x7f3c8c0d2fb0 msgr2=0x7f3c8c15e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 shutdown_connections 2023-12-08T08:18:09.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.523+0000 7f3c90f39640 1 -- 172.21.15.50:0/3488874106 wait complete. 2023-12-08T08:18:09.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:09.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:09.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.644+0000 7f4866a89640 1 Processor -- start 2023-12-08T08:18:09.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.644+0000 7f4866a89640 1 -- start start 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4866a89640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f48600d1200 0x7f48600d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4866a89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4866a89640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600b4370 con 0x7f48600ceb50 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4866a89640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600b48a0 con 0x7f48600d1200 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4866a89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600d1bf0 con 0x7f48600d0690 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f485ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4864825640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f48600d1200 0x7f48600d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f485ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600d3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:40450/0 (socket says 172.21.15.50:40450) 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f485ffff640 1 -- 172.21.15.50:0/2122739938 learned_addr learned my addr 172.21.15.50:0/2122739938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4865026640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f48600ceb50 0x7f4860160620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:54262/0 (socket says 172.21.15.50:54262) 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4864825640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f48600d1200 0x7f48600d15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:50684/0 (socket says 172.21.15.50:50684) 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4864825640 1 -- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 msgr2=0x7f48600d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4864825640 1 --2- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600d3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4864825640 1 -- 172.21.15.50:0/2122739938 >> v1:172.21.15.170:6789/0 conn(0x7f48600ceb50 legacy=0x7f4860160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f485f7fe640 1 -- 172.21.15.50:0/2122739938 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308962038 0 0) 0x7f48600b4370 con 0x7f48600ceb50 2023-12-08T08:18:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f4864825640 1 -- 172.21.15.50:0/2122739938 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600d2170 con 0x7f48600d1200 2023-12-08T08:18:09.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.645+0000 7f485ffff640 1 --2- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.646+0000 7f4864825640 1 --2- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600d15e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48540097a0 tx=0x7f485402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc9a6995c8adba22 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.646+0000 7f485f7fe640 1 -- 172.21.15.50:0/2122739938 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485402e070 con 0x7f48600d1200 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.646+0000 7f485f7fe640 1 -- 172.21.15.50:0/2122739938 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48540315a0 con 0x7f48600d1200 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.646+0000 7f485f7fe640 1 -- 172.21.15.50:0/2122739938 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854031930 con 0x7f48600d1200 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 -- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 msgr2=0x7f48600d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 --2- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600d15e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48540097a0 tx=0x7f485402b840 comp rx=0 tx=0).stop 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 -- 172.21.15.50:0/2122739938 shutdown_connections 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 --2- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 --2- 172.21.15.50:0/2122739938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600d15e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 -- 172.21.15.50:0/2122739938 >> 172.21.15.50:0/2122739938 conn(0x7f48600d3090 msgr2=0x7f48600d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 -- 172.21.15.50:0/2122739938 shutdown_connections 2023-12-08T08:18:09.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.647+0000 7f4866a89640 1 -- 172.21.15.50:0/2122739938 wait complete. 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.648+0000 7f4866a89640 1 Processor -- start 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.648+0000 7f4866a89640 1 -- start start 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4866a89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48600ceb50 0x7f48600ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4866a89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4866a89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600cf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4866a89640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600cd010 con 0x7f48600ceb50 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4866a89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600caea0 con 0x7f48600d1200 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4866a89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600ca600 con 0x7f48600d0690 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4864825640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48600ceb50 0x7f48600ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4864825640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48600ceb50 0x7f48600ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:49652/0 (socket says 172.21.15.50:49652) 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4864825640 1 -- 172.21.15.50:0/4269856683 learned_addr learned my addr 172.21.15.50:0/4269856683 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f4865026640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.649+0000 7f485ffff640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4864825640 1 -- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 msgr2=0x7f48600b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4864825640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4864825640 1 -- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 msgr2=0x7f48600cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4864825640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4864825640 1 -- 172.21.15.50:0/4269856683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0094d0 con 0x7f48600ceb50 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f485ffff640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4865026640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4864825640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48600ceb50 0x7f48600ccad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48540097a0 tx=0x7f48540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f485d7fa640 1 -- 172.21.15.50:0/4269856683 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854004230 con 0x7f48600ceb50 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f485d7fa640 1 -- 172.21.15.50:0/4269856683 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854004390 con 0x7f48600ceb50 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4854009400 con 0x7f48600ceb50 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f485d7fa640 1 -- 172.21.15.50:0/4269856683 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854003850 con 0x7f48600ceb50 2023-12-08T08:18:09.654 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.650+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600cabc0 con 0x7f48600ceb50 2023-12-08T08:18:09.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.651+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860067430 con 0x7f48600ceb50 2023-12-08T08:18:09.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.651+0000 7f485d7fa640 1 -- 172.21.15.50:0/4269856683 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f48540039b0 con 0x7f48600ceb50 2023-12-08T08:18:09.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.652+0000 7f485d7fa640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f484406ae40 0x7f484406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.652+0000 7f485d7fa640 1 -- 172.21.15.50:0/4269856683 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48540aba00 con 0x7f48600ceb50 2023-12-08T08:18:09.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.652+0000 7f485ffff640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f484406ae40 0x7f484406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.655 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.652+0000 7f485ffff640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f484406ae40 0x7f484406d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48600c9980 tx=0x7f484c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.656+0000 7f485d7fa640 1 -- 172.21.15.50:0/4269856683 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4854076730 con 0x7f48600ceb50 2023-12-08T08:18:09.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.831+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48600cf140 con 0x7f48600ceb50 2023-12-08T08:18:09.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.832+0000 7f485d7fa640 1 -- 172.21.15.50:0/4269856683 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4854079d50 con 0x7f48600ceb50 2023-12-08T08:18:09.834 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.833+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f484406ae40 msgr2=0x7f484406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.833+0000 7f4866a89640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f484406ae40 0x7f484406d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48600c9980 tx=0x7f484c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.833+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48600ceb50 msgr2=0x7f48600ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.833+0000 7f4866a89640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48600ceb50 0x7f48600ccad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f48540097a0 tx=0x7f48540046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.833+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 shutdown_connections 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.834+0000 7f4866a89640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f484406ae40 0x7f484406d300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.834+0000 7f4866a89640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48600d1200 0x7f48600cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.834+0000 7f4866a89640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48600d0690 0x7f48600b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.834+0000 7f4866a89640 1 --2- 172.21.15.50:0/4269856683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48600ceb50 0x7f48600ccad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.834+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 >> 172.21.15.50:0/4269856683 conn(0x7f48600d3090 msgr2=0x7f486015f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.834+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 shutdown_connections 2023-12-08T08:18:09.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.834+0000 7f4866a89640 1 -- 172.21.15.50:0/4269856683 wait complete. 2023-12-08T08:18:09.846 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93e26e7640 1 Processor -- start 2023-12-08T08:18:09.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93e26e7640 1 -- start start 2023-12-08T08:18:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93e26e7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93dc071130 0x7f93dc0715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93e26e7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f93dc06f0c0 0x7f93dc06f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93e26e7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93dc06e300 con 0x7f93dc159c50 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93e26e7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc06e110 con 0x7f93dc071130 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93e26e7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93dc071b00 con 0x7f93dc06f0c0 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.957+0000 7f93db7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93dc071130 0x7f93dc0715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.958+0000 7f93db7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93dc071130 0x7f93dc0715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51120/0 (socket says 172.21.15.50:51120) 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.958+0000 7f93db7fe640 1 -- 172.21.15.50:0/2060547366 learned_addr learned my addr 172.21.15.50:0/2060547366 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.958+0000 7f93e0c84640 1 --2- 172.21.15.50:0/2060547366 >> v2:172.21.15.170:3300/0 conn(0x7f93dc06f0c0 0x7f93dc06f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.958+0000 7f93db7fe640 1 -- 172.21.15.50:0/2060547366 >> v2:172.21.15.170:3300/0 conn(0x7f93dc06f0c0 msgr2=0x7f93dc06f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.958+0000 7f93db7fe640 1 --2- 172.21.15.50:0/2060547366 >> v2:172.21.15.170:3300/0 conn(0x7f93dc06f0c0 0x7f93dc06f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.958+0000 7f93db7fe640 1 -- 172.21.15.50:0/2060547366 >> v1:172.21.15.170:6789/0 conn(0x7f93dc159c50 legacy=0x7f93dc0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:09.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.958+0000 7f93db7fe640 1 -- 172.21.15.50:0/2060547366 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc06e5e0 con 0x7f93dc071130 2023-12-08T08:18:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93db7fe640 1 --2- 172.21.15.50:0/2060547366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc071130 0x7f93dc0715c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93dc06d9a0 tx=0x7f93d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5511ac22a2d184 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93daffd640 1 -- 172.21.15.50:0/2060547366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0030860 con 0x7f93dc071130 2023-12-08T08:18:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93daffd640 1 -- 172.21.15.50:0/2060547366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d00309c0 con 0x7f93dc071130 2023-12-08T08:18:09.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93daffd640 1 -- 172.21.15.50:0/2060547366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0030d50 con 0x7f93dc071130 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 -- 172.21.15.50:0/2060547366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc071130 msgr2=0x7f93dc0715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2060547366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc071130 0x7f93dc0715c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93dc06d9a0 tx=0x7f93d002b9a0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 -- 172.21.15.50:0/2060547366 shutdown_connections 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2060547366 >> v2:172.21.15.170:3300/0 conn(0x7f93dc06f0c0 0x7f93dc06f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2060547366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc071130 0x7f93dc0715c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 -- 172.21.15.50:0/2060547366 >> 172.21.15.50:0/2060547366 conn(0x7f93dc0cfcd0 msgr2=0x7f93dc0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 -- 172.21.15.50:0/2060547366 shutdown_connections 2023-12-08T08:18:09.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.959+0000 7f93e26e7640 1 -- 172.21.15.50:0/2060547366 wait complete. 2023-12-08T08:18:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.960+0000 7f93e26e7640 1 Processor -- start 2023-12-08T08:18:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93e26e7640 1 -- start start 2023-12-08T08:18:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93e26e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06f0c0 0x7f93dc14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93e26e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93dc071130 0x7f93dc15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93e26e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93dc159c50 0x7f93dc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93e26e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc157590 con 0x7f93dc06f0c0 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93e26e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc157240 con 0x7f93dc071130 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93e26e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93dc15aa80 con 0x7f93dc159c50 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.961+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06f0c0 0x7f93dc14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06f0c0 0x7f93dc14e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51132/0 (socket says 172.21.15.50:51132) 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 -- 172.21.15.50:0/2255882667 learned_addr learned my addr 172.21.15.50:0/2255882667 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93e0c84640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93dc159c50 0x7f93dc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93db7fe640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93dc071130 0x7f93dc15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 -- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93dc159c50 msgr2=0x7f93dc15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93dc159c50 0x7f93dc15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 -- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93dc071130 msgr2=0x7f93dc15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93dc071130 0x7f93dc15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:09.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 -- 172.21.15.50:0/2255882667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d00094d0 con 0x7f93dc06f0c0 2023-12-08T08:18:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93dbfff640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06f0c0 0x7f93dc14e350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c400 tx=0x7f93cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93d8ff9640 1 -- 172.21.15.50:0/2255882667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0052d0 con 0x7f93dc06f0c0 2023-12-08T08:18:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93d8ff9640 1 -- 172.21.15.50:0/2255882667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc005430 con 0x7f93dc06f0c0 2023-12-08T08:18:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc15ad60 con 0x7f93dc06f0c0 2023-12-08T08:18:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93d8ff9640 1 -- 172.21.15.50:0/2255882667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc003830 con 0x7f93dc06f0c0 2023-12-08T08:18:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.962+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93dc14e890 con 0x7f93dc06f0c0 2023-12-08T08:18:09.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.963+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93dc06d730 con 0x7f93dc06f0c0 2023-12-08T08:18:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.964+0000 7f93d8ff9640 1 -- 172.21.15.50:0/2255882667 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f93cc003990 con 0x7f93dc06f0c0 2023-12-08T08:18:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.964+0000 7f93d8ff9640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f93c806ae40 0x7f93c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.964+0000 7f93d8ff9640 1 -- 172.21.15.50:0/2255882667 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93cc088eb0 con 0x7f93dc06f0c0 2023-12-08T08:18:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.964+0000 7f93db7fe640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f93c806ae40 0x7f93c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.965+0000 7f93db7fe640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f93c806ae40 0x7f93c806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93d0036000 tx=0x7f93d0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:09.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:09.968+0000 7f93d8ff9640 1 -- 172.21.15.50:0/2255882667 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93cc053c70 con 0x7f93dc06f0c0 2023-12-08T08:18:10.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.142+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93dc067ad0 con 0x7f93dc06f0c0 2023-12-08T08:18:10.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.143+0000 7f93d8ff9640 1 -- 172.21.15.50:0/2255882667 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93cc017020 con 0x7f93dc06f0c0 2023-12-08T08:18:10.145 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:10.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f93c806ae40 msgr2=0x7f93c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f93c806ae40 0x7f93c806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93d0036000 tx=0x7f93d0008030 comp rx=0 tx=0).stop 2023-12-08T08:18:10.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06f0c0 msgr2=0x7f93dc14e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06f0c0 0x7f93dc14e350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c400 tx=0x7f93cc00c8c0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 shutdown_connections 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f93c806ae40 0x7f93c806d300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93dc159c50 0x7f93dc15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93dc071130 0x7f93dc15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 --2- 172.21.15.50:0/2255882667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93dc06f0c0 0x7f93dc14e350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 >> 172.21.15.50:0/2255882667 conn(0x7f93dc0cfcd0 msgr2=0x7f93dc0cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 shutdown_connections 2023-12-08T08:18:10.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.145+0000 7f93e26e7640 1 -- 172.21.15.50:0/2255882667 wait complete. 2023-12-08T08:18:10.158 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:10.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.266+0000 7f83b134c640 1 Processor -- start 2023-12-08T08:18:10.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.266+0000 7f83b134c640 1 -- start start 2023-12-08T08:18:10.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83b134c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f83ac0cfa80 0x7f83ac0d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83b134c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83ac0ce690 0x7f83ac0cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83b134c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ac0b5ec0 con 0x7f83ac0d10f0 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83b134c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac0d03a0 con 0x7f83ac0ce690 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83b134c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ac0cede0 con 0x7f83ac0cfa80 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83aa7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f83ac0ce690 0x7f83ac0cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83ab7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f83ac0d10f0 0x7f83ac0d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58450/0 (socket says 172.21.15.50:58450) 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83ab7fe640 1 -- 172.21.15.50:0/538080638 learned_addr learned my addr 172.21.15.50:0/538080638 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83aaffd640 1 --2- 172.21.15.50:0/538080638 >> v2:172.21.15.170:3300/0 conn(0x7f83ac0cfa80 0x7f83ac0d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83aa7fc640 1 -- 172.21.15.50:0/538080638 >> v2:172.21.15.170:3300/0 conn(0x7f83ac0cfa80 msgr2=0x7f83ac0d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83aa7fc640 1 --2- 172.21.15.50:0/538080638 >> v2:172.21.15.170:3300/0 conn(0x7f83ac0cfa80 0x7f83ac0d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83aa7fc640 1 -- 172.21.15.50:0/538080638 >> v1:172.21.15.50:6789/0 conn(0x7f83ac0d10f0 legacy=0x7f83ac0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83aa7fc640 1 -- 172.21.15.50:0/538080638 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0b6110 con 0x7f83ac0ce690 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.267+0000 7f83a9ffb640 1 -- 172.21.15.50:0/538080638 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415861800 0 0) 0x7f83ac0b5ec0 con 0x7f83ac0d10f0 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.268+0000 7f83aa7fc640 1 --2- 172.21.15.50:0/538080638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0ce690 0x7f83ac0cfe60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f83ac06ad40 tx=0x7f83a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b687770f95182166 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.268+0000 7f83a9ffb640 1 -- 172.21.15.50:0/538080638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a002e070 con 0x7f83ac0ce690 2023-12-08T08:18:10.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.268+0000 7f83a9ffb640 1 -- 172.21.15.50:0/538080638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00315a0 con 0x7f83ac0ce690 2023-12-08T08:18:10.272 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.268+0000 7f83a9ffb640 1 -- 172.21.15.50:0/538080638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0031930 con 0x7f83ac0ce690 2023-12-08T08:18:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 -- 172.21.15.50:0/538080638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0ce690 msgr2=0x7f83ac0cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 --2- 172.21.15.50:0/538080638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0ce690 0x7f83ac0cfe60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f83ac06ad40 tx=0x7f83a002b840 comp rx=0 tx=0).stop 2023-12-08T08:18:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 -- 172.21.15.50:0/538080638 shutdown_connections 2023-12-08T08:18:10.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 --2- 172.21.15.50:0/538080638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0ce690 0x7f83ac0cfe60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 --2- 172.21.15.50:0/538080638 >> v2:172.21.15.170:3300/0 conn(0x7f83ac0cfa80 0x7f83ac0d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 -- 172.21.15.50:0/538080638 >> 172.21.15.50:0/538080638 conn(0x7f83ac09c340 msgr2=0x7f83ac0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 -- 172.21.15.50:0/538080638 shutdown_connections 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.269+0000 7f83b134c640 1 -- 172.21.15.50:0/538080638 wait complete. 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.270+0000 7f83b134c640 1 Processor -- start 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.270+0000 7f83b134c640 1 -- start start 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83b134c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83ac0ce690 0x7f83ac1f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83b134c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0cfa80 0x7f83ac0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83b134c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83ac0d10f0 0x7f83ac0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83b134c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac159c10 con 0x7f83ac0cfa80 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83b134c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac0cd360 con 0x7f83ac0d10f0 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83b134c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac15e610 con 0x7f83ac0ce690 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0cfa80 0x7f83ac0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0cfa80 0x7f83ac0cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51152/0 (socket says 172.21.15.50:51152) 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 -- 172.21.15.50:0/2190497426 learned_addr learned my addr 172.21.15.50:0/2190497426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aaffd640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83ac0ce690 0x7f83ac1f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83ab7fe640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83ac0d10f0 0x7f83ac0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 -- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83ac0ce690 msgr2=0x7f83ac1f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83ac0ce690 0x7f83ac1f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 -- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83ac0d10f0 msgr2=0x7f83ac0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83ac0d10f0 0x7f83ac0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 -- 172.21.15.50:0/2190497426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a0009400 con 0x7f83ac0cfa80 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.271+0000 7f83aa7fc640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0cfa80 0x7f83ac0cc8e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009890 tx=0x7f83a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.272+0000 7f83937fe640 1 -- 172.21.15.50:0/2190497426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0032840 con 0x7f83ac0cfa80 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.272+0000 7f83937fe640 1 -- 172.21.15.50:0/2190497426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00329a0 con 0x7f83ac0cfa80 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.272+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ac15e8b0 con 0x7f83ac0cfa80 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.272+0000 7f83937fe640 1 -- 172.21.15.50:0/2190497426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0032d50 con 0x7f83ac0cfa80 2023-12-08T08:18:10.276 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.272+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ac15ee70 con 0x7f83ac0cfa80 2023-12-08T08:18:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.272+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ac067430 con 0x7f83ac0cfa80 2023-12-08T08:18:10.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.273+0000 7f83937fe640 1 -- 172.21.15.50:0/2190497426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f83a003b3f0 con 0x7f83ac0cfa80 2023-12-08T08:18:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.273+0000 7f83937fe640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f839806ae40 0x7f839806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.273+0000 7f83937fe640 1 -- 172.21.15.50:0/2190497426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83a00aba50 con 0x7f83ac0cfa80 2023-12-08T08:18:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.274+0000 7f83aaffd640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f839806ae40 0x7f839806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.274+0000 7f83aaffd640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f839806ae40 0x7f839806d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f839c006fd0 tx=0x7f839c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.278+0000 7f83937fe640 1 -- 172.21.15.50:0/2190497426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83a00766e0 con 0x7f83ac0cfa80 2023-12-08T08:18:10.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.452+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83ac0d2e50 con 0x7f83ac0cfa80 2023-12-08T08:18:10.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.453+0000 7f83937fe640 1 -- 172.21.15.50:0/2190497426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83a0079d00 con 0x7f83ac0cfa80 2023-12-08T08:18:10.455 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f839806ae40 msgr2=0x7f839806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f839806ae40 0x7f839806d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f839c006fd0 tx=0x7f839c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0cfa80 msgr2=0x7f83ac0cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0cfa80 0x7f83ac0cc8e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009890 tx=0x7f83a00046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 shutdown_connections 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f839806ae40 0x7f839806d300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83ac0cfa80 0x7f83ac0cc8e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83ac0d10f0 0x7f83ac0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 --2- 172.21.15.50:0/2190497426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83ac0ce690 0x7f83ac1f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 >> 172.21.15.50:0/2190497426 conn(0x7f83ac09c340 msgr2=0x7f83ac0d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 shutdown_connections 2023-12-08T08:18:10.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.455+0000 7f83b134c640 1 -- 172.21.15.50:0/2190497426 wait complete. 2023-12-08T08:18:10.468 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.575+0000 7f2fbeb7c640 1 Processor -- start 2023-12-08T08:18:10.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.575+0000 7f2fbeb7c640 1 -- start start 2023-12-08T08:18:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbeb7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80cfa80 0x7f2fb80d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbeb7c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb80b5ec0 con 0x7f2fb80b6bf0 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbeb7c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb80cede0 con 0x7f2fb80ce690 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbeb7c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb80b6110 con 0x7f2fb80cfa80 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbd119640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2fb80b6bf0 0x7f2fb80b7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58458/0 (socket says 172.21.15.50:58458) 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbd119640 1 -- 172.21.15.50:0/1853688875 learned_addr learned my addr 172.21.15.50:0/1853688875 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbc918640 1 --2- 172.21.15.50:0/1853688875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80cfa80 0x7f2fb80d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919079444 0 0) 0x7f2fb80b5ec0 con 0x7f2fb80b6bf0 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa0003520 con 0x7f2fb80b6bf0 2023-12-08T08:18:10.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729231007 0 0) 0x7f2fb80cede0 con 0x7f2fb80ce690 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb80b5ec0 con 0x7f2fb80ce690 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbc918640 1 -- 172.21.15.50:0/1853688875 >> v1:172.21.15.170:6789/0 conn(0x7f2fb80ce690 legacy=0x7f2fb80cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbc918640 1 -- 172.21.15.50:0/1853688875 >> v1:172.21.15.50:6789/0 conn(0x7f2fb80b6bf0 legacy=0x7f2fb80b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175412592 0 0) 0x7f2fa0003520 con 0x7f2fb80b6bf0 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.576+0000 7f2fbc918640 1 -- 172.21.15.50:0/1853688875 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80b63f0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.577+0000 7f2fbc918640 1 --2- 172.21.15.50:0/1853688875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80cfa80 0x7f2fb80d3b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40097d0 tx=0x7f2fb402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc73dc83c363613 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.577+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00019f0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.577+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb402e050 con 0x7f2fb80cfa80 2023-12-08T08:18:10.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.577+0000 7f2faf7fe640 1 -- 172.21.15.50:0/1853688875 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4030710 con 0x7f2fb80cfa80 2023-12-08T08:18:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.578+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/1853688875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80cfa80 msgr2=0x7f2fb80d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.578+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/1853688875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80cfa80 0x7f2fb80d3b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40097d0 tx=0x7f2fb402b770 comp rx=0 tx=0).stop 2023-12-08T08:18:10.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.578+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/1853688875 shutdown_connections 2023-12-08T08:18:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.578+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/1853688875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80cfa80 0x7f2fb80d3b80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.578+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/1853688875 >> 172.21.15.50:0/1853688875 conn(0x7f2fb809c340 msgr2=0x7f2fb80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.578+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/1853688875 shutdown_connections 2023-12-08T08:18:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.578+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/1853688875 wait complete. 2023-12-08T08:18:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.579+0000 7f2fbeb7c640 1 Processor -- start 2023-12-08T08:18:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.579+0000 7f2fbeb7c640 1 -- start start 2023-12-08T08:18:10.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbeb7c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb80b6bf0 0x7f2fb8158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbeb7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80ce690 0x7f2fb80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbeb7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cfa80 0x7f2fb81f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbeb7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81446a0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbeb7c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81448f0 con 0x7f2fb80b6bf0 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbeb7c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb8144bd0 con 0x7f2fb80ce690 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cfa80 0x7f2fb81f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cfa80 0x7f2fb81f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51162/0 (socket says 172.21.15.50:51162) 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 -- 172.21.15.50:0/761253789 learned_addr learned my addr 172.21.15.50:0/761253789 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbc918640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb80b6bf0 0x7f2fb8158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2faffff640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80ce690 0x7f2fb80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 -- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80ce690 msgr2=0x7f2fb80c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80ce690 0x7f2fb80c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 -- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb80b6bf0 msgr2=0x7f2fb8158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb80b6bf0 0x7f2fb8158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbd119640 1 -- 172.21.15.50:0/761253789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4009400 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.580+0000 7f2fbc918640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb80b6bf0 0x7f2fb8158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.581+0000 7f2fbd119640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cfa80 0x7f2fb81f2a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0001f80 tx=0x7f2fb000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.581+0000 7f2fad7fa640 1 -- 172.21.15.50:0/761253789 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0012400 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.581+0000 7f2fad7fa640 1 -- 172.21.15.50:0/761253789 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0012580 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.581+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb8144eb0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.581+0000 7f2fad7fa640 1 -- 172.21.15.50:0/761253789 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0012930 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.581+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb80c96c0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.582+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb81453d0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.582+0000 7f2fad7fa640 1 -- 172.21.15.50:0/761253789 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fb0012a90 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.583+0000 7f2fad7fa640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2fa406ae40 0x7f2fa406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.583+0000 7f2fad7fa640 1 -- 172.21.15.50:0/761253789 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fb008a1c0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.583+0000 7f2fbc918640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2fa406ae40 0x7f2fa406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.583+0000 7f2fbc918640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2fa406ae40 0x7f2fa406d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4034000 tx=0x7f2fb4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.587+0000 7f2fad7fa640 1 -- 172.21.15.50:0/761253789 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2fb81453d0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.765+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2fb81453d0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.766+0000 7f2fad7fa640 1 -- 172.21.15.50:0/761253789 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2fb81453d0 con 0x7f2fb80cfa80 2023-12-08T08:18:10.768 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2fa406ae40 msgr2=0x7f2fa406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2fa406ae40 0x7f2fa406d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4034000 tx=0x7f2fb4008030 comp rx=0 tx=0).stop 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cfa80 msgr2=0x7f2fb81f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cfa80 0x7f2fb81f2a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0001f80 tx=0x7f2fb000a430 comp rx=0 tx=0).stop 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 shutdown_connections 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2fa406ae40 0x7f2fa406d300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2fb80cfa80 0x7f2fb81f2a40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fb80ce690 0x7f2fb80c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 --2- 172.21.15.50:0/761253789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fb80b6bf0 0x7f2fb8158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 >> 172.21.15.50:0/761253789 conn(0x7f2fb809c340 msgr2=0x7f2fb80cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 shutdown_connections 2023-12-08T08:18:10.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.768+0000 7f2fbeb7c640 1 -- 172.21.15.50:0/761253789 wait complete. 2023-12-08T08:18:10.782 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:10.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.888+0000 7fef901c9640 1 Processor -- start 2023-12-08T08:18:10.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.888+0000 7fef901c9640 1 -- start start 2023-12-08T08:18:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef901c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef901c9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fef8815f890 0x7fef8815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef901c9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8815ee90 con 0x7fef880d3ad0 2023-12-08T08:18:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef901c9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef880d0fe0 con 0x7fef8815f890 2023-12-08T08:18:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef901c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef880d1280 con 0x7fef8815d580 2023-12-08T08:18:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef8df65640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef8e766640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fef8815f890 0x7fef8815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef8df65640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880d1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:56482/0 (socket says 172.21.15.50:56482) 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef8df65640 1 -- 172.21.15.50:0/3440940441 learned_addr learned my addr 172.21.15.50:0/3440940441 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.889+0000 7fef8d764640 1 --1- 172.21.15.50:0/3440940441 >> v1:172.21.15.170:6789/0 conn(0x7fef880d3ad0 0x7fef8815f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49502/0 (socket says 172.21.15.50:49502) 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.890+0000 7fef8df65640 1 -- 172.21.15.50:0/3440940441 >> v2:172.21.15.170:3300/0 conn(0x7fef8815f890 msgr2=0x7fef8815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.890+0000 7fef8df65640 1 --2- 172.21.15.50:0/3440940441 >> v2:172.21.15.170:3300/0 conn(0x7fef8815f890 0x7fef8815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.890+0000 7fef8df65640 1 -- 172.21.15.50:0/3440940441 >> v1:172.21.15.170:6789/0 conn(0x7fef880d3ad0 legacy=0x7fef8815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.890+0000 7fef8cf63640 1 -- 172.21.15.50:0/3440940441 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000844222 0 0) 0x7fef8815ee90 con 0x7fef880d3ad0 2023-12-08T08:18:10.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.890+0000 7fef8df65640 1 -- 172.21.15.50:0/3440940441 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880d1560 con 0x7fef8815d580 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef8df65640 1 --2- 172.21.15.50:0/3440940441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880d1d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef78009e50 tx=0x7fef7802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdd88994cf0267b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef8cf63640 1 -- 172.21.15.50:0/3440940441 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7802ca70 con 0x7fef8815d580 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef8cf63640 1 -- 172.21.15.50:0/3440940441 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7802cbd0 con 0x7fef8815d580 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef8cf63640 1 -- 172.21.15.50:0/3440940441 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780343f0 con 0x7fef8815d580 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 -- 172.21.15.50:0/3440940441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 msgr2=0x7fef880d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 --2- 172.21.15.50:0/3440940441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880d1d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef78009e50 tx=0x7fef7802bed0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 -- 172.21.15.50:0/3440940441 shutdown_connections 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 --2- 172.21.15.50:0/3440940441 >> v2:172.21.15.170:3300/0 conn(0x7fef8815f890 0x7fef8815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 --2- 172.21.15.50:0/3440940441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880d1d60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 -- 172.21.15.50:0/3440940441 >> 172.21.15.50:0/3440940441 conn(0x7fef880d2fb0 msgr2=0x7fef880d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 -- 172.21.15.50:0/3440940441 shutdown_connections 2023-12-08T08:18:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.891+0000 7fef901c9640 1 -- 172.21.15.50:0/3440940441 wait complete. 2023-12-08T08:18:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.892+0000 7fef901c9640 1 Processor -- start 2023-12-08T08:18:10.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.892+0000 7fef901c9640 1 -- start start 2023-12-08T08:18:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef901c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef880d3ad0 0x7fef88157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef901c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef901c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8815f890 0x7fef881586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef901c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef881f67b0 con 0x7fef8815f890 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef901c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef881f6a90 con 0x7fef880d3ad0 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef901c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef881f6d70 con 0x7fef8815d580 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef8e766640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8815f890 0x7fef881586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef8e766640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8815f890 0x7fef881586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51178/0 (socket says 172.21.15.50:51178) 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef8e766640 1 -- 172.21.15.50:0/3287544372 learned_addr learned my addr 172.21.15.50:0/3287544372 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef8df65640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef880d3ad0 0x7fef88157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.893+0000 7fef8d764640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef8e766640 1 -- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 msgr2=0x7fef880b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef8e766640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef8e766640 1 -- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef880d3ad0 msgr2=0x7fef88157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef8e766640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef880d3ad0 0x7fef88157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef8e766640 1 -- 172.21.15.50:0/3287544372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78009b30 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef8e766640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8815f890 0x7fef881586d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e930 tx=0x7fef8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef867fc640 1 -- 172.21.15.50:0/3287544372 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef80009690 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef867fc640 1 -- 172.21.15.50:0/3287544372 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8000c980 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef867fc640 1 -- 172.21.15.50:0/3287544372 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8000cd30 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef881f7050 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.894+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef881f7610 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.895+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef880d09d0 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.896+0000 7fef867fc640 1 -- 172.21.15.50:0/3287544372 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef80013470 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.896+0000 7fef867fc640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fef7406ae40 0x7fef7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.896+0000 7fef867fc640 1 -- 172.21.15.50:0/3287544372 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef80089aa0 con 0x7fef8815f890 2023-12-08T08:18:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.896+0000 7fef8df65640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fef7406ae40 0x7fef7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.897+0000 7fef8df65640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fef7406ae40 0x7fef7406d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fef78035000 tx=0x7fef78030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:10.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:10.900+0000 7fef867fc640 1 -- 172.21.15.50:0/3287544372 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef800549d0 con 0x7fef8815f890 2023-12-08T08:18:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.090+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef88067430 con 0x7fef8815f890 2023-12-08T08:18:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.090+0000 7fef867fc640 1 -- 172.21.15.50:0/3287544372 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef80017080 con 0x7fef8815f890 2023-12-08T08:18:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fef7406ae40 msgr2=0x7fef7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fef7406ae40 0x7fef7406d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fef78035000 tx=0x7fef78030000 comp rx=0 tx=0).stop 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8815f890 msgr2=0x7fef881586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8815f890 0x7fef881586d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e930 tx=0x7fef8000edf0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 shutdown_connections 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fef7406ae40 0x7fef7406d300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fef8815f890 0x7fef881586d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fef8815d580 0x7fef880b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 --2- 172.21.15.50:0/3287544372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef880d3ad0 0x7fef88157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 >> 172.21.15.50:0/3287544372 conn(0x7fef880d2fb0 msgr2=0x7fef8815f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 shutdown_connections 2023-12-08T08:18:11.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:11.092+0000 7fef901c9640 1 -- 172.21.15.50:0/3287544372 wait complete. 2023-12-08T08:18:11.105 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:18:11.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:11.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-08T08:18:11.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi050.stderr:ceph-fuse[95637]: fuse finished with error 0 and tester_r 0 2023-12-08T08:18:11.136 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:18:17.237 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:18:17.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:17.238 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-08T08:18:17.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.418+0000 7fb919817640 1 Processor -- start 2023-12-08T08:18:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.418+0000 7fb919817640 1 -- start start 2023-12-08T08:18:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.418+0000 7fb919817640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb914158ee0 0x7fb914070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.418+0000 7fb919817640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9140cbd10 0x7fb91406c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb919817640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9140720d0 con 0x7fb91415b750 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb919817640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140cc890 con 0x7fb9140cbd10 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb919817640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140714c0 con 0x7fb914158ee0 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb912ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb914158ee0 0x7fb914070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb9137fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9140cbd10 0x7fb91406c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb912ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb914158ee0 0x7fb914070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:56508/0 (socket says 172.21.15.50:56508) 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb9137fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9140cbd10 0x7fb91406c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:60554/0 (socket says 172.21.15.50:60554) 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb912ffd640 1 -- 172.21.15.50:0/4093827412 learned_addr learned my addr 172.21.15.50:0/4093827412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb9127fc640 1 --1- 172.21.15.50:0/4093827412 >> v1:172.21.15.170:6789/0 conn(0x7fb91415b750 0x7fb9140cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49516/0 (socket says 172.21.15.50:49516) 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb9137fe640 1 -- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb914158ee0 msgr2=0x7fb914070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb9137fe640 1 --2- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb914158ee0 0x7fb914070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb9137fe640 1 -- 172.21.15.50:0/4093827412 >> v1:172.21.15.170:6789/0 conn(0x7fb91415b750 legacy=0x7fb9140cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb9137fe640 1 -- 172.21.15.50:0/4093827412 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140717a0 con 0x7fb9140cbd10 2023-12-08T08:18:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.419+0000 7fb912ffd640 1 --2- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb914158ee0 0x7fb914070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.420+0000 7fb9137fe640 1 --2- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9140cbd10 0x7fb91406c480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009d90 tx=0x7fb90c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcd79510679c5dc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.420+0000 7fb911ffb640 1 -- 172.21.15.50:0/4093827412 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c02cbc0 con 0x7fb9140cbd10 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.420+0000 7fb911ffb640 1 -- 172.21.15.50:0/4093827412 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c02cd20 con 0x7fb9140cbd10 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.420+0000 7fb911ffb640 1 -- 172.21.15.50:0/4093827412 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c034660 con 0x7fb9140cbd10 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 -- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9140cbd10 msgr2=0x7fb91406c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 --2- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9140cbd10 0x7fb91406c480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009d90 tx=0x7fb90c02be10 comp rx=0 tx=0).stop 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 -- 172.21.15.50:0/4093827412 shutdown_connections 2023-12-08T08:18:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 --2- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9140cbd10 0x7fb91406c480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 --2- 172.21.15.50:0/4093827412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb914158ee0 0x7fb914070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 -- 172.21.15.50:0/4093827412 >> 172.21.15.50:0/4093827412 conn(0x7fb9140b09f0 msgr2=0x7fb9140b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 -- 172.21.15.50:0/4093827412 shutdown_connections 2023-12-08T08:18:17.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.421+0000 7fb919817640 1 -- 172.21.15.50:0/4093827412 wait complete. 2023-12-08T08:18:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.422+0000 7fb919817640 1 Processor -- start 2023-12-08T08:18:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.422+0000 7fb919817640 1 -- start start 2023-12-08T08:18:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb919817640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9140cbd10 0x7fb9140b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb919817640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb914158ee0 0x7fb9140ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb919817640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91415b750 0x7fb914151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb919817640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91409ae00 con 0x7fb914158ee0 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb919817640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91409ac00 con 0x7fb91415b750 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb919817640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b3da0 con 0x7fb9140cbd10 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb914158ee0 0x7fb9140ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb914158ee0 0x7fb9140ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51194/0 (socket says 172.21.15.50:51194) 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 -- 172.21.15.50:0/2156244604 learned_addr learned my addr 172.21.15.50:0/2156244604 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9137fe640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91415b750 0x7fb914151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb912ffd640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9140cbd10 0x7fb9140b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 -- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9140cbd10 msgr2=0x7fb9140b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9140cbd10 0x7fb9140b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 -- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91415b750 msgr2=0x7fb914151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91415b750 0x7fb914151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.423+0000 7fb9127fc640 1 -- 172.21.15.50:0/2156244604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040094d0 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.424+0000 7fb9127fc640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb914158ee0 0x7fb9140ad000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c3e0 tx=0x7fb90800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.424+0000 7fb8fbfff640 1 -- 172.21.15.50:0/2156244604 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080074e0 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.424+0000 7fb8fbfff640 1 -- 172.21.15.50:0/2156244604 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb908007640 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.424+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c009a70 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.424+0000 7fb8fbfff640 1 -- 172.21.15.50:0/2156244604 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9080049e0 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.424+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9140cf240 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.425+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb914067430 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.425+0000 7fb8fbfff640 1 -- 172.21.15.50:0/2156244604 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb908004b40 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.426+0000 7fb8fbfff640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb90006ae40 0x7fb90006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.426+0000 7fb8fbfff640 1 -- 172.21.15.50:0/2156244604 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb908089420 con 0x7fb914158ee0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.426+0000 7fb912ffd640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb90006ae40 0x7fb90006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.427+0000 7fb912ffd640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb90006ae40 0x7fb90006d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb904009cf0 tx=0x7fb904008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.430+0000 7fb8fbfff640 1 -- 172.21.15.50:0/2156244604 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9080540b0 con 0x7fb914158ee0 2023-12-08T08:18:17.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.606+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9140732a0 con 0x7fb914158ee0 2023-12-08T08:18:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.607+0000 7fb8fbfff640 1 -- 172.21.15.50:0/2156244604 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fb9080576d0 con 0x7fb914158ee0 2023-12-08T08:18:17.610 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:17.610 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb90006ae40 msgr2=0x7fb90006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb90006ae40 0x7fb90006d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb904009cf0 tx=0x7fb904008040 comp rx=0 tx=0).stop 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb914158ee0 msgr2=0x7fb9140ad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb914158ee0 0x7fb9140ad000 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c3e0 tx=0x7fb90800c8a0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 shutdown_connections 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb90006ae40 0x7fb90006d300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb914158ee0 0x7fb9140ad000 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb91415b750 0x7fb914151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 --2- 172.21.15.50:0/2156244604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9140cbd10 0x7fb9140b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 >> 172.21.15.50:0/2156244604 conn(0x7fb9140b09f0 msgr2=0x7fb9140af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 shutdown_connections 2023-12-08T08:18:17.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.609+0000 7fb919817640 1 -- 172.21.15.50:0/2156244604 wait complete. 2023-12-08T08:18:17.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.726+0000 7fddb7b1d640 1 Processor -- start 2023-12-08T08:18:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb7b1d640 1 -- start start 2023-12-08T08:18:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb7b1d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb0157ba0 0x7fddb015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb7b1d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddb015a960 0x7fddb006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb7b1d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb015b410 con 0x7fddb006d7e0 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb7b1d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb006dc70 con 0x7fddb015a960 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb7b1d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb015ae50 con 0x7fddb0157ba0 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb60ba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fddb006d7e0 0x7fddb0071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58464/0 (socket says 172.21.15.50:58464) 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb50b8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fddb015a960 0x7fddb006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.727+0000 7fddb60ba640 1 -- 172.21.15.50:0/216916405 learned_addr learned my addr 172.21.15.50:0/216916405 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.728+0000 7fddb58b9640 1 --2- 172.21.15.50:0/216916405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb0157ba0 0x7fddb015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.728+0000 7fddb48b7640 1 -- 172.21.15.50:0/216916405 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670624548 0 0) 0x7fddb015b410 con 0x7fddb006d7e0 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.728+0000 7fddb48b7640 1 -- 172.21.15.50:0/216916405 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd9c003520 con 0x7fddb006d7e0 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.728+0000 7fddb50b8640 1 -- 172.21.15.50:0/216916405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb0157ba0 msgr2=0x7fddb015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.728+0000 7fddb50b8640 1 --2- 172.21.15.50:0/216916405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb0157ba0 0x7fddb015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.728+0000 7fddb50b8640 1 -- 172.21.15.50:0/216916405 >> v1:172.21.15.50:6789/0 conn(0x7fddb006d7e0 legacy=0x7fddb0071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.728+0000 7fddb50b8640 1 -- 172.21.15.50:0/216916405 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb015b130 con 0x7fddb015a960 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb50b8640 1 --2- 172.21.15.50:0/216916405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb015a960 0x7fddb006d2a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdda00097a0 tx=0x7fdda002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abed60562aec9867 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb48b7640 1 -- 172.21.15.50:0/216916405 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda002e070 con 0x7fddb015a960 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb48b7640 1 -- 172.21.15.50:0/216916405 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda00315a0 con 0x7fddb015a960 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb48b7640 1 -- 172.21.15.50:0/216916405 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda0031930 con 0x7fddb015a960 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 -- 172.21.15.50:0/216916405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb015a960 msgr2=0x7fddb006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/216916405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb015a960 0x7fddb006d2a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdda00097a0 tx=0x7fdda002b840 comp rx=0 tx=0).stop 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 -- 172.21.15.50:0/216916405 shutdown_connections 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/216916405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb015a960 0x7fddb006d2a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/216916405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb0157ba0 0x7fddb015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 -- 172.21.15.50:0/216916405 >> 172.21.15.50:0/216916405 conn(0x7fddb00cff90 msgr2=0x7fddb00d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 -- 172.21.15.50:0/216916405 shutdown_connections 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.729+0000 7fddb7b1d640 1 -- 172.21.15.50:0/216916405 wait complete. 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 Processor -- start 2023-12-08T08:18:17.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 -- start start 2023-12-08T08:18:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb006d7e0 0x7fddb01586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0157ba0 0x7fddb01449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb015a960 0x7fddb0144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00cedb0 con 0x7fddb0157ba0 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00ce230 con 0x7fddb006d7e0 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb7b1d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00ce510 con 0x7fddb015a960 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb50b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0157ba0 0x7fddb01449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb50b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0157ba0 0x7fddb01449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51208/0 (socket says 172.21.15.50:51208) 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.731+0000 7fddb50b8640 1 -- 172.21.15.50:0/3341015087 learned_addr learned my addr 172.21.15.50:0/3341015087 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb58b9640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb006d7e0 0x7fddb01586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb60ba640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb015a960 0x7fddb0144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb50b8640 1 -- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb015a960 msgr2=0x7fddb0144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb50b8640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb015a960 0x7fddb0144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb50b8640 1 -- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb006d7e0 msgr2=0x7fddb01586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb50b8640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb006d7e0 0x7fddb01586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb50b8640 1 -- 172.21.15.50:0/3341015087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0009400 con 0x7fddb0157ba0 2023-12-08T08:18:17.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb50b8640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0157ba0 0x7fddb01449b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdda0034040 tx=0x7fdda00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fdda67fc640 1 -- 172.21.15.50:0/3341015087 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda0032840 con 0x7fddb0157ba0 2023-12-08T08:18:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fdda67fc640 1 -- 172.21.15.50:0/3341015087 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0031f00 con 0x7fddb0157ba0 2023-12-08T08:18:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fdda67fc640 1 -- 172.21.15.50:0/3341015087 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda0032c00 con 0x7fddb0157ba0 2023-12-08T08:18:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb00ce7f0 con 0x7fddb0157ba0 2023-12-08T08:18:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.732+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb014f720 con 0x7fddb0157ba0 2023-12-08T08:18:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.733+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb014f910 con 0x7fddb0157ba0 2023-12-08T08:18:17.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.733+0000 7fdda67fc640 1 -- 172.21.15.50:0/3341015087 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdda003b3f0 con 0x7fddb0157ba0 2023-12-08T08:18:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.734+0000 7fdda67fc640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdd9406ae40 0x7fdd9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.734+0000 7fdda67fc640 1 -- 172.21.15.50:0/3341015087 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdda00ab700 con 0x7fddb0157ba0 2023-12-08T08:18:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.734+0000 7fddb58b9640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdd9406ae40 0x7fdd9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:17.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.735+0000 7fddb58b9640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdd9406ae40 0x7fdd9406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fddac009ad0 tx=0x7fddac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:17.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.738+0000 7fdda67fc640 1 -- 172.21.15.50:0/3341015087 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdda0076550 con 0x7fddb0157ba0 2023-12-08T08:18:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.918+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddb0067ad0 con 0x7fddb0157ba0 2023-12-08T08:18:17.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.919+0000 7fdda67fc640 1 -- 172.21.15.50:0/3341015087 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fdda0079b70 con 0x7fddb0157ba0 2023-12-08T08:18:17.922 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:17.922 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:17.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdd9406ae40 msgr2=0x7fdd9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdd9406ae40 0x7fdd9406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fddac009ad0 tx=0x7fddac008040 comp rx=0 tx=0).stop 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0157ba0 msgr2=0x7fddb01449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0157ba0 0x7fddb01449b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdda0034040 tx=0x7fdda00046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 shutdown_connections 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdd9406ae40 0x7fdd9406d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fddb0157ba0 0x7fddb01449b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddb015a960 0x7fddb0144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 --2- 172.21.15.50:0/3341015087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddb006d7e0 0x7fddb01586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 >> 172.21.15.50:0/3341015087 conn(0x7fddb00cff90 msgr2=0x7fddb0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 shutdown_connections 2023-12-08T08:18:17.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:17.922+0000 7fddb7b1d640 1 -- 172.21.15.50:0/3341015087 wait complete. 2023-12-08T08:18:17.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:18:18.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.042+0000 7f4f3c71d640 1 Processor -- start 2023-12-08T08:18:18.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.042+0000 7f4f3c71d640 1 -- start start 2023-12-08T08:18:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3c71d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3415d4f0 0x7f4f340b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3c71d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4f340cef90 0x7f4f340cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3c71d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f340b2280 con 0x7f4f340b0920 2023-12-08T08:18:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3c71d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3406bb40 con 0x7f4f340cef90 2023-12-08T08:18:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3c71d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340b1430 con 0x7f4f3415d4f0 2023-12-08T08:18:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3a4b9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3415d4f0 0x7f4f340b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3acba640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4f340cef90 0x7f4f340cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3a4b9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3415d4f0 0x7f4f340b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:56554/0 (socket says 172.21.15.50:56554) 2023-12-08T08:18:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3acba640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4f340cef90 0x7f4f340cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:60590/0 (socket says 172.21.15.50:60590) 2023-12-08T08:18:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f39cb8640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f4f340b0920 0x7f4f340b0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49530/0 (socket says 172.21.15.50:49530) 2023-12-08T08:18:18.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3a4b9640 1 -- 172.21.15.50:0/946741992 learned_addr learned my addr 172.21.15.50:0/946741992 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3acba640 1 -- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3415d4f0 msgr2=0x7f4f340b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3acba640 1 --2- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3415d4f0 0x7f4f340b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3acba640 1 -- 172.21.15.50:0/946741992 >> v1:172.21.15.170:6789/0 conn(0x7f4f340b0920 legacy=0x7f4f340b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f394b7640 1 -- 172.21.15.50:0/946741992 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969918660 0 0) 0x7f4f340b2280 con 0x7f4f340b0920 2023-12-08T08:18:18.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3acba640 1 -- 172.21.15.50:0/946741992 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340b2710 con 0x7f4f340cef90 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.043+0000 7f4f3a4b9640 1 --2- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3415d4f0 0x7f4f340b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.044+0000 7f4f3acba640 1 --2- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340cef90 0x7f4f340cf420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d90 tx=0x7f4f2c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ba479e187ebfa77 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.044+0000 7f4f394b7640 1 -- 172.21.15.50:0/946741992 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c02cc50 con 0x7f4f340cef90 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.044+0000 7f4f394b7640 1 -- 172.21.15.50:0/946741992 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c02cdb0 con 0x7f4f340cef90 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.044+0000 7f4f394b7640 1 -- 172.21.15.50:0/946741992 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c034660 con 0x7f4f340cef90 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 -- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340cef90 msgr2=0x7f4f340cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340cef90 0x7f4f340cf420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009d90 tx=0x7f4f2c02bea0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 -- 172.21.15.50:0/946741992 shutdown_connections 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f340cef90 0x7f4f340cf420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/946741992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f3415d4f0 0x7f4f340b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 -- 172.21.15.50:0/946741992 >> 172.21.15.50:0/946741992 conn(0x7f4f340d0e00 msgr2=0x7f4f340d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 -- 172.21.15.50:0/946741992 shutdown_connections 2023-12-08T08:18:18.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.045+0000 7f4f3c71d640 1 -- 172.21.15.50:0/946741992 wait complete. 2023-12-08T08:18:18.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.046+0000 7f4f3c71d640 1 Processor -- start 2023-12-08T08:18:18.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.046+0000 7f4f3c71d640 1 -- start start 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3c71d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340b0920 0x7f4f340cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3c71d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340cef90 0x7f4f3415f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3c71d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3415d4f0 0x7f4f3415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3c71d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340cb9d0 con 0x7f4f340cef90 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3c71d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340cbcb0 con 0x7f4f3415d4f0 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3c71d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f340cbf90 con 0x7f4f340b0920 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340cef90 0x7f4f3415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340cef90 0x7f4f3415f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51224/0 (socket says 172.21.15.50:51224) 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 -- 172.21.15.50:0/836481242 learned_addr learned my addr 172.21.15.50:0/836481242 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3a4b9640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340b0920 0x7f4f340cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3acba640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3415d4f0 0x7f4f3415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 -- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340b0920 msgr2=0x7f4f340cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340b0920 0x7f4f340cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 -- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3415d4f0 msgr2=0x7f4f3415f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3415d4f0 0x7f4f3415f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f39cb8640 1 -- 172.21.15.50:0/836481242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300094d0 con 0x7f4f340cef90 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.047+0000 7f4f3a4b9640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340b0920 0x7f4f340cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.048+0000 7f4f39cb8640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340cef90 0x7f4f3415f460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c4d0 tx=0x7f4f2400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.048+0000 7f4f2affd640 1 -- 172.21.15.50:0/836481242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240074e0 con 0x7f4f340cef90 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.048+0000 7f4f2affd640 1 -- 172.21.15.50:0/836481242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f24007660 con 0x7f4f340cef90 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.048+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c009a70 con 0x7f4f340cef90 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.048+0000 7f4f2affd640 1 -- 172.21.15.50:0/836481242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24004a20 con 0x7f4f340cef90 2023-12-08T08:18:18.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.048+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f340cc550 con 0x7f4f340cef90 2023-12-08T08:18:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.049+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f34067430 con 0x7f4f340cef90 2023-12-08T08:18:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.049+0000 7f4f2affd640 1 -- 172.21.15.50:0/836481242 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f24004b80 con 0x7f4f340cef90 2023-12-08T08:18:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.050+0000 7f4f2affd640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4f1806ae40 0x7f4f1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.050+0000 7f4f2affd640 1 -- 172.21.15.50:0/836481242 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f24088af0 con 0x7f4f340cef90 2023-12-08T08:18:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.050+0000 7f4f3a4b9640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4f1806ae40 0x7f4f1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:18.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.051+0000 7f4f3a4b9640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4f1806ae40 0x7f4f1806d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009d10 tx=0x7f4f30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:18.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.054+0000 7f4f2affd640 1 -- 172.21.15.50:0/836481242 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f240538b0 con 0x7f4f340cef90 2023-12-08T08:18:18.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.266+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4f341607b0 con 0x7f4f340cef90 2023-12-08T08:18:18.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.918+0000 7f4f2affd640 1 -- 172.21.15.50:0/836481242 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4f24018020 con 0x7f4f340cef90 2023-12-08T08:18:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4f1806ae40 msgr2=0x7f4f1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4f1806ae40 0x7f4f1806d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009d10 tx=0x7f4f30008040 comp rx=0 tx=0).stop 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340cef90 msgr2=0x7f4f3415f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340cef90 0x7f4f3415f460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c4d0 tx=0x7f4f2400c990 comp rx=0 tx=0).stop 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 shutdown_connections 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4f1806ae40 0x7f4f1806d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f340cef90 0x7f4f3415f460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f3415d4f0 0x7f4f3415f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 --2- 172.21.15.50:0/836481242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f340b0920 0x7f4f340cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 >> 172.21.15.50:0/836481242 conn(0x7f4f340d0e00 msgr2=0x7f4f3415c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:18.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 shutdown_connections 2023-12-08T08:18:18.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:18.922+0000 7f4f3c71d640 1 -- 172.21.15.50:0/836481242 wait complete. 2023-12-08T08:18:18.937 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-08T08:18:18.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:18:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.050+0000 7fcc06543640 1 Processor -- start 2023-12-08T08:18:19.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.050+0000 7fcc06543640 1 -- start start 2023-12-08T08:18:19.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.051+0000 7fcc06543640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 0x7fcc000b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.051+0000 7fcc06543640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000b5f00 con 0x7fcc000b8950 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.051+0000 7fcc06543640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000b6170 con 0x7fcc000cf570 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.051+0000 7fcc06543640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000b6450 con 0x7fcc000cf9b0 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.051+0000 7fcbfffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc000b8950 0x7fcc000ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:58474/0 (socket says 172.21.15.50:58474) 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.051+0000 7fcbfffff640 1 -- 172.21.15.50:0/819511678 learned_addr learned my addr 172.21.15.50:0/819511678 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222015444 0 0) 0x7fcc000b5f00 con 0x7fcc000b8950 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbec003520 con 0x7fcc000b8950 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcc04ae0640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 0x7fcc000b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486985846 0 0) 0x7fcbec003520 con 0x7fcc000b8950 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 msgr2=0x7fcc000b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 0x7fcc000b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 >> v1:172.21.15.170:6789/0 conn(0x7fcc000cf570 legacy=0x7fcc000b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000b6730 con 0x7fcc000b8950 2023-12-08T08:18:19.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fcbe8001670 con 0x7fcc000b8950 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 >> v1:172.21.15.50:6789/0 conn(0x7fcc000b8950 legacy=0x7fcc000ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbec0039a0 0x7fcbec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 0x7fcbec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbec004d00 0x7fcbec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000b6450 con 0x7fcbec0039a0 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec00bb10 con 0x7fcbec004d00 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec00bcd0 con 0x7fcc000cf9b0 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfffff640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbec0039a0 0x7fcbec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbff7fe640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 0x7fcbec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcc04ae0640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbec004d00 0x7fcbec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfffff640 1 -- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 msgr2=0x7fcbec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfffff640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc000cf9b0 0x7fcbec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfffff640 1 -- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbec004d00 msgr2=0x7fcbec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfffff640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbec004d00 0x7fcbec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.052+0000 7fcbfffff640 1 -- 172.21.15.50:0/819511678 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000b6730 con 0x7fcbec0039a0 2023-12-08T08:18:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.053+0000 7fcbfffff640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbec0039a0 0x7fcbec003dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c340 tx=0x7fcbec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344273689c448e9c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.053+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe802cbb0 con 0x7fcbec0039a0 2023-12-08T08:18:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.053+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe802cd10 con 0x7fcbec0039a0 2023-12-08T08:18:19.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.053+0000 7fcbfeffd640 1 -- 172.21.15.50:0/819511678 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8005b10 con 0x7fcbec0039a0 2023-12-08T08:18:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.054+0000 7fcc06543640 1 -- 172.21.15.50:0/819511678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbec0039a0 msgr2=0x7fcbec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.054+0000 7fcc06543640 1 --2- 172.21.15.50:0/819511678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcbec0039a0 0x7fcbec003dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c340 tx=0x7fcbec0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.054+0000 7fcc04ae0640 1 -- 172.21.15.50:0/819511678 reap_dead start 2023-12-08T08:18:19.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.054+0000 7fcc06543640 1 -- 172.21.15.50:0/819511678 shutdown_connections 2023-12-08T08:18:19.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.054+0000 7fcc06543640 1 -- 172.21.15.50:0/819511678 >> 172.21.15.50:0/819511678 conn(0x7fcc000d3010 msgr2=0x7fcc000d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:19.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.054+0000 7fcc06543640 1 -- 172.21.15.50:0/819511678 shutdown_connections 2023-12-08T08:18:19.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.054+0000 7fcc06543640 1 -- 172.21.15.50:0/819511678 wait complete. 2023-12-08T08:18:19.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.055+0000 7fcc06543640 1 Processor -- start 2023-12-08T08:18:19.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.055+0000 7fcc06543640 1 -- start start 2023-12-08T08:18:19.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc06543640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbec0039a0 0x7fcc00153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc06543640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc0009de80 0x7fcc0009e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc06543640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0009fdc0 0x7fcc000a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc06543640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0009e840 con 0x7fcc0009fdc0 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc06543640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c76f0 con 0x7fcc0009de80 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc06543640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c79d0 con 0x7fcbec0039a0 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0009fdc0 0x7fcc000a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0009fdc0 0x7fcc000a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51244/0 (socket says 172.21.15.50:51244) 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 -- 172.21.15.50:0/1545663624 learned_addr learned my addr 172.21.15.50:0/1545663624 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcbfffff640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbec0039a0 0x7fcc00153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcbff7fe640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc0009de80 0x7fcc0009e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 -- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbec0039a0 msgr2=0x7fcc00153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbec0039a0 0x7fcc00153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 -- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc0009de80 msgr2=0x7fcc0009e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc0009de80 0x7fcc0009e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcc04ae0640 1 -- 172.21.15.50:0/1545663624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000c7cb0 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.056+0000 7fcbff7fe640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc0009de80 0x7fcc0009e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.057+0000 7fcc04ae0640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0009fdc0 0x7fcc000a0240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc000cd960 tx=0x7fcbf8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.057+0000 7fcbfcff9640 1 -- 172.21.15.50:0/1545663624 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80046a0 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.057+0000 7fcbfcff9640 1 -- 172.21.15.50:0/1545663624 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf8004800 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.057+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc000c7f90 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.057+0000 7fcbfcff9640 1 -- 172.21.15.50:0/1545663624 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8015660 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.057+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc000a0780 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.058+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc000c84b0 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.058+0000 7fcbfcff9640 1 -- 172.21.15.50:0/1545663624 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbf80157c0 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.059+0000 7fcbfcff9640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcbe006ae70 0x7fcbe006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.059+0000 7fcbfcff9640 1 -- 172.21.15.50:0/1545663624 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbf8089e50 con 0x7fcc0009fdc0 2023-12-08T08:18:19.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.059+0000 7fcbfffff640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcbe006ae70 0x7fcbe006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.059+0000 7fcbfffff640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcbe006ae70 0x7fcbe006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8034000 tx=0x7fcbe8037040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:19.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.063+0000 7fcbfcff9640 1 -- 172.21.15.50:0/1545663624 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc000c84b0 con 0x7fcc0009fdc0 2023-12-08T08:18:19.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.280+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcc000c84b0 con 0x7fcc0009fdc0 2023-12-08T08:18:19.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.920+0000 7fcbfcff9640 1 -- 172.21.15.50:0/1545663624 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc000c84b0 con 0x7fcc0009fdc0 2023-12-08T08:18:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcbe006ae70 msgr2=0x7fcbe006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcbe006ae70 0x7fcbe006d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8034000 tx=0x7fcbe8037040 comp rx=0 tx=0).stop 2023-12-08T08:18:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0009fdc0 msgr2=0x7fcc000a0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0009fdc0 0x7fcc000a0240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc000cd960 tx=0x7fcbf8007700 comp rx=0 tx=0).stop 2023-12-08T08:18:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 shutdown_connections 2023-12-08T08:18:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcbe006ae70 0x7fcbe006d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc0009fdc0 0x7fcc000a0240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc0009de80 0x7fcc0009e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 --2- 172.21.15.50:0/1545663624 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbec0039a0 0x7fcc00153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:19.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 >> 172.21.15.50:0/1545663624 conn(0x7fcc000d3010 msgr2=0x7fcc001605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:19.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 shutdown_connections 2023-12-08T08:18:19.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:19.923+0000 7fcc06543640 1 -- 172.21.15.50:0/1545663624 wait complete. 2023-12-08T08:18:19.938 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:18:19.939 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:20.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.048+0000 7f9d0febb640 1 Processor -- start 2023-12-08T08:18:20.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0febb640 1 -- start start 2023-12-08T08:18:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0febb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d08160a00 0x7f9d080d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0febb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d080b1ea0 0x7f9d080cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0febb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9d080cfe10 0x7f9d080d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0febb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d080d02a0 con 0x7f9d080b1ea0 2023-12-08T08:18:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0febb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d080b2610 con 0x7f9d080cfe10 2023-12-08T08:18:20.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0febb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080b28e0 con 0x7f9d08160a00 2023-12-08T08:18:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.049+0000 7f9d0d456640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d080b1ea0 0x7f9d080cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0d456640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9d080b1ea0 0x7f9d080cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56970/0 (socket says 172.21.15.50:56970) 2023-12-08T08:18:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0d456640 1 -- 172.21.15.50:0/1490552068 learned_addr learned my addr 172.21.15.50:0/1490552068 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0dc57640 1 --2- 172.21.15.50:0/1490552068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d08160a00 0x7f9d080d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0e458640 1 --2- 172.21.15.50:0/1490552068 >> v2:172.21.15.170:3300/0 conn(0x7f9d080cfe10 0x7f9d080d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0d456640 1 -- 172.21.15.50:0/1490552068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d08160a00 msgr2=0x7f9d080d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:20.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0d456640 1 --2- 172.21.15.50:0/1490552068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d08160a00 0x7f9d080d3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0d456640 1 -- 172.21.15.50:0/1490552068 >> v2:172.21.15.170:3300/0 conn(0x7f9d080cfe10 msgr2=0x7f9d080d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0d456640 1 --2- 172.21.15.50:0/1490552068 >> v2:172.21.15.170:3300/0 conn(0x7f9d080cfe10 0x7f9d080d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0d456640 1 -- 172.21.15.50:0/1490552068 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d080ce7c0 con 0x7f9d080b1ea0 2023-12-08T08:18:20.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0e458640 1 --2- 172.21.15.50:0/1490552068 >> v2:172.21.15.170:3300/0 conn(0x7f9d080cfe10 0x7f9d080d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.050+0000 7f9d0dc57640 1 --2- 172.21.15.50:0/1490552068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d08160a00 0x7f9d080d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0d456640 1 --2- 172.21.15.50:0/1490552068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d080b1ea0 0x7f9d080cf8d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9d080d0490 tx=0x7f9cfc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbd04efd22caab8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0cc55640 1 -- 172.21.15.50:0/1490552068 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc031860 con 0x7f9d080b1ea0 2023-12-08T08:18:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0cc55640 1 -- 172.21.15.50:0/1490552068 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc0319c0 con 0x7f9d080b1ea0 2023-12-08T08:18:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0cc55640 1 -- 172.21.15.50:0/1490552068 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc031d50 con 0x7f9d080b1ea0 2023-12-08T08:18:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0febb640 1 -- 172.21.15.50:0/1490552068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d080b1ea0 msgr2=0x7f9d080cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0febb640 1 --2- 172.21.15.50:0/1490552068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d080b1ea0 0x7f9d080cf8d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9d080d0490 tx=0x7f9cfc02b900 comp rx=0 tx=0).stop 2023-12-08T08:18:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0febb640 1 -- 172.21.15.50:0/1490552068 shutdown_connections 2023-12-08T08:18:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0febb640 1 --2- 172.21.15.50:0/1490552068 >> v2:172.21.15.170:3300/0 conn(0x7f9d080cfe10 0x7f9d080d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0febb640 1 --2- 172.21.15.50:0/1490552068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d080b1ea0 0x7f9d080cf8d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0febb640 1 --2- 172.21.15.50:0/1490552068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d08160a00 0x7f9d080d3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.051+0000 7f9d0febb640 1 -- 172.21.15.50:0/1490552068 >> 172.21.15.50:0/1490552068 conn(0x7f9d0809c300 msgr2=0x7f9d080d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.052+0000 7f9d0febb640 1 -- 172.21.15.50:0/1490552068 shutdown_connections 2023-12-08T08:18:20.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.052+0000 7f9d0febb640 1 -- 172.21.15.50:0/1490552068 wait complete. 2023-12-08T08:18:20.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 Processor -- start 2023-12-08T08:18:20.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 -- start start 2023-12-08T08:18:20.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d080b1ea0 0x7f9d080cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d080cfe10 0x7f9d081f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08160a00 0x7f9d081f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080cad40 con 0x7f9d08160a00 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080cb020 con 0x7f9d080cfe10 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.053+0000 7f9d0febb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080cb300 con 0x7f9d080b1ea0 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08160a00 0x7f9d081f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08160a00 0x7f9d081f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:56984/0 (socket says 172.21.15.50:56984) 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 -- 172.21.15.50:0/23919896 learned_addr learned my addr 172.21.15.50:0/23919896 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0d456640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d080cfe10 0x7f9d081f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0dc57640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d080b1ea0 0x7f9d080cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 -- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d080b1ea0 msgr2=0x7f9d080cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d080b1ea0 0x7f9d080cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 -- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d080cfe10 msgr2=0x7f9d081f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d080cfe10 0x7f9d081f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 -- 172.21.15.50:0/23919896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0094d0 con 0x7f9d08160a00 2023-12-08T08:18:20.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0d456640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d080cfe10 0x7f9d081f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0dc57640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d080b1ea0 0x7f9d080cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0e458640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08160a00 0x7f9d081f63f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800cd50 tx=0x7f9cf800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d067fc640 1 -- 172.21.15.50:0/23919896 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800f680 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d067fc640 1 -- 172.21.15.50:0/23919896 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800f800 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d080cb5e0 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d067fc640 1 -- 172.21.15.50:0/23919896 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800fbb0 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.054+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d080b7a80 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.055+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d080cbb00 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.056+0000 7f9d067fc640 1 -- 172.21.15.50:0/23919896 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cf800b040 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.056+0000 7f9d067fc640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9cf406ae40 0x7f9cf406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.056+0000 7f9d067fc640 1 -- 172.21.15.50:0/23919896 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9cf808a310 con 0x7f9d08160a00 2023-12-08T08:18:20.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.056+0000 7f9d0dc57640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9cf406ae40 0x7f9cf406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.057+0000 7f9d0dc57640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9cf406ae40 0x7f9cf406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d000088b0 tx=0x7f9d00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.060+0000 7f9d067fc640 1 -- 172.21.15.50:0/23919896 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d080cbb00 con 0x7f9d08160a00 2023-12-08T08:18:20.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.272+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d080cbb00 con 0x7f9d08160a00 2023-12-08T08:18:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.273+0000 7f9d067fc640 1 -- 172.21.15.50:0/23919896 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f9d080cbb00 con 0x7f9d08160a00 2023-12-08T08:18:20.275 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:20.275 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:18:20.275 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:18:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9cf406ae40 msgr2=0x7f9cf406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9cf406ae40 0x7f9cf406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d000088b0 tx=0x7f9d00008040 comp rx=0 tx=0).stop 2023-12-08T08:18:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08160a00 msgr2=0x7f9d081f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08160a00 0x7f9d081f63f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800cd50 tx=0x7f9cf800a650 comp rx=0 tx=0).stop 2023-12-08T08:18:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 shutdown_connections 2023-12-08T08:18:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9cf406ae40 0x7f9cf406d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.277 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d08160a00 0x7f9d081f63f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d080cfe10 0x7f9d081f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 --2- 172.21.15.50:0/23919896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d080b1ea0 0x7f9d080cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 >> 172.21.15.50:0/23919896 conn(0x7f9d0809c300 msgr2=0x7f9d0806b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 shutdown_connections 2023-12-08T08:18:20.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.274+0000 7f9d0febb640 1 -- 172.21.15.50:0/23919896 wait complete. 2023-12-08T08:18:20.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:20.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.391+0000 7fed28339640 1 Processor -- start 2023-12-08T08:18:20.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.391+0000 7fed28339640 1 -- start start 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.392+0000 7fed28339640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed2015d490 0x7fed2006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.392+0000 7fed28339640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed200ce270 con 0x7fed2006c940 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.392+0000 7fed28339640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed200ce550 con 0x7fed2006ea40 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.392+0000 7fed28339640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2006b920 con 0x7fed2015d490 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.392+0000 7fed260d5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fed2015d490 0x7fed2006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.392+0000 7fed258d4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fed2006c940 0x7fed2006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35076/0 (socket says 172.21.15.50:35076) 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.392+0000 7fed258d4640 1 -- 172.21.15.50:0/849637002 learned_addr learned my addr 172.21.15.50:0/849637002 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:20.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.393+0000 7fed260d5640 1 -- 172.21.15.50:0/849637002 >> v1:172.21.15.170:6789/0 conn(0x7fed2006ea40 legacy=0x7fed200d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.393+0000 7fed260d5640 1 -- 172.21.15.50:0/849637002 >> v1:172.21.15.50:6789/0 conn(0x7fed2006c940 legacy=0x7fed2006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.393+0000 7fed260d5640 1 -- 172.21.15.50:0/849637002 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2006bc00 con 0x7fed2015d490 2023-12-08T08:18:20.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.393+0000 7fed250d3640 1 -- 172.21.15.50:0/849637002 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711969130 0 0) 0x7fed200ce270 con 0x7fed2006c940 2023-12-08T08:18:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.393+0000 7fed260d5640 1 --2- 172.21.15.50:0/849637002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2015d490 0x7fed2006c400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed10009d90 tx=0x7fed1002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdf1ee4db50577 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed250d3640 1 -- 172.21.15.50:0/849637002 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1002cc60 con 0x7fed2015d490 2023-12-08T08:18:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed250d3640 1 -- 172.21.15.50:0/849637002 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1002cdc0 con 0x7fed2015d490 2023-12-08T08:18:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed250d3640 1 -- 172.21.15.50:0/849637002 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10034660 con 0x7fed2015d490 2023-12-08T08:18:20.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed28339640 1 -- 172.21.15.50:0/849637002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2015d490 msgr2=0x7fed2006c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed28339640 1 --2- 172.21.15.50:0/849637002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2015d490 0x7fed2006c400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed10009d90 tx=0x7fed1002beb0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed28339640 1 -- 172.21.15.50:0/849637002 shutdown_connections 2023-12-08T08:18:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed28339640 1 --2- 172.21.15.50:0/849637002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2015d490 0x7fed2006c400 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed28339640 1 -- 172.21.15.50:0/849637002 >> 172.21.15.50:0/849637002 conn(0x7fed20099a10 msgr2=0x7fed20099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed28339640 1 -- 172.21.15.50:0/849637002 shutdown_connections 2023-12-08T08:18:20.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.394+0000 7fed28339640 1 -- 172.21.15.50:0/849637002 wait complete. 2023-12-08T08:18:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.395+0000 7fed28339640 1 Processor -- start 2023-12-08T08:18:20.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.395+0000 7fed28339640 1 -- start start 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed28339640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2006c940 0x7fed201f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed28339640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed2015bc40 0x7fed201f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed28339640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed201f3610 0x7fed20160d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed28339640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed201f31f0 con 0x7fed2006c940 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed28339640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200c9b80 con 0x7fed2015bc40 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed28339640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed201f6960 con 0x7fed201f3610 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed260d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2006c940 0x7fed201f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed260d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2006c940 0x7fed201f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57002/0 (socket says 172.21.15.50:57002) 2023-12-08T08:18:20.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed260d5640 1 -- 172.21.15.50:0/142931327 learned_addr learned my addr 172.21.15.50:0/142931327 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed260d5640 1 -- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed201f3610 msgr2=0x7fed20160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed260d5640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed201f3610 0x7fed20160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed260d5640 1 -- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed2015bc40 msgr2=0x7fed201f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.396+0000 7fed258d4640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed2015bc40 0x7fed201f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed260d5640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed2015bc40 0x7fed201f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed260d5640 1 -- 172.21.15.50:0/142931327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009a70 con 0x7fed2006c940 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed260d5640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2006c940 0x7fed201f03e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed10009d90 tx=0x7fed10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed1effd640 1 -- 172.21.15.50:0/142931327 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1003e610 con 0x7fed2006c940 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed1effd640 1 -- 172.21.15.50:0/142931327 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1003e770 con 0x7fed2006c940 2023-12-08T08:18:20.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed201f6c30 con 0x7fed2006c940 2023-12-08T08:18:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed1effd640 1 -- 172.21.15.50:0/142931327 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1003eb20 con 0x7fed2006c940 2023-12-08T08:18:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.397+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed201f71f0 con 0x7fed2006c940 2023-12-08T08:18:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.398+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed201f3330 con 0x7fed2006c940 2023-12-08T08:18:20.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.398+0000 7fed1effd640 1 -- 172.21.15.50:0/142931327 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed1003b050 con 0x7fed2006c940 2023-12-08T08:18:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.399+0000 7fed1effd640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fed0c06ae70 0x7fed0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.399+0000 7fed1effd640 1 -- 172.21.15.50:0/142931327 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed100ac110 con 0x7fed2006c940 2023-12-08T08:18:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.399+0000 7fed258d4640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fed0c06ae70 0x7fed0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.399+0000 7fed258d4640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fed0c06ae70 0x7fed0c06d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed14000f60 tx=0x7fed14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.403+0000 7fed1effd640 1 -- 172.21.15.50:0/142931327 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed201f3330 con 0x7fed2006c940 2023-12-08T08:18:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.581+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed201f3330 con 0x7fed2006c940 2023-12-08T08:18:20.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.582+0000 7fed1effd640 1 -- 172.21.15.50:0/142931327 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fed201f3330 con 0x7fed2006c940 2023-12-08T08:18:20.587 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:20.587 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:20.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fed0c06ae70 msgr2=0x7fed0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fed0c06ae70 0x7fed0c06d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed14000f60 tx=0x7fed14009040 comp rx=0 tx=0).stop 2023-12-08T08:18:20.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2006c940 msgr2=0x7fed201f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2006c940 0x7fed201f03e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed10009d90 tx=0x7fed10004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 shutdown_connections 2023-12-08T08:18:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fed0c06ae70 0x7fed0c06d330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fed201f3610 0x7fed20160d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed2015bc40 0x7fed201f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 --2- 172.21.15.50:0/142931327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fed2006c940 0x7fed201f03e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 >> 172.21.15.50:0/142931327 conn(0x7fed20099a10 msgr2=0x7fed200cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:20.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 shutdown_connections 2023-12-08T08:18:20.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.584+0000 7fed28339640 1 -- 172.21.15.50:0/142931327 wait complete. 2023-12-08T08:18:20.597 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:18:20.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.701+0000 7fcb6763d640 1 Processor -- start 2023-12-08T08:18:20.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.701+0000 7fcb6763d640 1 -- start start 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.702+0000 7fcb6763d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb6015d580 0x7fcb600d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.702+0000 7fcb6763d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6015ee90 con 0x7fcb6015f890 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.702+0000 7fcb6763d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb600d0fe0 con 0x7fcb600d3ad0 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.702+0000 7fcb6763d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600d1280 con 0x7fcb6015d580 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.702+0000 7fcb653d9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcb6015d580 0x7fcb600d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.702+0000 7fcb65bda640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcb6015f890 0x7fcb6015d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35080/0 (socket says 172.21.15.50:35080) 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.702+0000 7fcb65bda640 1 -- 172.21.15.50:0/399363757 learned_addr learned my addr 172.21.15.50:0/399363757 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:20.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.703+0000 7fcb653d9640 1 -- 172.21.15.50:0/399363757 >> v1:172.21.15.170:6789/0 conn(0x7fcb600d3ad0 legacy=0x7fcb6015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:20.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.703+0000 7fcb653d9640 1 -- 172.21.15.50:0/399363757 >> v1:172.21.15.50:6789/0 conn(0x7fcb6015f890 legacy=0x7fcb6015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.703+0000 7fcb653d9640 1 -- 172.21.15.50:0/399363757 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600d1560 con 0x7fcb6015d580 2023-12-08T08:18:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.703+0000 7fcb653d9640 1 --2- 172.21.15.50:0/399363757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb6015d580 0x7fcb600d1d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097d0 tx=0x7fcb5802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20087a1b992e54 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.703+0000 7fcb5ffff640 1 -- 172.21.15.50:0/399363757 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5802e070 con 0x7fcb6015d580 2023-12-08T08:18:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb5ffff640 1 -- 172.21.15.50:0/399363757 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb580315a0 con 0x7fcb6015d580 2023-12-08T08:18:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb5ffff640 1 -- 172.21.15.50:0/399363757 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58031930 con 0x7fcb6015d580 2023-12-08T08:18:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb6763d640 1 -- 172.21.15.50:0/399363757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb6015d580 msgr2=0x7fcb600d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb6763d640 1 --2- 172.21.15.50:0/399363757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb6015d580 0x7fcb600d1d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097d0 tx=0x7fcb5802b840 comp rx=0 tx=0).stop 2023-12-08T08:18:20.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb6763d640 1 -- 172.21.15.50:0/399363757 shutdown_connections 2023-12-08T08:18:20.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb6763d640 1 --2- 172.21.15.50:0/399363757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb6015d580 0x7fcb600d1d60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb6763d640 1 -- 172.21.15.50:0/399363757 >> 172.21.15.50:0/399363757 conn(0x7fcb600d2fb0 msgr2=0x7fcb600d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:20.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb6763d640 1 -- 172.21.15.50:0/399363757 shutdown_connections 2023-12-08T08:18:20.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.704+0000 7fcb6763d640 1 -- 172.21.15.50:0/399363757 wait complete. 2023-12-08T08:18:20.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.705+0000 7fcb6763d640 1 Processor -- start 2023-12-08T08:18:20.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.705+0000 7fcb6763d640 1 -- start start 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb6763d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb600d3ad0 0x7fcb6015e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb6763d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb6015d580 0x7fcb6015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb6763d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb6015f890 0x7fcb6014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb6763d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600ca420 con 0x7fcb600d3ad0 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb6763d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600cb7f0 con 0x7fcb6015f890 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb6763d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600b8ce0 con 0x7fcb6015d580 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb653d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb600d3ad0 0x7fcb6015e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb653d9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb600d3ad0 0x7fcb6015e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57032/0 (socket says 172.21.15.50:57032) 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb653d9640 1 -- 172.21.15.50:0/1031986275 learned_addr learned my addr 172.21.15.50:0/1031986275 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb65bda640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb6015f890 0x7fcb6014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.706+0000 7fcb64bd8640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb6015d580 0x7fcb6015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb653d9640 1 -- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb6015d580 msgr2=0x7fcb6015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb653d9640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb6015d580 0x7fcb6015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb653d9640 1 -- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb6015f890 msgr2=0x7fcb6014ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb653d9640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb6015f890 0x7fcb6014ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb653d9640 1 -- 172.21.15.50:0/1031986275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009400 con 0x7fcb600d3ad0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb65bda640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb6015f890 0x7fcb6014ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb653d9640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb600d3ad0 0x7fcb6015e120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098f0 tx=0x7fcb580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb5dffb640 1 -- 172.21.15.50:0/1031986275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58032900 con 0x7fcb600d3ad0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb5dffb640 1 -- 172.21.15.50:0/1031986275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58032aa0 con 0x7fcb600d3ad0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb5dffb640 1 -- 172.21.15.50:0/1031986275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58032e50 con 0x7fcb600d3ad0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6015be70 con 0x7fcb600d3ad0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.707+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb600cba20 con 0x7fcb600d3ad0 2023-12-08T08:18:20.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.708+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb600d09d0 con 0x7fcb600d3ad0 2023-12-08T08:18:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.709+0000 7fcb5dffb640 1 -- 172.21.15.50:0/1031986275 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb580453f0 con 0x7fcb600d3ad0 2023-12-08T08:18:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.709+0000 7fcb5dffb640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcb4c06ae40 0x7fcb4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.709+0000 7fcb5dffb640 1 -- 172.21.15.50:0/1031986275 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb580abc90 con 0x7fcb600d3ad0 2023-12-08T08:18:20.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.709+0000 7fcb64bd8640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcb4c06ae40 0x7fcb4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:20.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.710+0000 7fcb64bd8640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcb4c06ae40 0x7fcb4c06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb60153210 tx=0x7fcb54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:20.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.713+0000 7fcb5dffb640 1 -- 172.21.15.50:0/1031986275 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb58076ae0 con 0x7fcb600d3ad0 2023-12-08T08:18:20.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.887+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb6015eba0 con 0x7fcb4c06ae40 2023-12-08T08:18:20.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.896+0000 7fcb5dffb640 1 -- 172.21.15.50:0/1031986275 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345285 (secure 0 0 0) 0x7fcb6015eba0 con 0x7fcb4c06ae40 2023-12-08T08:18:20.906 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:20.909 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:18:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcb4c06ae40 msgr2=0x7fcb4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcb4c06ae40 0x7fcb4c06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcb60153210 tx=0x7fcb54009040 comp rx=0 tx=0).stop 2023-12-08T08:18:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb600d3ad0 msgr2=0x7fcb6015e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb600d3ad0 0x7fcb6015e120 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098f0 tx=0x7fcb580046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 shutdown_connections 2023-12-08T08:18:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcb4c06ae40 0x7fcb4c06d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb6015f890 0x7fcb6014ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb6015d580 0x7fcb6015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 --2- 172.21.15.50:0/1031986275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb600d3ad0 0x7fcb6015e120 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 >> 172.21.15.50:0/1031986275 conn(0x7fcb600d2fb0 msgr2=0x7fcb600b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 shutdown_connections 2023-12-08T08:18:20.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:20.900+0000 7fcb6763d640 1 -- 172.21.15.50:0/1031986275 wait complete. 2023-12-08T08:18:20.915 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-08T08:18:20.116934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252652,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722068,"statfs":{"total":773094113280,"available":772835397632,"internally_reserved":0,"allocated":3280896,"data_stored":1987327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2227,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003532"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872492+0000","last_change":"2023-12-08T08:17:56.842906+0000","last_active":"2023-12-08T08:18:01.872492+0000","last_peered":"2023-12-08T08:18:01.872492+0000","last_clean":"2023-12-08T08:18:01.872492+0000","last_became_active":"2023-12-08T08:17:56.842598+0000","last_became_peered":"2023-12-08T08:17:56.842598+0000","last_unstale":"2023-12-08T08:18:01.872492+0000","last_undegraded":"2023-12-08T08:18:01.872492+0000","last_fullsized":"2023-12-08T08:18:01.872492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867626+0000","last_change":"2023-12-08T08:17:57.870410+0000","last_active":"2023-12-08T08:18:01.867626+0000","last_peered":"2023-12-08T08:18:01.867626+0000","last_clean":"2023-12-08T08:18:01.867626+0000","last_became_active":"2023-12-08T08:17:57.870101+0000","last_became_peered":"2023-12-08T08:17:57.870101+0000","last_unstale":"2023-12-08T08:18:01.867626+0000","last_undegraded":"2023-12-08T08:18:01.867626+0000","last_fullsized":"2023-12-08T08:18:01.867626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567811+0000","last_change":"2023-12-08T08:18:01.878712+0000","last_active":"2023-12-08T08:18:03.567811+0000","last_peered":"2023-12-08T08:18:03.567811+0000","last_clean":"2023-12-08T08:18:03.567811+0000","last_became_active":"2023-12-08T08:18:01.878261+0000","last_became_peered":"2023-12-08T08:18:01.878261+0000","last_unstale":"2023-12-08T08:18:03.567811+0000","last_undegraded":"2023-12-08T08:18:03.567811+0000","last_fullsized":"2023-12-08T08:18:03.567811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:07:23.896888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867824+0000","last_change":"2023-12-08T08:17:56.843766+0000","last_active":"2023-12-08T08:18:01.867824+0000","last_peered":"2023-12-08T08:18:01.867824+0000","last_clean":"2023-12-08T08:18:01.867824+0000","last_became_active":"2023-12-08T08:17:56.843478+0000","last_became_peered":"2023-12-08T08:17:56.843478+0000","last_unstale":"2023-12-08T08:18:01.867824+0000","last_undegraded":"2023-12-08T08:18:01.867824+0000","last_fullsized":"2023-12-08T08:18:01.867824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872240+0000","last_change":"2023-12-08T08:17:57.855561+0000","last_active":"2023-12-08T08:18:01.872240+0000","last_peered":"2023-12-08T08:18:01.872240+0000","last_clean":"2023-12-08T08:18:01.872240+0000","last_became_active":"2023-12-08T08:17:57.855268+0000","last_became_peered":"2023-12-08T08:17:57.855268+0000","last_unstale":"2023-12-08T08:18:01.872240+0000","last_undegraded":"2023-12-08T08:18:01.872240+0000","last_fullsized":"2023-12-08T08:18:01.872240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568140+0000","last_change":"2023-12-08T08:18:01.889314+0000","last_active":"2023-12-08T08:18:03.568140+0000","last_peered":"2023-12-08T08:18:03.568140+0000","last_clean":"2023-12-08T08:18:03.568140+0000","last_became_active":"2023-12-08T08:18:01.888906+0000","last_became_peered":"2023-12-08T08:18:01.888906+0000","last_unstale":"2023-12-08T08:18:03.568140+0000","last_undegraded":"2023-12-08T08:18:03.568140+0000","last_fullsized":"2023-12-08T08:18:03.568140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:01.114329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868720+0000","last_change":"2023-12-08T08:17:56.842810+0000","last_active":"2023-12-08T08:18:01.868720+0000","last_peered":"2023-12-08T08:18:01.868720+0000","last_clean":"2023-12-08T08:18:01.868720+0000","last_became_active":"2023-12-08T08:17:56.842480+0000","last_became_peered":"2023-12-08T08:17:56.842480+0000","last_unstale":"2023-12-08T08:18:01.868720+0000","last_undegraded":"2023-12-08T08:18:01.868720+0000","last_fullsized":"2023-12-08T08:18:01.868720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869147+0000","last_change":"2023-12-08T08:17:57.859900+0000","last_active":"2023-12-08T08:18:01.869147+0000","last_peered":"2023-12-08T08:18:01.869147+0000","last_clean":"2023-12-08T08:18:01.869147+0000","last_became_active":"2023-12-08T08:17:57.859600+0000","last_became_peered":"2023-12-08T08:17:57.859600+0000","last_unstale":"2023-12-08T08:18:01.869147+0000","last_undegraded":"2023-12-08T08:18:01.869147+0000","last_fullsized":"2023-12-08T08:18:01.869147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568611+0000","last_change":"2023-12-08T08:18:01.889433+0000","last_active":"2023-12-08T08:18:03.568611+0000","last_peered":"2023-12-08T08:18:03.568611+0000","last_clean":"2023-12-08T08:18:03.568611+0000","last_became_active":"2023-12-08T08:18:01.888357+0000","last_became_peered":"2023-12-08T08:18:01.888357+0000","last_unstale":"2023-12-08T08:18:03.568611+0000","last_undegraded":"2023-12-08T08:18:03.568611+0000","last_fullsized":"2023-12-08T08:18:03.568611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:46.554041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868282+0000","last_change":"2023-12-08T08:17:56.840379+0000","last_active":"2023-12-08T08:18:01.868282+0000","last_peered":"2023-12-08T08:18:01.868282+0000","last_clean":"2023-12-08T08:18:01.868282+0000","last_became_active":"2023-12-08T08:17:56.840103+0000","last_became_peered":"2023-12-08T08:17:56.840103+0000","last_unstale":"2023-12-08T08:18:01.868282+0000","last_undegraded":"2023-12-08T08:18:01.868282+0000","last_fullsized":"2023-12-08T08:18:01.868282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870159+0000","last_change":"2023-12-08T08:17:57.858103+0000","last_active":"2023-12-08T08:18:01.870159+0000","last_peered":"2023-12-08T08:18:01.870159+0000","last_clean":"2023-12-08T08:18:01.870159+0000","last_became_active":"2023-12-08T08:17:57.857699+0000","last_became_peered":"2023-12-08T08:17:57.857699+0000","last_unstale":"2023-12-08T08:18:01.870159+0000","last_undegraded":"2023-12-08T08:18:01.870159+0000","last_fullsized":"2023-12-08T08:18:01.870159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568317+0000","last_change":"2023-12-08T08:18:01.885166+0000","last_active":"2023-12-08T08:18:03.568317+0000","last_peered":"2023-12-08T08:18:03.568317+0000","last_clean":"2023-12-08T08:18:03.568317+0000","last_became_active":"2023-12-08T08:18:01.884779+0000","last_became_peered":"2023-12-08T08:18:01.884779+0000","last_unstale":"2023-12-08T08:18:03.568317+0000","last_undegraded":"2023-12-08T08:18:03.568317+0000","last_fullsized":"2023-12-08T08:18:03.568317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:57.811272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880413+0000","last_change":"2023-12-08T08:17:57.865810+0000","last_active":"2023-12-08T08:18:01.880413+0000","last_peered":"2023-12-08T08:18:01.880413+0000","last_clean":"2023-12-08T08:18:01.880413+0000","last_became_active":"2023-12-08T08:17:57.865552+0000","last_became_peered":"2023-12-08T08:17:57.865552+0000","last_unstale":"2023-12-08T08:18:01.880413+0000","last_undegraded":"2023-12-08T08:18:01.880413+0000","last_fullsized":"2023-12-08T08:18:01.880413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868484+0000","last_change":"2023-12-08T08:17:56.840140+0000","last_active":"2023-12-08T08:18:01.868484+0000","last_peered":"2023-12-08T08:18:01.868484+0000","last_clean":"2023-12-08T08:18:01.868484+0000","last_became_active":"2023-12-08T08:17:56.839795+0000","last_became_peered":"2023-12-08T08:17:56.839795+0000","last_unstale":"2023-12-08T08:18:01.868484+0000","last_undegraded":"2023-12-08T08:18:01.868484+0000","last_fullsized":"2023-12-08T08:18:01.868484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:56.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569186+0000","last_change":"2023-12-08T08:18:01.891012+0000","last_active":"2023-12-08T08:18:03.569186+0000","last_peered":"2023-12-08T08:18:03.569186+0000","last_clean":"2023-12-08T08:18:03.569186+0000","last_became_active":"2023-12-08T08:18:01.890400+0000","last_became_peered":"2023-12-08T08:18:01.890400+0000","last_unstale":"2023-12-08T08:18:03.569186+0000","last_undegraded":"2023-12-08T08:18:03.569186+0000","last_fullsized":"2023-12-08T08:18:03.569186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:16.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867759+0000","last_change":"2023-12-08T08:17:57.864890+0000","last_active":"2023-12-08T08:18:01.867759+0000","last_peered":"2023-12-08T08:18:01.867759+0000","last_clean":"2023-12-08T08:18:01.867759+0000","last_became_active":"2023-12-08T08:17:57.864513+0000","last_became_peered":"2023-12-08T08:17:57.864513+0000","last_unstale":"2023-12-08T08:18:01.867759+0000","last_undegraded":"2023-12-08T08:18:01.867759+0000","last_fullsized":"2023-12-08T08:18:01.867759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885708+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.885708+0000","last_peered":"2023-12-08T08:18:01.885708+0000","last_clean":"2023-12-08T08:18:01.885708+0000","last_became_active":"2023-12-08T08:17:56.832192+0000","last_became_peered":"2023-12-08T08:17:56.832192+0000","last_unstale":"2023-12-08T08:18:01.885708+0000","last_undegraded":"2023-12-08T08:18:01.885708+0000","last_fullsized":"2023-12-08T08:18:01.885708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:09.417617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568758+0000","last_change":"2023-12-08T08:18:01.892174+0000","last_active":"2023-12-08T08:18:03.568758+0000","last_peered":"2023-12-08T08:18:03.568758+0000","last_clean":"2023-12-08T08:18:03.568758+0000","last_became_active":"2023-12-08T08:18:01.891139+0000","last_became_peered":"2023-12-08T08:18:01.891139+0000","last_unstale":"2023-12-08T08:18:03.568758+0000","last_undegraded":"2023-12-08T08:18:03.568758+0000","last_fullsized":"2023-12-08T08:18:03.568758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:06.144172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869779+0000","last_change":"2023-12-08T08:17:57.853306+0000","last_active":"2023-12-08T08:18:01.869779+0000","last_peered":"2023-12-08T08:18:01.869779+0000","last_clean":"2023-12-08T08:18:01.869779+0000","last_became_active":"2023-12-08T08:17:57.852939+0000","last_became_peered":"2023-12-08T08:17:57.852939+0000","last_unstale":"2023-12-08T08:18:01.869779+0000","last_undegraded":"2023-12-08T08:18:01.869779+0000","last_fullsized":"2023-12-08T08:18:01.869779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885213+0000","last_change":"2023-12-08T08:17:56.837763+0000","last_active":"2023-12-08T08:18:01.885213+0000","last_peered":"2023-12-08T08:18:01.885213+0000","last_clean":"2023-12-08T08:18:01.885213+0000","last_became_active":"2023-12-08T08:17:56.837469+0000","last_became_peered":"2023-12-08T08:17:56.837469+0000","last_unstale":"2023-12-08T08:18:01.885213+0000","last_undegraded":"2023-12-08T08:18:01.885213+0000","last_fullsized":"2023-12-08T08:18:01.885213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569232+0000","last_change":"2023-12-08T08:18:01.892151+0000","last_active":"2023-12-08T08:18:03.569232+0000","last_peered":"2023-12-08T08:18:03.569232+0000","last_clean":"2023-12-08T08:18:03.569232+0000","last_became_active":"2023-12-08T08:18:01.891748+0000","last_became_peered":"2023-12-08T08:18:01.891748+0000","last_unstale":"2023-12-08T08:18:03.569232+0000","last_undegraded":"2023-12-08T08:18:03.569232+0000","last_fullsized":"2023-12-08T08:18:03.569232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.874659+0000","last_change":"2023-12-08T08:17:57.856848+0000","last_active":"2023-12-08T08:18:01.874659+0000","last_peered":"2023-12-08T08:18:01.874659+0000","last_clean":"2023-12-08T08:18:01.874659+0000","last_became_active":"2023-12-08T08:17:57.856604+0000","last_became_peered":"2023-12-08T08:17:57.856604+0000","last_unstale":"2023-12-08T08:18:01.874659+0000","last_undegraded":"2023-12-08T08:18:01.874659+0000","last_fullsized":"2023-12-08T08:18:01.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867949+0000","last_change":"2023-12-08T08:17:56.842489+0000","last_active":"2023-12-08T08:18:01.867949+0000","last_peered":"2023-12-08T08:18:01.867949+0000","last_clean":"2023-12-08T08:18:01.867949+0000","last_became_active":"2023-12-08T08:17:56.842218+0000","last_became_peered":"2023-12-08T08:17:56.842218+0000","last_unstale":"2023-12-08T08:18:01.867949+0000","last_undegraded":"2023-12-08T08:18:01.867949+0000","last_fullsized":"2023-12-08T08:18:01.867949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569378+0000","last_change":"2023-12-08T08:18:01.891618+0000","last_active":"2023-12-08T08:18:03.569378+0000","last_peered":"2023-12-08T08:18:03.569378+0000","last_clean":"2023-12-08T08:18:03.569378+0000","last_became_active":"2023-12-08T08:18:01.891182+0000","last_became_peered":"2023-12-08T08:18:01.891182+0000","last_unstale":"2023-12-08T08:18:03.569378+0000","last_undegraded":"2023-12-08T08:18:03.569378+0000","last_fullsized":"2023-12-08T08:18:03.569378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:52.932114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873203+0000","last_change":"2023-12-08T08:17:57.853709+0000","last_active":"2023-12-08T08:18:01.873203+0000","last_peered":"2023-12-08T08:18:01.873203+0000","last_clean":"2023-12-08T08:18:01.873203+0000","last_became_active":"2023-12-08T08:17:57.853422+0000","last_became_peered":"2023-12-08T08:17:57.853422+0000","last_unstale":"2023-12-08T08:18:01.873203+0000","last_undegraded":"2023-12-08T08:18:01.873203+0000","last_fullsized":"2023-12-08T08:18:01.873203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881686+0000","last_change":"2023-12-08T08:17:56.838162+0000","last_active":"2023-12-08T08:18:01.881686+0000","last_peered":"2023-12-08T08:18:01.881686+0000","last_clean":"2023-12-08T08:18:01.881686+0000","last_became_active":"2023-12-08T08:17:56.837914+0000","last_became_peered":"2023-12-08T08:17:56.837914+0000","last_unstale":"2023-12-08T08:18:01.881686+0000","last_undegraded":"2023-12-08T08:18:01.881686+0000","last_fullsized":"2023-12-08T08:18:01.881686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568391+0000","last_change":"2023-12-08T08:18:01.886684+0000","last_active":"2023-12-08T08:18:03.568391+0000","last_peered":"2023-12-08T08:18:03.568391+0000","last_clean":"2023-12-08T08:18:03.568391+0000","last_became_active":"2023-12-08T08:18:01.886257+0000","last_became_peered":"2023-12-08T08:18:01.886257+0000","last_unstale":"2023-12-08T08:18:03.568391+0000","last_undegraded":"2023-12-08T08:18:03.568391+0000","last_fullsized":"2023-12-08T08:18:03.568391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868425+0000","last_change":"2023-12-08T08:17:57.864189+0000","last_active":"2023-12-08T08:18:01.868425+0000","last_peered":"2023-12-08T08:18:01.868425+0000","last_clean":"2023-12-08T08:18:01.868425+0000","last_became_active":"2023-12-08T08:17:57.863656+0000","last_became_peered":"2023-12-08T08:17:57.863656+0000","last_unstale":"2023-12-08T08:18:01.868425+0000","last_undegraded":"2023-12-08T08:18:01.868425+0000","last_fullsized":"2023-12-08T08:18:01.868425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885512+0000","last_change":"2023-12-08T08:17:56.835325+0000","last_active":"2023-12-08T08:18:01.885512+0000","last_peered":"2023-12-08T08:18:01.885512+0000","last_clean":"2023-12-08T08:18:01.885512+0000","last_became_active":"2023-12-08T08:17:56.834877+0000","last_became_peered":"2023-12-08T08:17:56.834877+0000","last_unstale":"2023-12-08T08:18:01.885512+0000","last_undegraded":"2023-12-08T08:18:01.885512+0000","last_fullsized":"2023-12-08T08:18:01.885512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567624+0000","last_change":"2023-12-08T08:18:01.891058+0000","last_active":"2023-12-08T08:18:03.567624+0000","last_peered":"2023-12-08T08:18:03.567624+0000","last_clean":"2023-12-08T08:18:03.567624+0000","last_became_active":"2023-12-08T08:18:01.890653+0000","last_became_peered":"2023-12-08T08:18:01.890653+0000","last_unstale":"2023-12-08T08:18:03.567624+0000","last_undegraded":"2023-12-08T08:18:03.567624+0000","last_fullsized":"2023-12-08T08:18:03.567624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885917+0000","last_change":"2023-12-08T08:17:57.851573+0000","last_active":"2023-12-08T08:18:01.885917+0000","last_peered":"2023-12-08T08:18:01.885917+0000","last_clean":"2023-12-08T08:18:01.885917+0000","last_became_active":"2023-12-08T08:17:57.851275+0000","last_became_peered":"2023-12-08T08:17:57.851275+0000","last_unstale":"2023-12-08T08:18:01.885917+0000","last_undegraded":"2023-12-08T08:18:01.885917+0000","last_fullsized":"2023-12-08T08:18:01.885917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868821+0000","last_change":"2023-12-08T08:17:56.842419+0000","last_active":"2023-12-08T08:18:01.868821+0000","last_peered":"2023-12-08T08:18:01.868821+0000","last_clean":"2023-12-08T08:18:01.868821+0000","last_became_active":"2023-12-08T08:17:56.842113+0000","last_became_peered":"2023-12-08T08:17:56.842113+0000","last_unstale":"2023-12-08T08:18:01.868821+0000","last_undegraded":"2023-12-08T08:18:01.868821+0000","last_fullsized":"2023-12-08T08:18:01.868821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569320+0000","last_change":"2023-12-08T08:18:01.896199+0000","last_active":"2023-12-08T08:18:03.569320+0000","last_peered":"2023-12-08T08:18:03.569320+0000","last_clean":"2023-12-08T08:18:03.569320+0000","last_became_active":"2023-12-08T08:18:01.895808+0000","last_became_peered":"2023-12-08T08:18:01.895808+0000","last_unstale":"2023-12-08T08:18:03.569320+0000","last_undegraded":"2023-12-08T08:18:03.569320+0000","last_fullsized":"2023-12-08T08:18:03.569320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870316+0000","last_change":"2023-12-08T08:17:57.865891+0000","last_active":"2023-12-08T08:18:01.870316+0000","last_peered":"2023-12-08T08:18:01.870316+0000","last_clean":"2023-12-08T08:18:01.870316+0000","last_became_active":"2023-12-08T08:17:57.865615+0000","last_became_peered":"2023-12-08T08:17:57.865615+0000","last_unstale":"2023-12-08T08:18:01.870316+0000","last_undegraded":"2023-12-08T08:18:01.870316+0000","last_fullsized":"2023-12-08T08:18:01.870316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.886007+0000","last_change":"2023-12-08T08:17:56.841200+0000","last_active":"2023-12-08T08:18:01.886007+0000","last_peered":"2023-12-08T08:18:01.886007+0000","last_clean":"2023-12-08T08:18:01.886007+0000","last_became_active":"2023-12-08T08:17:56.840931+0000","last_became_peered":"2023-12-08T08:17:56.840931+0000","last_unstale":"2023-12-08T08:18:01.886007+0000","last_undegraded":"2023-12-08T08:18:01.886007+0000","last_fullsized":"2023-12-08T08:18:01.886007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569499+0000","last_change":"2023-12-08T08:18:01.891062+0000","last_active":"2023-12-08T08:18:03.569499+0000","last_peered":"2023-12-08T08:18:03.569499+0000","last_clean":"2023-12-08T08:18:03.569499+0000","last_became_active":"2023-12-08T08:18:01.889897+0000","last_became_peered":"2023-12-08T08:18:01.889897+0000","last_unstale":"2023-12-08T08:18:03.569499+0000","last_undegraded":"2023-12-08T08:18:03.569499+0000","last_fullsized":"2023-12-08T08:18:03.569499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875197+0000","last_change":"2023-12-08T08:17:57.858835+0000","last_active":"2023-12-08T08:18:01.875197+0000","last_peered":"2023-12-08T08:18:01.875197+0000","last_clean":"2023-12-08T08:18:01.875197+0000","last_became_active":"2023-12-08T08:17:57.857435+0000","last_became_peered":"2023-12-08T08:17:57.857435+0000","last_unstale":"2023-12-08T08:18:01.875197+0000","last_undegraded":"2023-12-08T08:18:01.875197+0000","last_fullsized":"2023-12-08T08:18:01.875197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:23:20.987641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869458+0000","last_change":"2023-12-08T08:17:56.837734+0000","last_active":"2023-12-08T08:18:01.869458+0000","last_peered":"2023-12-08T08:18:01.869458+0000","last_clean":"2023-12-08T08:18:01.869458+0000","last_became_active":"2023-12-08T08:17:56.837449+0000","last_became_peered":"2023-12-08T08:17:56.837449+0000","last_unstale":"2023-12-08T08:18:01.869458+0000","last_undegraded":"2023-12-08T08:18:01.869458+0000","last_fullsized":"2023-12-08T08:18:01.869458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568865+0000","last_change":"2023-12-08T08:18:01.890850+0000","last_active":"2023-12-08T08:18:03.568865+0000","last_peered":"2023-12-08T08:18:03.568865+0000","last_clean":"2023-12-08T08:18:03.568865+0000","last_became_active":"2023-12-08T08:18:01.890183+0000","last_became_peered":"2023-12-08T08:18:01.890183+0000","last_unstale":"2023-12-08T08:18:03.568865+0000","last_undegraded":"2023-12-08T08:18:03.568865+0000","last_fullsized":"2023-12-08T08:18:03.568865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885216+0000","last_change":"2023-12-08T08:17:57.851203+0000","last_active":"2023-12-08T08:18:01.885216+0000","last_peered":"2023-12-08T08:18:01.885216+0000","last_clean":"2023-12-08T08:18:01.885216+0000","last_became_active":"2023-12-08T08:17:57.850672+0000","last_became_peered":"2023-12-08T08:17:57.850672+0000","last_unstale":"2023-12-08T08:18:01.885216+0000","last_undegraded":"2023-12-08T08:18:01.885216+0000","last_fullsized":"2023-12-08T08:18:01.885216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873056+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.873056+0000","last_peered":"2023-12-08T08:18:01.873056+0000","last_clean":"2023-12-08T08:18:01.873056+0000","last_became_active":"2023-12-08T08:17:56.832238+0000","last_became_peered":"2023-12-08T08:17:56.832238+0000","last_unstale":"2023-12-08T08:18:01.873056+0000","last_undegraded":"2023-12-08T08:18:01.873056+0000","last_fullsized":"2023-12-08T08:18:01.873056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569367+0000","last_change":"2023-12-08T08:18:01.894980+0000","last_active":"2023-12-08T08:18:03.569367+0000","last_peered":"2023-12-08T08:18:03.569367+0000","last_clean":"2023-12-08T08:18:03.569367+0000","last_became_active":"2023-12-08T08:18:01.894588+0000","last_became_peered":"2023-12-08T08:18:01.894588+0000","last_unstale":"2023-12-08T08:18:03.569367+0000","last_undegraded":"2023-12-08T08:18:03.569367+0000","last_fullsized":"2023-12-08T08:18:03.569367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871709+0000","last_change":"2023-12-08T08:17:57.848723+0000","last_active":"2023-12-08T08:18:01.871709+0000","last_peered":"2023-12-08T08:18:01.871709+0000","last_clean":"2023-12-08T08:18:01.871709+0000","last_became_active":"2023-12-08T08:17:57.848474+0000","last_became_peered":"2023-12-08T08:17:57.848474+0000","last_unstale":"2023-12-08T08:18:01.871709+0000","last_undegraded":"2023-12-08T08:18:01.871709+0000","last_fullsized":"2023-12-08T08:18:01.871709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:23.681343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867954+0000","last_change":"2023-12-08T08:17:56.839808+0000","last_active":"2023-12-08T08:18:01.867954+0000","last_peered":"2023-12-08T08:18:01.867954+0000","last_clean":"2023-12-08T08:18:01.867954+0000","last_became_active":"2023-12-08T08:17:56.839540+0000","last_became_peered":"2023-12-08T08:17:56.839540+0000","last_unstale":"2023-12-08T08:18:01.867954+0000","last_undegraded":"2023-12-08T08:18:01.867954+0000","last_fullsized":"2023-12-08T08:18:01.867954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569746+0000","last_change":"2023-12-08T08:18:01.897047+0000","last_active":"2023-12-08T08:18:03.569746+0000","last_peered":"2023-12-08T08:18:03.569746+0000","last_clean":"2023-12-08T08:18:03.569746+0000","last_became_active":"2023-12-08T08:18:01.896673+0000","last_became_peered":"2023-12-08T08:18:01.896673+0000","last_unstale":"2023-12-08T08:18:03.569746+0000","last_undegraded":"2023-12-08T08:18:03.569746+0000","last_fullsized":"2023-12-08T08:18:03.569746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868108+0000","last_change":"2023-12-08T08:17:57.863988+0000","last_active":"2023-12-08T08:18:01.868108+0000","last_peered":"2023-12-08T08:18:01.868108+0000","last_clean":"2023-12-08T08:18:01.868108+0000","last_became_active":"2023-12-08T08:17:57.863672+0000","last_became_peered":"2023-12-08T08:17:57.863672+0000","last_unstale":"2023-12-08T08:18:01.868108+0000","last_undegraded":"2023-12-08T08:18:01.868108+0000","last_fullsized":"2023-12-08T08:18:01.868108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868596+0000","last_change":"2023-12-08T08:17:56.838442+0000","last_active":"2023-12-08T08:18:01.868596+0000","last_peered":"2023-12-08T08:18:01.868596+0000","last_clean":"2023-12-08T08:18:01.868596+0000","last_became_active":"2023-12-08T08:17:56.838200+0000","last_became_peered":"2023-12-08T08:17:56.838200+0000","last_unstale":"2023-12-08T08:18:01.868596+0000","last_undegraded":"2023-12-08T08:18:01.868596+0000","last_fullsized":"2023-12-08T08:18:01.868596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:05.691540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868065+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:18:01.868065+0000","last_peered":"2023-12-08T08:18:01.868065+0000","last_clean":"2023-12-08T08:18:01.868065+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:18:01.868065+0000","last_undegraded":"2023-12-08T08:18:01.868065+0000","last_fullsized":"2023-12-08T08:18:01.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880838+0000","last_change":"2023-12-08T08:18:01.888488+0000","last_active":"2023-12-08T08:18:02.880838+0000","last_peered":"2023-12-08T08:18:02.880838+0000","last_clean":"2023-12-08T08:18:02.880838+0000","last_became_active":"2023-12-08T08:18:01.888094+0000","last_became_peered":"2023-12-08T08:18:01.888094+0000","last_unstale":"2023-12-08T08:18:02.880838+0000","last_undegraded":"2023-12-08T08:18:02.880838+0000","last_fullsized":"2023-12-08T08:18:02.880838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868680+0000","last_change":"2023-12-08T08:17:57.857404+0000","last_active":"2023-12-08T08:18:01.868680+0000","last_peered":"2023-12-08T08:18:01.868680+0000","last_clean":"2023-12-08T08:18:01.868680+0000","last_became_active":"2023-12-08T08:17:57.857153+0000","last_became_peered":"2023-12-08T08:17:57.857153+0000","last_unstale":"2023-12-08T08:18:01.868680+0000","last_undegraded":"2023-12-08T08:18:01.868680+0000","last_fullsized":"2023-12-08T08:18:01.868680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873513+0000","last_change":"2023-12-08T08:17:56.839948+0000","last_active":"2023-12-08T08:18:01.873513+0000","last_peered":"2023-12-08T08:18:01.873513+0000","last_clean":"2023-12-08T08:18:01.873513+0000","last_became_active":"2023-12-08T08:17:56.839635+0000","last_became_peered":"2023-12-08T08:17:56.839635+0000","last_unstale":"2023-12-08T08:18:01.873513+0000","last_undegraded":"2023-12-08T08:18:01.873513+0000","last_fullsized":"2023-12-08T08:18:01.873513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.879318+0000","last_change":"2023-12-08T08:18:01.896627+0000","last_active":"2023-12-08T08:18:02.879318+0000","last_peered":"2023-12-08T08:18:02.879318+0000","last_clean":"2023-12-08T08:18:02.879318+0000","last_became_active":"2023-12-08T08:18:01.896206+0000","last_became_peered":"2023-12-08T08:18:01.896206+0000","last_unstale":"2023-12-08T08:18:02.879318+0000","last_undegraded":"2023-12-08T08:18:02.879318+0000","last_fullsized":"2023-12-08T08:18:02.879318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:10.446350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869237+0000","last_change":"2023-12-08T08:17:57.868521+0000","last_active":"2023-12-08T08:18:01.869237+0000","last_peered":"2023-12-08T08:18:01.869237+0000","last_clean":"2023-12-08T08:18:01.869237+0000","last_became_active":"2023-12-08T08:17:57.866204+0000","last_became_peered":"2023-12-08T08:17:57.866204+0000","last_unstale":"2023-12-08T08:18:01.869237+0000","last_undegraded":"2023-12-08T08:18:01.869237+0000","last_fullsized":"2023-12-08T08:18:01.869237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885415+0000","last_change":"2023-12-08T08:17:56.831155+0000","last_active":"2023-12-08T08:18:01.885415+0000","last_peered":"2023-12-08T08:18:01.885415+0000","last_clean":"2023-12-08T08:18:01.885415+0000","last_became_active":"2023-12-08T08:17:56.830810+0000","last_became_peered":"2023-12-08T08:17:56.830810+0000","last_unstale":"2023-12-08T08:18:01.885415+0000","last_undegraded":"2023-12-08T08:18:01.885415+0000","last_fullsized":"2023-12-08T08:18:01.885415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569993+0000","last_change":"2023-12-08T08:18:01.888765+0000","last_active":"2023-12-08T08:18:03.569993+0000","last_peered":"2023-12-08T08:18:03.569993+0000","last_clean":"2023-12-08T08:18:03.569993+0000","last_became_active":"2023-12-08T08:18:01.888409+0000","last_became_peered":"2023-12-08T08:18:01.888409+0000","last_unstale":"2023-12-08T08:18:03.569993+0000","last_undegraded":"2023-12-08T08:18:03.569993+0000","last_fullsized":"2023-12-08T08:18:03.569993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868755+0000","last_change":"2023-12-08T08:17:57.862594+0000","last_active":"2023-12-08T08:18:01.868755+0000","last_peered":"2023-12-08T08:18:01.868755+0000","last_clean":"2023-12-08T08:18:01.868755+0000","last_became_active":"2023-12-08T08:17:57.862124+0000","last_became_peered":"2023-12-08T08:17:57.862124+0000","last_unstale":"2023-12-08T08:18:01.868755+0000","last_undegraded":"2023-12-08T08:18:01.868755+0000","last_fullsized":"2023-12-08T08:18:01.868755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:34.877529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875757+0000","last_change":"2023-12-08T08:17:56.838532+0000","last_active":"2023-12-08T08:18:01.875757+0000","last_peered":"2023-12-08T08:18:01.875757+0000","last_clean":"2023-12-08T08:18:01.875757+0000","last_became_active":"2023-12-08T08:17:56.838220+0000","last_became_peered":"2023-12-08T08:17:56.838220+0000","last_unstale":"2023-12-08T08:18:01.875757+0000","last_undegraded":"2023-12-08T08:18:01.875757+0000","last_fullsized":"2023-12-08T08:18:01.875757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568060+0000","last_change":"2023-12-08T08:18:01.882801+0000","last_active":"2023-12-08T08:18:03.568060+0000","last_peered":"2023-12-08T08:18:03.568060+0000","last_clean":"2023-12-08T08:18:03.568060+0000","last_became_active":"2023-12-08T08:18:01.882438+0000","last_became_peered":"2023-12-08T08:18:01.882438+0000","last_unstale":"2023-12-08T08:18:03.568060+0000","last_undegraded":"2023-12-08T08:18:03.568060+0000","last_fullsized":"2023-12-08T08:18:03.568060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868362+0000","last_change":"2023-12-08T08:17:57.854674+0000","last_active":"2023-12-08T08:18:01.868362+0000","last_peered":"2023-12-08T08:18:01.868362+0000","last_clean":"2023-12-08T08:18:01.868362+0000","last_became_active":"2023-12-08T08:17:57.854400+0000","last_became_peered":"2023-12-08T08:17:57.854400+0000","last_unstale":"2023-12-08T08:18:01.868362+0000","last_undegraded":"2023-12-08T08:18:01.868362+0000","last_fullsized":"2023-12-08T08:18:01.868362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871957+0000","last_change":"2023-12-08T08:17:56.833827+0000","last_active":"2023-12-08T08:18:01.871957+0000","last_peered":"2023-12-08T08:18:01.871957+0000","last_clean":"2023-12-08T08:18:01.871957+0000","last_became_active":"2023-12-08T08:17:56.833544+0000","last_became_peered":"2023-12-08T08:17:56.833544+0000","last_unstale":"2023-12-08T08:18:01.871957+0000","last_undegraded":"2023-12-08T08:18:01.871957+0000","last_fullsized":"2023-12-08T08:18:01.871957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:30:08.734416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568098+0000","last_change":"2023-12-08T08:18:01.890953+0000","last_active":"2023-12-08T08:18:03.568098+0000","last_peered":"2023-12-08T08:18:03.568098+0000","last_clean":"2023-12-08T08:18:03.568098+0000","last_became_active":"2023-12-08T08:18:01.890169+0000","last_became_peered":"2023-12-08T08:18:01.890169+0000","last_unstale":"2023-12-08T08:18:03.568098+0000","last_undegraded":"2023-12-08T08:18:03.568098+0000","last_fullsized":"2023-12-08T08:18:03.568098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:14.643740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868180+0000","last_change":"2023-12-08T08:17:57.858656+0000","last_active":"2023-12-08T08:18:01.868180+0000","last_peered":"2023-12-08T08:18:01.868180+0000","last_clean":"2023-12-08T08:18:01.868180+0000","last_became_active":"2023-12-08T08:17:57.858335+0000","last_became_peered":"2023-12-08T08:17:57.858335+0000","last_unstale":"2023-12-08T08:18:01.868180+0000","last_undegraded":"2023-12-08T08:18:01.868180+0000","last_fullsized":"2023-12-08T08:18:01.868180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872816+0000","last_change":"2023-12-08T08:17:56.828427+0000","last_active":"2023-12-08T08:18:01.872816+0000","last_peered":"2023-12-08T08:18:01.872816+0000","last_clean":"2023-12-08T08:18:01.872816+0000","last_became_active":"2023-12-08T08:17:56.828104+0000","last_became_peered":"2023-12-08T08:17:56.828104+0000","last_unstale":"2023-12-08T08:18:01.872816+0000","last_undegraded":"2023-12-08T08:18:01.872816+0000","last_fullsized":"2023-12-08T08:18:01.872816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:35.770309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569594+0000","last_change":"2023-12-08T08:18:01.882325+0000","last_active":"2023-12-08T08:18:03.569594+0000","last_peered":"2023-12-08T08:18:03.569594+0000","last_clean":"2023-12-08T08:18:03.569594+0000","last_became_active":"2023-12-08T08:18:01.881811+0000","last_became_peered":"2023-12-08T08:18:01.881811+0000","last_unstale":"2023-12-08T08:18:03.569594+0000","last_undegraded":"2023-12-08T08:18:03.569594+0000","last_fullsized":"2023-12-08T08:18:03.569594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881194+0000","last_change":"2023-12-08T08:17:57.868472+0000","last_active":"2023-12-08T08:18:01.881194+0000","last_peered":"2023-12-08T08:18:01.881194+0000","last_clean":"2023-12-08T08:18:01.881194+0000","last_became_active":"2023-12-08T08:17:57.867557+0000","last_became_peered":"2023-12-08T08:17:57.867557+0000","last_unstale":"2023-12-08T08:18:01.881194+0000","last_undegraded":"2023-12-08T08:18:01.881194+0000","last_fullsized":"2023-12-08T08:18:01.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880481+0000","last_change":"2023-12-08T08:17:56.834501+0000","last_active":"2023-12-08T08:18:01.880481+0000","last_peered":"2023-12-08T08:18:01.880481+0000","last_clean":"2023-12-08T08:18:01.880481+0000","last_became_active":"2023-12-08T08:17:56.834216+0000","last_became_peered":"2023-12-08T08:17:56.834216+0000","last_unstale":"2023-12-08T08:18:01.880481+0000","last_undegraded":"2023-12-08T08:18:01.880481+0000","last_fullsized":"2023-12-08T08:18:01.880481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568473+0000","last_change":"2023-12-08T08:18:01.891154+0000","last_active":"2023-12-08T08:18:03.568473+0000","last_peered":"2023-12-08T08:18:03.568473+0000","last_clean":"2023-12-08T08:18:03.568473+0000","last_became_active":"2023-12-08T08:18:01.890734+0000","last_became_peered":"2023-12-08T08:18:01.890734+0000","last_unstale":"2023-12-08T08:18:03.568473+0000","last_undegraded":"2023-12-08T08:18:03.568473+0000","last_fullsized":"2023-12-08T08:18:03.568473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:18:11.033301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868378+0000","last_change":"2023-12-08T08:17:57.861535+0000","last_active":"2023-12-08T08:18:01.868378+0000","last_peered":"2023-12-08T08:18:01.868378+0000","last_clean":"2023-12-08T08:18:01.868378+0000","last_became_active":"2023-12-08T08:17:57.860529+0000","last_became_peered":"2023-12-08T08:17:57.860529+0000","last_unstale":"2023-12-08T08:18:01.868378+0000","last_undegraded":"2023-12-08T08:18:01.868378+0000","last_fullsized":"2023-12-08T08:18:01.868378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869270+0000","last_change":"2023-12-08T08:17:56.838952+0000","last_active":"2023-12-08T08:18:01.869270+0000","last_peered":"2023-12-08T08:18:01.869270+0000","last_clean":"2023-12-08T08:18:01.869270+0000","last_became_active":"2023-12-08T08:17:56.838708+0000","last_became_peered":"2023-12-08T08:17:56.838708+0000","last_unstale":"2023-12-08T08:18:01.869270+0000","last_undegraded":"2023-12-08T08:18:01.869270+0000","last_fullsized":"2023-12-08T08:18:01.869270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568624+0000","last_change":"2023-12-08T08:18:01.893574+0000","last_active":"2023-12-08T08:18:03.568624+0000","last_peered":"2023-12-08T08:18:03.568624+0000","last_clean":"2023-12-08T08:18:03.568624+0000","last_became_active":"2023-12-08T08:18:01.892008+0000","last_became_peered":"2023-12-08T08:18:01.892008+0000","last_unstale":"2023-12-08T08:18:03.568624+0000","last_undegraded":"2023-12-08T08:18:03.568624+0000","last_fullsized":"2023-12-08T08:18:03.568624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:59:58.367917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873150+0000","last_change":"2023-12-08T08:17:57.858464+0000","last_active":"2023-12-08T08:18:01.873150+0000","last_peered":"2023-12-08T08:18:01.873150+0000","last_clean":"2023-12-08T08:18:01.873150+0000","last_became_active":"2023-12-08T08:17:57.857748+0000","last_became_peered":"2023-12-08T08:17:57.857748+0000","last_unstale":"2023-12-08T08:18:01.873150+0000","last_undegraded":"2023-12-08T08:18:01.873150+0000","last_fullsized":"2023-12-08T08:18:01.873150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872709+0000","last_change":"2023-12-08T08:17:56.834818+0000","last_active":"2023-12-08T08:18:01.872709+0000","last_peered":"2023-12-08T08:18:01.872709+0000","last_clean":"2023-12-08T08:18:01.872709+0000","last_became_active":"2023-12-08T08:17:56.834412+0000","last_became_peered":"2023-12-08T08:17:56.834412+0000","last_unstale":"2023-12-08T08:18:01.872709+0000","last_undegraded":"2023-12-08T08:18:01.872709+0000","last_fullsized":"2023-12-08T08:18:01.872709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569218+0000","last_change":"2023-12-08T08:18:01.879603+0000","last_active":"2023-12-08T08:18:03.569218+0000","last_peered":"2023-12-08T08:18:03.569218+0000","last_clean":"2023-12-08T08:18:03.569218+0000","last_became_active":"2023-12-08T08:18:01.879223+0000","last_became_peered":"2023-12-08T08:18:01.879223+0000","last_unstale":"2023-12-08T08:18:03.569218+0000","last_undegraded":"2023-12-08T08:18:03.569218+0000","last_fullsized":"2023-12-08T08:18:03.569218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868610+0000","last_change":"2023-12-08T08:17:57.867653+0000","last_active":"2023-12-08T08:18:01.868610+0000","last_peered":"2023-12-08T08:18:01.868610+0000","last_clean":"2023-12-08T08:18:01.868610+0000","last_became_active":"2023-12-08T08:17:57.867361+0000","last_became_peered":"2023-12-08T08:17:57.867361+0000","last_unstale":"2023-12-08T08:18:01.868610+0000","last_undegraded":"2023-12-08T08:18:01.868610+0000","last_fullsized":"2023-12-08T08:18:01.868610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:07.193843+0000","last_change":"2023-12-08T08:17:56.841032+0000","last_active":"2023-12-08T08:18:07.193843+0000","last_peered":"2023-12-08T08:18:07.193843+0000","last_clean":"2023-12-08T08:18:07.193843+0000","last_became_active":"2023-12-08T08:17:56.840787+0000","last_became_peered":"2023-12-08T08:17:56.840787+0000","last_unstale":"2023-12-08T08:18:07.193843+0000","last_undegraded":"2023-12-08T08:18:07.193843+0000","last_fullsized":"2023-12-08T08:18:07.193843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569636+0000","last_change":"2023-12-08T08:18:01.891258+0000","last_active":"2023-12-08T08:18:03.569636+0000","last_peered":"2023-12-08T08:18:03.569636+0000","last_clean":"2023-12-08T08:18:03.569636+0000","last_became_active":"2023-12-08T08:18:01.889956+0000","last_became_peered":"2023-12-08T08:18:01.889956+0000","last_unstale":"2023-12-08T08:18:03.569636+0000","last_undegraded":"2023-12-08T08:18:03.569636+0000","last_fullsized":"2023-12-08T08:18:03.569636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873425+0000","last_change":"2023-12-08T08:17:57.855938+0000","last_active":"2023-12-08T08:18:01.873425+0000","last_peered":"2023-12-08T08:18:01.873425+0000","last_clean":"2023-12-08T08:18:01.873425+0000","last_became_active":"2023-12-08T08:17:57.855668+0000","last_became_peered":"2023-12-08T08:17:57.855668+0000","last_unstale":"2023-12-08T08:18:01.873425+0000","last_undegraded":"2023-12-08T08:18:01.873425+0000","last_fullsized":"2023-12-08T08:18:01.873425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:53.755384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885215+0000","last_change":"2023-12-08T08:17:56.840188+0000","last_active":"2023-12-08T08:18:01.885215+0000","last_peered":"2023-12-08T08:18:01.885215+0000","last_clean":"2023-12-08T08:18:01.885215+0000","last_became_active":"2023-12-08T08:17:56.839837+0000","last_became_peered":"2023-12-08T08:17:56.839837+0000","last_unstale":"2023-12-08T08:18:01.885215+0000","last_undegraded":"2023-12-08T08:18:01.885215+0000","last_fullsized":"2023-12-08T08:18:01.885215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568880+0000","last_change":"2023-12-08T08:18:01.891860+0000","last_active":"2023-12-08T08:18:03.568880+0000","last_peered":"2023-12-08T08:18:03.568880+0000","last_clean":"2023-12-08T08:18:03.568880+0000","last_became_active":"2023-12-08T08:18:01.890853+0000","last_became_peered":"2023-12-08T08:18:01.890853+0000","last_unstale":"2023-12-08T08:18:03.568880+0000","last_undegraded":"2023-12-08T08:18:03.568880+0000","last_fullsized":"2023-12-08T08:18:03.568880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:30.071394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872334+0000","last_change":"2023-12-08T08:17:57.855509+0000","last_active":"2023-12-08T08:18:01.872334+0000","last_peered":"2023-12-08T08:18:01.872334+0000","last_clean":"2023-12-08T08:18:01.872334+0000","last_became_active":"2023-12-08T08:17:57.855195+0000","last_became_peered":"2023-12-08T08:17:57.855195+0000","last_unstale":"2023-12-08T08:18:01.872334+0000","last_undegraded":"2023-12-08T08:18:01.872334+0000","last_fullsized":"2023-12-08T08:18:01.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868832+0000","last_change":"2023-12-08T08:17:56.838218+0000","last_active":"2023-12-08T08:18:01.868832+0000","last_peered":"2023-12-08T08:18:01.868832+0000","last_clean":"2023-12-08T08:18:01.868832+0000","last_became_active":"2023-12-08T08:17:56.837942+0000","last_became_peered":"2023-12-08T08:17:56.837942+0000","last_unstale":"2023-12-08T08:18:01.868832+0000","last_undegraded":"2023-12-08T08:18:01.868832+0000","last_fullsized":"2023-12-08T08:18:01.868832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:12.171098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567801+0000","last_change":"2023-12-08T08:18:01.888958+0000","last_active":"2023-12-08T08:18:03.567801+0000","last_peered":"2023-12-08T08:18:03.567801+0000","last_clean":"2023-12-08T08:18:03.567801+0000","last_became_active":"2023-12-08T08:18:01.888522+0000","last_became_peered":"2023-12-08T08:18:01.888522+0000","last_unstale":"2023-12-08T08:18:03.567801+0000","last_undegraded":"2023-12-08T08:18:03.567801+0000","last_fullsized":"2023-12-08T08:18:03.567801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868748+0000","last_change":"2023-12-08T08:17:57.859464+0000","last_active":"2023-12-08T08:18:01.868748+0000","last_peered":"2023-12-08T08:18:01.868748+0000","last_clean":"2023-12-08T08:18:01.868748+0000","last_became_active":"2023-12-08T08:17:57.857871+0000","last_became_peered":"2023-12-08T08:17:57.857871+0000","last_unstale":"2023-12-08T08:18:01.868748+0000","last_undegraded":"2023-12-08T08:18:01.868748+0000","last_fullsized":"2023-12-08T08:18:01.868748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881565+0000","last_change":"2023-12-08T08:17:56.840338+0000","last_active":"2023-12-08T08:18:01.881565+0000","last_peered":"2023-12-08T08:18:01.881565+0000","last_clean":"2023-12-08T08:18:01.881565+0000","last_became_active":"2023-12-08T08:17:56.838415+0000","last_became_peered":"2023-12-08T08:17:56.838415+0000","last_unstale":"2023-12-08T08:18:01.881565+0000","last_undegraded":"2023-12-08T08:18:01.881565+0000","last_fullsized":"2023-12-08T08:18:01.881565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567966+0000","last_change":"2023-12-08T08:18:01.886353+0000","last_active":"2023-12-08T08:18:03.567966+0000","last_peered":"2023-12-08T08:18:03.567966+0000","last_clean":"2023-12-08T08:18:03.567966+0000","last_became_active":"2023-12-08T08:18:01.885733+0000","last_became_peered":"2023-12-08T08:18:01.885733+0000","last_unstale":"2023-12-08T08:18:03.567966+0000","last_undegraded":"2023-12-08T08:18:03.567966+0000","last_fullsized":"2023-12-08T08:18:03.567966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:42:20.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569455+0000","last_change":"2023-12-08T08:18:01.898257+0000","last_active":"2023-12-08T08:18:03.569455+0000","last_peered":"2023-12-08T08:18:03.569455+0000","last_clean":"2023-12-08T08:18:03.569455+0000","last_became_active":"2023-12-08T08:18:01.897895+0000","last_became_peered":"2023-12-08T08:18:01.897895+0000","last_unstale":"2023-12-08T08:18:03.569455+0000","last_undegraded":"2023-12-08T08:18:03.569455+0000","last_fullsized":"2023-12-08T08:18:03.569455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885110+0000","last_change":"2023-12-08T08:17:57.852450+0000","last_active":"2023-12-08T08:18:01.885110+0000","last_peered":"2023-12-08T08:18:01.885110+0000","last_clean":"2023-12-08T08:18:01.885110+0000","last_became_active":"2023-12-08T08:17:57.852146+0000","last_became_peered":"2023-12-08T08:17:57.852146+0000","last_unstale":"2023-12-08T08:18:01.885110+0000","last_undegraded":"2023-12-08T08:18:01.885110+0000","last_fullsized":"2023-12-08T08:18:01.885110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870056+0000","last_change":"2023-12-08T08:17:56.834758+0000","last_active":"2023-12-08T08:18:01.870056+0000","last_peered":"2023-12-08T08:18:01.870056+0000","last_clean":"2023-12-08T08:18:01.870056+0000","last_became_active":"2023-12-08T08:17:56.834493+0000","last_became_peered":"2023-12-08T08:17:56.834493+0000","last_unstale":"2023-12-08T08:18:01.870056+0000","last_undegraded":"2023-12-08T08:18:01.870056+0000","last_fullsized":"2023-12-08T08:18:01.870056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880773+0000","last_change":"2023-12-08T08:18:01.897055+0000","last_active":"2023-12-08T08:18:02.880773+0000","last_peered":"2023-12-08T08:18:02.880773+0000","last_clean":"2023-12-08T08:18:02.880773+0000","last_became_active":"2023-12-08T08:18:01.896646+0000","last_became_peered":"2023-12-08T08:18:01.896646+0000","last_unstale":"2023-12-08T08:18:02.880773+0000","last_undegraded":"2023-12-08T08:18:02.880773+0000","last_fullsized":"2023-12-08T08:18:02.880773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:29.043747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869691+0000","last_change":"2023-12-08T08:17:57.864805+0000","last_active":"2023-12-08T08:18:01.869691+0000","last_peered":"2023-12-08T08:18:01.869691+0000","last_clean":"2023-12-08T08:18:01.869691+0000","last_became_active":"2023-12-08T08:17:57.864486+0000","last_became_peered":"2023-12-08T08:17:57.864486+0000","last_unstale":"2023-12-08T08:18:01.869691+0000","last_undegraded":"2023-12-08T08:18:01.869691+0000","last_fullsized":"2023-12-08T08:18:01.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870461+0000","last_change":"2023-12-08T08:17:56.836827+0000","last_active":"2023-12-08T08:18:01.870461+0000","last_peered":"2023-12-08T08:18:01.870461+0000","last_clean":"2023-12-08T08:18:01.870461+0000","last_became_active":"2023-12-08T08:17:56.836562+0000","last_became_peered":"2023-12-08T08:17:56.836562+0000","last_unstale":"2023-12-08T08:18:01.870461+0000","last_undegraded":"2023-12-08T08:18:01.870461+0000","last_fullsized":"2023-12-08T08:18:01.870461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880545+0000","last_change":"2023-12-08T08:17:56.831417+0000","last_active":"2023-12-08T08:18:01.880545+0000","last_peered":"2023-12-08T08:18:01.880545+0000","last_clean":"2023-12-08T08:18:01.880545+0000","last_became_active":"2023-12-08T08:17:56.830988+0000","last_became_peered":"2023-12-08T08:17:56.830988+0000","last_unstale":"2023-12-08T08:18:01.880545+0000","last_undegraded":"2023-12-08T08:18:01.880545+0000","last_fullsized":"2023-12-08T08:18:01.880545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872623+0000","last_change":"2023-12-08T08:17:57.848661+0000","last_active":"2023-12-08T08:18:01.872623+0000","last_peered":"2023-12-08T08:18:01.872623+0000","last_clean":"2023-12-08T08:18:01.872623+0000","last_became_active":"2023-12-08T08:17:57.848371+0000","last_became_peered":"2023-12-08T08:17:57.848371+0000","last_unstale":"2023-12-08T08:18:01.872623+0000","last_undegraded":"2023-12-08T08:18:01.872623+0000","last_fullsized":"2023-12-08T08:18:01.872623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.878886+0000","last_change":"2023-12-08T08:18:01.892612+0000","last_active":"2023-12-08T08:18:02.878886+0000","last_peered":"2023-12-08T08:18:02.878886+0000","last_clean":"2023-12-08T08:18:02.878886+0000","last_became_active":"2023-12-08T08:18:01.892204+0000","last_became_peered":"2023-12-08T08:18:01.892204+0000","last_unstale":"2023-12-08T08:18:02.878886+0000","last_undegraded":"2023-12-08T08:18:02.878886+0000","last_fullsized":"2023-12-08T08:18:02.878886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:27.724596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867878+0000","last_change":"2023-12-08T08:17:56.842132+0000","last_active":"2023-12-08T08:18:01.867878+0000","last_peered":"2023-12-08T08:18:01.867878+0000","last_clean":"2023-12-08T08:18:01.867878+0000","last_became_active":"2023-12-08T08:17:56.841864+0000","last_became_peered":"2023-12-08T08:17:56.841864+0000","last_unstale":"2023-12-08T08:18:01.867878+0000","last_undegraded":"2023-12-08T08:18:01.867878+0000","last_fullsized":"2023-12-08T08:18:01.867878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872976+0000","last_change":"2023-12-08T08:17:57.851016+0000","last_active":"2023-12-08T08:18:01.872976+0000","last_peered":"2023-12-08T08:18:01.872976+0000","last_clean":"2023-12-08T08:18:01.872976+0000","last_became_active":"2023-12-08T08:17:57.850755+0000","last_became_peered":"2023-12-08T08:17:57.850755+0000","last_unstale":"2023-12-08T08:18:01.872976+0000","last_undegraded":"2023-12-08T08:18:01.872976+0000","last_fullsized":"2023-12-08T08:18:01.872976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:31.989844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569175+0000","last_change":"2023-12-08T08:18:01.894077+0000","last_active":"2023-12-08T08:18:03.569175+0000","last_peered":"2023-12-08T08:18:03.569175+0000","last_clean":"2023-12-08T08:18:03.569175+0000","last_became_active":"2023-12-08T08:18:01.893598+0000","last_became_peered":"2023-12-08T08:18:01.893598+0000","last_unstale":"2023-12-08T08:18:03.569175+0000","last_undegraded":"2023-12-08T08:18:03.569175+0000","last_fullsized":"2023-12-08T08:18:03.569175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:42:43.972716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880217+0000","last_change":"2023-12-08T08:17:57.867998+0000","last_active":"2023-12-08T08:18:01.880217+0000","last_peered":"2023-12-08T08:18:01.880217+0000","last_clean":"2023-12-08T08:18:01.880217+0000","last_became_active":"2023-12-08T08:17:57.867727+0000","last_became_peered":"2023-12-08T08:17:57.867727+0000","last_unstale":"2023-12-08T08:18:01.880217+0000","last_undegraded":"2023-12-08T08:18:01.880217+0000","last_fullsized":"2023-12-08T08:18:01.880217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872963+0000","last_change":"2023-12-08T08:17:57.858911+0000","last_active":"2023-12-08T08:18:01.872963+0000","last_peered":"2023-12-08T08:18:01.872963+0000","last_clean":"2023-12-08T08:18:01.872963+0000","last_became_active":"2023-12-08T08:17:57.857682+0000","last_became_peered":"2023-12-08T08:17:57.857682+0000","last_unstale":"2023-12-08T08:18:01.872963+0000","last_undegraded":"2023-12-08T08:18:01.872963+0000","last_fullsized":"2023-12-08T08:18:01.872963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:20.413569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869275+0000","last_change":"2023-12-08T08:17:57.854413+0000","last_active":"2023-12-08T08:18:01.869275+0000","last_peered":"2023-12-08T08:18:01.869275+0000","last_clean":"2023-12-08T08:18:01.869275+0000","last_became_active":"2023-12-08T08:17:57.854156+0000","last_became_peered":"2023-12-08T08:17:57.854156+0000","last_unstale":"2023-12-08T08:18:01.869275+0000","last_undegraded":"2023-12-08T08:18:01.869275+0000","last_fullsized":"2023-12-08T08:18:01.869275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872542+0000","last_change":"2023-12-08T08:17:57.853043+0000","last_active":"2023-12-08T08:18:01.872542+0000","last_peered":"2023-12-08T08:18:01.872542+0000","last_clean":"2023-12-08T08:18:01.872542+0000","last_became_active":"2023-12-08T08:17:57.852710+0000","last_became_peered":"2023-12-08T08:17:57.852710+0000","last_unstale":"2023-12-08T08:18:01.872542+0000","last_undegraded":"2023-12-08T08:18:01.872542+0000","last_fullsized":"2023-12-08T08:18:01.872542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868777+0000","last_change":"2023-12-08T08:17:57.862525+0000","last_active":"2023-12-08T08:18:01.868777+0000","last_peered":"2023-12-08T08:18:01.868777+0000","last_clean":"2023-12-08T08:18:01.868777+0000","last_became_active":"2023-12-08T08:17:57.862274+0000","last_became_peered":"2023-12-08T08:17:57.862274+0000","last_unstale":"2023-12-08T08:18:01.868777+0000","last_undegraded":"2023-12-08T08:18:01.868777+0000","last_fullsized":"2023-12-08T08:18:01.868777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885096+0000","last_change":"2023-12-08T08:17:57.850983+0000","last_active":"2023-12-08T08:18:01.885096+0000","last_peered":"2023-12-08T08:18:01.885096+0000","last_clean":"2023-12-08T08:18:01.885096+0000","last_became_active":"2023-12-08T08:17:57.850648+0000","last_became_peered":"2023-12-08T08:17:57.850648+0000","last_unstale":"2023-12-08T08:18:01.885096+0000","last_undegraded":"2023-12-08T08:18:01.885096+0000","last_fullsized":"2023-12-08T08:18:01.885096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880266+0000","last_change":"2023-12-08T08:17:57.871856+0000","last_active":"2023-12-08T08:18:01.880266+0000","last_peered":"2023-12-08T08:18:01.880266+0000","last_clean":"2023-12-08T08:18:01.880266+0000","last_became_active":"2023-12-08T08:17:57.871436+0000","last_became_peered":"2023-12-08T08:17:57.871436+0000","last_unstale":"2023-12-08T08:18:01.880266+0000","last_undegraded":"2023-12-08T08:18:01.880266+0000","last_fullsized":"2023-12-08T08:18:01.880266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868325+0000","last_change":"2023-12-08T08:17:57.861903+0000","last_active":"2023-12-08T08:18:01.868325+0000","last_peered":"2023-12-08T08:18:01.868325+0000","last_clean":"2023-12-08T08:18:01.868325+0000","last_became_active":"2023-12-08T08:17:57.861604+0000","last_became_peered":"2023-12-08T08:17:57.861604+0000","last_unstale":"2023-12-08T08:18:01.868325+0000","last_undegraded":"2023-12-08T08:18:01.868325+0000","last_fullsized":"2023-12-08T08:18:01.868325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869960+0000","last_change":"2023-12-08T08:17:57.853217+0000","last_active":"2023-12-08T08:18:01.869960+0000","last_peered":"2023-12-08T08:18:01.869960+0000","last_clean":"2023-12-08T08:18:01.869960+0000","last_became_active":"2023-12-08T08:17:57.852944+0000","last_became_peered":"2023-12-08T08:17:57.852944+0000","last_unstale":"2023-12-08T08:18:01.869960+0000","last_undegraded":"2023-12-08T08:18:01.869960+0000","last_fullsized":"2023-12-08T08:18:01.869960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869655+0000","last_change":"2023-12-08T08:17:57.861199+0000","last_active":"2023-12-08T08:18:01.869655+0000","last_peered":"2023-12-08T08:18:01.869655+0000","last_clean":"2023-12-08T08:18:01.869655+0000","last_became_active":"2023-12-08T08:17:57.860929+0000","last_became_peered":"2023-12-08T08:17:57.860929+0000","last_unstale":"2023-12-08T08:18:01.869655+0000","last_undegraded":"2023-12-08T08:18:01.869655+0000","last_fullsized":"2023-12-08T08:18:01.869655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869190+0000","last_change":"2023-12-08T08:17:57.857515+0000","last_active":"2023-12-08T08:18:01.869190+0000","last_peered":"2023-12-08T08:18:01.869190+0000","last_clean":"2023-12-08T08:18:01.869190+0000","last_became_active":"2023-12-08T08:17:57.857211+0000","last_became_peered":"2023-12-08T08:17:57.857211+0000","last_unstale":"2023-12-08T08:18:01.869190+0000","last_undegraded":"2023-12-08T08:18:01.869190+0000","last_fullsized":"2023-12-08T08:18:01.869190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872446+0000","last_change":"2023-12-08T08:17:57.858919+0000","last_active":"2023-12-08T08:18:01.872446+0000","last_peered":"2023-12-08T08:18:01.872446+0000","last_clean":"2023-12-08T08:18:01.872446+0000","last_became_active":"2023-12-08T08:17:57.858591+0000","last_became_peered":"2023-12-08T08:17:57.858591+0000","last_unstale":"2023-12-08T08:18:01.872446+0000","last_undegraded":"2023-12-08T08:18:01.872446+0000","last_fullsized":"2023-12-08T08:18:01.872446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880097+0000","last_change":"2023-12-08T08:17:57.867005+0000","last_active":"2023-12-08T08:18:01.880097+0000","last_peered":"2023-12-08T08:18:01.880097+0000","last_clean":"2023-12-08T08:18:01.880097+0000","last_became_active":"2023-12-08T08:17:57.866755+0000","last_became_peered":"2023-12-08T08:17:57.866755+0000","last_unstale":"2023-12-08T08:18:01.880097+0000","last_undegraded":"2023-12-08T08:18:01.880097+0000","last_fullsized":"2023-12-08T08:18:01.880097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868792+0000","last_change":"2023-12-08T08:17:57.857239+0000","last_active":"2023-12-08T08:18:01.868792+0000","last_peered":"2023-12-08T08:18:01.868792+0000","last_clean":"2023-12-08T08:18:01.868792+0000","last_became_active":"2023-12-08T08:17:57.856974+0000","last_became_peered":"2023-12-08T08:17:57.856974+0000","last_unstale":"2023-12-08T08:18:01.868792+0000","last_undegraded":"2023-12-08T08:18:01.868792+0000","last_fullsized":"2023-12-08T08:18:01.868792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875617+0000","last_change":"2023-12-08T08:17:57.870364+0000","last_active":"2023-12-08T08:18:01.875617+0000","last_peered":"2023-12-08T08:18:01.875617+0000","last_clean":"2023-12-08T08:18:01.875617+0000","last_became_active":"2023-12-08T08:17:57.870055+0000","last_became_peered":"2023-12-08T08:17:57.870055+0000","last_unstale":"2023-12-08T08:18:01.875617+0000","last_undegraded":"2023-12-08T08:18:01.875617+0000","last_fullsized":"2023-12-08T08:18:01.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869535+0000","last_change":"2023-12-08T08:17:57.856731+0000","last_active":"2023-12-08T08:18:01.869535+0000","last_peered":"2023-12-08T08:18:01.869535+0000","last_clean":"2023-12-08T08:18:01.869535+0000","last_became_active":"2023-12-08T08:17:57.856474+0000","last_became_peered":"2023-12-08T08:17:57.856474+0000","last_unstale":"2023-12-08T08:18:01.869535+0000","last_undegraded":"2023-12-08T08:18:01.869535+0000","last_fullsized":"2023-12-08T08:18:01.869535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869853+0000","last_change":"2023-12-08T08:17:57.863405+0000","last_active":"2023-12-08T08:18:01.869853+0000","last_peered":"2023-12-08T08:18:01.869853+0000","last_clean":"2023-12-08T08:18:01.869853+0000","last_became_active":"2023-12-08T08:17:57.863134+0000","last_became_peered":"2023-12-08T08:17:57.863134+0000","last_unstale":"2023-12-08T08:18:01.869853+0000","last_undegraded":"2023-12-08T08:18:01.869853+0000","last_fullsized":"2023-12-08T08:18:01.869853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885204+0000","last_change":"2023-12-08T08:17:57.860480+0000","last_active":"2023-12-08T08:18:01.885204+0000","last_peered":"2023-12-08T08:18:01.885204+0000","last_clean":"2023-12-08T08:18:01.885204+0000","last_became_active":"2023-12-08T08:17:57.860188+0000","last_became_peered":"2023-12-08T08:17:57.860188+0000","last_unstale":"2023-12-08T08:18:01.885204+0000","last_undegraded":"2023-12-08T08:18:01.885204+0000","last_fullsized":"2023-12-08T08:18:01.885204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873034+0000","last_change":"2023-12-08T08:17:57.852445+0000","last_active":"2023-12-08T08:18:01.873034+0000","last_peered":"2023-12-08T08:18:01.873034+0000","last_clean":"2023-12-08T08:18:01.873034+0000","last_became_active":"2023-12-08T08:17:57.852166+0000","last_became_peered":"2023-12-08T08:17:57.852166+0000","last_unstale":"2023-12-08T08:18:01.873034+0000","last_undegraded":"2023-12-08T08:18:01.873034+0000","last_fullsized":"2023-12-08T08:18:01.873034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:13.038005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867672+0000","last_change":"2023-12-08T08:17:57.869784+0000","last_active":"2023-12-08T08:18:01.867672+0000","last_peered":"2023-12-08T08:18:01.867672+0000","last_clean":"2023-12-08T08:18:01.867672+0000","last_became_active":"2023-12-08T08:17:57.869480+0000","last_became_peered":"2023-12-08T08:17:57.869480+0000","last_unstale":"2023-12-08T08:18:01.867672+0000","last_undegraded":"2023-12-08T08:18:01.867672+0000","last_fullsized":"2023-12-08T08:18:01.867672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873259+0000","last_change":"2023-12-08T08:17:57.870844+0000","last_active":"2023-12-08T08:18:01.873259+0000","last_peered":"2023-12-08T08:18:01.873259+0000","last_clean":"2023-12-08T08:18:01.873259+0000","last_became_active":"2023-12-08T08:17:57.870537+0000","last_became_peered":"2023-12-08T08:17:57.870537+0000","last_unstale":"2023-12-08T08:18:01.873259+0000","last_undegraded":"2023-12-08T08:18:01.873259+0000","last_fullsized":"2023-12-08T08:18:01.873259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:35.384529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880776+0000","last_change":"2023-12-08T08:17:57.867745+0000","last_active":"2023-12-08T08:18:01.880776+0000","last_peered":"2023-12-08T08:18:01.880776+0000","last_clean":"2023-12-08T08:18:01.880776+0000","last_became_active":"2023-12-08T08:17:57.867492+0000","last_became_peered":"2023-12-08T08:17:57.867492+0000","last_unstale":"2023-12-08T08:18:01.880776+0000","last_undegraded":"2023-12-08T08:18:01.880776+0000","last_fullsized":"2023-12-08T08:18:01.880776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880175+0000","last_change":"2023-12-08T08:17:57.866534+0000","last_active":"2023-12-08T08:18:01.880175+0000","last_peered":"2023-12-08T08:18:01.880175+0000","last_clean":"2023-12-08T08:18:01.880175+0000","last_became_active":"2023-12-08T08:17:57.866280+0000","last_became_peered":"2023-12-08T08:17:57.866280+0000","last_unstale":"2023-12-08T08:18:01.880175+0000","last_undegraded":"2023-12-08T08:18:01.880175+0000","last_fullsized":"2023-12-08T08:18:01.880175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868651+0000","last_change":"2023-12-08T08:17:57.862123+0000","last_active":"2023-12-08T08:18:01.868651+0000","last_peered":"2023-12-08T08:18:01.868651+0000","last_clean":"2023-12-08T08:18:01.868651+0000","last_became_active":"2023-12-08T08:17:57.859905+0000","last_became_peered":"2023-12-08T08:17:57.859905+0000","last_unstale":"2023-12-08T08:18:01.868651+0000","last_undegraded":"2023-12-08T08:18:01.868651+0000","last_fullsized":"2023-12-08T08:18:01.868651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:02.076263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869059+0000","last_change":"2023-12-08T08:17:57.864037+0000","last_active":"2023-12-08T08:18:01.869059+0000","last_peered":"2023-12-08T08:18:01.869059+0000","last_clean":"2023-12-08T08:18:01.869059+0000","last_became_active":"2023-12-08T08:17:57.862943+0000","last_became_peered":"2023-12-08T08:17:57.862943+0000","last_unstale":"2023-12-08T08:18:01.869059+0000","last_undegraded":"2023-12-08T08:18:01.869059+0000","last_fullsized":"2023-12-08T08:18:01.869059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868564+0000","last_change":"2023-12-08T08:17:57.863052+0000","last_active":"2023-12-08T08:18:01.868564+0000","last_peered":"2023-12-08T08:18:01.868564+0000","last_clean":"2023-12-08T08:18:01.868564+0000","last_became_active":"2023-12-08T08:17:57.862762+0000","last_became_peered":"2023-12-08T08:17:57.862762+0000","last_unstale":"2023-12-08T08:18:01.868564+0000","last_undegraded":"2023-12-08T08:18:01.868564+0000","last_fullsized":"2023-12-08T08:18:01.868564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869100+0000","last_change":"2023-12-08T08:17:57.863846+0000","last_active":"2023-12-08T08:18:01.869100+0000","last_peered":"2023-12-08T08:18:01.869100+0000","last_clean":"2023-12-08T08:18:01.869100+0000","last_became_active":"2023-12-08T08:17:57.863582+0000","last_became_peered":"2023-12-08T08:17:57.863582+0000","last_unstale":"2023-12-08T08:18:01.869100+0000","last_undegraded":"2023-12-08T08:18:01.869100+0000","last_fullsized":"2023-12-08T08:18:01.869100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868290+0000","last_change":"2023-12-08T08:17:57.860800+0000","last_active":"2023-12-08T08:18:01.868290+0000","last_peered":"2023-12-08T08:18:01.868290+0000","last_clean":"2023-12-08T08:18:01.868290+0000","last_became_active":"2023-12-08T08:17:57.859933+0000","last_became_peered":"2023-12-08T08:17:57.859933+0000","last_unstale":"2023-12-08T08:18:01.868290+0000","last_undegraded":"2023-12-08T08:18:01.868290+0000","last_fullsized":"2023-12-08T08:18:01.868290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869044+0000","last_change":"2023-12-08T08:17:57.866870+0000","last_active":"2023-12-08T08:18:01.869044+0000","last_peered":"2023-12-08T08:18:01.869044+0000","last_clean":"2023-12-08T08:18:01.869044+0000","last_became_active":"2023-12-08T08:17:57.866242+0000","last_became_peered":"2023-12-08T08:17:57.866242+0000","last_unstale":"2023-12-08T08:18:01.869044+0000","last_undegraded":"2023-12-08T08:18:01.869044+0000","last_fullsized":"2023-12-08T08:18:01.869044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872306+0000","last_change":"2023-12-08T08:17:57.853244+0000","last_active":"2023-12-08T08:18:01.872306+0000","last_peered":"2023-12-08T08:18:01.872306+0000","last_clean":"2023-12-08T08:18:01.872306+0000","last_became_active":"2023-12-08T08:17:57.852962+0000","last_became_peered":"2023-12-08T08:17:57.852962+0000","last_unstale":"2023-12-08T08:18:01.872306+0000","last_undegraded":"2023-12-08T08:18:01.872306+0000","last_fullsized":"2023-12-08T08:18:01.872306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885422+0000","last_change":"2023-12-08T08:17:57.861311+0000","last_active":"2023-12-08T08:18:01.885422+0000","last_peered":"2023-12-08T08:18:01.885422+0000","last_clean":"2023-12-08T08:18:01.885422+0000","last_became_active":"2023-12-08T08:17:57.860997+0000","last_became_peered":"2023-12-08T08:17:57.860997+0000","last_unstale":"2023-12-08T08:18:01.885422+0000","last_undegraded":"2023-12-08T08:18:01.885422+0000","last_fullsized":"2023-12-08T08:18:01.885422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868647+0000","last_change":"2023-12-08T08:17:57.869587+0000","last_active":"2023-12-08T08:18:01.868647+0000","last_peered":"2023-12-08T08:18:01.868647+0000","last_clean":"2023-12-08T08:18:01.868647+0000","last_became_active":"2023-12-08T08:17:57.869269+0000","last_became_peered":"2023-12-08T08:17:57.869269+0000","last_unstale":"2023-12-08T08:18:01.868647+0000","last_undegraded":"2023-12-08T08:18:01.868647+0000","last_fullsized":"2023-12-08T08:18:01.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:41.285450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:20.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:21.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.069+0000 7f10e192c640 1 Processor -- start 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.069+0000 7f10e192c640 1 -- start start 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.070+0000 7f10e192c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc159a10 0x7f10dc0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.070+0000 7f10e192c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f10dc071760 0x7f10dc0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.070+0000 7f10e192c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc06dae0 con 0x7f10dc071dc0 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.070+0000 7f10e192c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0b3fa0 con 0x7f10dc071760 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.070+0000 7f10e192c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0ae2e0 con 0x7f10dc159a10 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10db7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f10dc071760 0x7f10dc0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10daffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc159a10 0x7f10dc0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10d3fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f10dc071dc0 0x7f10dc06c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51656/0 (socket says 172.21.15.50:51656) 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10db7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f10dc071760 0x7f10dc0b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37652/0 (socket says 172.21.15.50:37652) 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10d3fff640 1 -- 172.21.15.50:0/2559160023 learned_addr learned my addr 172.21.15.50:0/2559160023 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10da7fc640 1 -- 172.21.15.50:0/2559160023 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750209621 0 0) 0x7f10dc06dae0 con 0x7f10dc071dc0 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10da7fc640 1 -- 172.21.15.50:0/2559160023 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c8004630 con 0x7f10dc071dc0 2023-12-08T08:18:21.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10db7fe640 1 -- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc159a10 msgr2=0x7f10dc0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10db7fe640 1 --2- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc159a10 0x7f10dc0b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10db7fe640 1 -- 172.21.15.50:0/2559160023 >> v1:172.21.15.170:6789/0 conn(0x7f10dc071dc0 legacy=0x7f10dc06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10db7fe640 1 -- 172.21.15.50:0/2559160023 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc06dd30 con 0x7f10dc071760 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.071+0000 7f10daffd640 1 --2- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc159a10 0x7f10dc0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.072+0000 7f10db7fe640 1 --2- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc071760 0x7f10dc0b3a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009d90 tx=0x7f10d402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7820c1fcfcbe4d99 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.072+0000 7f10da7fc640 1 -- 172.21.15.50:0/2559160023 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d402cb30 con 0x7f10dc071760 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.072+0000 7f10da7fc640 1 -- 172.21.15.50:0/2559160023 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d402cc90 con 0x7f10dc071760 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.072+0000 7f10da7fc640 1 -- 172.21.15.50:0/2559160023 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4034440 con 0x7f10dc071760 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 -- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc071760 msgr2=0x7f10dc0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 --2- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc071760 0x7f10dc0b3a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009d90 tx=0x7f10d402bd80 comp rx=0 tx=0).stop 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 -- 172.21.15.50:0/2559160023 shutdown_connections 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 --2- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc071760 0x7f10dc0b3a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 --2- 172.21.15.50:0/2559160023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc159a10 0x7f10dc0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 -- 172.21.15.50:0/2559160023 >> 172.21.15.50:0/2559160023 conn(0x7f10dc0b09f0 msgr2=0x7f10dc0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 -- 172.21.15.50:0/2559160023 shutdown_connections 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.073+0000 7f10e192c640 1 -- 172.21.15.50:0/2559160023 wait complete. 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.074+0000 7f10e192c640 1 Processor -- start 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.074+0000 7f10e192c640 1 -- start start 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10e192c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10dc071760 0x7f10dc145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10e192c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc071dc0 0x7f10dc154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10e192c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc159a10 0x7f10dc154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10e192c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc151b60 con 0x7f10dc071760 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10e192c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc151e20 con 0x7f10dc159a10 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10e192c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc152100 con 0x7f10dc071dc0 2023-12-08T08:18:21.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10dc071760 0x7f10dc145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10dc071760 0x7f10dc145510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57040/0 (socket says 172.21.15.50:57040) 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 -- 172.21.15.50:0/845000051 learned_addr learned my addr 172.21.15.50:0/845000051 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10db7fe640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc159a10 0x7f10dc154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10d3fff640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc071dc0 0x7f10dc154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 -- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc071dc0 msgr2=0x7f10dc154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc071dc0 0x7f10dc154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 -- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc159a10 msgr2=0x7f10dc154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc159a10 0x7f10dc154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 -- 172.21.15.50:0/845000051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009400 con 0x7f10dc071760 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10daffd640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10dc071760 0x7f10dc145510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00e960 tx=0x7f10cc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.075+0000 7f10d8ff9640 1 -- 172.21.15.50:0/845000051 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc00ca00 con 0x7f10dc071760 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.076+0000 7f10d8ff9640 1 -- 172.21.15.50:0/845000051 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc00cb60 con 0x7f10dc071760 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.076+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d4009a70 con 0x7f10dc071760 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.076+0000 7f10d8ff9640 1 -- 172.21.15.50:0/845000051 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc013470 con 0x7f10dc071760 2023-12-08T08:18:21.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.076+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc145a50 con 0x7f10dc071760 2023-12-08T08:18:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.077+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc067430 con 0x7f10dc071760 2023-12-08T08:18:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.077+0000 7f10d8ff9640 1 -- 172.21.15.50:0/845000051 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10cc0135d0 con 0x7f10dc071760 2023-12-08T08:18:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.077+0000 7f10d8ff9640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f10bc06ae70 0x7f10bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.078+0000 7f10d8ff9640 1 -- 172.21.15.50:0/845000051 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10cc089a10 con 0x7f10dc071760 2023-12-08T08:18:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.078+0000 7f10d3fff640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f10bc06ae70 0x7f10bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.078+0000 7f10d3fff640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f10bc06ae70 0x7f10bc06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10dc159420 tx=0x7f10c4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.082+0000 7f10d8ff9640 1 -- 172.21.15.50:0/845000051 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10cc054910 con 0x7f10dc071760 2023-12-08T08:18:21.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.252+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10dc0adf70 con 0x7f10bc06ae70 2023-12-08T08:18:21.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.261+0000 7f10d8ff9640 1 -- 172.21.15.50:0/845000051 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345285 (secure 0 0 0) 0x7f10c40014d0 con 0x7f10bc06ae70 2023-12-08T08:18:21.265 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:21.271 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:18:21.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f10bc06ae70 msgr2=0x7f10bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f10bc06ae70 0x7f10bc06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10dc159420 tx=0x7f10c4007d30 comp rx=0 tx=0).stop 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10dc071760 msgr2=0x7f10dc145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10dc071760 0x7f10dc145510 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00e960 tx=0x7f10cc00ee20 comp rx=0 tx=0).stop 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 shutdown_connections 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f10bc06ae70 0x7f10bc06d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10dc159a10 0x7f10dc154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f10dc071dc0 0x7f10dc154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.274 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 --2- 172.21.15.50:0/845000051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f10dc071760 0x7f10dc145510 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 >> 172.21.15.50:0/845000051 conn(0x7f10dc0b09f0 msgr2=0x7f10dc06c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 shutdown_connections 2023-12-08T08:18:21.275 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.265+0000 7f10e192c640 1 -- 172.21.15.50:0/845000051 wait complete. 2023-12-08T08:18:21.278 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-08T08:18:20.116934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252652,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722068,"statfs":{"total":773094113280,"available":772835397632,"internally_reserved":0,"allocated":3280896,"data_stored":1987327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2227,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003532"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872492+0000","last_change":"2023-12-08T08:17:56.842906+0000","last_active":"2023-12-08T08:18:01.872492+0000","last_peered":"2023-12-08T08:18:01.872492+0000","last_clean":"2023-12-08T08:18:01.872492+0000","last_became_active":"2023-12-08T08:17:56.842598+0000","last_became_peered":"2023-12-08T08:17:56.842598+0000","last_unstale":"2023-12-08T08:18:01.872492+0000","last_undegraded":"2023-12-08T08:18:01.872492+0000","last_fullsized":"2023-12-08T08:18:01.872492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867626+0000","last_change":"2023-12-08T08:17:57.870410+0000","last_active":"2023-12-08T08:18:01.867626+0000","last_peered":"2023-12-08T08:18:01.867626+0000","last_clean":"2023-12-08T08:18:01.867626+0000","last_became_active":"2023-12-08T08:17:57.870101+0000","last_became_peered":"2023-12-08T08:17:57.870101+0000","last_unstale":"2023-12-08T08:18:01.867626+0000","last_undegraded":"2023-12-08T08:18:01.867626+0000","last_fullsized":"2023-12-08T08:18:01.867626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567811+0000","last_change":"2023-12-08T08:18:01.878712+0000","last_active":"2023-12-08T08:18:03.567811+0000","last_peered":"2023-12-08T08:18:03.567811+0000","last_clean":"2023-12-08T08:18:03.567811+0000","last_became_active":"2023-12-08T08:18:01.878261+0000","last_became_peered":"2023-12-08T08:18:01.878261+0000","last_unstale":"2023-12-08T08:18:03.567811+0000","last_undegraded":"2023-12-08T08:18:03.567811+0000","last_fullsized":"2023-12-08T08:18:03.567811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:07:23.896888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867824+0000","last_change":"2023-12-08T08:17:56.843766+0000","last_active":"2023-12-08T08:18:01.867824+0000","last_peered":"2023-12-08T08:18:01.867824+0000","last_clean":"2023-12-08T08:18:01.867824+0000","last_became_active":"2023-12-08T08:17:56.843478+0000","last_became_peered":"2023-12-08T08:17:56.843478+0000","last_unstale":"2023-12-08T08:18:01.867824+0000","last_undegraded":"2023-12-08T08:18:01.867824+0000","last_fullsized":"2023-12-08T08:18:01.867824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872240+0000","last_change":"2023-12-08T08:17:57.855561+0000","last_active":"2023-12-08T08:18:01.872240+0000","last_peered":"2023-12-08T08:18:01.872240+0000","last_clean":"2023-12-08T08:18:01.872240+0000","last_became_active":"2023-12-08T08:17:57.855268+0000","last_became_peered":"2023-12-08T08:17:57.855268+0000","last_unstale":"2023-12-08T08:18:01.872240+0000","last_undegraded":"2023-12-08T08:18:01.872240+0000","last_fullsized":"2023-12-08T08:18:01.872240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568140+0000","last_change":"2023-12-08T08:18:01.889314+0000","last_active":"2023-12-08T08:18:03.568140+0000","last_peered":"2023-12-08T08:18:03.568140+0000","last_clean":"2023-12-08T08:18:03.568140+0000","last_became_active":"2023-12-08T08:18:01.888906+0000","last_became_peered":"2023-12-08T08:18:01.888906+0000","last_unstale":"2023-12-08T08:18:03.568140+0000","last_undegraded":"2023-12-08T08:18:03.568140+0000","last_fullsized":"2023-12-08T08:18:03.568140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:01.114329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868720+0000","last_change":"2023-12-08T08:17:56.842810+0000","last_active":"2023-12-08T08:18:01.868720+0000","last_peered":"2023-12-08T08:18:01.868720+0000","last_clean":"2023-12-08T08:18:01.868720+0000","last_became_active":"2023-12-08T08:17:56.842480+0000","last_became_peered":"2023-12-08T08:17:56.842480+0000","last_unstale":"2023-12-08T08:18:01.868720+0000","last_undegraded":"2023-12-08T08:18:01.868720+0000","last_fullsized":"2023-12-08T08:18:01.868720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869147+0000","last_change":"2023-12-08T08:17:57.859900+0000","last_active":"2023-12-08T08:18:01.869147+0000","last_peered":"2023-12-08T08:18:01.869147+0000","last_clean":"2023-12-08T08:18:01.869147+0000","last_became_active":"2023-12-08T08:17:57.859600+0000","last_became_peered":"2023-12-08T08:17:57.859600+0000","last_unstale":"2023-12-08T08:18:01.869147+0000","last_undegraded":"2023-12-08T08:18:01.869147+0000","last_fullsized":"2023-12-08T08:18:01.869147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568611+0000","last_change":"2023-12-08T08:18:01.889433+0000","last_active":"2023-12-08T08:18:03.568611+0000","last_peered":"2023-12-08T08:18:03.568611+0000","last_clean":"2023-12-08T08:18:03.568611+0000","last_became_active":"2023-12-08T08:18:01.888357+0000","last_became_peered":"2023-12-08T08:18:01.888357+0000","last_unstale":"2023-12-08T08:18:03.568611+0000","last_undegraded":"2023-12-08T08:18:03.568611+0000","last_fullsized":"2023-12-08T08:18:03.568611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:46.554041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868282+0000","last_change":"2023-12-08T08:17:56.840379+0000","last_active":"2023-12-08T08:18:01.868282+0000","last_peered":"2023-12-08T08:18:01.868282+0000","last_clean":"2023-12-08T08:18:01.868282+0000","last_became_active":"2023-12-08T08:17:56.840103+0000","last_became_peered":"2023-12-08T08:17:56.840103+0000","last_unstale":"2023-12-08T08:18:01.868282+0000","last_undegraded":"2023-12-08T08:18:01.868282+0000","last_fullsized":"2023-12-08T08:18:01.868282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870159+0000","last_change":"2023-12-08T08:17:57.858103+0000","last_active":"2023-12-08T08:18:01.870159+0000","last_peered":"2023-12-08T08:18:01.870159+0000","last_clean":"2023-12-08T08:18:01.870159+0000","last_became_active":"2023-12-08T08:17:57.857699+0000","last_became_peered":"2023-12-08T08:17:57.857699+0000","last_unstale":"2023-12-08T08:18:01.870159+0000","last_undegraded":"2023-12-08T08:18:01.870159+0000","last_fullsized":"2023-12-08T08:18:01.870159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568317+0000","last_change":"2023-12-08T08:18:01.885166+0000","last_active":"2023-12-08T08:18:03.568317+0000","last_peered":"2023-12-08T08:18:03.568317+0000","last_clean":"2023-12-08T08:18:03.568317+0000","last_became_active":"2023-12-08T08:18:01.884779+0000","last_became_peered":"2023-12-08T08:18:01.884779+0000","last_unstale":"2023-12-08T08:18:03.568317+0000","last_undegraded":"2023-12-08T08:18:03.568317+0000","last_fullsized":"2023-12-08T08:18:03.568317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:57.811272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880413+0000","last_change":"2023-12-08T08:17:57.865810+0000","last_active":"2023-12-08T08:18:01.880413+0000","last_peered":"2023-12-08T08:18:01.880413+0000","last_clean":"2023-12-08T08:18:01.880413+0000","last_became_active":"2023-12-08T08:17:57.865552+0000","last_became_peered":"2023-12-08T08:17:57.865552+0000","last_unstale":"2023-12-08T08:18:01.880413+0000","last_undegraded":"2023-12-08T08:18:01.880413+0000","last_fullsized":"2023-12-08T08:18:01.880413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868484+0000","last_change":"2023-12-08T08:17:56.840140+0000","last_active":"2023-12-08T08:18:01.868484+0000","last_peered":"2023-12-08T08:18:01.868484+0000","last_clean":"2023-12-08T08:18:01.868484+0000","last_became_active":"2023-12-08T08:17:56.839795+0000","last_became_peered":"2023-12-08T08:17:56.839795+0000","last_unstale":"2023-12-08T08:18:01.868484+0000","last_undegraded":"2023-12-08T08:18:01.868484+0000","last_fullsized":"2023-12-08T08:18:01.868484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:56.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569186+0000","last_change":"2023-12-08T08:18:01.891012+0000","last_active":"2023-12-08T08:18:03.569186+0000","last_peered":"2023-12-08T08:18:03.569186+0000","last_clean":"2023-12-08T08:18:03.569186+0000","last_became_active":"2023-12-08T08:18:01.890400+0000","last_became_peered":"2023-12-08T08:18:01.890400+0000","last_unstale":"2023-12-08T08:18:03.569186+0000","last_undegraded":"2023-12-08T08:18:03.569186+0000","last_fullsized":"2023-12-08T08:18:03.569186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:16.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867759+0000","last_change":"2023-12-08T08:17:57.864890+0000","last_active":"2023-12-08T08:18:01.867759+0000","last_peered":"2023-12-08T08:18:01.867759+0000","last_clean":"2023-12-08T08:18:01.867759+0000","last_became_active":"2023-12-08T08:17:57.864513+0000","last_became_peered":"2023-12-08T08:17:57.864513+0000","last_unstale":"2023-12-08T08:18:01.867759+0000","last_undegraded":"2023-12-08T08:18:01.867759+0000","last_fullsized":"2023-12-08T08:18:01.867759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885708+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.885708+0000","last_peered":"2023-12-08T08:18:01.885708+0000","last_clean":"2023-12-08T08:18:01.885708+0000","last_became_active":"2023-12-08T08:17:56.832192+0000","last_became_peered":"2023-12-08T08:17:56.832192+0000","last_unstale":"2023-12-08T08:18:01.885708+0000","last_undegraded":"2023-12-08T08:18:01.885708+0000","last_fullsized":"2023-12-08T08:18:01.885708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:09.417617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568758+0000","last_change":"2023-12-08T08:18:01.892174+0000","last_active":"2023-12-08T08:18:03.568758+0000","last_peered":"2023-12-08T08:18:03.568758+0000","last_clean":"2023-12-08T08:18:03.568758+0000","last_became_active":"2023-12-08T08:18:01.891139+0000","last_became_peered":"2023-12-08T08:18:01.891139+0000","last_unstale":"2023-12-08T08:18:03.568758+0000","last_undegraded":"2023-12-08T08:18:03.568758+0000","last_fullsized":"2023-12-08T08:18:03.568758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:06.144172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869779+0000","last_change":"2023-12-08T08:17:57.853306+0000","last_active":"2023-12-08T08:18:01.869779+0000","last_peered":"2023-12-08T08:18:01.869779+0000","last_clean":"2023-12-08T08:18:01.869779+0000","last_became_active":"2023-12-08T08:17:57.852939+0000","last_became_peered":"2023-12-08T08:17:57.852939+0000","last_unstale":"2023-12-08T08:18:01.869779+0000","last_undegraded":"2023-12-08T08:18:01.869779+0000","last_fullsized":"2023-12-08T08:18:01.869779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885213+0000","last_change":"2023-12-08T08:17:56.837763+0000","last_active":"2023-12-08T08:18:01.885213+0000","last_peered":"2023-12-08T08:18:01.885213+0000","last_clean":"2023-12-08T08:18:01.885213+0000","last_became_active":"2023-12-08T08:17:56.837469+0000","last_became_peered":"2023-12-08T08:17:56.837469+0000","last_unstale":"2023-12-08T08:18:01.885213+0000","last_undegraded":"2023-12-08T08:18:01.885213+0000","last_fullsized":"2023-12-08T08:18:01.885213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569232+0000","last_change":"2023-12-08T08:18:01.892151+0000","last_active":"2023-12-08T08:18:03.569232+0000","last_peered":"2023-12-08T08:18:03.569232+0000","last_clean":"2023-12-08T08:18:03.569232+0000","last_became_active":"2023-12-08T08:18:01.891748+0000","last_became_peered":"2023-12-08T08:18:01.891748+0000","last_unstale":"2023-12-08T08:18:03.569232+0000","last_undegraded":"2023-12-08T08:18:03.569232+0000","last_fullsized":"2023-12-08T08:18:03.569232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.874659+0000","last_change":"2023-12-08T08:17:57.856848+0000","last_active":"2023-12-08T08:18:01.874659+0000","last_peered":"2023-12-08T08:18:01.874659+0000","last_clean":"2023-12-08T08:18:01.874659+0000","last_became_active":"2023-12-08T08:17:57.856604+0000","last_became_peered":"2023-12-08T08:17:57.856604+0000","last_unstale":"2023-12-08T08:18:01.874659+0000","last_undegraded":"2023-12-08T08:18:01.874659+0000","last_fullsized":"2023-12-08T08:18:01.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867949+0000","last_change":"2023-12-08T08:17:56.842489+0000","last_active":"2023-12-08T08:18:01.867949+0000","last_peered":"2023-12-08T08:18:01.867949+0000","last_clean":"2023-12-08T08:18:01.867949+0000","last_became_active":"2023-12-08T08:17:56.842218+0000","last_became_peered":"2023-12-08T08:17:56.842218+0000","last_unstale":"2023-12-08T08:18:01.867949+0000","last_undegraded":"2023-12-08T08:18:01.867949+0000","last_fullsized":"2023-12-08T08:18:01.867949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569378+0000","last_change":"2023-12-08T08:18:01.891618+0000","last_active":"2023-12-08T08:18:03.569378+0000","last_peered":"2023-12-08T08:18:03.569378+0000","last_clean":"2023-12-08T08:18:03.569378+0000","last_became_active":"2023-12-08T08:18:01.891182+0000","last_became_peered":"2023-12-08T08:18:01.891182+0000","last_unstale":"2023-12-08T08:18:03.569378+0000","last_undegraded":"2023-12-08T08:18:03.569378+0000","last_fullsized":"2023-12-08T08:18:03.569378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:52.932114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873203+0000","last_change":"2023-12-08T08:17:57.853709+0000","last_active":"2023-12-08T08:18:01.873203+0000","last_peered":"2023-12-08T08:18:01.873203+0000","last_clean":"2023-12-08T08:18:01.873203+0000","last_became_active":"2023-12-08T08:17:57.853422+0000","last_became_peered":"2023-12-08T08:17:57.853422+0000","last_unstale":"2023-12-08T08:18:01.873203+0000","last_undegraded":"2023-12-08T08:18:01.873203+0000","last_fullsized":"2023-12-08T08:18:01.873203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881686+0000","last_change":"2023-12-08T08:17:56.838162+0000","last_active":"2023-12-08T08:18:01.881686+0000","last_peered":"2023-12-08T08:18:01.881686+0000","last_clean":"2023-12-08T08:18:01.881686+0000","last_became_active":"2023-12-08T08:17:56.837914+0000","last_became_peered":"2023-12-08T08:17:56.837914+0000","last_unstale":"2023-12-08T08:18:01.881686+0000","last_undegraded":"2023-12-08T08:18:01.881686+0000","last_fullsized":"2023-12-08T08:18:01.881686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568391+0000","last_change":"2023-12-08T08:18:01.886684+0000","last_active":"2023-12-08T08:18:03.568391+0000","last_peered":"2023-12-08T08:18:03.568391+0000","last_clean":"2023-12-08T08:18:03.568391+0000","last_became_active":"2023-12-08T08:18:01.886257+0000","last_became_peered":"2023-12-08T08:18:01.886257+0000","last_unstale":"2023-12-08T08:18:03.568391+0000","last_undegraded":"2023-12-08T08:18:03.568391+0000","last_fullsized":"2023-12-08T08:18:03.568391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868425+0000","last_change":"2023-12-08T08:17:57.864189+0000","last_active":"2023-12-08T08:18:01.868425+0000","last_peered":"2023-12-08T08:18:01.868425+0000","last_clean":"2023-12-08T08:18:01.868425+0000","last_became_active":"2023-12-08T08:17:57.863656+0000","last_became_peered":"2023-12-08T08:17:57.863656+0000","last_unstale":"2023-12-08T08:18:01.868425+0000","last_undegraded":"2023-12-08T08:18:01.868425+0000","last_fullsized":"2023-12-08T08:18:01.868425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885512+0000","last_change":"2023-12-08T08:17:56.835325+0000","last_active":"2023-12-08T08:18:01.885512+0000","last_peered":"2023-12-08T08:18:01.885512+0000","last_clean":"2023-12-08T08:18:01.885512+0000","last_became_active":"2023-12-08T08:17:56.834877+0000","last_became_peered":"2023-12-08T08:17:56.834877+0000","last_unstale":"2023-12-08T08:18:01.885512+0000","last_undegraded":"2023-12-08T08:18:01.885512+0000","last_fullsized":"2023-12-08T08:18:01.885512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567624+0000","last_change":"2023-12-08T08:18:01.891058+0000","last_active":"2023-12-08T08:18:03.567624+0000","last_peered":"2023-12-08T08:18:03.567624+0000","last_clean":"2023-12-08T08:18:03.567624+0000","last_became_active":"2023-12-08T08:18:01.890653+0000","last_became_peered":"2023-12-08T08:18:01.890653+0000","last_unstale":"2023-12-08T08:18:03.567624+0000","last_undegraded":"2023-12-08T08:18:03.567624+0000","last_fullsized":"2023-12-08T08:18:03.567624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885917+0000","last_change":"2023-12-08T08:17:57.851573+0000","last_active":"2023-12-08T08:18:01.885917+0000","last_peered":"2023-12-08T08:18:01.885917+0000","last_clean":"2023-12-08T08:18:01.885917+0000","last_became_active":"2023-12-08T08:17:57.851275+0000","last_became_peered":"2023-12-08T08:17:57.851275+0000","last_unstale":"2023-12-08T08:18:01.885917+0000","last_undegraded":"2023-12-08T08:18:01.885917+0000","last_fullsized":"2023-12-08T08:18:01.885917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868821+0000","last_change":"2023-12-08T08:17:56.842419+0000","last_active":"2023-12-08T08:18:01.868821+0000","last_peered":"2023-12-08T08:18:01.868821+0000","last_clean":"2023-12-08T08:18:01.868821+0000","last_became_active":"2023-12-08T08:17:56.842113+0000","last_became_peered":"2023-12-08T08:17:56.842113+0000","last_unstale":"2023-12-08T08:18:01.868821+0000","last_undegraded":"2023-12-08T08:18:01.868821+0000","last_fullsized":"2023-12-08T08:18:01.868821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569320+0000","last_change":"2023-12-08T08:18:01.896199+0000","last_active":"2023-12-08T08:18:03.569320+0000","last_peered":"2023-12-08T08:18:03.569320+0000","last_clean":"2023-12-08T08:18:03.569320+0000","last_became_active":"2023-12-08T08:18:01.895808+0000","last_became_peered":"2023-12-08T08:18:01.895808+0000","last_unstale":"2023-12-08T08:18:03.569320+0000","last_undegraded":"2023-12-08T08:18:03.569320+0000","last_fullsized":"2023-12-08T08:18:03.569320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870316+0000","last_change":"2023-12-08T08:17:57.865891+0000","last_active":"2023-12-08T08:18:01.870316+0000","last_peered":"2023-12-08T08:18:01.870316+0000","last_clean":"2023-12-08T08:18:01.870316+0000","last_became_active":"2023-12-08T08:17:57.865615+0000","last_became_peered":"2023-12-08T08:17:57.865615+0000","last_unstale":"2023-12-08T08:18:01.870316+0000","last_undegraded":"2023-12-08T08:18:01.870316+0000","last_fullsized":"2023-12-08T08:18:01.870316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.886007+0000","last_change":"2023-12-08T08:17:56.841200+0000","last_active":"2023-12-08T08:18:01.886007+0000","last_peered":"2023-12-08T08:18:01.886007+0000","last_clean":"2023-12-08T08:18:01.886007+0000","last_became_active":"2023-12-08T08:17:56.840931+0000","last_became_peered":"2023-12-08T08:17:56.840931+0000","last_unstale":"2023-12-08T08:18:01.886007+0000","last_undegraded":"2023-12-08T08:18:01.886007+0000","last_fullsized":"2023-12-08T08:18:01.886007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569499+0000","last_change":"2023-12-08T08:18:01.891062+0000","last_active":"2023-12-08T08:18:03.569499+0000","last_peered":"2023-12-08T08:18:03.569499+0000","last_clean":"2023-12-08T08:18:03.569499+0000","last_became_active":"2023-12-08T08:18:01.889897+0000","last_became_peered":"2023-12-08T08:18:01.889897+0000","last_unstale":"2023-12-08T08:18:03.569499+0000","last_undegraded":"2023-12-08T08:18:03.569499+0000","last_fullsized":"2023-12-08T08:18:03.569499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875197+0000","last_change":"2023-12-08T08:17:57.858835+0000","last_active":"2023-12-08T08:18:01.875197+0000","last_peered":"2023-12-08T08:18:01.875197+0000","last_clean":"2023-12-08T08:18:01.875197+0000","last_became_active":"2023-12-08T08:17:57.857435+0000","last_became_peered":"2023-12-08T08:17:57.857435+0000","last_unstale":"2023-12-08T08:18:01.875197+0000","last_undegraded":"2023-12-08T08:18:01.875197+0000","last_fullsized":"2023-12-08T08:18:01.875197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:23:20.987641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869458+0000","last_change":"2023-12-08T08:17:56.837734+0000","last_active":"2023-12-08T08:18:01.869458+0000","last_peered":"2023-12-08T08:18:01.869458+0000","last_clean":"2023-12-08T08:18:01.869458+0000","last_became_active":"2023-12-08T08:17:56.837449+0000","last_became_peered":"2023-12-08T08:17:56.837449+0000","last_unstale":"2023-12-08T08:18:01.869458+0000","last_undegraded":"2023-12-08T08:18:01.869458+0000","last_fullsized":"2023-12-08T08:18:01.869458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568865+0000","last_change":"2023-12-08T08:18:01.890850+0000","last_active":"2023-12-08T08:18:03.568865+0000","last_peered":"2023-12-08T08:18:03.568865+0000","last_clean":"2023-12-08T08:18:03.568865+0000","last_became_active":"2023-12-08T08:18:01.890183+0000","last_became_peered":"2023-12-08T08:18:01.890183+0000","last_unstale":"2023-12-08T08:18:03.568865+0000","last_undegraded":"2023-12-08T08:18:03.568865+0000","last_fullsized":"2023-12-08T08:18:03.568865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885216+0000","last_change":"2023-12-08T08:17:57.851203+0000","last_active":"2023-12-08T08:18:01.885216+0000","last_peered":"2023-12-08T08:18:01.885216+0000","last_clean":"2023-12-08T08:18:01.885216+0000","last_became_active":"2023-12-08T08:17:57.850672+0000","last_became_peered":"2023-12-08T08:17:57.850672+0000","last_unstale":"2023-12-08T08:18:01.885216+0000","last_undegraded":"2023-12-08T08:18:01.885216+0000","last_fullsized":"2023-12-08T08:18:01.885216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873056+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.873056+0000","last_peered":"2023-12-08T08:18:01.873056+0000","last_clean":"2023-12-08T08:18:01.873056+0000","last_became_active":"2023-12-08T08:17:56.832238+0000","last_became_peered":"2023-12-08T08:17:56.832238+0000","last_unstale":"2023-12-08T08:18:01.873056+0000","last_undegraded":"2023-12-08T08:18:01.873056+0000","last_fullsized":"2023-12-08T08:18:01.873056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569367+0000","last_change":"2023-12-08T08:18:01.894980+0000","last_active":"2023-12-08T08:18:03.569367+0000","last_peered":"2023-12-08T08:18:03.569367+0000","last_clean":"2023-12-08T08:18:03.569367+0000","last_became_active":"2023-12-08T08:18:01.894588+0000","last_became_peered":"2023-12-08T08:18:01.894588+0000","last_unstale":"2023-12-08T08:18:03.569367+0000","last_undegraded":"2023-12-08T08:18:03.569367+0000","last_fullsized":"2023-12-08T08:18:03.569367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871709+0000","last_change":"2023-12-08T08:17:57.848723+0000","last_active":"2023-12-08T08:18:01.871709+0000","last_peered":"2023-12-08T08:18:01.871709+0000","last_clean":"2023-12-08T08:18:01.871709+0000","last_became_active":"2023-12-08T08:17:57.848474+0000","last_became_peered":"2023-12-08T08:17:57.848474+0000","last_unstale":"2023-12-08T08:18:01.871709+0000","last_undegraded":"2023-12-08T08:18:01.871709+0000","last_fullsized":"2023-12-08T08:18:01.871709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:23.681343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867954+0000","last_change":"2023-12-08T08:17:56.839808+0000","last_active":"2023-12-08T08:18:01.867954+0000","last_peered":"2023-12-08T08:18:01.867954+0000","last_clean":"2023-12-08T08:18:01.867954+0000","last_became_active":"2023-12-08T08:17:56.839540+0000","last_became_peered":"2023-12-08T08:17:56.839540+0000","last_unstale":"2023-12-08T08:18:01.867954+0000","last_undegraded":"2023-12-08T08:18:01.867954+0000","last_fullsized":"2023-12-08T08:18:01.867954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569746+0000","last_change":"2023-12-08T08:18:01.897047+0000","last_active":"2023-12-08T08:18:03.569746+0000","last_peered":"2023-12-08T08:18:03.569746+0000","last_clean":"2023-12-08T08:18:03.569746+0000","last_became_active":"2023-12-08T08:18:01.896673+0000","last_became_peered":"2023-12-08T08:18:01.896673+0000","last_unstale":"2023-12-08T08:18:03.569746+0000","last_undegraded":"2023-12-08T08:18:03.569746+0000","last_fullsized":"2023-12-08T08:18:03.569746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868108+0000","last_change":"2023-12-08T08:17:57.863988+0000","last_active":"2023-12-08T08:18:01.868108+0000","last_peered":"2023-12-08T08:18:01.868108+0000","last_clean":"2023-12-08T08:18:01.868108+0000","last_became_active":"2023-12-08T08:17:57.863672+0000","last_became_peered":"2023-12-08T08:17:57.863672+0000","last_unstale":"2023-12-08T08:18:01.868108+0000","last_undegraded":"2023-12-08T08:18:01.868108+0000","last_fullsized":"2023-12-08T08:18:01.868108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868596+0000","last_change":"2023-12-08T08:17:56.838442+0000","last_active":"2023-12-08T08:18:01.868596+0000","last_peered":"2023-12-08T08:18:01.868596+0000","last_clean":"2023-12-08T08:18:01.868596+0000","last_became_active":"2023-12-08T08:17:56.838200+0000","last_became_peered":"2023-12-08T08:17:56.838200+0000","last_unstale":"2023-12-08T08:18:01.868596+0000","last_undegraded":"2023-12-08T08:18:01.868596+0000","last_fullsized":"2023-12-08T08:18:01.868596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:05.691540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868065+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:18:01.868065+0000","last_peered":"2023-12-08T08:18:01.868065+0000","last_clean":"2023-12-08T08:18:01.868065+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:18:01.868065+0000","last_undegraded":"2023-12-08T08:18:01.868065+0000","last_fullsized":"2023-12-08T08:18:01.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880838+0000","last_change":"2023-12-08T08:18:01.888488+0000","last_active":"2023-12-08T08:18:02.880838+0000","last_peered":"2023-12-08T08:18:02.880838+0000","last_clean":"2023-12-08T08:18:02.880838+0000","last_became_active":"2023-12-08T08:18:01.888094+0000","last_became_peered":"2023-12-08T08:18:01.888094+0000","last_unstale":"2023-12-08T08:18:02.880838+0000","last_undegraded":"2023-12-08T08:18:02.880838+0000","last_fullsized":"2023-12-08T08:18:02.880838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868680+0000","last_change":"2023-12-08T08:17:57.857404+0000","last_active":"2023-12-08T08:18:01.868680+0000","last_peered":"2023-12-08T08:18:01.868680+0000","last_clean":"2023-12-08T08:18:01.868680+0000","last_became_active":"2023-12-08T08:17:57.857153+0000","last_became_peered":"2023-12-08T08:17:57.857153+0000","last_unstale":"2023-12-08T08:18:01.868680+0000","last_undegraded":"2023-12-08T08:18:01.868680+0000","last_fullsized":"2023-12-08T08:18:01.868680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873513+0000","last_change":"2023-12-08T08:17:56.839948+0000","last_active":"2023-12-08T08:18:01.873513+0000","last_peered":"2023-12-08T08:18:01.873513+0000","last_clean":"2023-12-08T08:18:01.873513+0000","last_became_active":"2023-12-08T08:17:56.839635+0000","last_became_peered":"2023-12-08T08:17:56.839635+0000","last_unstale":"2023-12-08T08:18:01.873513+0000","last_undegraded":"2023-12-08T08:18:01.873513+0000","last_fullsized":"2023-12-08T08:18:01.873513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.879318+0000","last_change":"2023-12-08T08:18:01.896627+0000","last_active":"2023-12-08T08:18:02.879318+0000","last_peered":"2023-12-08T08:18:02.879318+0000","last_clean":"2023-12-08T08:18:02.879318+0000","last_became_active":"2023-12-08T08:18:01.896206+0000","last_became_peered":"2023-12-08T08:18:01.896206+0000","last_unstale":"2023-12-08T08:18:02.879318+0000","last_undegraded":"2023-12-08T08:18:02.879318+0000","last_fullsized":"2023-12-08T08:18:02.879318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:10.446350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869237+0000","last_change":"2023-12-08T08:17:57.868521+0000","last_active":"2023-12-08T08:18:01.869237+0000","last_peered":"2023-12-08T08:18:01.869237+0000","last_clean":"2023-12-08T08:18:01.869237+0000","last_became_active":"2023-12-08T08:17:57.866204+0000","last_became_peered":"2023-12-08T08:17:57.866204+0000","last_unstale":"2023-12-08T08:18:01.869237+0000","last_undegraded":"2023-12-08T08:18:01.869237+0000","last_fullsized":"2023-12-08T08:18:01.869237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885415+0000","last_change":"2023-12-08T08:17:56.831155+0000","last_active":"2023-12-08T08:18:01.885415+0000","last_peered":"2023-12-08T08:18:01.885415+0000","last_clean":"2023-12-08T08:18:01.885415+0000","last_became_active":"2023-12-08T08:17:56.830810+0000","last_became_peered":"2023-12-08T08:17:56.830810+0000","last_unstale":"2023-12-08T08:18:01.885415+0000","last_undegraded":"2023-12-08T08:18:01.885415+0000","last_fullsized":"2023-12-08T08:18:01.885415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569993+0000","last_change":"2023-12-08T08:18:01.888765+0000","last_active":"2023-12-08T08:18:03.569993+0000","last_peered":"2023-12-08T08:18:03.569993+0000","last_clean":"2023-12-08T08:18:03.569993+0000","last_became_active":"2023-12-08T08:18:01.888409+0000","last_became_peered":"2023-12-08T08:18:01.888409+0000","last_unstale":"2023-12-08T08:18:03.569993+0000","last_undegraded":"2023-12-08T08:18:03.569993+0000","last_fullsized":"2023-12-08T08:18:03.569993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868755+0000","last_change":"2023-12-08T08:17:57.862594+0000","last_active":"2023-12-08T08:18:01.868755+0000","last_peered":"2023-12-08T08:18:01.868755+0000","last_clean":"2023-12-08T08:18:01.868755+0000","last_became_active":"2023-12-08T08:17:57.862124+0000","last_became_peered":"2023-12-08T08:17:57.862124+0000","last_unstale":"2023-12-08T08:18:01.868755+0000","last_undegraded":"2023-12-08T08:18:01.868755+0000","last_fullsized":"2023-12-08T08:18:01.868755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:34.877529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875757+0000","last_change":"2023-12-08T08:17:56.838532+0000","last_active":"2023-12-08T08:18:01.875757+0000","last_peered":"2023-12-08T08:18:01.875757+0000","last_clean":"2023-12-08T08:18:01.875757+0000","last_became_active":"2023-12-08T08:17:56.838220+0000","last_became_peered":"2023-12-08T08:17:56.838220+0000","last_unstale":"2023-12-08T08:18:01.875757+0000","last_undegraded":"2023-12-08T08:18:01.875757+0000","last_fullsized":"2023-12-08T08:18:01.875757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568060+0000","last_change":"2023-12-08T08:18:01.882801+0000","last_active":"2023-12-08T08:18:03.568060+0000","last_peered":"2023-12-08T08:18:03.568060+0000","last_clean":"2023-12-08T08:18:03.568060+0000","last_became_active":"2023-12-08T08:18:01.882438+0000","last_became_peered":"2023-12-08T08:18:01.882438+0000","last_unstale":"2023-12-08T08:18:03.568060+0000","last_undegraded":"2023-12-08T08:18:03.568060+0000","last_fullsized":"2023-12-08T08:18:03.568060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868362+0000","last_change":"2023-12-08T08:17:57.854674+0000","last_active":"2023-12-08T08:18:01.868362+0000","last_peered":"2023-12-08T08:18:01.868362+0000","last_clean":"2023-12-08T08:18:01.868362+0000","last_became_active":"2023-12-08T08:17:57.854400+0000","last_became_peered":"2023-12-08T08:17:57.854400+0000","last_unstale":"2023-12-08T08:18:01.868362+0000","last_undegraded":"2023-12-08T08:18:01.868362+0000","last_fullsized":"2023-12-08T08:18:01.868362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871957+0000","last_change":"2023-12-08T08:17:56.833827+0000","last_active":"2023-12-08T08:18:01.871957+0000","last_peered":"2023-12-08T08:18:01.871957+0000","last_clean":"2023-12-08T08:18:01.871957+0000","last_became_active":"2023-12-08T08:17:56.833544+0000","last_became_peered":"2023-12-08T08:17:56.833544+0000","last_unstale":"2023-12-08T08:18:01.871957+0000","last_undegraded":"2023-12-08T08:18:01.871957+0000","last_fullsized":"2023-12-08T08:18:01.871957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:30:08.734416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568098+0000","last_change":"2023-12-08T08:18:01.890953+0000","last_active":"2023-12-08T08:18:03.568098+0000","last_peered":"2023-12-08T08:18:03.568098+0000","last_clean":"2023-12-08T08:18:03.568098+0000","last_became_active":"2023-12-08T08:18:01.890169+0000","last_became_peered":"2023-12-08T08:18:01.890169+0000","last_unstale":"2023-12-08T08:18:03.568098+0000","last_undegraded":"2023-12-08T08:18:03.568098+0000","last_fullsized":"2023-12-08T08:18:03.568098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:14.643740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868180+0000","last_change":"2023-12-08T08:17:57.858656+0000","last_active":"2023-12-08T08:18:01.868180+0000","last_peered":"2023-12-08T08:18:01.868180+0000","last_clean":"2023-12-08T08:18:01.868180+0000","last_became_active":"2023-12-08T08:17:57.858335+0000","last_became_peered":"2023-12-08T08:17:57.858335+0000","last_unstale":"2023-12-08T08:18:01.868180+0000","last_undegraded":"2023-12-08T08:18:01.868180+0000","last_fullsized":"2023-12-08T08:18:01.868180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872816+0000","last_change":"2023-12-08T08:17:56.828427+0000","last_active":"2023-12-08T08:18:01.872816+0000","last_peered":"2023-12-08T08:18:01.872816+0000","last_clean":"2023-12-08T08:18:01.872816+0000","last_became_active":"2023-12-08T08:17:56.828104+0000","last_became_peered":"2023-12-08T08:17:56.828104+0000","last_unstale":"2023-12-08T08:18:01.872816+0000","last_undegraded":"2023-12-08T08:18:01.872816+0000","last_fullsized":"2023-12-08T08:18:01.872816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:35.770309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569594+0000","last_change":"2023-12-08T08:18:01.882325+0000","last_active":"2023-12-08T08:18:03.569594+0000","last_peered":"2023-12-08T08:18:03.569594+0000","last_clean":"2023-12-08T08:18:03.569594+0000","last_became_active":"2023-12-08T08:18:01.881811+0000","last_became_peered":"2023-12-08T08:18:01.881811+0000","last_unstale":"2023-12-08T08:18:03.569594+0000","last_undegraded":"2023-12-08T08:18:03.569594+0000","last_fullsized":"2023-12-08T08:18:03.569594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881194+0000","last_change":"2023-12-08T08:17:57.868472+0000","last_active":"2023-12-08T08:18:01.881194+0000","last_peered":"2023-12-08T08:18:01.881194+0000","last_clean":"2023-12-08T08:18:01.881194+0000","last_became_active":"2023-12-08T08:17:57.867557+0000","last_became_peered":"2023-12-08T08:17:57.867557+0000","last_unstale":"2023-12-08T08:18:01.881194+0000","last_undegraded":"2023-12-08T08:18:01.881194+0000","last_fullsized":"2023-12-08T08:18:01.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880481+0000","last_change":"2023-12-08T08:17:56.834501+0000","last_active":"2023-12-08T08:18:01.880481+0000","last_peered":"2023-12-08T08:18:01.880481+0000","last_clean":"2023-12-08T08:18:01.880481+0000","last_became_active":"2023-12-08T08:17:56.834216+0000","last_became_peered":"2023-12-08T08:17:56.834216+0000","last_unstale":"2023-12-08T08:18:01.880481+0000","last_undegraded":"2023-12-08T08:18:01.880481+0000","last_fullsized":"2023-12-08T08:18:01.880481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568473+0000","last_change":"2023-12-08T08:18:01.891154+0000","last_active":"2023-12-08T08:18:03.568473+0000","last_peered":"2023-12-08T08:18:03.568473+0000","last_clean":"2023-12-08T08:18:03.568473+0000","last_became_active":"2023-12-08T08:18:01.890734+0000","last_became_peered":"2023-12-08T08:18:01.890734+0000","last_unstale":"2023-12-08T08:18:03.568473+0000","last_undegraded":"2023-12-08T08:18:03.568473+0000","last_fullsized":"2023-12-08T08:18:03.568473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:18:11.033301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868378+0000","last_change":"2023-12-08T08:17:57.861535+0000","last_active":"2023-12-08T08:18:01.868378+0000","last_peered":"2023-12-08T08:18:01.868378+0000","last_clean":"2023-12-08T08:18:01.868378+0000","last_became_active":"2023-12-08T08:17:57.860529+0000","last_became_peered":"2023-12-08T08:17:57.860529+0000","last_unstale":"2023-12-08T08:18:01.868378+0000","last_undegraded":"2023-12-08T08:18:01.868378+0000","last_fullsized":"2023-12-08T08:18:01.868378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869270+0000","last_change":"2023-12-08T08:17:56.838952+0000","last_active":"2023-12-08T08:18:01.869270+0000","last_peered":"2023-12-08T08:18:01.869270+0000","last_clean":"2023-12-08T08:18:01.869270+0000","last_became_active":"2023-12-08T08:17:56.838708+0000","last_became_peered":"2023-12-08T08:17:56.838708+0000","last_unstale":"2023-12-08T08:18:01.869270+0000","last_undegraded":"2023-12-08T08:18:01.869270+0000","last_fullsized":"2023-12-08T08:18:01.869270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568624+0000","last_change":"2023-12-08T08:18:01.893574+0000","last_active":"2023-12-08T08:18:03.568624+0000","last_peered":"2023-12-08T08:18:03.568624+0000","last_clean":"2023-12-08T08:18:03.568624+0000","last_became_active":"2023-12-08T08:18:01.892008+0000","last_became_peered":"2023-12-08T08:18:01.892008+0000","last_unstale":"2023-12-08T08:18:03.568624+0000","last_undegraded":"2023-12-08T08:18:03.568624+0000","last_fullsized":"2023-12-08T08:18:03.568624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:59:58.367917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873150+0000","last_change":"2023-12-08T08:17:57.858464+0000","last_active":"2023-12-08T08:18:01.873150+0000","last_peered":"2023-12-08T08:18:01.873150+0000","last_clean":"2023-12-08T08:18:01.873150+0000","last_became_active":"2023-12-08T08:17:57.857748+0000","last_became_peered":"2023-12-08T08:17:57.857748+0000","last_unstale":"2023-12-08T08:18:01.873150+0000","last_undegraded":"2023-12-08T08:18:01.873150+0000","last_fullsized":"2023-12-08T08:18:01.873150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872709+0000","last_change":"2023-12-08T08:17:56.834818+0000","last_active":"2023-12-08T08:18:01.872709+0000","last_peered":"2023-12-08T08:18:01.872709+0000","last_clean":"2023-12-08T08:18:01.872709+0000","last_became_active":"2023-12-08T08:17:56.834412+0000","last_became_peered":"2023-12-08T08:17:56.834412+0000","last_unstale":"2023-12-08T08:18:01.872709+0000","last_undegraded":"2023-12-08T08:18:01.872709+0000","last_fullsized":"2023-12-08T08:18:01.872709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569218+0000","last_change":"2023-12-08T08:18:01.879603+0000","last_active":"2023-12-08T08:18:03.569218+0000","last_peered":"2023-12-08T08:18:03.569218+0000","last_clean":"2023-12-08T08:18:03.569218+0000","last_became_active":"2023-12-08T08:18:01.879223+0000","last_became_peered":"2023-12-08T08:18:01.879223+0000","last_unstale":"2023-12-08T08:18:03.569218+0000","last_undegraded":"2023-12-08T08:18:03.569218+0000","last_fullsized":"2023-12-08T08:18:03.569218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868610+0000","last_change":"2023-12-08T08:17:57.867653+0000","last_active":"2023-12-08T08:18:01.868610+0000","last_peered":"2023-12-08T08:18:01.868610+0000","last_clean":"2023-12-08T08:18:01.868610+0000","last_became_active":"2023-12-08T08:17:57.867361+0000","last_became_peered":"2023-12-08T08:17:57.867361+0000","last_unstale":"2023-12-08T08:18:01.868610+0000","last_undegraded":"2023-12-08T08:18:01.868610+0000","last_fullsized":"2023-12-08T08:18:01.868610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:07.193843+0000","last_change":"2023-12-08T08:17:56.841032+0000","last_active":"2023-12-08T08:18:07.193843+0000","last_peered":"2023-12-08T08:18:07.193843+0000","last_clean":"2023-12-08T08:18:07.193843+0000","last_became_active":"2023-12-08T08:17:56.840787+0000","last_became_peered":"2023-12-08T08:17:56.840787+0000","last_unstale":"2023-12-08T08:18:07.193843+0000","last_undegraded":"2023-12-08T08:18:07.193843+0000","last_fullsized":"2023-12-08T08:18:07.193843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569636+0000","last_change":"2023-12-08T08:18:01.891258+0000","last_active":"2023-12-08T08:18:03.569636+0000","last_peered":"2023-12-08T08:18:03.569636+0000","last_clean":"2023-12-08T08:18:03.569636+0000","last_became_active":"2023-12-08T08:18:01.889956+0000","last_became_peered":"2023-12-08T08:18:01.889956+0000","last_unstale":"2023-12-08T08:18:03.569636+0000","last_undegraded":"2023-12-08T08:18:03.569636+0000","last_fullsized":"2023-12-08T08:18:03.569636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873425+0000","last_change":"2023-12-08T08:17:57.855938+0000","last_active":"2023-12-08T08:18:01.873425+0000","last_peered":"2023-12-08T08:18:01.873425+0000","last_clean":"2023-12-08T08:18:01.873425+0000","last_became_active":"2023-12-08T08:17:57.855668+0000","last_became_peered":"2023-12-08T08:17:57.855668+0000","last_unstale":"2023-12-08T08:18:01.873425+0000","last_undegraded":"2023-12-08T08:18:01.873425+0000","last_fullsized":"2023-12-08T08:18:01.873425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:53.755384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885215+0000","last_change":"2023-12-08T08:17:56.840188+0000","last_active":"2023-12-08T08:18:01.885215+0000","last_peered":"2023-12-08T08:18:01.885215+0000","last_clean":"2023-12-08T08:18:01.885215+0000","last_became_active":"2023-12-08T08:17:56.839837+0000","last_became_peered":"2023-12-08T08:17:56.839837+0000","last_unstale":"2023-12-08T08:18:01.885215+0000","last_undegraded":"2023-12-08T08:18:01.885215+0000","last_fullsized":"2023-12-08T08:18:01.885215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568880+0000","last_change":"2023-12-08T08:18:01.891860+0000","last_active":"2023-12-08T08:18:03.568880+0000","last_peered":"2023-12-08T08:18:03.568880+0000","last_clean":"2023-12-08T08:18:03.568880+0000","last_became_active":"2023-12-08T08:18:01.890853+0000","last_became_peered":"2023-12-08T08:18:01.890853+0000","last_unstale":"2023-12-08T08:18:03.568880+0000","last_undegraded":"2023-12-08T08:18:03.568880+0000","last_fullsized":"2023-12-08T08:18:03.568880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:30.071394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872334+0000","last_change":"2023-12-08T08:17:57.855509+0000","last_active":"2023-12-08T08:18:01.872334+0000","last_peered":"2023-12-08T08:18:01.872334+0000","last_clean":"2023-12-08T08:18:01.872334+0000","last_became_active":"2023-12-08T08:17:57.855195+0000","last_became_peered":"2023-12-08T08:17:57.855195+0000","last_unstale":"2023-12-08T08:18:01.872334+0000","last_undegraded":"2023-12-08T08:18:01.872334+0000","last_fullsized":"2023-12-08T08:18:01.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868832+0000","last_change":"2023-12-08T08:17:56.838218+0000","last_active":"2023-12-08T08:18:01.868832+0000","last_peered":"2023-12-08T08:18:01.868832+0000","last_clean":"2023-12-08T08:18:01.868832+0000","last_became_active":"2023-12-08T08:17:56.837942+0000","last_became_peered":"2023-12-08T08:17:56.837942+0000","last_unstale":"2023-12-08T08:18:01.868832+0000","last_undegraded":"2023-12-08T08:18:01.868832+0000","last_fullsized":"2023-12-08T08:18:01.868832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:12.171098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567801+0000","last_change":"2023-12-08T08:18:01.888958+0000","last_active":"2023-12-08T08:18:03.567801+0000","last_peered":"2023-12-08T08:18:03.567801+0000","last_clean":"2023-12-08T08:18:03.567801+0000","last_became_active":"2023-12-08T08:18:01.888522+0000","last_became_peered":"2023-12-08T08:18:01.888522+0000","last_unstale":"2023-12-08T08:18:03.567801+0000","last_undegraded":"2023-12-08T08:18:03.567801+0000","last_fullsized":"2023-12-08T08:18:03.567801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868748+0000","last_change":"2023-12-08T08:17:57.859464+0000","last_active":"2023-12-08T08:18:01.868748+0000","last_peered":"2023-12-08T08:18:01.868748+0000","last_clean":"2023-12-08T08:18:01.868748+0000","last_became_active":"2023-12-08T08:17:57.857871+0000","last_became_peered":"2023-12-08T08:17:57.857871+0000","last_unstale":"2023-12-08T08:18:01.868748+0000","last_undegraded":"2023-12-08T08:18:01.868748+0000","last_fullsized":"2023-12-08T08:18:01.868748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881565+0000","last_change":"2023-12-08T08:17:56.840338+0000","last_active":"2023-12-08T08:18:01.881565+0000","last_peered":"2023-12-08T08:18:01.881565+0000","last_clean":"2023-12-08T08:18:01.881565+0000","last_became_active":"2023-12-08T08:17:56.838415+0000","last_became_peered":"2023-12-08T08:17:56.838415+0000","last_unstale":"2023-12-08T08:18:01.881565+0000","last_undegraded":"2023-12-08T08:18:01.881565+0000","last_fullsized":"2023-12-08T08:18:01.881565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567966+0000","last_change":"2023-12-08T08:18:01.886353+0000","last_active":"2023-12-08T08:18:03.567966+0000","last_peered":"2023-12-08T08:18:03.567966+0000","last_clean":"2023-12-08T08:18:03.567966+0000","last_became_active":"2023-12-08T08:18:01.885733+0000","last_became_peered":"2023-12-08T08:18:01.885733+0000","last_unstale":"2023-12-08T08:18:03.567966+0000","last_undegraded":"2023-12-08T08:18:03.567966+0000","last_fullsized":"2023-12-08T08:18:03.567966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:42:20.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569455+0000","last_change":"2023-12-08T08:18:01.898257+0000","last_active":"2023-12-08T08:18:03.569455+0000","last_peered":"2023-12-08T08:18:03.569455+0000","last_clean":"2023-12-08T08:18:03.569455+0000","last_became_active":"2023-12-08T08:18:01.897895+0000","last_became_peered":"2023-12-08T08:18:01.897895+0000","last_unstale":"2023-12-08T08:18:03.569455+0000","last_undegraded":"2023-12-08T08:18:03.569455+0000","last_fullsized":"2023-12-08T08:18:03.569455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885110+0000","last_change":"2023-12-08T08:17:57.852450+0000","last_active":"2023-12-08T08:18:01.885110+0000","last_peered":"2023-12-08T08:18:01.885110+0000","last_clean":"2023-12-08T08:18:01.885110+0000","last_became_active":"2023-12-08T08:17:57.852146+0000","last_became_peered":"2023-12-08T08:17:57.852146+0000","last_unstale":"2023-12-08T08:18:01.885110+0000","last_undegraded":"2023-12-08T08:18:01.885110+0000","last_fullsized":"2023-12-08T08:18:01.885110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870056+0000","last_change":"2023-12-08T08:17:56.834758+0000","last_active":"2023-12-08T08:18:01.870056+0000","last_peered":"2023-12-08T08:18:01.870056+0000","last_clean":"2023-12-08T08:18:01.870056+0000","last_became_active":"2023-12-08T08:17:56.834493+0000","last_became_peered":"2023-12-08T08:17:56.834493+0000","last_unstale":"2023-12-08T08:18:01.870056+0000","last_undegraded":"2023-12-08T08:18:01.870056+0000","last_fullsized":"2023-12-08T08:18:01.870056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880773+0000","last_change":"2023-12-08T08:18:01.897055+0000","last_active":"2023-12-08T08:18:02.880773+0000","last_peered":"2023-12-08T08:18:02.880773+0000","last_clean":"2023-12-08T08:18:02.880773+0000","last_became_active":"2023-12-08T08:18:01.896646+0000","last_became_peered":"2023-12-08T08:18:01.896646+0000","last_unstale":"2023-12-08T08:18:02.880773+0000","last_undegraded":"2023-12-08T08:18:02.880773+0000","last_fullsized":"2023-12-08T08:18:02.880773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:29.043747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869691+0000","last_change":"2023-12-08T08:17:57.864805+0000","last_active":"2023-12-08T08:18:01.869691+0000","last_peered":"2023-12-08T08:18:01.869691+0000","last_clean":"2023-12-08T08:18:01.869691+0000","last_became_active":"2023-12-08T08:17:57.864486+0000","last_became_peered":"2023-12-08T08:17:57.864486+0000","last_unstale":"2023-12-08T08:18:01.869691+0000","last_undegraded":"2023-12-08T08:18:01.869691+0000","last_fullsized":"2023-12-08T08:18:01.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870461+0000","last_change":"2023-12-08T08:17:56.836827+0000","last_active":"2023-12-08T08:18:01.870461+0000","last_peered":"2023-12-08T08:18:01.870461+0000","last_clean":"2023-12-08T08:18:01.870461+0000","last_became_active":"2023-12-08T08:17:56.836562+0000","last_became_peered":"2023-12-08T08:17:56.836562+0000","last_unstale":"2023-12-08T08:18:01.870461+0000","last_undegraded":"2023-12-08T08:18:01.870461+0000","last_fullsized":"2023-12-08T08:18:01.870461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880545+0000","last_change":"2023-12-08T08:17:56.831417+0000","last_active":"2023-12-08T08:18:01.880545+0000","last_peered":"2023-12-08T08:18:01.880545+0000","last_clean":"2023-12-08T08:18:01.880545+0000","last_became_active":"2023-12-08T08:17:56.830988+0000","last_became_peered":"2023-12-08T08:17:56.830988+0000","last_unstale":"2023-12-08T08:18:01.880545+0000","last_undegraded":"2023-12-08T08:18:01.880545+0000","last_fullsized":"2023-12-08T08:18:01.880545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872623+0000","last_change":"2023-12-08T08:17:57.848661+0000","last_active":"2023-12-08T08:18:01.872623+0000","last_peered":"2023-12-08T08:18:01.872623+0000","last_clean":"2023-12-08T08:18:01.872623+0000","last_became_active":"2023-12-08T08:17:57.848371+0000","last_became_peered":"2023-12-08T08:17:57.848371+0000","last_unstale":"2023-12-08T08:18:01.872623+0000","last_undegraded":"2023-12-08T08:18:01.872623+0000","last_fullsized":"2023-12-08T08:18:01.872623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.878886+0000","last_change":"2023-12-08T08:18:01.892612+0000","last_active":"2023-12-08T08:18:02.878886+0000","last_peered":"2023-12-08T08:18:02.878886+0000","last_clean":"2023-12-08T08:18:02.878886+0000","last_became_active":"2023-12-08T08:18:01.892204+0000","last_became_peered":"2023-12-08T08:18:01.892204+0000","last_unstale":"2023-12-08T08:18:02.878886+0000","last_undegraded":"2023-12-08T08:18:02.878886+0000","last_fullsized":"2023-12-08T08:18:02.878886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:27.724596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867878+0000","last_change":"2023-12-08T08:17:56.842132+0000","last_active":"2023-12-08T08:18:01.867878+0000","last_peered":"2023-12-08T08:18:01.867878+0000","last_clean":"2023-12-08T08:18:01.867878+0000","last_became_active":"2023-12-08T08:17:56.841864+0000","last_became_peered":"2023-12-08T08:17:56.841864+0000","last_unstale":"2023-12-08T08:18:01.867878+0000","last_undegraded":"2023-12-08T08:18:01.867878+0000","last_fullsized":"2023-12-08T08:18:01.867878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872976+0000","last_change":"2023-12-08T08:17:57.851016+0000","last_active":"2023-12-08T08:18:01.872976+0000","last_peered":"2023-12-08T08:18:01.872976+0000","last_clean":"2023-12-08T08:18:01.872976+0000","last_became_active":"2023-12-08T08:17:57.850755+0000","last_became_peered":"2023-12-08T08:17:57.850755+0000","last_unstale":"2023-12-08T08:18:01.872976+0000","last_undegraded":"2023-12-08T08:18:01.872976+0000","last_fullsized":"2023-12-08T08:18:01.872976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:31.989844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569175+0000","last_change":"2023-12-08T08:18:01.894077+0000","last_active":"2023-12-08T08:18:03.569175+0000","last_peered":"2023-12-08T08:18:03.569175+0000","last_clean":"2023-12-08T08:18:03.569175+0000","last_became_active":"2023-12-08T08:18:01.893598+0000","last_became_peered":"2023-12-08T08:18:01.893598+0000","last_unstale":"2023-12-08T08:18:03.569175+0000","last_undegraded":"2023-12-08T08:18:03.569175+0000","last_fullsized":"2023-12-08T08:18:03.569175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:42:43.972716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880217+0000","last_change":"2023-12-08T08:17:57.867998+0000","last_active":"2023-12-08T08:18:01.880217+0000","last_peered":"2023-12-08T08:18:01.880217+0000","last_clean":"2023-12-08T08:18:01.880217+0000","last_became_active":"2023-12-08T08:17:57.867727+0000","last_became_peered":"2023-12-08T08:17:57.867727+0000","last_unstale":"2023-12-08T08:18:01.880217+0000","last_undegraded":"2023-12-08T08:18:01.880217+0000","last_fullsized":"2023-12-08T08:18:01.880217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872963+0000","last_change":"2023-12-08T08:17:57.858911+0000","last_active":"2023-12-08T08:18:01.872963+0000","last_peered":"2023-12-08T08:18:01.872963+0000","last_clean":"2023-12-08T08:18:01.872963+0000","last_became_active":"2023-12-08T08:17:57.857682+0000","last_became_peered":"2023-12-08T08:17:57.857682+0000","last_unstale":"2023-12-08T08:18:01.872963+0000","last_undegraded":"2023-12-08T08:18:01.872963+0000","last_fullsized":"2023-12-08T08:18:01.872963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:20.413569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869275+0000","last_change":"2023-12-08T08:17:57.854413+0000","last_active":"2023-12-08T08:18:01.869275+0000","last_peered":"2023-12-08T08:18:01.869275+0000","last_clean":"2023-12-08T08:18:01.869275+0000","last_became_active":"2023-12-08T08:17:57.854156+0000","last_became_peered":"2023-12-08T08:17:57.854156+0000","last_unstale":"2023-12-08T08:18:01.869275+0000","last_undegraded":"2023-12-08T08:18:01.869275+0000","last_fullsized":"2023-12-08T08:18:01.869275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872542+0000","last_change":"2023-12-08T08:17:57.853043+0000","last_active":"2023-12-08T08:18:01.872542+0000","last_peered":"2023-12-08T08:18:01.872542+0000","last_clean":"2023-12-08T08:18:01.872542+0000","last_became_active":"2023-12-08T08:17:57.852710+0000","last_became_peered":"2023-12-08T08:17:57.852710+0000","last_unstale":"2023-12-08T08:18:01.872542+0000","last_undegraded":"2023-12-08T08:18:01.872542+0000","last_fullsized":"2023-12-08T08:18:01.872542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868777+0000","last_change":"2023-12-08T08:17:57.862525+0000","last_active":"2023-12-08T08:18:01.868777+0000","last_peered":"2023-12-08T08:18:01.868777+0000","last_clean":"2023-12-08T08:18:01.868777+0000","last_became_active":"2023-12-08T08:17:57.862274+0000","last_became_peered":"2023-12-08T08:17:57.862274+0000","last_unstale":"2023-12-08T08:18:01.868777+0000","last_undegraded":"2023-12-08T08:18:01.868777+0000","last_fullsized":"2023-12-08T08:18:01.868777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885096+0000","last_change":"2023-12-08T08:17:57.850983+0000","last_active":"2023-12-08T08:18:01.885096+0000","last_peered":"2023-12-08T08:18:01.885096+0000","last_clean":"2023-12-08T08:18:01.885096+0000","last_became_active":"2023-12-08T08:17:57.850648+0000","last_became_peered":"2023-12-08T08:17:57.850648+0000","last_unstale":"2023-12-08T08:18:01.885096+0000","last_undegraded":"2023-12-08T08:18:01.885096+0000","last_fullsized":"2023-12-08T08:18:01.885096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880266+0000","last_change":"2023-12-08T08:17:57.871856+0000","last_active":"2023-12-08T08:18:01.880266+0000","last_peered":"2023-12-08T08:18:01.880266+0000","last_clean":"2023-12-08T08:18:01.880266+0000","last_became_active":"2023-12-08T08:17:57.871436+0000","last_became_peered":"2023-12-08T08:17:57.871436+0000","last_unstale":"2023-12-08T08:18:01.880266+0000","last_undegraded":"2023-12-08T08:18:01.880266+0000","last_fullsized":"2023-12-08T08:18:01.880266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868325+0000","last_change":"2023-12-08T08:17:57.861903+0000","last_active":"2023-12-08T08:18:01.868325+0000","last_peered":"2023-12-08T08:18:01.868325+0000","last_clean":"2023-12-08T08:18:01.868325+0000","last_became_active":"2023-12-08T08:17:57.861604+0000","last_became_peered":"2023-12-08T08:17:57.861604+0000","last_unstale":"2023-12-08T08:18:01.868325+0000","last_undegraded":"2023-12-08T08:18:01.868325+0000","last_fullsized":"2023-12-08T08:18:01.868325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869960+0000","last_change":"2023-12-08T08:17:57.853217+0000","last_active":"2023-12-08T08:18:01.869960+0000","last_peered":"2023-12-08T08:18:01.869960+0000","last_clean":"2023-12-08T08:18:01.869960+0000","last_became_active":"2023-12-08T08:17:57.852944+0000","last_became_peered":"2023-12-08T08:17:57.852944+0000","last_unstale":"2023-12-08T08:18:01.869960+0000","last_undegraded":"2023-12-08T08:18:01.869960+0000","last_fullsized":"2023-12-08T08:18:01.869960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869655+0000","last_change":"2023-12-08T08:17:57.861199+0000","last_active":"2023-12-08T08:18:01.869655+0000","last_peered":"2023-12-08T08:18:01.869655+0000","last_clean":"2023-12-08T08:18:01.869655+0000","last_became_active":"2023-12-08T08:17:57.860929+0000","last_became_peered":"2023-12-08T08:17:57.860929+0000","last_unstale":"2023-12-08T08:18:01.869655+0000","last_undegraded":"2023-12-08T08:18:01.869655+0000","last_fullsized":"2023-12-08T08:18:01.869655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869190+0000","last_change":"2023-12-08T08:17:57.857515+0000","last_active":"2023-12-08T08:18:01.869190+0000","last_peered":"2023-12-08T08:18:01.869190+0000","last_clean":"2023-12-08T08:18:01.869190+0000","last_became_active":"2023-12-08T08:17:57.857211+0000","last_became_peered":"2023-12-08T08:17:57.857211+0000","last_unstale":"2023-12-08T08:18:01.869190+0000","last_undegraded":"2023-12-08T08:18:01.869190+0000","last_fullsized":"2023-12-08T08:18:01.869190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872446+0000","last_change":"2023-12-08T08:17:57.858919+0000","last_active":"2023-12-08T08:18:01.872446+0000","last_peered":"2023-12-08T08:18:01.872446+0000","last_clean":"2023-12-08T08:18:01.872446+0000","last_became_active":"2023-12-08T08:17:57.858591+0000","last_became_peered":"2023-12-08T08:17:57.858591+0000","last_unstale":"2023-12-08T08:18:01.872446+0000","last_undegraded":"2023-12-08T08:18:01.872446+0000","last_fullsized":"2023-12-08T08:18:01.872446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880097+0000","last_change":"2023-12-08T08:17:57.867005+0000","last_active":"2023-12-08T08:18:01.880097+0000","last_peered":"2023-12-08T08:18:01.880097+0000","last_clean":"2023-12-08T08:18:01.880097+0000","last_became_active":"2023-12-08T08:17:57.866755+0000","last_became_peered":"2023-12-08T08:17:57.866755+0000","last_unstale":"2023-12-08T08:18:01.880097+0000","last_undegraded":"2023-12-08T08:18:01.880097+0000","last_fullsized":"2023-12-08T08:18:01.880097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868792+0000","last_change":"2023-12-08T08:17:57.857239+0000","last_active":"2023-12-08T08:18:01.868792+0000","last_peered":"2023-12-08T08:18:01.868792+0000","last_clean":"2023-12-08T08:18:01.868792+0000","last_became_active":"2023-12-08T08:17:57.856974+0000","last_became_peered":"2023-12-08T08:17:57.856974+0000","last_unstale":"2023-12-08T08:18:01.868792+0000","last_undegraded":"2023-12-08T08:18:01.868792+0000","last_fullsized":"2023-12-08T08:18:01.868792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875617+0000","last_change":"2023-12-08T08:17:57.870364+0000","last_active":"2023-12-08T08:18:01.875617+0000","last_peered":"2023-12-08T08:18:01.875617+0000","last_clean":"2023-12-08T08:18:01.875617+0000","last_became_active":"2023-12-08T08:17:57.870055+0000","last_became_peered":"2023-12-08T08:17:57.870055+0000","last_unstale":"2023-12-08T08:18:01.875617+0000","last_undegraded":"2023-12-08T08:18:01.875617+0000","last_fullsized":"2023-12-08T08:18:01.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869535+0000","last_change":"2023-12-08T08:17:57.856731+0000","last_active":"2023-12-08T08:18:01.869535+0000","last_peered":"2023-12-08T08:18:01.869535+0000","last_clean":"2023-12-08T08:18:01.869535+0000","last_became_active":"2023-12-08T08:17:57.856474+0000","last_became_peered":"2023-12-08T08:17:57.856474+0000","last_unstale":"2023-12-08T08:18:01.869535+0000","last_undegraded":"2023-12-08T08:18:01.869535+0000","last_fullsized":"2023-12-08T08:18:01.869535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869853+0000","last_change":"2023-12-08T08:17:57.863405+0000","last_active":"2023-12-08T08:18:01.869853+0000","last_peered":"2023-12-08T08:18:01.869853+0000","last_clean":"2023-12-08T08:18:01.869853+0000","last_became_active":"2023-12-08T08:17:57.863134+0000","last_became_peered":"2023-12-08T08:17:57.863134+0000","last_unstale":"2023-12-08T08:18:01.869853+0000","last_undegraded":"2023-12-08T08:18:01.869853+0000","last_fullsized":"2023-12-08T08:18:01.869853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885204+0000","last_change":"2023-12-08T08:17:57.860480+0000","last_active":"2023-12-08T08:18:01.885204+0000","last_peered":"2023-12-08T08:18:01.885204+0000","last_clean":"2023-12-08T08:18:01.885204+0000","last_became_active":"2023-12-08T08:17:57.860188+0000","last_became_peered":"2023-12-08T08:17:57.860188+0000","last_unstale":"2023-12-08T08:18:01.885204+0000","last_undegraded":"2023-12-08T08:18:01.885204+0000","last_fullsized":"2023-12-08T08:18:01.885204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873034+0000","last_change":"2023-12-08T08:17:57.852445+0000","last_active":"2023-12-08T08:18:01.873034+0000","last_peered":"2023-12-08T08:18:01.873034+0000","last_clean":"2023-12-08T08:18:01.873034+0000","last_became_active":"2023-12-08T08:17:57.852166+0000","last_became_peered":"2023-12-08T08:17:57.852166+0000","last_unstale":"2023-12-08T08:18:01.873034+0000","last_undegraded":"2023-12-08T08:18:01.873034+0000","last_fullsized":"2023-12-08T08:18:01.873034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:13.038005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867672+0000","last_change":"2023-12-08T08:17:57.869784+0000","last_active":"2023-12-08T08:18:01.867672+0000","last_peered":"2023-12-08T08:18:01.867672+0000","last_clean":"2023-12-08T08:18:01.867672+0000","last_became_active":"2023-12-08T08:17:57.869480+0000","last_became_peered":"2023-12-08T08:17:57.869480+0000","last_unstale":"2023-12-08T08:18:01.867672+0000","last_undegraded":"2023-12-08T08:18:01.867672+0000","last_fullsized":"2023-12-08T08:18:01.867672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873259+0000","last_change":"2023-12-08T08:17:57.870844+0000","last_active":"2023-12-08T08:18:01.873259+0000","last_peered":"2023-12-08T08:18:01.873259+0000","last_clean":"2023-12-08T08:18:01.873259+0000","last_became_active":"2023-12-08T08:17:57.870537+0000","last_became_peered":"2023-12-08T08:17:57.870537+0000","last_unstale":"2023-12-08T08:18:01.873259+0000","last_undegraded":"2023-12-08T08:18:01.873259+0000","last_fullsized":"2023-12-08T08:18:01.873259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:35.384529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880776+0000","last_change":"2023-12-08T08:17:57.867745+0000","last_active":"2023-12-08T08:18:01.880776+0000","last_peered":"2023-12-08T08:18:01.880776+0000","last_clean":"2023-12-08T08:18:01.880776+0000","last_became_active":"2023-12-08T08:17:57.867492+0000","last_became_peered":"2023-12-08T08:17:57.867492+0000","last_unstale":"2023-12-08T08:18:01.880776+0000","last_undegraded":"2023-12-08T08:18:01.880776+0000","last_fullsized":"2023-12-08T08:18:01.880776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880175+0000","last_change":"2023-12-08T08:17:57.866534+0000","last_active":"2023-12-08T08:18:01.880175+0000","last_peered":"2023-12-08T08:18:01.880175+0000","last_clean":"2023-12-08T08:18:01.880175+0000","last_became_active":"2023-12-08T08:17:57.866280+0000","last_became_peered":"2023-12-08T08:17:57.866280+0000","last_unstale":"2023-12-08T08:18:01.880175+0000","last_undegraded":"2023-12-08T08:18:01.880175+0000","last_fullsized":"2023-12-08T08:18:01.880175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868651+0000","last_change":"2023-12-08T08:17:57.862123+0000","last_active":"2023-12-08T08:18:01.868651+0000","last_peered":"2023-12-08T08:18:01.868651+0000","last_clean":"2023-12-08T08:18:01.868651+0000","last_became_active":"2023-12-08T08:17:57.859905+0000","last_became_peered":"2023-12-08T08:17:57.859905+0000","last_unstale":"2023-12-08T08:18:01.868651+0000","last_undegraded":"2023-12-08T08:18:01.868651+0000","last_fullsized":"2023-12-08T08:18:01.868651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:02.076263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869059+0000","last_change":"2023-12-08T08:17:57.864037+0000","last_active":"2023-12-08T08:18:01.869059+0000","last_peered":"2023-12-08T08:18:01.869059+0000","last_clean":"2023-12-08T08:18:01.869059+0000","last_became_active":"2023-12-08T08:17:57.862943+0000","last_became_peered":"2023-12-08T08:17:57.862943+0000","last_unstale":"2023-12-08T08:18:01.869059+0000","last_undegraded":"2023-12-08T08:18:01.869059+0000","last_fullsized":"2023-12-08T08:18:01.869059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868564+0000","last_change":"2023-12-08T08:17:57.863052+0000","last_active":"2023-12-08T08:18:01.868564+0000","last_peered":"2023-12-08T08:18:01.868564+0000","last_clean":"2023-12-08T08:18:01.868564+0000","last_became_active":"2023-12-08T08:17:57.862762+0000","last_became_peered":"2023-12-08T08:17:57.862762+0000","last_unstale":"2023-12-08T08:18:01.868564+0000","last_undegraded":"2023-12-08T08:18:01.868564+0000","last_fullsized":"2023-12-08T08:18:01.868564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869100+0000","last_change":"2023-12-08T08:17:57.863846+0000","last_active":"2023-12-08T08:18:01.869100+0000","last_peered":"2023-12-08T08:18:01.869100+0000","last_clean":"2023-12-08T08:18:01.869100+0000","last_became_active":"2023-12-08T08:17:57.863582+0000","last_became_peered":"2023-12-08T08:17:57.863582+0000","last_unstale":"2023-12-08T08:18:01.869100+0000","last_undegraded":"2023-12-08T08:18:01.869100+0000","last_fullsized":"2023-12-08T08:18:01.869100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868290+0000","last_change":"2023-12-08T08:17:57.860800+0000","last_active":"2023-12-08T08:18:01.868290+0000","last_peered":"2023-12-08T08:18:01.868290+0000","last_clean":"2023-12-08T08:18:01.868290+0000","last_became_active":"2023-12-08T08:17:57.859933+0000","last_became_peered":"2023-12-08T08:17:57.859933+0000","last_unstale":"2023-12-08T08:18:01.868290+0000","last_undegraded":"2023-12-08T08:18:01.868290+0000","last_fullsized":"2023-12-08T08:18:01.868290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869044+0000","last_change":"2023-12-08T08:17:57.866870+0000","last_active":"2023-12-08T08:18:01.869044+0000","last_peered":"2023-12-08T08:18:01.869044+0000","last_clean":"2023-12-08T08:18:01.869044+0000","last_became_active":"2023-12-08T08:17:57.866242+0000","last_became_peered":"2023-12-08T08:17:57.866242+0000","last_unstale":"2023-12-08T08:18:01.869044+0000","last_undegraded":"2023-12-08T08:18:01.869044+0000","last_fullsized":"2023-12-08T08:18:01.869044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872306+0000","last_change":"2023-12-08T08:17:57.853244+0000","last_active":"2023-12-08T08:18:01.872306+0000","last_peered":"2023-12-08T08:18:01.872306+0000","last_clean":"2023-12-08T08:18:01.872306+0000","last_became_active":"2023-12-08T08:17:57.852962+0000","last_became_peered":"2023-12-08T08:17:57.852962+0000","last_unstale":"2023-12-08T08:18:01.872306+0000","last_undegraded":"2023-12-08T08:18:01.872306+0000","last_fullsized":"2023-12-08T08:18:01.872306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885422+0000","last_change":"2023-12-08T08:17:57.861311+0000","last_active":"2023-12-08T08:18:01.885422+0000","last_peered":"2023-12-08T08:18:01.885422+0000","last_clean":"2023-12-08T08:18:01.885422+0000","last_became_active":"2023-12-08T08:17:57.860997+0000","last_became_peered":"2023-12-08T08:17:57.860997+0000","last_unstale":"2023-12-08T08:18:01.885422+0000","last_undegraded":"2023-12-08T08:18:01.885422+0000","last_fullsized":"2023-12-08T08:18:01.885422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868647+0000","last_change":"2023-12-08T08:17:57.869587+0000","last_active":"2023-12-08T08:18:01.868647+0000","last_peered":"2023-12-08T08:18:01.868647+0000","last_clean":"2023-12-08T08:18:01.868647+0000","last_became_active":"2023-12-08T08:17:57.869269+0000","last_became_peered":"2023-12-08T08:17:57.869269+0000","last_unstale":"2023-12-08T08:18:01.868647+0000","last_undegraded":"2023-12-08T08:18:01.868647+0000","last_fullsized":"2023-12-08T08:18:01.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:41.285450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:21.284 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:18:21.284 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-08T08:18:21.284 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-08T08:18:21.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-08T08:18:21.285 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-08T08:18:21.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.424+0000 7fafbee10640 1 Processor -- start 2023-12-08T08:18:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.424+0000 7fafbee10640 1 -- start start 2023-12-08T08:18:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafbee10640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 0x7fafb806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafbee10640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb8070db0 con 0x7fafb8140a10 2023-12-08T08:18:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafbee10640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb8071090 con 0x7fafb80ce3e0 2023-12-08T08:18:21.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafbee10640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb8070ba0 con 0x7fafb8071e50 2023-12-08T08:18:21.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafbcbac640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fafb8140a10 0x7fafb80cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35082/0 (socket says 172.21.15.50:35082) 2023-12-08T08:18:21.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafbcbac640 1 -- 172.21.15.50:0/179903047 learned_addr learned my addr 172.21.15.50:0/179903047 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:21.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364475247 0 0) 0x7fafb8070db0 con 0x7fafb8140a10 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa8003520 con 0x7fafb8140a10 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.425+0000 7fafbd3ad640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 0x7fafb806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 54974552 0 0) 0x7fafa8003520 con 0x7fafb8140a10 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 msgr2=0x7fafb806c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 0x7fafb806c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 >> v1:172.21.15.170:6789/0 conn(0x7fafb80ce3e0 legacy=0x7fafb80b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8071370 con 0x7fafb8140a10 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fafac001670 con 0x7fafb8140a10 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 >> v1:172.21.15.50:6789/0 conn(0x7fafb8140a10 legacy=0x7fafb80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa80039a0 0x7fafa8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 0x7fafa80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa8004d00 0x7fafa8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb8070ba0 con 0x7fafa8004d00 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa800baf0 con 0x7fafa80039a0 2023-12-08T08:18:21.430 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa800bcb0 con 0x7fafb8071e50 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafbd3ad640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa8004d00 0x7fafa8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafbcbac640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa80039a0 0x7fafa8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafb7fff640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 0x7fafa80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafbd3ad640 1 -- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 msgr2=0x7fafa80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafbd3ad640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071e50 0x7fafa80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafbd3ad640 1 -- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa80039a0 msgr2=0x7fafa8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafbd3ad640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa80039a0 0x7fafa8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.426+0000 7fafbd3ad640 1 -- 172.21.15.50:0/179903047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa8003520 con 0x7fafa8004d00 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.427+0000 7fafbd3ad640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa8004d00 0x7fafa8005180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009f90 tx=0x7fafa80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b23def97379e72d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.427+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb002cbd0 con 0x7fafa8004d00 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.427+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000f040 con 0x7fafa8004d00 2023-12-08T08:18:21.431 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.427+0000 7fafb77fe640 1 -- 172.21.15.50:0/179903047 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0034440 con 0x7fafa8004d00 2023-12-08T08:18:21.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.427+0000 7fafbee10640 1 -- 172.21.15.50:0/179903047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa8004d00 msgr2=0x7fafa8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.427+0000 7fafbee10640 1 --2- 172.21.15.50:0/179903047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa8004d00 0x7fafa8005180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009f90 tx=0x7fafa80057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.427+0000 7fafbd3ad640 1 -- 172.21.15.50:0/179903047 reap_dead start 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.428+0000 7fafbee10640 1 -- 172.21.15.50:0/179903047 shutdown_connections 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.428+0000 7fafbee10640 1 -- 172.21.15.50:0/179903047 >> 172.21.15.50:0/179903047 conn(0x7fafb80b09f0 msgr2=0x7fafb80b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.428+0000 7fafbee10640 1 -- 172.21.15.50:0/179903047 shutdown_connections 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.428+0000 7fafbee10640 1 -- 172.21.15.50:0/179903047 wait complete. 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.429+0000 7fafbee10640 1 Processor -- start 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.429+0000 7fafbee10640 1 -- start start 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbee10640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa8004d00 0x7fafb813e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbee10640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb813f350 0x7fafb8159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbee10640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb8099a10 0x7fafb80c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbee10640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb813f810 con 0x7fafb813f350 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbee10640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb813faf0 con 0x7fafb8099a10 2023-12-08T08:18:21.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbee10640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb8141f00 con 0x7fafa8004d00 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb813f350 0x7fafb8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb813f350 0x7fafb8159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57064/0 (socket says 172.21.15.50:57064) 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 -- 172.21.15.50:0/2081843709 learned_addr learned my addr 172.21.15.50:0/2081843709 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbcbac640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa8004d00 0x7fafb813e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbd3ad640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb8099a10 0x7fafb80c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 -- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa8004d00 msgr2=0x7fafb813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa8004d00 0x7fafb813e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 -- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb8099a10 msgr2=0x7fafb80c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb8099a10 0x7fafb80c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 -- 172.21.15.50:0/2081843709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb81421e0 con 0x7fafb813f350 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbd3ad640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb8099a10 0x7fafb80c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafbcbac640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa8004d00 0x7fafb813e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.430+0000 7fafb7fff640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb813f350 0x7fafb8159a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafa400f7f0 tx=0x7fafa400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.431+0000 7fafb57fa640 1 -- 172.21.15.50:0/2081843709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa40050d0 con 0x7fafb813f350 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.431+0000 7fafb57fa640 1 -- 172.21.15.50:0/2081843709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4005230 con 0x7fafb813f350 2023-12-08T08:18:21.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.431+0000 7fafb57fa640 1 -- 172.21.15.50:0/2081843709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400d730 con 0x7fafb813f350 2023-12-08T08:18:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.431+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb81424c0 con 0x7fafb813f350 2023-12-08T08:18:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.431+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb80c9400 con 0x7fafb813f350 2023-12-08T08:18:21.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.432+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb80c9620 con 0x7fafb813f350 2023-12-08T08:18:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.432+0000 7fafb57fa640 1 -- 172.21.15.50:0/2081843709 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafa400d890 con 0x7fafb813f350 2023-12-08T08:18:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.433+0000 7fafb57fa640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf9c06ae70 0x7faf9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.433+0000 7fafb57fa640 1 -- 172.21.15.50:0/2081843709 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafa4089780 con 0x7fafb813f350 2023-12-08T08:18:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.433+0000 7fafbcbac640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf9c06ae70 0x7faf9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.433+0000 7fafbcbac640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf9c06ae70 0x7faf9c06d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fafac001050 tx=0x7fafac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.437+0000 7fafb57fa640 1 -- 172.21.15.50:0/2081843709 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafa40545d0 con 0x7fafb813f350 2023-12-08T08:18:21.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.662+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fafb8067430 con 0x7fafb813f350 2023-12-08T08:18:21.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.665+0000 7fafb57fa640 1 -- 172.21.15.50:0/2081843709 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171036 (secure 0 0 0) 0x7fafa4057bf0 con 0x7fafb813f350 2023-12-08T08:18:21.670 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf9c06ae70 msgr2=0x7faf9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf9c06ae70 0x7faf9c06d330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fafac001050 tx=0x7fafac009040 comp rx=0 tx=0).stop 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb813f350 msgr2=0x7fafb8159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb813f350 0x7fafb8159a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafa400f7f0 tx=0x7fafa400fcb0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 shutdown_connections 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf9c06ae70 0x7faf9c06d330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafb813f350 0x7fafb8159a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb8099a10 0x7fafb80c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 --2- 172.21.15.50:0/2081843709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa8004d00 0x7fafb813e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 >> 172.21.15.50:0/2081843709 conn(0x7fafb80b09f0 msgr2=0x7fafb80b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 shutdown_connections 2023-12-08T08:18:21.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.668+0000 7fafbee10640 1 -- 172.21.15.50:0/2081843709 wait complete. 2023-12-08T08:18:21.681 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":374285324},{"type":"v1","addr":"172.21.15.170:6833","nonce":374285324}]},"active_addr":"172.21.15.170:6833/374285324","active_change":"2023-12-08T08:17:36.101560+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":4073071530}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2385646980}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3944525877}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1559810792}]}]} 2023-12-08T08:18:21.684 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-08T08:18:21.684 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-08T08:18:21.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.790+0000 7f5ee2ae5640 1 Processor -- start 2023-12-08T08:18:21.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.790+0000 7f5ee2ae5640 1 -- start start 2023-12-08T08:18:21.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee2ae5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5edc0ce3e0 0x7f5edc0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee2ae5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5edc071e50 0x7f5edc0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee2ae5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc0b29b0 con 0x7f5edc140a10 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee2ae5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc070ba0 con 0x7f5edc071e50 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee2ae5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc070db0 con 0x7f5edc0ce3e0 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee1082640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5edc071e50 0x7f5edc0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee0881640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5edc140a10 0x7f5edc0cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35098/0 (socket says 172.21.15.50:35098) 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee0881640 1 -- 172.21.15.50:0/154258128 learned_addr learned my addr 172.21.15.50:0/154258128 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ed3fff640 1 --2- 172.21.15.50:0/154258128 >> v2:172.21.15.170:3300/0 conn(0x7f5edc0ce3e0 0x7f5edc0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee1082640 1 -- 172.21.15.50:0/154258128 >> v2:172.21.15.170:3300/0 conn(0x7f5edc0ce3e0 msgr2=0x7f5edc0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee1082640 1 --2- 172.21.15.50:0/154258128 >> v2:172.21.15.170:3300/0 conn(0x7f5edc0ce3e0 0x7f5edc0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee1082640 1 -- 172.21.15.50:0/154258128 >> v1:172.21.15.50:6789/0 conn(0x7f5edc140a10 legacy=0x7f5edc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ee1082640 1 -- 172.21.15.50:0/154258128 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc071090 con 0x7f5edc071e50 2023-12-08T08:18:21.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.791+0000 7f5ed3fff640 1 --2- 172.21.15.50:0/154258128 >> v2:172.21.15.170:3300/0 conn(0x7f5edc0ce3e0 0x7f5edc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:21.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.792+0000 7f5ee1082640 1 --2- 172.21.15.50:0/154258128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc0b2470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0b41c0 tx=0x7f5ed402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49665931973b6eb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.792+0000 7f5ed37fe640 1 -- 172.21.15.50:0/154258128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed402cd00 con 0x7f5edc071e50 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.792+0000 7f5ed37fe640 1 -- 172.21.15.50:0/154258128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed402ce60 con 0x7f5edc071e50 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.792+0000 7f5ed37fe640 1 -- 172.21.15.50:0/154258128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4034660 con 0x7f5edc071e50 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/154258128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 msgr2=0x7f5edc0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/154258128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc0b2470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0b41c0 tx=0x7f5ed402bf50 comp rx=0 tx=0).stop 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/154258128 shutdown_connections 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/154258128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc0b2470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/154258128 >> v2:172.21.15.170:3300/0 conn(0x7f5edc0ce3e0 0x7f5edc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/154258128 >> 172.21.15.50:0/154258128 conn(0x7f5edc0b09f0 msgr2=0x7f5edc0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/154258128 shutdown_connections 2023-12-08T08:18:21.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.793+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/154258128 wait complete. 2023-12-08T08:18:21.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.794+0000 7f5ee2ae5640 1 Processor -- start 2023-12-08T08:18:21.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.794+0000 7f5ee2ae5640 1 -- start start 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee2ae5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee2ae5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5edc0ce3e0 0x7f5edc15af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee2ae5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5edc140a10 0x7f5edc09a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee2ae5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc15b5b0 con 0x7f5edc071e50 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee2ae5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc09ab00 con 0x7f5edc0ce3e0 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee2ae5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc09b060 con 0x7f5edc140a10 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57080/0 (socket says 172.21.15.50:57080) 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 -- 172.21.15.50:0/1997520932 learned_addr learned my addr 172.21.15.50:0/1997520932 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee1082640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5edc140a10 0x7f5edc09a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ed3fff640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5edc0ce3e0 0x7f5edc15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 -- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5edc140a10 msgr2=0x7f5edc09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5edc140a10 0x7f5edc09a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 -- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5edc0ce3e0 msgr2=0x7f5edc15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5edc0ce3e0 0x7f5edc15af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee0881640 1 -- 172.21.15.50:0/1997520932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009a70 con 0x7f5edc071e50 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ed3fff640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5edc0ce3e0 0x7f5edc15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.795+0000 7f5ee1082640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5edc140a10 0x7f5edc09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.796+0000 7f5ee0881640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc158c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c480 tx=0x7f5ed800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.796+0000 7f5ed17fa640 1 -- 172.21.15.50:0/1997520932 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8005ce0 con 0x7f5edc071e50 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.796+0000 7f5ed17fa640 1 -- 172.21.15.50:0/1997520932 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8005e40 con 0x7f5edc071e50 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.796+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc09b340 con 0x7f5edc071e50 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.796+0000 7f5ed17fa640 1 -- 172.21.15.50:0/1997520932 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80072f0 con 0x7f5edc071e50 2023-12-08T08:18:21.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.796+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc09b900 con 0x7f5edc071e50 2023-12-08T08:18:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.797+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc074320 con 0x7f5edc071e50 2023-12-08T08:18:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.797+0000 7f5ed17fa640 1 -- 172.21.15.50:0/1997520932 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ed8007510 con 0x7f5edc071e50 2023-12-08T08:18:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.798+0000 7f5ed17fa640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5ec806ae40 0x7f5ec806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.798+0000 7f5ed17fa640 1 -- 172.21.15.50:0/1997520932 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ed8088e30 con 0x7f5edc071e50 2023-12-08T08:18:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.798+0000 7f5ed3fff640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5ec806ae40 0x7f5ec806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:21.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.798+0000 7f5ed3fff640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5ec806ae40 0x7f5ec806d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:21.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.802+0000 7f5ed17fa640 1 -- 172.21.15.50:0/1997520932 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ed8053c90 con 0x7f5edc071e50 2023-12-08T08:18:21.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.982+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5edc067430 con 0x7f5edc071e50 2023-12-08T08:18:21.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.983+0000 7f5ed17fa640 1 -- 172.21.15.50:0/1997520932 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f5ed8017020 con 0x7f5edc071e50 2023-12-08T08:18:21.985 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:21.985 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5ec806ae40 msgr2=0x7f5ec806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5ec806ae40 0x7f5ec806d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc008040 comp rx=0 tx=0).stop 2023-12-08T08:18:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 msgr2=0x7f5edc158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc158c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c480 tx=0x7f5ed800c940 comp rx=0 tx=0).stop 2023-12-08T08:18:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 shutdown_connections 2023-12-08T08:18:21.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5ec806ae40 0x7f5ec806d300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5edc140a10 0x7f5edc09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5edc0ce3e0 0x7f5edc15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 --2- 172.21.15.50:0/1997520932 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5edc071e50 0x7f5edc158c30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 >> 172.21.15.50:0/1997520932 conn(0x7f5edc0b09f0 msgr2=0x7f5edc0cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 shutdown_connections 2023-12-08T08:18:21.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:21.985+0000 7f5ee2ae5640 1 -- 172.21.15.50:0/1997520932 wait complete. 2023-12-08T08:18:21.998 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-08T08:18:21.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:22.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.103+0000 7f004a490640 1 Processor -- start 2023-12-08T08:18:22.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.103+0000 7f004a490640 1 -- start start 2023-12-08T08:18:22.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f004a490640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 0x7f00440d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f004a490640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004415ee90 con 0x7f004415f890 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f004a490640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440d0fe0 con 0x7f00440d3ad0 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f004a490640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440d1280 con 0x7f004415d580 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0048a2d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f004415f890 0x7f004415d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35112/0 (socket says 172.21.15.50:35112) 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0048a2d640 1 -- 172.21.15.50:0/1035562220 learned_addr learned my addr 172.21.15.50:0/1035562220 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0043fff640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 0x7f00440d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151667627 0 0) 0x7f004415ee90 con 0x7f004415f890 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f002c003520 con 0x7f004415f890 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3946486557 0 0) 0x7f002c003520 con 0x7f004415f890 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 msgr2=0x7f00440d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 0x7f00440d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 >> v1:172.21.15.170:6789/0 conn(0x7f00440d3ad0 legacy=0x7f004415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440d1560 con 0x7f004415f890 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f003c0019f0 con 0x7f004415f890 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 >> v1:172.21.15.50:6789/0 conn(0x7f004415f890 legacy=0x7f004415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c0039a0 0x7f002c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f002c004350 0x7f002c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 0x7f002c005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440d1280 con 0x7f002c0039a0 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c00ba30 con 0x7f002c004350 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.104+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c00bbf0 con 0x7f004415d580 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f0043fff640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c0039a0 0x7f002c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f00437fe640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f002c004350 0x7f002c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f0048a2d640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 0x7f002c005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f0043fff640 1 -- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 msgr2=0x7f002c005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f0043fff640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f004415d580 0x7f002c005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f0043fff640 1 -- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f002c004350 msgr2=0x7f002c004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f0043fff640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f002c004350 0x7f002c004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.105+0000 7f0043fff640 1 -- 172.21.15.50:0/1035562220 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c003520 con 0x7f002c0039a0 2023-12-08T08:18:22.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f0043fff640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c0039a0 0x7f002c003d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0034009ac0 tx=0x7f002c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822b0452a3a7c869 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003402c6b0 con 0x7f002c0039a0 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003402c810 con 0x7f002c0039a0 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f0042ffd640 1 -- 172.21.15.50:0/1035562220 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003402cba0 con 0x7f002c0039a0 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f004a490640 1 -- 172.21.15.50:0/1035562220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c0039a0 msgr2=0x7f002c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f004a490640 1 --2- 172.21.15.50:0/1035562220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f002c0039a0 0x7f002c003d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0034009ac0 tx=0x7f002c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f0048a2d640 1 -- 172.21.15.50:0/1035562220 reap_dead start 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f004a490640 1 -- 172.21.15.50:0/1035562220 shutdown_connections 2023-12-08T08:18:22.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f004a490640 1 -- 172.21.15.50:0/1035562220 >> 172.21.15.50:0/1035562220 conn(0x7f00440d2fb0 msgr2=0x7f00440d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f004a490640 1 -- 172.21.15.50:0/1035562220 shutdown_connections 2023-12-08T08:18:22.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.106+0000 7f004a490640 1 -- 172.21.15.50:0/1035562220 wait complete. 2023-12-08T08:18:22.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.108+0000 7f004a490640 1 Processor -- start 2023-12-08T08:18:22.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.108+0000 7f004a490640 1 -- start start 2023-12-08T08:18:22.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.108+0000 7f004a490640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f002c0039a0 0x7f004414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.108+0000 7f004a490640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00440c84b0 0x7f00440b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f004a490640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00440c8910 0x7f00440b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f004a490640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00441e6710 con 0x7f00440c8910 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f004a490640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00440c91a0 con 0x7f00440c84b0 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f004a490640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004414f8c0 con 0x7f002c0039a0 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00440c8910 0x7f00440b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00440c8910 0x7f00440b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57100/0 (socket says 172.21.15.50:57100) 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 -- 172.21.15.50:0/253569014 learned_addr learned my addr 172.21.15.50:0/253569014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0043fff640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f002c0039a0 0x7f004414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f00437fe640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00440c84b0 0x7f00440b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 -- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f002c0039a0 msgr2=0x7f004414f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f002c0039a0 0x7f004414f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 -- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00440c84b0 msgr2=0x7f00440b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00440c84b0 0x7f00440b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 -- 172.21.15.50:0/253569014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440c8ec0 con 0x7f00440c8910 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f00437fe640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00440c84b0 0x7f00440b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:22.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0048a2d640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00440c8910 0x7f00440b1300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f004415fc70 tx=0x7f003c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0040ff9640 1 -- 172.21.15.50:0/253569014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c00ab70 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0040ff9640 1 -- 172.21.15.50:0/253569014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c00acf0 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00441e6050 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f0040ff9640 1 -- 172.21.15.50:0/253569014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c013630 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.109+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004415cd20 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.110+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00440d09d0 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.111+0000 7f0040ff9640 1 -- 172.21.15.50:0/253569014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f003c013790 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.111+0000 7f0040ff9640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f003006ae70 0x7f003006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.111+0000 7f0040ff9640 1 -- 172.21.15.50:0/253569014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f003c089e90 con 0x7f00440c8910 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.111+0000 7f0043fff640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f003006ae70 0x7f003006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.112+0000 7f0043fff640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f003006ae70 0x7f003006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0034036000 tx=0x7f0034030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.116+0000 7f0040ff9640 1 -- 172.21.15.50:0/253569014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f003c054ce0 con 0x7f00440c8910 2023-12-08T08:18:22.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.294+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f004415cee0 con 0x7f00440c8910 2023-12-08T08:18:22.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.295+0000 7f0040ff9640 1 -- 172.21.15.50:0/253569014 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f004415cee0 con 0x7f00440c8910 2023-12-08T08:18:22.297 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:22.298 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f003006ae70 msgr2=0x7f003006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f003006ae70 0x7f003006d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0034036000 tx=0x7f0034030000 comp rx=0 tx=0).stop 2023-12-08T08:18:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00440c8910 msgr2=0x7f00440b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00440c8910 0x7f00440b1300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f004415fc70 tx=0x7f003c007bd0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 shutdown_connections 2023-12-08T08:18:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f003006ae70 0x7f003006d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00440c8910 0x7f00440b1300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00440c84b0 0x7f00440b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 --2- 172.21.15.50:0/253569014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f002c0039a0 0x7f004414f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 >> 172.21.15.50:0/253569014 conn(0x7f00440d2fb0 msgr2=0x7f004406b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 shutdown_connections 2023-12-08T08:18:22.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.297+0000 7f004a490640 1 -- 172.21.15.50:0/253569014 wait complete. 2023-12-08T08:18:22.311 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-08T08:18:22.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-08T08:18:22.312 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-08T08:18:22.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-08T08:18:22.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-08T08:18:22.313 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-08T08:18:22.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-08T08:18:22.314 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-08T08:18:22.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.493+0000 7f304844b640 1 Processor -- start 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.493+0000 7f304844b640 1 -- start start 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.495+0000 7f304844b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f304006d530 0x7f304006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.495+0000 7f304844b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30401595a0 0x7f304006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.495+0000 7f304844b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304006de50 con 0x7f30400b31a0 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.495+0000 7f304844b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304015a860 con 0x7f30401595a0 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.495+0000 7f304844b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3040070190 con 0x7f304006d530 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.495+0000 7f30461e7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f304006d530 0x7f304006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.495+0000 7f30469e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30401595a0 0x7f304006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.496+0000 7f30469e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f30401595a0 0x7f304006c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57102/0 (socket says 172.21.15.50:57102) 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.496+0000 7f30469e8640 1 -- 172.21.15.50:0/193840346 learned_addr learned my addr 172.21.15.50:0/193840346 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.497+0000 7fa81f2f8640 1 Processor -- start 2023-12-08T08:18:22.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.497+0000 7fa81f2f8640 1 -- start start 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.496+0000 7f30461e7640 1 -- 172.21.15.50:0/193840346 >> v2:172.21.15.50:3300/0 conn(0x7f30401595a0 msgr2=0x7f304006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.496+0000 7f30461e7640 1 --2- 172.21.15.50:0/193840346 >> v2:172.21.15.50:3300/0 conn(0x7f30401595a0 0x7f304006c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.496+0000 7f30461e7640 1 -- 172.21.15.50:0/193840346 >> v1:172.21.15.170:6789/0 conn(0x7f30400b31a0 legacy=0x7f304006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.496+0000 7f30461e7640 1 -- 172.21.15.50:0/193840346 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040159aa0 con 0x7f304006d530 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.497+0000 7f985d178640 1 Processor -- start 2023-12-08T08:18:22.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.497+0000 7f985d178640 1 -- start start 2023-12-08T08:18:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.497+0000 7f30461e7640 1 --2- 172.21.15.50:0/193840346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f304006d530 0x7f304006d910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f304006bcd0 tx=0x7f303c02cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce357284f5108d74 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f30451e5640 1 -- 172.21.15.50:0/193840346 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c02d940 con 0x7f304006d530 2023-12-08T08:18:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f30451e5640 1 -- 172.21.15.50:0/193840346 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c02daa0 con 0x7f304006d530 2023-12-08T08:18:22.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f45eac09640 1 Processor -- start 2023-12-08T08:18:22.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f985d178640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f985816ea90 0x7f98580cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f985d178640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f98580cbc10 0x7f98580ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f985d178640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580cc040 con 0x7f985816a4e0 2023-12-08T08:18:22.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f985d178640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98580b3f40 con 0x7f985816ea90 2023-12-08T08:18:22.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f985d178640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98580b3180 con 0x7f98580cbc10 2023-12-08T08:18:22.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.498+0000 7f45eac09640 1 -- start start 2023-12-08T08:18:22.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f985759e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f98580cbc10 0x7f98580ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81f2f8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8100e75c0 0x7fa81004ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81f2f8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa810058990 0x7fa810053500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81f2f8640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8100e79a0 con 0x7fa810056a80 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81f2f8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa810006a50 con 0x7fa810058990 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81f2f8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa810057940 con 0x7fa8100e75c0 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f304844b640 1 -- 172.21.15.50:0/193840346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f304006d530 msgr2=0x7f304006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f304844b640 1 --2- 172.21.15.50:0/193840346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f304006d530 0x7f304006d910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f304006bcd0 tx=0x7f303c02cb90 comp rx=0 tx=0).stop 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81eaf7640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa810056a80 0x7fa810006e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35124/0 (socket says 172.21.15.50:35124) 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81eaf7640 1 -- 172.21.15.50:0/935374300 learned_addr learned my addr 172.21.15.50:0/935374300 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81daf5640 1 --2- 172.21.15.50:0/935374300 >> v2:172.21.15.170:3300/0 conn(0x7fa810058990 0x7fa810053500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81e2f6640 1 --2- 172.21.15.50:0/935374300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8100e75c0 0x7fa81004ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f9856d9d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f985816a4e0 0x7f985806d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51688/0 (socket says 172.21.15.50:51688) 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f9856d9d640 1 -- 172.21.15.50:0/2566483868 learned_addr learned my addr 172.21.15.50:0/2566483868 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f985659c640 1 --2- 172.21.15.50:0/2566483868 >> v2:172.21.15.50:3300/0 conn(0x7f985816ea90 0x7f98580cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f2939c75640 1 Processor -- start 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f8d4c35a640 1 Processor -- start 2023-12-08T08:18:22.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f439c525640 1 Processor -- start 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f304844b640 1 -- 172.21.15.50:0/193840346 shutdown_connections 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f304844b640 1 --2- 172.21.15.50:0/193840346 >> v2:172.21.15.50:3300/0 conn(0x7f30401595a0 0x7f304006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f304844b640 1 --2- 172.21.15.50:0/193840346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f304006d530 0x7f304006d910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f304844b640 1 -- 172.21.15.50:0/193840346 >> 172.21.15.50:0/193840346 conn(0x7f30400b09f0 msgr2=0x7f30400b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7f8d4c35a640 1 -- start start 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81e2f6640 1 -- 172.21.15.50:0/935374300 >> v2:172.21.15.170:3300/0 conn(0x7fa810058990 msgr2=0x7fa810053500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81e2f6640 1 --2- 172.21.15.50:0/935374300 >> v2:172.21.15.170:3300/0 conn(0x7fa810058990 0x7fa810053500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81e2f6640 1 -- 172.21.15.50:0/935374300 >> v1:172.21.15.50:6789/0 conn(0x7fa810056a80 legacy=0x7fa810006e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.499+0000 7fa81e2f6640 1 -- 172.21.15.50:0/935374300 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100063d0 con 0x7fa8100e75c0 2023-12-08T08:18:22.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f304844b640 1 -- 172.21.15.50:0/193840346 shutdown_connections 2023-12-08T08:18:22.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f9855d9b640 1 -- 172.21.15.50:0/2566483868 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898406048 0 0) 0x7f98580cc040 con 0x7f985816a4e0 2023-12-08T08:18:22.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f9855d9b640 1 -- 172.21.15.50:0/2566483868 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9840003520 con 0x7f985816a4e0 2023-12-08T08:18:22.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f45eac09640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f45dc04fc20 0x7f45dc050090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f45eac09640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc005e60 con 0x7f45dc006e70 2023-12-08T08:18:22.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f45eac09640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0060b0 con 0x7f45dc0e0e10 2023-12-08T08:18:22.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f45eac09640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc006390 con 0x7f45dc04fc20 2023-12-08T08:18:22.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f45e9c07640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f45dc0e0e10 0x7f45dc0485e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51694/0 (socket says 172.21.15.50:51694) 2023-12-08T08:18:22.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f45e9c07640 1 -- 172.21.15.50:0/940324040 learned_addr learned my addr 172.21.15.50:0/940324040 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f985759e640 1 -- 172.21.15.50:0/2566483868 >> v2:172.21.15.50:3300/0 conn(0x7f985816ea90 msgr2=0x7f98580cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f9855d9b640 1 -- 172.21.15.50:0/2566483868 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2189989208 0 0) 0x7f9840003520 con 0x7f985816a4e0 2023-12-08T08:18:22.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f2939c75640 1 -- start start 2023-12-08T08:18:22.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f985759e640 1 --2- 172.21.15.50:0/2566483868 >> v2:172.21.15.50:3300/0 conn(0x7f985816ea90 0x7f98580cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f985759e640 1 -- 172.21.15.50:0/2566483868 >> v1:172.21.15.170:6789/0 conn(0x7f985816a4e0 legacy=0x7f985806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f985759e640 1 -- 172.21.15.50:0/2566483868 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580b3460 con 0x7f98580cbc10 2023-12-08T08:18:22.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288711214 0 0) 0x7f45dc005e60 con 0x7f45dc006e70 2023-12-08T08:18:22.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d0003520 con 0x7f45dc006e70 2023-12-08T08:18:22.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e9406640 1 --2- 172.21.15.50:0/940324040 >> v2:172.21.15.170:3300/0 conn(0x7f45dc04fc20 0x7f45dc050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f439c525640 1 -- start start 2023-12-08T08:18:22.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2889191667 0 0) 0x7f45d0003520 con 0x7f45dc006e70 2023-12-08T08:18:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 >> v2:172.21.15.170:3300/0 conn(0x7f45dc04fc20 msgr2=0x7f45dc050090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 --2- 172.21.15.50:0/940324040 >> v2:172.21.15.170:3300/0 conn(0x7f45dc04fc20 0x7f45dc050090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 >> v1:172.21.15.170:6789/0 conn(0x7f45dc0e0e10 legacy=0x7f45dc0485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc006670 con 0x7f45dc006e70 2023-12-08T08:18:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f8d4c35a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d3c0df220 0x7f8d3c038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f985659c640 1 --2- 172.21.15.50:0/2566483868 >> v2:172.21.15.50:3300/0 conn(0x7f985816ea90 0x7f98580cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7fbd3a18a640 1 Processor -- start 2023-12-08T08:18:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.500+0000 7f304844b640 1 -- 172.21.15.50:0/193840346 wait complete. 2023-12-08T08:18:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f2939c75640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2934161860 0x7f293406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f2939c75640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293406ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f2939c75640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f293406d3b0 0x7f2934165310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f2939c75640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2934161c40 con 0x7f293406d3b0 2023-12-08T08:18:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f45e4068980 con 0x7f45dc006e70 2023-12-08T08:18:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f2939c75640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293406d840 con 0x7f2934161860 2023-12-08T08:18:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f2939c75640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2934070230 con 0x7f293406c920 2023-12-08T08:18:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f29337fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2934161860 0x7f293406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f29337fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2934161860 0x7f293406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37732/0 (socket says 172.21.15.50:37732) 2023-12-08T08:18:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f29337fe640 1 -- 172.21.15.50:0/328041858 learned_addr learned my addr 172.21.15.50:0/328041858 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f2933fff640 1 --2- 172.21.15.50:0/328041858 >> v2:172.21.15.50:3300/0 conn(0x7f293406d3b0 0x7f2934165310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7fa81e2f6640 1 --2- 172.21.15.50:0/935374300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8100e75c0 0x7fa81004ca00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94e9c6f3ac64c2d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 >> v1:172.21.15.50:6789/0 conn(0x7f45dc006e70 legacy=0x7f45dc039e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439c525640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c0ead00 0x7f438c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439c525640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f438c04ffd0 0x7f438c037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439c525640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c054330 con 0x7f438c038110 2023-12-08T08:18:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439c525640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c053720 con 0x7f438c04ffd0 2023-12-08T08:18:22.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439c525640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c053a00 con 0x7f438c0ead00 2023-12-08T08:18:22.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.501+0000 7f304844b640 1 Processor -- start 2023-12-08T08:18:22.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f8d4c35a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8d3c0501a0 0x7f8d3c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f304844b640 1 -- start start 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f985759e640 1 --2- 172.21.15.50:0/2566483868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98580cbc10 0x7f98580ccbc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f985806df10 tx=0x7f985002e300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bc9e4fa588acb41 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439a2c1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c0ead00 0x7f438c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439a2c1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c0ead00 0x7f438c04fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37386/0 (socket says 172.21.15.50:37386) 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439a2c1640 1 -- 172.21.15.50:0/2628604515 learned_addr learned my addr 172.21.15.50:0/2628604515 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f4399ac0640 1 --2- 172.21.15.50:0/2628604515 >> v2:172.21.15.50:3300/0 conn(0x7f438c04ffd0 0x7f438c037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f8d498f5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8d3c053c70 0x7f8d3c04fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35142/0 (socket says 172.21.15.50:35142) 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f8d4c35a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3c0544c0 con 0x7f8d3c053c70 2023-12-08T08:18:22.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f8d4c35a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c0541e0 con 0x7f8d3c0df220 2023-12-08T08:18:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f8d4c35a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c005f30 con 0x7f8d3c0501a0 2023-12-08T08:18:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f8d4a0f6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d3c0df220 0x7f8d3c038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f8d498f5640 1 -- 172.21.15.50:0/265021920 learned_addr learned my addr 172.21.15.50:0/265021920 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7fbd3a18a640 1 -- start start 2023-12-08T08:18:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f2932ffd640 1 --2- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293406ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f29337fe640 1 -- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 msgr2=0x7f293406ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f29337fe640 1 --2- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293406ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f29337fe640 1 -- 172.21.15.50:0/328041858 >> v2:172.21.15.50:3300/0 conn(0x7f293406d3b0 msgr2=0x7f2934165310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7fa81d2f4640 1 -- 172.21.15.50:0/935374300 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080316f0 con 0x7fa8100e75c0 2023-12-08T08:18:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439a2c1640 1 -- 172.21.15.50:0/2628604515 >> v2:172.21.15.50:3300/0 conn(0x7f438c04ffd0 msgr2=0x7f438c037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439a2c1640 1 --2- 172.21.15.50:0/2628604515 >> v2:172.21.15.50:3300/0 conn(0x7f438c04ffd0 0x7f438c037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439a2c1640 1 -- 172.21.15.50:0/2628604515 >> v1:172.21.15.170:6789/0 conn(0x7f438c038110 legacy=0x7f438c0385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f439a2c1640 1 -- 172.21.15.50:0/2628604515 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c053ce0 con 0x7f438c0ead00 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f45e8c05640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d0003970 0x7f45d0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f45e8c05640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d00042d0 0x7f45d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f45e8c05640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d0004fa0 0x7f45d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc006390 con 0x7f45d0004fa0 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d000bef0 con 0x7f45d0003970 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d000c0b0 con 0x7f45d00042d0 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f9855d9b640 1 -- 172.21.15.50:0/2566483868 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848001690 con 0x7f98580cbc10 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f9855d9b640 1 -- 172.21.15.50:0/2566483868 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985002ee30 con 0x7f98580cbc10 2023-12-08T08:18:22.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f9855d9b640 1 -- 172.21.15.50:0/2566483868 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985000a2f0 con 0x7f98580cbc10 2023-12-08T08:18:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f29337fe640 1 --2- 172.21.15.50:0/328041858 >> v2:172.21.15.50:3300/0 conn(0x7f293406d3b0 0x7f2934165310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f29337fe640 1 -- 172.21.15.50:0/328041858 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340b39b0 con 0x7f2934161860 2023-12-08T08:18:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f8d4a8f7640 1 --2- 172.21.15.50:0/265021920 >> v2:172.21.15.170:3300/0 conn(0x7f8d3c0501a0 0x7f8d3c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fbd3a18a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbd3406abe0 0x7fbd34165a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f8d4a0f6640 1 -- 172.21.15.50:0/265021920 >> v2:172.21.15.170:3300/0 conn(0x7f8d3c0501a0 msgr2=0x7f8d3c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f8d490f4640 1 -- 172.21.15.50:0/265021920 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866543518 0 0) 0x7f8d3c0544c0 con 0x7f8d3c053c70 2023-12-08T08:18:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f8d4a0f6640 1 --2- 172.21.15.50:0/265021920 >> v2:172.21.15.170:3300/0 conn(0x7f8d3c0501a0 0x7f8d3c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f8d4a0f6640 1 -- 172.21.15.50:0/265021920 >> v1:172.21.15.50:6789/0 conn(0x7f8d3c053c70 legacy=0x7f8d3c04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f304844b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304006d530 0x7f304015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f8d4a0f6640 1 -- 172.21.15.50:0/265021920 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c006210 con 0x7f8d3c0df220 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.502+0000 7fa81d2f4640 1 -- 172.21.15.50:0/935374300 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808031850 con 0x7fa8100e75c0 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fa81f2f8640 1 -- 172.21.15.50:0/935374300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8100e75c0 msgr2=0x7fa81004ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fa81f2f8640 1 --2- 172.21.15.50:0/935374300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8100e75c0 0x7fa81004ca00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa80802b790 comp rx=0 tx=0).stop 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fa81f2f8640 1 -- 172.21.15.50:0/935374300 shutdown_connections 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fa81f2f8640 1 --2- 172.21.15.50:0/935374300 >> v2:172.21.15.170:3300/0 conn(0x7fa810058990 0x7fa810053500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fa81f2f8640 1 --2- 172.21.15.50:0/935374300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8100e75c0 0x7fa81004ca00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fa81f2f8640 1 -- 172.21.15.50:0/935374300 >> 172.21.15.50:0/935374300 conn(0x7fa81003a9a0 msgr2=0x7fa81003adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f45ea408640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d0004fa0 0x7f45d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7f45e9c07640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d0003970 0x7f45d0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fbd3a18a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3406f930 con 0x7fbd3414ad90 2023-12-08T08:18:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fbd3a18a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd34162550 con 0x7fbd34161900 2023-12-08T08:18:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fbd3a18a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd34165650 con 0x7fbd3406abe0 2023-12-08T08:18:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fbd39989640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fbd34161900 0x7fbd340b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51708/0 (socket says 172.21.15.50:51708) 2023-12-08T08:18:22.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fbd39989640 1 -- 172.21.15.50:0/364142973 learned_addr learned my addr 172.21.15.50:0/364142973 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.503+0000 7fbd38987640 1 --2- 172.21.15.50:0/364142973 >> v2:172.21.15.170:3300/0 conn(0x7fbd3406abe0 0x7fbd34165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f2933fff640 1 --2- 172.21.15.50:0/328041858 >> v2:172.21.15.50:3300/0 conn(0x7f293406d3b0 0x7f2934165310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 -- 172.21.15.50:0/2566483868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98580cbc10 msgr2=0x7f98580ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 --2- 172.21.15.50:0/2566483868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98580cbc10 0x7f98580ccbc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f985806df10 tx=0x7f985002e300 comp rx=0 tx=0).stop 2023-12-08T08:18:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f45e9406640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d00042d0 0x7f45d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 -- 172.21.15.50:0/2566483868 shutdown_connections 2023-12-08T08:18:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 --2- 172.21.15.50:0/2566483868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98580cbc10 0x7f98580ccbc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 --2- 172.21.15.50:0/2566483868 >> v2:172.21.15.50:3300/0 conn(0x7f985816ea90 0x7f98580cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 -- 172.21.15.50:0/2566483868 >> 172.21.15.50:0/2566483868 conn(0x7f98580b09f0 msgr2=0x7f98580b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7fbd2bfff640 1 -- 172.21.15.50:0/364142973 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781774095 0 0) 0x7fbd34162550 con 0x7fbd34161900 2023-12-08T08:18:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 -- 172.21.15.50:0/2566483868 shutdown_connections 2023-12-08T08:18:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7fbd2bfff640 1 -- 172.21.15.50:0/364142973 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd20003520 con 0x7fbd34161900 2023-12-08T08:18:22.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f985d178640 1 -- 172.21.15.50:0/2566483868 wait complete. 2023-12-08T08:18:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7fbd38987640 1 -- 172.21.15.50:0/364142973 >> v1:172.21.15.170:6789/0 conn(0x7fbd34161900 legacy=0x7fbd340b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7fbd38987640 1 -- 172.21.15.50:0/364142973 >> v1:172.21.15.50:6789/0 conn(0x7fbd3414ad90 legacy=0x7fbd3406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7fbd38987640 1 -- 172.21.15.50:0/364142973 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34162830 con 0x7fbd3406abe0 2023-12-08T08:18:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f29337fe640 1 --2- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2934161860 0x7f293406c2d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f293406bf30 tx=0x7f292c02bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b78457d945387ace server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f30461e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304006d530 0x7f304015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7fa81f2f8640 1 -- 172.21.15.50:0/935374300 shutdown_connections 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7fa81f2f8640 1 -- 172.21.15.50:0/935374300 wait complete. 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f45ea408640 1 -- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d00042d0 msgr2=0x7f45d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f45ea408640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d00042d0 0x7f45d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f45ea408640 1 -- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d0003970 msgr2=0x7f45d0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f45ea408640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45d0003970 0x7f45d0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f45ea408640 1 -- 172.21.15.50:0/940324040 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0003520 con 0x7f45d0004fa0 2023-12-08T08:18:22.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f439a2c1640 1 --2- 172.21.15.50:0/2628604515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c0ead00 0x7f438c04fa90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43940684d0 tx=0x7f43940a5c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d95d79922a3e8b4d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f30461e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304006d530 0x7f304015e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57152/0 (socket says 172.21.15.50:57152) 2023-12-08T08:18:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f29327fc640 1 -- 172.21.15.50:0/328041858 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c02caa0 con 0x7f2934161860 2023-12-08T08:18:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f29327fc640 1 -- 172.21.15.50:0/328041858 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c02cc00 con 0x7f2934161860 2023-12-08T08:18:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f29327fc640 1 -- 172.21.15.50:0/328041858 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0343f0 con 0x7f2934161860 2023-12-08T08:18:22.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f30461e7640 1 -- 172.21.15.50:0/2873593830 learned_addr learned my addr 172.21.15.50:0/2873593830 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.504+0000 7f43992bf640 1 -- 172.21.15.50:0/2628604515 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43940a6ac0 con 0x7f438c0ead00 2023-12-08T08:18:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f304844b640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30400b31a0 0x7f304014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f43992bf640 1 -- 172.21.15.50:0/2628604515 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43940a6c60 con 0x7f438c0ead00 2023-12-08T08:18:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f304844b640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30401595a0 0x7f304015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f304844b640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040099a10 con 0x7f304006d530 2023-12-08T08:18:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f304844b640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304015e920 con 0x7f30400b31a0 2023-12-08T08:18:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f304844b640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304014fa10 con 0x7f30401595a0 2023-12-08T08:18:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f8d4a0f6640 1 --2- 172.21.15.50:0/265021920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 0x7f8d3c038080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c033e80 tx=0x7f8d4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca6ffd4fd32c145 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f43992bf640 1 -- 172.21.15.50:0/2628604515 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43940a6ac0 con 0x7f438c0ead00 2023-12-08T08:18:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f8d490f4640 1 -- 172.21.15.50:0/265021920 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4002e070 con 0x7f8d3c0df220 2023-12-08T08:18:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7fbd38987640 1 --2- 172.21.15.50:0/364142973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406abe0 0x7fbd34165a70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009d90 tx=0x7fbd2c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1949a475feaf91b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f8d490f4640 1 -- 172.21.15.50:0/265021920 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d400315a0 con 0x7f8d3c0df220 2023-12-08T08:18:22.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f45ea408640 1 -- 172.21.15.50:0/940324040 reap_dead start 2023-12-08T08:18:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f30459e6640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30400b31a0 0x7f304014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7fbd2bfff640 1 -- 172.21.15.50:0/364142973 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c02cbd0 con 0x7fbd3406abe0 2023-12-08T08:18:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7fbd2bfff640 1 -- 172.21.15.50:0/364142973 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c02cd30 con 0x7fbd3406abe0 2023-12-08T08:18:22.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7f30469e8640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30401595a0 0x7f304015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.505+0000 7fbd2bfff640 1 -- 172.21.15.50:0/364142973 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c02cea0 con 0x7fbd3406abe0 2023-12-08T08:18:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7fa81f2f8640 1 Processor -- start 2023-12-08T08:18:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f30459e6640 1 -- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30401595a0 msgr2=0x7f304015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f30459e6640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30401595a0 0x7f304015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f30459e6640 1 -- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304006d530 msgr2=0x7f304015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 -- 172.21.15.50:0/2628604515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c0ead00 msgr2=0x7f438c04fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 --2- 172.21.15.50:0/2628604515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c0ead00 0x7f438c04fa90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43940684d0 tx=0x7f43940a5c50 comp rx=0 tx=0).stop 2023-12-08T08:18:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7fa81f2f8640 1 -- start start 2023-12-08T08:18:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 -- 172.21.15.50:0/2628604515 shutdown_connections 2023-12-08T08:18:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 --2- 172.21.15.50:0/2628604515 >> v2:172.21.15.50:3300/0 conn(0x7f438c04ffd0 0x7f438c037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 --2- 172.21.15.50:0/2628604515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c0ead00 0x7f438c04fa90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 -- 172.21.15.50:0/2628604515 >> 172.21.15.50:0/2628604515 conn(0x7f438c009fb0 msgr2=0x7f438c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f8d490f4640 1 -- 172.21.15.50:0/265021920 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4002e070 con 0x7f8d3c0df220 2023-12-08T08:18:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f30459e6640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304006d530 0x7f304015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f30459e6640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c009c90 con 0x7f30400b31a0 2023-12-08T08:18:22.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f985d178640 1 Processor -- start 2023-12-08T08:18:22.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 -- 172.21.15.50:0/2628604515 shutdown_connections 2023-12-08T08:18:22.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f30461e7640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f304006d530 0x7f304015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:22.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f985d178640 1 -- start start 2023-12-08T08:18:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f30459e6640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30400b31a0 0x7f304014f4d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f303800c7b0 tx=0x7f303800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800aa50 con 0x7f30400b31a0 2023-12-08T08:18:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f304844b640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304014eb00 con 0x7f30400b31a0 2023-12-08T08:18:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f304844b640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304014f0c0 con 0x7f30400b31a0 2023-12-08T08:18:22.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f439c525640 1 -- 172.21.15.50:0/2628604515 wait complete. 2023-12-08T08:18:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f45ea408640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d0004fa0 0x7f45d000b980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45e4068ee0 tx=0x7f45d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d09f6177dfc279 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f8d4c35a640 1 -- 172.21.15.50:0/265021920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 msgr2=0x7f8d3c038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f8d4c35a640 1 --2- 172.21.15.50:0/265021920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 0x7f8d3c038080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c033e80 tx=0x7f8d4002b840 comp rx=0 tx=0).stop 2023-12-08T08:18:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f8d4c35a640 1 -- 172.21.15.50:0/265021920 shutdown_connections 2023-12-08T08:18:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f8d4c35a640 1 --2- 172.21.15.50:0/265021920 >> v2:172.21.15.170:3300/0 conn(0x7f8d3c0501a0 0x7f8d3c006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f8d4c35a640 1 --2- 172.21.15.50:0/265021920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 0x7f8d3c038080 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f8d4c35a640 1 -- 172.21.15.50:0/265021920 >> 172.21.15.50:0/265021920 conn(0x7f8d3c009fb0 msgr2=0x7f8d3c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7fbd3a18a640 1 -- 172.21.15.50:0/364142973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406abe0 msgr2=0x7fbd34165a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7fbd3a18a640 1 --2- 172.21.15.50:0/364142973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406abe0 0x7fbd34165a70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009d90 tx=0x7fbd2c02be20 comp rx=0 tx=0).stop 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fbd3a18a640 1 -- 172.21.15.50:0/364142973 shutdown_connections 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fbd3a18a640 1 --2- 172.21.15.50:0/364142973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406abe0 0x7fbd34165a70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fbd3a18a640 1 -- 172.21.15.50:0/364142973 >> 172.21.15.50:0/364142973 conn(0x7fbd340b1860 msgr2=0x7fbd340b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fbd3a18a640 1 -- 172.21.15.50:0/364142973 shutdown_connections 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f2939c75640 1 -- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2934161860 msgr2=0x7f293406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.506+0000 7f2939c75640 1 --2- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2934161860 0x7f293406c2d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f293406bf30 tx=0x7f292c02bf00 comp rx=0 tx=0).stop 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f2939c75640 1 -- 172.21.15.50:0/328041858 shutdown_connections 2023-12-08T08:18:22.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f2939c75640 1 --2- 172.21.15.50:0/328041858 >> v2:172.21.15.50:3300/0 conn(0x7f293406d3b0 0x7f2934165310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f2939c75640 1 --2- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293406ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f2939c75640 1 --2- 172.21.15.50:0/328041858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2934161860 0x7f293406c2d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f2939c75640 1 -- 172.21.15.50:0/328041858 >> 172.21.15.50:0/328041858 conn(0x7f29340b09f0 msgr2=0x7f29340b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f2939c75640 1 -- 172.21.15.50:0/328041858 shutdown_connections 2023-12-08T08:18:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800abf0 con 0x7f30400b31a0 2023-12-08T08:18:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800ce60 con 0x7f30400b31a0 2023-12-08T08:18:22.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fa81f2f8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa810056a80 0x7fa81000d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fbd3a18a640 1 -- 172.21.15.50:0/364142973 wait complete. 2023-12-08T08:18:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fa81f2f8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa810058990 0x7fa810174080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985d178640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98580cbc10 0x7f98581677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fa81f2f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8100e75c0 0x7fa8100e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985d178640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985816a4e0 0x7f985816e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985d178640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f985816ea90 0x7f98580ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985d178640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985809c9e0 con 0x7f985816a4e0 2023-12-08T08:18:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985d178640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985809b940 con 0x7f985816ea90 2023-12-08T08:18:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985d178640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985809bc20 con 0x7f98580cbc10 2023-12-08T08:18:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fa81f2f8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81000a550 con 0x7fa810058990 2023-12-08T08:18:22.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fa81f2f8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101732c0 con 0x7fa8100e75c0 2023-12-08T08:18:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fa81f2f8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101735a0 con 0x7fa810056a80 2023-12-08T08:18:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985816a4e0 0x7f985816e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f9856d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98580cbc10 0x7f98581677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985816a4e0 0x7f985816e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57156/0 (socket says 172.21.15.50:57156) 2023-12-08T08:18:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7f985659c640 1 -- 172.21.15.50:0/1024960623 learned_addr learned my addr 172.21.15.50:0/1024960623 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f985759e640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f985816ea90 0x7f98580ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40ab870 con 0x7f45d0004fa0 2023-12-08T08:18:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.507+0000 7fa81eaf7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8100e75c0 0x7fa8100e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40aba10 con 0x7f45d0004fa0 2023-12-08T08:18:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f45e8c05640 1 -- 172.21.15.50:0/940324040 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40abe00 con 0x7f45d0004fa0 2023-12-08T08:18:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7fa81eaf7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8100e75c0 0x7fa8100e41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37778/0 (socket says 172.21.15.50:37778) 2023-12-08T08:18:22.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7fa81eaf7640 1 -- 172.21.15.50:0/1485644490 learned_addr learned my addr 172.21.15.50:0/1485644490 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f439c525640 1 Processor -- start 2023-12-08T08:18:22.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f439c525640 1 -- start start 2023-12-08T08:18:22.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f304844b640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3028000fc0 con 0x7f30400b31a0 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f985659c640 1 -- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98580cbc10 msgr2=0x7f98581677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f985659c640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98580cbc10 0x7f98581677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f985659c640 1 -- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f985816ea90 msgr2=0x7f98580ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f985659c640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f985816ea90 0x7f98580ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f985659c640 1 -- 172.21.15.50:0/1024960623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c009400 con 0x7f985816a4e0 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7fa81eaf7640 1 -- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa810056a80 msgr2=0x7fa81000d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7fa81eaf7640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa810056a80 0x7fa81000d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7fa81eaf7640 1 -- 172.21.15.50:0/1485644490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa810058990 msgr2=0x7fa810174080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7fa81eaf7640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa810058990 0x7fa810174080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7fa81eaf7640 1 -- 172.21.15.50:0/1485644490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808009400 con 0x7fa8100e75c0 2023-12-08T08:18:22.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f8d4c35a640 1 -- 172.21.15.50:0/265021920 shutdown_connections 2023-12-08T08:18:22.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fa81eaf7640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8100e75c0 0x7fa8100e41d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c390 tx=0x7fa81400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f8d4c35a640 1 -- 172.21.15.50:0/265021920 wait complete. 2023-12-08T08:18:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f45eac09640 1 -- 172.21.15.50:0/940324040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d0004fa0 msgr2=0x7f45d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f45eac09640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d0004fa0 0x7f45d000b980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45e4068ee0 tx=0x7f45d00057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f985659c640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985816a4e0 0x7f985816e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f984c00e960 tx=0x7f984c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3038012420 con 0x7f30400b31a0 2023-12-08T08:18:22.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00ca00 con 0x7f985816a4e0 2023-12-08T08:18:22.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fa80effd640 1 -- 172.21.15.50:0/1485644490 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814005ce0 con 0x7fa8100e75c0 2023-12-08T08:18:22.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fa80effd640 1 -- 172.21.15.50:0/1485644490 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814005e40 con 0x7fa8100e75c0 2023-12-08T08:18:22.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fa80effd640 1 -- 172.21.15.50:0/1485644490 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140072d0 con 0x7fa8100e75c0 2023-12-08T08:18:22.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c00cb60 con 0x7f985816a4e0 2023-12-08T08:18:22.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa810173880 con 0x7fa8100e75c0 2023-12-08T08:18:22.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa810009de0 con 0x7fa8100e75c0 2023-12-08T08:18:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c013470 con 0x7f985816a4e0 2023-12-08T08:18:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985000c050 con 0x7f985816a4e0 2023-12-08T08:18:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985809c1e0 con 0x7f985816a4e0 2023-12-08T08:18:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f3036ffd640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f302406af10 0x7f302406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30380899c0 con 0x7f30400b31a0 2023-12-08T08:18:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f3036ffd640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7f3024074550 0x7f3024076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f30461e7640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f302406af10 0x7f302406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f30469e8640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7f3024074550 0x7f3024076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3024077060 con 0x7f3024074550 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303808e2a0 con 0x7f30400b31a0 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f30461e7640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f302406af10 0x7f302406d3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f303c02cbd0 tx=0x7f303c031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f439c525640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c038110 0x7f438c0df070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7f439c525640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f438c04ffd0 0x7f438c04cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f439c525640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0ead00 0x7f438c0473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f439c525640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0e85f0 con 0x7f438c0ead00 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f439c525640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c04bb90 con 0x7f438c04ffd0 2023-12-08T08:18:22.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f439c525640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c04be70 con 0x7f438c038110 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f45eac09640 1 -- 172.21.15.50:0/940324040 shutdown_connections 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f45eac09640 1 --2- 172.21.15.50:0/940324040 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45d0004fa0 0x7f45d000b980 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f45eac09640 1 -- 172.21.15.50:0/940324040 >> 172.21.15.50:0/940324040 conn(0x7f45dc009f80 msgr2=0x7f45dc00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f45eac09640 1 -- 172.21.15.50:0/940324040 shutdown_connections 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fbd3a18a640 1 Processor -- start 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.509+0000 7fbd3a18a640 1 -- start start 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd3a18a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3406abe0 0x7fbd3413fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd3a18a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3414ad90 0x7fbd3415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd3a18a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd34161900 0x7fbd3415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd3a18a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34140140 con 0x7fbd3406abe0 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd3a18a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34140420 con 0x7fbd3414ad90 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd3a18a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd34140700 con 0x7fbd34161900 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd39989640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd34161900 0x7fbd3415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd39989640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd34161900 0x7fbd3415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37426/0 (socket says 172.21.15.50:37426) 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd39989640 1 -- 172.21.15.50:0/1370683807 learned_addr learned my addr 172.21.15.50:0/1370683807 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7fbd38987640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3414ad90 0x7fbd3415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7fbd39989640 1 -- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3414ad90 msgr2=0x7fbd3415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7fbd39989640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3414ad90 0x7fbd3415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7fbd39989640 1 -- 172.21.15.50:0/1370683807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3406abe0 msgr2=0x7fbd3413fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7fbd39989640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd3406abe0 0x7fbd3413fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7fbd39989640 1 -- 172.21.15.50:0/1370683807 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c009a70 con 0x7fbd34161900 2023-12-08T08:18:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.508+0000 7f2939c75640 1 -- 172.21.15.50:0/328041858 wait complete. 2023-12-08T08:18:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f2939c75640 1 Processor -- start 2023-12-08T08:18:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f45eac09640 1 -- 172.21.15.50:0/940324040 wait complete. 2023-12-08T08:18:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f8d4c35a640 1 Processor -- start 2023-12-08T08:18:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f2939c75640 1 -- start start 2023-12-08T08:18:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f4399ac0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f438c04ffd0 0x7f438c04cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f4399ac0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f438c04ffd0 0x7f438c04cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37796/0 (socket says 172.21.15.50:37796) 2023-12-08T08:18:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f4399ac0640 1 -- 172.21.15.50:0/313133656 learned_addr learned my addr 172.21.15.50:0/313133656 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f8d4c35a640 1 -- start start 2023-12-08T08:18:22.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.510+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98580b2e30 con 0x7f985816a4e0 2023-12-08T08:18:22.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7f439aac2640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0ead00 0x7f438c0473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.511+0000 7fbd39989640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd34161900 0x7fbd3415bc60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c390 tx=0x7fbd2400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24005ce0 con 0x7fbd34161900 2023-12-08T08:18:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24005e40 con 0x7fbd34161900 2023-12-08T08:18:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f439aac2640 1 -- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c038110 msgr2=0x7f438c0df070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T08:18:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f439aac2640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f438c038110 0x7f438c0df070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f439aac2640 1 -- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f438c04ffd0 msgr2=0x7f438c04cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f439aac2640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f438c04ffd0 0x7f438c04cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f439aac2640 1 -- 172.21.15.50:0/313133656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394068760 con 0x7f438c0ead00 2023-12-08T08:18:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f45eac09640 1 Processor -- start 2023-12-08T08:18:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f45eac09640 1 -- start start 2023-12-08T08:18:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7f2939c75640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7fa80effd640 1 -- 172.21.15.50:0/1485644490 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa814007430 con 0x7fa8100e75c0 2023-12-08T08:18:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7fa80effd640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa7fc06af10 0x7fa7fc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.512+0000 7fa80effd640 1 -- 172.21.15.50:0/1485644490 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa814088c10 con 0x7fa8100e75c0 2023-12-08T08:18:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4c35a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d3c0501a0 0x7f8d3c034e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f2939c75640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293406d3b0 0x7f2934161d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f439aac2640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0ead00 0x7f438c0473a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f439000c3c0 tx=0x7f439000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4c35a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d3c053c70 0x7f8d3c0d6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7fa81f2f8640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7fa8000015e0 0x7fa800003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 --> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa800006b40 con 0x7fa8000015e0 2023-12-08T08:18:22.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f29337fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f29337fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293415c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37448/0 (socket says 172.21.15.50:37448) 2023-12-08T08:18:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4c35a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 0x7f8d3c047360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f2932ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293406d3b0 0x7f2934161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f2932ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293406d3b0 0x7f2934161d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37818/0 (socket says 172.21.15.50:37818) 2023-12-08T08:18:22.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f2939c75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2934161860 0x7f29340ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900052d0 con 0x7f438c0ead00 2023-12-08T08:18:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd240072f0 con 0x7fbd34161900 2023-12-08T08:18:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd341409e0 con 0x7fbd34161900 2023-12-08T08:18:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd34148440 con 0x7fbd34161900 2023-12-08T08:18:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4c35a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0d3510 con 0x7f8d3c0df220 2023-12-08T08:18:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d498f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d3c053c70 0x7f8d3c0d6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7fa81e2f6640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa7fc06af10 0x7fa7fc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4a0f6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d3c0501a0 0x7f8d3c034e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4c35a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0d37f0 con 0x7f8d3c053c70 2023-12-08T08:18:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4c35a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0d3ad0 con 0x7f8d3c0501a0 2023-12-08T08:18:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4a0f6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d3c0501a0 0x7f8d3c034e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37454/0 (socket says 172.21.15.50:37454) 2023-12-08T08:18:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4a0f6640 1 -- 172.21.15.50:0/3161782505 learned_addr learned my addr 172.21.15.50:0/3161782505 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c04c150 con 0x7f438c0ead00 2023-12-08T08:18:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c04c710 con 0x7f438c0ead00 2023-12-08T08:18:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f8d4a8f7640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 0x7f8d3c047360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f2939c75640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340cd730 con 0x7f2934161860 2023-12-08T08:18:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f2939c75640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340cd960 con 0x7f293406d3b0 2023-12-08T08:18:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f2939c75640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340cdc40 con 0x7f293406c920 2023-12-08T08:18:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f29337fe640 1 -- 172.21.15.50:0/491930153 learned_addr learned my addr 172.21.15.50:0/491930153 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f984c0135d0 con 0x7f985816a4e0 2023-12-08T08:18:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.513+0000 7f983f7fe640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f984406af10 0x7f984406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f984c089ab0 con 0x7f985816a4e0 2023-12-08T08:18:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f983f7fe640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f98440744d0 0x7f9844076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 --> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9844076fe0 con 0x7f98440744d0 2023-12-08T08:18:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f8d4a8f7640 1 -- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d3c0501a0 msgr2=0x7f8d3c034e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f984c054900 con 0x7f985816a4e0 2023-12-08T08:18:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f8d4a8f7640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d3c0501a0 0x7f8d3c034e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f8d4a8f7640 1 -- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d3c053c70 msgr2=0x7f8d3c0d6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f8d4a8f7640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d3c053c70 0x7f8d3c0d6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f45eac09640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d0004fa0 0x7f45dc0c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f8d4a8f7640 1 -- 172.21.15.50:0/3161782505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009400 con 0x7f8d3c0df220 2023-12-08T08:18:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f45eac09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0e33e0 0x7f45dc0d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f2933fff640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2934161860 0x7f29340ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7fa81daf5640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7fa8000015e0 0x7fa800003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f30469e8640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7f3024074550 0x7f3024076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f9856d9d640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f984406af10 0x7f984406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f45eac09640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45dc0d76e0 0x7f45dc0e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f8d4a8f7640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 0x7f8d3c047360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400d460 tx=0x7f8d3400d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f2933fff640 1 -- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 msgr2=0x7f293415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f2933fff640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f2933fff640 1 -- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293406d3b0 msgr2=0x7f2934161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f2933fff640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f293406d3b0 0x7f2934161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f2933fff640 1 -- 172.21.15.50:0/491930153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c009b30 con 0x7f2934161860 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f29337fe640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f293406c920 0x7f293415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f45e9406640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0e33e0 0x7f45dc0d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.514+0000 7f45eac09640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0d7b60 con 0x7f45dc0e33e0 2023-12-08T08:18:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9406640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0e33e0 0x7f45dc0d71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57216/0 (socket says 172.21.15.50:57216) 2023-12-08T08:18:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9406640 1 -- 172.21.15.50:0/3652278420 learned_addr learned my addr 172.21.15.50:0/3652278420 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0e2340 con 0x7f45dc0d76e0 2023-12-08T08:18:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0e2620 con 0x7f45d0004fa0 2023-12-08T08:18:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45ea408640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45dc0d76e0 0x7f45dc0e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd34140590 con 0x7fbd34161900 2023-12-08T08:18:22.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9c07640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d0004fa0 0x7f45dc0c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34018070 con 0x7f8d3c0df220 2023-12-08T08:18:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f985759e640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f98440744d0 0x7f9844076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f9856d9d640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f984406af10 0x7f984406d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98480017c0 tx=0x7f9848001630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f438c000e90 con 0x7f438c0ead00 2023-12-08T08:18:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390005430 con 0x7f438c0ead00 2023-12-08T08:18:22.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f2933fff640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2934161860 0x7f29340ceaa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f292800e560 tx=0x7f292800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7fa81daf5640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7fa8000015e0 0x7fa800003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9406640 1 -- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d0004fa0 msgr2=0x7f45dc0c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9406640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45d0004fa0 0x7f45dc0c0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9406640 1 -- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45dc0d76e0 msgr2=0x7f45dc0e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9406640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45dc0d76e0 0x7f45dc0e15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f45e9406640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0e2900 con 0x7f45dc0e33e0 2023-12-08T08:18:22.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900052d0 con 0x7f438c0ead00 2023-12-08T08:18:22.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== osd.1 v2:172.21.15.50:6808/1632731687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3024077060 con 0x7f3024074550 2023-12-08T08:18:22.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.515+0000 7fa81e2f6640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa7fc06af10 0x7fa7fc06d3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa808008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43900067d0 con 0x7f438c0ead00 2023-12-08T08:18:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928004230 con 0x7f2934161860 2023-12-08T08:18:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2928004390 con 0x7f2934161860 2023-12-08T08:18:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928003830 con 0x7f2934161860 2023-12-08T08:18:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29340cdf20 con 0x7f2934161860 2023-12-08T08:18:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29340ce4e0 con 0x7f2934161860 2023-12-08T08:18:22.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f45e9406640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0e33e0 0x7f45dc0d71a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45d4011560 tx=0x7f45d4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c0d3db0 con 0x7f8d3c0df220 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f438affd640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f437806aea0 0x7f437806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43900571d0 con 0x7f438c0ead00 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f439a2c1640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f437806aea0 0x7f437806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f438affd640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f43780750b0 0x7f4378077550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 --> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4378077c20 con 0x7f43780750b0 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c0353b0 con 0x7f8d3c0df220 2023-12-08T08:18:22.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34004020 con 0x7f8d3c0df220 2023-12-08T08:18:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4390000f90 con 0x7f438c0ead00 2023-12-08T08:18:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f45ea408640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45dc0d76e0 0x7f45dc0e15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:22.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4015930 con 0x7f45dc0e33e0 2023-12-08T08:18:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d4015a90 con 0x7f45dc0e33e0 2023-12-08T08:18:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4015e00 con 0x7f45dc0e33e0 2023-12-08T08:18:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc0e2be0 con 0x7f45dc0e33e0 2023-12-08T08:18:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.516+0000 7f985759e640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f98440744d0 0x7f9844076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc0e1b10 con 0x7f45dc0e33e0 2023-12-08T08:18:22.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340041d0 con 0x7f8d3c0df220 2023-12-08T08:18:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7f439a2c1640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f437806aea0 0x7f437806d360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f438c053b40 tx=0x7f43940aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd24007450 con 0x7fbd34161900 2023-12-08T08:18:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.517+0000 7fbd29ffb640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1806af10 0x7fbd1806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd240896c0 con 0x7fbd34161900 2023-12-08T08:18:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7fbd39188640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1806af10 0x7fbd1806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7fbd29ffb640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7fbd180743e0 0x7fbd18076820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7fa80effd640 1 -- 172.21.15.50:0/1485644490 <== osd.0 v2:172.21.15.50:6824/1917445946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa800006b40 con 0x7fa8000015e0 2023-12-08T08:18:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 --> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd18076ef0 con 0x7fbd180743e0 2023-12-08T08:18:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd24089a70 con 0x7fbd34161900 2023-12-08T08:18:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45cc000fc0 con 0x7f45dc0e33e0 2023-12-08T08:18:22.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7fbd38987640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7fbd180743e0 0x7fbd18076820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== osd.2 v2:172.21.15.50:6800/2829123200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9844076fe0 con 0x7f98440744d0 2023-12-08T08:18:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.519+0000 7fbd38987640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7fbd180743e0 0x7fbd18076820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.519+0000 7fbd39188640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1806af10 0x7fbd1806d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd30001560 tx=0x7fbd30007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.519+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2934164f50 con 0x7f2934161860 2023-12-08T08:18:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.520+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== osd.6 v2:172.21.15.170:6800/116888421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbd18076ef0 con 0x7fbd180743e0 2023-12-08T08:18:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.520+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2928003990 con 0x7f2934161860 2023-12-08T08:18:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f291bfff640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f292006af10 0x7f292006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.519+0000 7f4399ac0640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f43780750b0 0x7f4378077550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.520+0000 7f4399ac0640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f43780750b0 0x7f4378077550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2928089310 con 0x7f2934161860 2023-12-08T08:18:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.518+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d2c000fc0 con 0x7f8d3c0df220 2023-12-08T08:18:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.520+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d34004330 con 0x7f8d3c0df220 2023-12-08T08:18:22.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f8d3affd640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d2806af10 0x7f8d2806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f291bfff640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7f2920074550 0x7f2920076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d340894c0 con 0x7f8d3c0df220 2023-12-08T08:18:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 --> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2920077060 con 0x7f2920074550 2023-12-08T08:18:22.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f292808b930 con 0x7f2934161860 2023-12-08T08:18:22.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== osd.3 v2:172.21.15.50:6809/3350672246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4378077c20 con 0x7f43780750b0 2023-12-08T08:18:22.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45d401d400 con 0x7f45dc0e33e0 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f8d3affd640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f8d28074360 0x7f8d280767a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f8d4a0f6640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d2806af10 0x7f8d2806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.521+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 --> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d28076e70 con 0x7f8d28074360 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f8d498f5640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f8d28074360 0x7f8d280767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d34054310 con 0x7f8d3c0df220 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f2932ffd640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7f2920074550 0x7f2920076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f29337fe640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f292006af10 0x7f292006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f45da7fc640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f45c806af10 0x7f45c806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f8d4a0f6640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d2806af10 0x7f8d2806d3d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000c00 tx=0x7f8d40008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45d408a350 con 0x7f45dc0e33e0 2023-12-08T08:18:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f45da7fc640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f45c8074550 0x7f45c8076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f8d498f5640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f8d28074360 0x7f8d280767a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45c8077060 con 0x7f45c8074550 2023-12-08T08:18:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.522+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45d408a700 con 0x7f45dc0e33e0 2023-12-08T08:18:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.523+0000 7f2932ffd640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7f2920074550 0x7f2920076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.523+0000 7f29337fe640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f292006af10 0x7f292006d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f292c000f80 tx=0x7f292c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.523+0000 7f45e9c07640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f45c806af10 0x7f45c806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.523+0000 7f45ea408640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f45c8074550 0x7f45c8076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.523+0000 7f45ea408640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f45c8074550 0x7f45c8076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.523+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== osd.5 v2:172.21.15.170:6816/1598851740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8d28076e70 con 0x7f8d28074360 2023-12-08T08:18:22.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.524+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== osd.7 v2:172.21.15.170:6808/2618727353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2920077060 con 0x7f2920074550 2023-12-08T08:18:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.524+0000 7f45e9c07640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f45c806af10 0x7f45c806d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45e0000c00 tx=0x7f45e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.524+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== osd.4 v2:172.21.15.170:6824/3545378016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f45c8077060 con 0x7f45c8074550 2023-12-08T08:18:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.545+0000 7f304844b640 1 -- 172.21.15.50:0/2873593830 --> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3028002cb0 con 0x7f3024074550 2023-12-08T08:18:22.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.546+0000 7f3036ffd640 1 -- 172.21.15.50:0/2873593830 <== osd.1 v2:172.21.15.50:6808/1632731687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3028002cb0 con 0x7f3024074550 2023-12-08T08:18:22.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.547+0000 7f3034ff9640 1 -- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7f3024074550 msgr2=0x7f3024076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.547+0000 7f3034ff9640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7f3024074550 0x7f3024076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.547+0000 7f3034ff9640 1 -- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f302406af10 msgr2=0x7f302406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.547+0000 7f3034ff9640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f302406af10 0x7f302406d3d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f303c02cbd0 tx=0x7f303c031000 comp rx=0 tx=0).stop 2023-12-08T08:18:22.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.547+0000 7f3034ff9640 1 -- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30400b31a0 msgr2=0x7f304014f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.547+0000 7f3034ff9640 1 --2- 172.21.15.50:0/2873593830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30400b31a0 0x7f304014f4d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f303800c7b0 tx=0x7f303800cc70 comp rx=0 tx=0).stop 2023-12-08T08:18:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.547+0000 7f30469e8640 1 -- 172.21.15.50:0/2873593830 reap_dead start 2023-12-08T08:18:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.551+0000 7f3034ff9640 1 -- 172.21.15.50:0/2873593830 shutdown_connections 2023-12-08T08:18:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.551+0000 7f3034ff9640 1 -- 172.21.15.50:0/2873593830 >> 172.21.15.50:0/2873593830 conn(0x7f30400b09f0 msgr2=0x7f30400adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.551+0000 7f3034ff9640 1 -- 172.21.15.50:0/2873593830 shutdown_connections 2023-12-08T08:18:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.551+0000 7f3034ff9640 1 -- 172.21.15.50:0/2873593830 wait complete. 2023-12-08T08:18:22.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.552+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 --> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f45cc002ce0 con 0x7f45c8074550 2023-12-08T08:18:22.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.551+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 --> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa800005bc0 con 0x7fa8000015e0 2023-12-08T08:18:22.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.552+0000 7fa80effd640 1 -- 172.21.15.50:0/1485644490 <== osd.0 v2:172.21.15.50:6824/1917445946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa800005bc0 con 0x7fa8000015e0 2023-12-08T08:18:22.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.552+0000 7f45da7fc640 1 -- 172.21.15.50:0/3652278420 <== osd.4 v2:172.21.15.170:6824/3545378016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f45cc002ce0 con 0x7f45c8074550 2023-12-08T08:18:22.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.552+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 --> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd34140590 con 0x7fbd180743e0 2023-12-08T08:18:22.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f45c8074550 msgr2=0x7f45c8076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f45eac09640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f45c8074550 0x7f45c8076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7fbd29ffb640 1 -- 172.21.15.50:0/1370683807 <== osd.6 v2:172.21.15.170:6800/116888421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd34140590 con 0x7fbd180743e0 2023-12-08T08:18:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 --> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98580b3a20 con 0x7f98440744d0 2023-12-08T08:18:22.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f45c806af10 msgr2=0x7f45c806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f45eac09640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f45c806af10 0x7f45c806d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45e0000c00 tx=0x7f45e0009040 comp rx=0 tx=0).stop 2023-12-08T08:18:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7fa8000015e0 msgr2=0x7fa800003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7fa81f2f8640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7fa8000015e0 0x7fa800003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0e33e0 msgr2=0x7f45dc0d71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f45eac09640 1 --2- 172.21.15.50:0/3652278420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45dc0e33e0 0x7f45dc0d71a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45d4011560 tx=0x7f45d4009f90 comp rx=0 tx=0).stop 2023-12-08T08:18:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7f45ea408640 1 -- 172.21.15.50:0/3652278420 reap_dead start 2023-12-08T08:18:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa7fc06af10 msgr2=0x7fa7fc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81f2f8640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa7fc06af10 0x7fa7fc06d3d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa8080097a0 tx=0x7fa808008030 comp rx=0 tx=0).stop 2023-12-08T08:18:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8100e75c0 msgr2=0x7fa8100e41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81f2f8640 1 --2- 172.21.15.50:0/1485644490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8100e75c0 0x7fa8100e41d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c390 tx=0x7fa81400c850 comp rx=0 tx=0).stop 2023-12-08T08:18:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.553+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7fbd180743e0 msgr2=0x7fbd18076820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd3a18a640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7fbd180743e0 0x7fbd18076820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 shutdown_connections 2023-12-08T08:18:22.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 >> 172.21.15.50:0/3652278420 conn(0x7f45dc009f80 msgr2=0x7f45dc0dffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7f983f7fe640 1 -- 172.21.15.50:0/1024960623 <== osd.2 v2:172.21.15.50:6800/2829123200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f985000a210 con 0x7f98440744d0 2023-12-08T08:18:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 shutdown_connections 2023-12-08T08:18:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7f45eac09640 1 -- 172.21.15.50:0/3652278420 wait complete. 2023-12-08T08:18:22.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81eaf7640 1 -- 172.21.15.50:0/1485644490 reap_dead start 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 shutdown_connections 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 >> 172.21.15.50:0/1485644490 conn(0x7fa81003a9a0 msgr2=0x7fa810038bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 shutdown_connections 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fa81f2f8640 1 -- 172.21.15.50:0/1485644490 wait complete. 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1806af10 msgr2=0x7fbd1806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd3a18a640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1806af10 0x7fbd1806d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd30001560 tx=0x7fbd30007990 comp rx=0 tx=0).stop 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd34161900 msgr2=0x7fbd3415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd3a18a640 1 --2- 172.21.15.50:0/1370683807 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd34161900 0x7fbd3415bc60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400c390 tx=0x7fbd2400c850 comp rx=0 tx=0).stop 2023-12-08T08:18:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd39989640 1 -- 172.21.15.50:0/1370683807 reap_dead start 2023-12-08T08:18:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f98440744d0 msgr2=0x7f9844076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985d178640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f98440744d0 0x7f9844076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 shutdown_connections 2023-12-08T08:18:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 >> 172.21.15.50:0/1370683807 conn(0x7fbd340b1860 msgr2=0x7fbd340b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f984406af10 msgr2=0x7f984406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 shutdown_connections 2023-12-08T08:18:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7fbd3a18a640 1 -- 172.21.15.50:0/1370683807 wait complete. 2023-12-08T08:18:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985d178640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f984406af10 0x7f984406d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98480017c0 tx=0x7f9848001630 comp rx=0 tx=0).stop 2023-12-08T08:18:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.554+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 --> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f438c0530c0 con 0x7f43780750b0 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985816a4e0 msgr2=0x7f985816e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985d178640 1 --2- 172.21.15.50:0/1024960623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985816a4e0 0x7f985816e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f984c00e960 tx=0x7f984c00ee20 comp rx=0 tx=0).stop 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985759e640 1 -- 172.21.15.50:0/1024960623 reap_dead start 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 shutdown_connections 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.555+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 >> 172.21.15.50:0/1024960623 conn(0x7f98580b09f0 msgr2=0x7f98580cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.556+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 shutdown_connections 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.556+0000 7f985d178640 1 -- 172.21.15.50:0/1024960623 wait complete. 2023-12-08T08:18:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.556+0000 7f438affd640 1 -- 172.21.15.50:0/313133656 <== osd.3 v2:172.21.15.50:6809/3350672246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f438c0530c0 con 0x7f43780750b0 2023-12-08T08:18:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.556+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f43780750b0 msgr2=0x7f4378077550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.556+0000 7f439c525640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f43780750b0 0x7f4378077550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.556+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 --> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29340b3f70 con 0x7f2920074550 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f437806aea0 msgr2=0x7f437806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f437806aea0 0x7f437806d360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f438c053b40 tx=0x7f43940aa000 comp rx=0 tx=0).stop 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0ead00 msgr2=0x7f438c0473a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 --2- 172.21.15.50:0/313133656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f438c0ead00 0x7f438c0473a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f439000c3c0 tx=0x7f439000c880 comp rx=0 tx=0).stop 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439aac2640 1 -- 172.21.15.50:0/313133656 reap_dead start 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 shutdown_connections 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 >> 172.21.15.50:0/313133656 conn(0x7f438c009fb0 msgr2=0x7f438c048590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f291bfff640 1 -- 172.21.15.50:0/491930153 <== osd.7 v2:172.21.15.170:6808/2618727353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2924004240 con 0x7f2920074550 2023-12-08T08:18:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 shutdown_connections 2023-12-08T08:18:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 --> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d2c002cb0 con 0x7f8d28074360 2023-12-08T08:18:22.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.557+0000 7f439c525640 1 -- 172.21.15.50:0/313133656 wait complete. 2023-12-08T08:18:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.558+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7f2920074550 msgr2=0x7f2920076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.558+0000 7f2939c75640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7f2920074550 0x7f2920076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.558+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f292006af10 msgr2=0x7f292006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.558+0000 7f2939c75640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f292006af10 0x7f292006d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f292c000f80 tx=0x7f292c030000 comp rx=0 tx=0).stop 2023-12-08T08:18:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.558+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2934161860 msgr2=0x7f29340ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.558+0000 7f2939c75640 1 --2- 172.21.15.50:0/491930153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2934161860 0x7f29340ceaa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f292800e560 tx=0x7f292800ea20 comp rx=0 tx=0).stop 2023-12-08T08:18:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.559+0000 7f2933fff640 1 -- 172.21.15.50:0/491930153 reap_dead start 2023-12-08T08:18:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.559+0000 7f8d3affd640 1 -- 172.21.15.50:0/3161782505 <== osd.5 v2:172.21.15.170:6816/1598851740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d2c002cb0 con 0x7f8d28074360 2023-12-08T08:18:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.559+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 shutdown_connections 2023-12-08T08:18:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.559+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 >> 172.21.15.50:0/491930153 conn(0x7f29340b09f0 msgr2=0x7f293406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.559+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 shutdown_connections 2023-12-08T08:18:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.559+0000 7f2939c75640 1 -- 172.21.15.50:0/491930153 wait complete. 2023-12-08T08:18:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.559+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f8d28074360 msgr2=0x7f8d280767a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.560+0000 7f8d4c35a640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f8d28074360 0x7f8d280767a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.560+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d2806af10 msgr2=0x7f8d2806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.560+0000 7f8d4c35a640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d2806af10 0x7f8d2806d3d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000c00 tx=0x7f8d40008030 comp rx=0 tx=0).stop 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.560+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 msgr2=0x7f8d3c047360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.560+0000 7f8d4c35a640 1 --2- 172.21.15.50:0/3161782505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d3c0df220 0x7f8d3c047360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400d460 tx=0x7f8d3400d920 comp rx=0 tx=0).stop 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.561+0000 7f8d4a8f7640 1 -- 172.21.15.50:0/3161782505 reap_dead start 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.561+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 shutdown_connections 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.561+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 >> 172.21.15.50:0/3161782505 conn(0x7f8d3c009fb0 msgr2=0x7f8d3c0d8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.561+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 shutdown_connections 2023-12-08T08:18:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.561+0000 7f8d4c35a640 1 -- 172.21.15.50:0/3161782505 wait complete. 2023-12-08T08:18:22.614 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2023-12-08T08:18:22.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T08:18:22.615 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:22.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T08:18:22.616 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:22.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T08:18:22.617 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:22.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T08:18:22.618 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2023-12-08T08:18:22.618 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T08:18:22.619 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:22.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T08:18:22.620 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:22.620 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:18:22.621 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:22.621 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T08:18:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.835+0000 7f139c30f640 1 Processor -- start 2023-12-08T08:18:22.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.836+0000 7f139c30f640 1 -- start start 2023-12-08T08:18:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.835+0000 7fb58bc52640 1 Processor -- start 2023-12-08T08:18:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.836+0000 7fb58bc52640 1 -- start start 2023-12-08T08:18:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7f139c30f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f139406dbe0 0x7f139406dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7f139c30f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f139415dc90 0x7f139415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7f8a1751d640 1 Processor -- start 2023-12-08T08:18:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7f8a1751d640 1 -- start start 2023-12-08T08:18:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7f139c30f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13940cebf0 con 0x7f13940711e0 2023-12-08T08:18:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7f27f8977640 1 Processor -- start 2023-12-08T08:18:22.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7f27f8977640 1 -- start start 2023-12-08T08:18:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7f139a8ac640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f13940711e0 0x7f13940715f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35160/0 (socket says 172.21.15.50:35160) 2023-12-08T08:18:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7f13998aa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f139415dc90 0x7f139415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7f13998aa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f139415dc90 0x7f139415e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57224/0 (socket says 172.21.15.50:57224) 2023-12-08T08:18:22.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7f13998aa640 1 -- 172.21.15.50:0/4160333124 learned_addr learned my addr 172.21.15.50:0/4160333124 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb58bc52640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb584159f80 0x7fb58406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb58bc52640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5840cf460 con 0x7fb58415e850 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb58bc52640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58415a3c0 con 0x7fb58406e0e0 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb58bc52640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58406e590 con 0x7fb584159f80 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb5891ed640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb584159f80 0x7fb58406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb5891ed640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb584159f80 0x7fb58406dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37846/0 (socket says 172.21.15.50:37846) 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb5891ed640 1 -- 172.21.15.50:0/3789446756 learned_addr learned my addr 172.21.15.50:0/3789446756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.837+0000 7fb5899ee640 1 --1- 172.21.15.50:0/3789446756 >> v1:172.21.15.50:6789/0 conn(0x7fb58415e850 0x7fb5840cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35148/0 (socket says 172.21.15.50:35148) 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7fb5891ed640 1 -- 172.21.15.50:0/3789446756 >> v1:172.21.15.170:6789/0 conn(0x7fb58406e0e0 legacy=0x7fb58406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7fb5891ed640 1 -- 172.21.15.50:0/3789446756 >> v1:172.21.15.50:6789/0 conn(0x7fb58415e850 legacy=0x7fb5840cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.838+0000 7fb5891ed640 1 -- 172.21.15.50:0/3789446756 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584160e90 con 0x7fb584159f80 2023-12-08T08:18:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f139c30f640 1 -- 172.21.15.50:0/4160333124 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139415e9c0 con 0x7f139415dc90 2023-12-08T08:18:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f139c30f640 1 -- 172.21.15.50:0/4160333124 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139415c590 con 0x7f139406dbe0 2023-12-08T08:18:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592148645 0 0) 0x7f13940cebf0 con 0x7f13940711e0 2023-12-08T08:18:22.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1380003520 con 0x7f13940711e0 2023-12-08T08:18:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7fb5891ed640 1 --2- 172.21.15.50:0/3789446756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb584159f80 0x7fb58406dba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb574011f90 tx=0x7fb57403ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d84f3ebf142a2ed server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f8977640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f27f40b1a50 0x7f27f406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f8977640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27f40b3bb0 0x7f27f4162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f8977640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f4162940 con 0x7f27f40b1e30 2023-12-08T08:18:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f8977640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f406c470 con 0x7f27f40b3bb0 2023-12-08T08:18:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f8977640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f406c750 con 0x7f27f40b1a50 2023-12-08T08:18:22.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27f40b3bb0 0x7f27f4162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f27f40b3bb0 0x7f27f4162400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57238/0 (socket says 172.21.15.50:57238) 2023-12-08T08:18:22.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7fb5889ec640 1 -- 172.21.15.50:0/3789446756 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740114e0 con 0x7fb584159f80 2023-12-08T08:18:22.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f139a0ab640 1 --2- 172.21.15.50:0/4160333124 >> v2:172.21.15.170:3300/0 conn(0x7f139406dbe0 0x7f139406dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.839+0000 7f27f259c640 1 -- 172.21.15.50:0/2099907532 learned_addr learned my addr 172.21.15.50:0/2099907532 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7fb5889ec640 1 -- 172.21.15.50:0/3789446756 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb574011640 con 0x7fb584159f80 2023-12-08T08:18:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7fb5889ec640 1 -- 172.21.15.50:0/3789446756 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400fa70 con 0x7fb584159f80 2023-12-08T08:18:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040660160 0 0) 0x7f1380003520 con 0x7f13940711e0 2023-12-08T08:18:22.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 >> v2:172.21.15.170:3300/0 conn(0x7f139406dbe0 msgr2=0x7f139406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13990a9640 1 --2- 172.21.15.50:0/4160333124 >> v2:172.21.15.170:3300/0 conn(0x7f139406dbe0 0x7f139406dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 >> v2:172.21.15.50:3300/0 conn(0x7f139415dc90 msgr2=0x7f139415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13990a9640 1 --2- 172.21.15.50:0/4160333124 >> v2:172.21.15.50:3300/0 conn(0x7f139415dc90 0x7f139415e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139406e500 con 0x7f13940711e0 2023-12-08T08:18:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f8a1751d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8a080e3080 0x7f8a08057d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f27f2d9d640 1 --2- 172.21.15.50:0/2099907532 >> v2:172.21.15.170:3300/0 conn(0x7f27f40b1a50 0x7f27f406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f8a152b9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8a080e3080 0x7f8a08057d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f27f259c640 1 -- 172.21.15.50:0/2099907532 >> v2:172.21.15.170:3300/0 conn(0x7f27f40b1a50 msgr2=0x7f27f406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f8a14ab8640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8a0803e800 0x7f8a08053bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51726/0 (socket says 172.21.15.50:51726) 2023-12-08T08:18:22.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f8a152b9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8a080e3080 0x7f8a08057d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37876/0 (socket says 172.21.15.50:37876) 2023-12-08T08:18:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13998aa640 1 --2- 172.21.15.50:0/4160333124 >> v2:172.21.15.50:3300/0 conn(0x7f139415dc90 0x7f139415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f27f259c640 1 --2- 172.21.15.50:0/2099907532 >> v2:172.21.15.170:3300/0 conn(0x7f27f40b1a50 0x7f27f406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f27f259c640 1 -- 172.21.15.50:0/2099907532 >> v1:172.21.15.170:6789/0 conn(0x7f27f40b1e30 legacy=0x7f27f406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f007ad7c640 1 Processor -- start 2023-12-08T08:18:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f27f259c640 1 -- 172.21.15.50:0/2099907532 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f406ca30 con 0x7f27f40b3bb0 2023-12-08T08:18:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.840+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f1390001670 con 0x7f13940711e0 2023-12-08T08:18:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 >> v1:172.21.15.50:6789/0 conn(0x7f13940711e0 legacy=0x7f13940715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13990a9640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1380003a40 0x7f1380003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13990a9640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f1380004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f007ad7c640 1 -- start start 2023-12-08T08:18:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a15aba640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a080542c0 0x7f8a08006890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35162/0 (socket says 172.21.15.50:35162) 2023-12-08T08:18:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13990a9640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1380005180 0x7f138000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139415e9c0 con 0x7f1380005180 2023-12-08T08:18:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139415c590 con 0x7f1380003a40 2023-12-08T08:18:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a14ab8640 1 -- 172.21.15.50:0/2917060472 learned_addr learned my addr 172.21.15.50:0/2917060472 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a08058290 con 0x7f8a080542c0 2023-12-08T08:18:22.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138000e230 con 0x7f13800047c0 2023-12-08T08:18:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a08058530 con 0x7f8a0803e800 2023-12-08T08:18:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f5a18232640 1 Processor -- start 2023-12-08T08:18:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a08006160 con 0x7f8a080e3080 2023-12-08T08:18:22.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13998aa640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f1380004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fbc8b4bb640 1 Processor -- start 2023-12-08T08:18:22.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fbc8b4bb640 1 -- start start 2023-12-08T08:18:22.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a07fff640 1 -- 172.21.15.50:0/2917060472 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396458542 0 0) 0x7f8a08058530 con 0x7f8a0803e800 2023-12-08T08:18:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a07fff640 1 -- 172.21.15.50:0/2917060472 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89fc003520 con 0x7f8a0803e800 2023-12-08T08:18:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a152b9640 1 -- 172.21.15.50:0/2917060472 >> v1:172.21.15.170:6789/0 conn(0x7f8a0803e800 legacy=0x7f8a08053bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a152b9640 1 -- 172.21.15.50:0/2917060472 >> v1:172.21.15.50:6789/0 conn(0x7f8a080542c0 legacy=0x7f8a08006890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f8a152b9640 1 -- 172.21.15.50:0/2917060472 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08058810 con 0x7f8a080e3080 2023-12-08T08:18:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f13998aa640 1 -- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1380003a40 msgr2=0x7f1380003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f139a0ab640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1380003a40 0x7f1380003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f13998aa640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1380003a40 0x7f1380003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f13998aa640 1 -- 172.21.15.50:0/4160333124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1380005180 msgr2=0x7f138000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f13998aa640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1380005180 0x7f138000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f27f259c640 1 --2- 172.21.15.50:0/2099907532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b3bb0 0x7f27f4162400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27f40cf570 tx=0x7f27ec02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68466eccaf105fd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7f5a18232640 1 -- start start 2023-12-08T08:18:22.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f007ad7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f007415f4e0 0x7f007415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f0073fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f00740cf900 0x7f007415edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51736/0 (socket says 172.21.15.50:51736) 2023-12-08T08:18:22.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f27f1d9b640 1 -- 172.21.15.50:0/2099907532 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec02c9f0 con 0x7f27f40b3bb0 2023-12-08T08:18:22.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f27f1d9b640 1 -- 172.21.15.50:0/2099907532 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec02cb50 con 0x7f27f40b3bb0 2023-12-08T08:18:22.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f0073fff640 1 -- 172.21.15.50:0/3722368523 learned_addr learned my addr 172.21.15.50:0/3722368523 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f0079319640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f007415f4e0 0x7f007415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a15fce640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f5a10159f80 0x7f5a100cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51744/0 (socket says 172.21.15.50:51744) 2023-12-08T08:18:22.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007415c150 con 0x7f00740cd240 2023-12-08T08:18:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8b4bb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbc7c00c060 0x7fbc7c038040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8b4bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc7c053c30 0x7fbc7c0df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8b4bb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0df720 con 0x7fbc7c033eb0 2023-12-08T08:18:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8b4bb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c054480 con 0x7fbc7c053c30 2023-12-08T08:18:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8b4bb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0541a0 con 0x7fbc7c00c060 2023-12-08T08:18:22.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8a4b9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbc7c00c060 0x7fbc7c038040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007415fb00 con 0x7f00740cf900 2023-12-08T08:18:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740cd620 con 0x7f007415f4e0 2023-12-08T08:18:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f27f8977640 1 -- 172.21.15.50:0/2099907532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b3bb0 msgr2=0x7f27f4162400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f27f8977640 1 --2- 172.21.15.50:0/2099907532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b3bb0 0x7f27f4162400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27f40cf570 tx=0x7f27ec02be50 comp rx=0 tx=0).stop 2023-12-08T08:18:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a18232640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5a1006e2b0 0x7f5a100caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a18232640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a100cf460 con 0x7f5a1015e850 2023-12-08T08:18:22.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a18232640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a100ce5a0 con 0x7f5a10159f80 2023-12-08T08:18:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a18232640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1015a360 con 0x7f5a1006e2b0 2023-12-08T08:18:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a157cd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5a1015e850 0x7f5a1006dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35184/0 (socket says 172.21.15.50:35184) 2023-12-08T08:18:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a157cd640 1 -- 172.21.15.50:0/397905149 learned_addr learned my addr 172.21.15.50:0/397905149 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f5a167cf640 1 --2- 172.21.15.50:0/397905149 >> v2:172.21.15.50:3300/0 conn(0x7f5a1006e2b0 0x7f5a100caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862012767 0 0) 0x7f007415fb00 con 0x7f00740cf900 2023-12-08T08:18:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597881070 0 0) 0x7f5a100cf460 con 0x7f5a1015e850 2023-12-08T08:18:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59fc003520 con 0x7f5a1015e850 2023-12-08T08:18:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214836705 0 0) 0x7f5a100ce5a0 con 0x7f5a10159f80 2023-12-08T08:18:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a100cf460 con 0x7f5a10159f80 2023-12-08T08:18:22.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c003520 con 0x7f00740cf900 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fb58bc52640 1 -- 172.21.15.50:0/3789446756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb584159f80 msgr2=0x7fb58406dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fb58bc52640 1 --2- 172.21.15.50:0/3789446756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb584159f80 0x7fb58406dba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb574011f90 tx=0x7fb57403ca50 comp rx=0 tx=0).stop 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fb58bc52640 1 -- 172.21.15.50:0/3789446756 shutdown_connections 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fb58bc52640 1 --2- 172.21.15.50:0/3789446756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb584159f80 0x7fb58406dba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fb58bc52640 1 -- 172.21.15.50:0/3789446756 >> 172.21.15.50:0/3789446756 conn(0x7fb5840b1860 msgr2=0x7fb5840b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fb58bc52640 1 -- 172.21.15.50:0/3789446756 shutdown_connections 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.841+0000 7fb58bc52640 1 -- 172.21.15.50:0/3789446756 wait complete. 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fb58bc52640 1 Processor -- start 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fb58bc52640 1 -- start start 2023-12-08T08:18:22.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3305899529 0 0) 0x7f5a100cf460 con 0x7f5a10159f80 2023-12-08T08:18:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f27f8977640 1 -- 172.21.15.50:0/2099907532 shutdown_connections 2023-12-08T08:18:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f27f8977640 1 --2- 172.21.15.50:0/2099907532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b3bb0 0x7f27f4162400 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27f40cf570 tx=0x7f27ec02be50 comp rx=0 tx=0).stop 2023-12-08T08:18:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f27f8977640 1 --2- 172.21.15.50:0/2099907532 >> v2:172.21.15.170:3300/0 conn(0x7f27f40b1a50 0x7f27f406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f27f8977640 1 -- 172.21.15.50:0/2099907532 >> 172.21.15.50:0/2099907532 conn(0x7f27f406a6b0 msgr2=0x7f27f406aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 >> v2:172.21.15.50:3300/0 conn(0x7f5a1006e2b0 msgr2=0x7f5a100caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 --2- 172.21.15.50:0/397905149 >> v2:172.21.15.50:3300/0 conn(0x7f5a1006e2b0 0x7f5a100caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 >> v1:172.21.15.50:6789/0 conn(0x7f5a1015e850 legacy=0x7f5a1006dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fb58bc52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb58406e0e0 0x7fb5841606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fb58bc52640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb584159f80 0x7fb58414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fb58bc52640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb58415e850 0x7fb58414a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fb58bc52640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58414aa10 con 0x7fb58415e850 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fb58bc52640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb584152500 con 0x7fb58406e0e0 2023-12-08T08:18:22.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fb58bc52640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb584215030 con 0x7fb584159f80 2023-12-08T08:18:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100ce850 con 0x7f5a10159f80 2023-12-08T08:18:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8a4b9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbc7c00c060 0x7fbc7c038040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37900/0 (socket says 172.21.15.50:37900) 2023-12-08T08:18:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7fbc8a4b9640 1 -- 172.21.15.50:0/3749709632 learned_addr learned my addr 172.21.15.50:0/3749709632 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fbc8a4b9640 1 -- 172.21.15.50:0/3749709632 >> v2:172.21.15.50:3300/0 conn(0x7fbc7c053c30 msgr2=0x7fbc7c0df1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fbc8a4b9640 1 --2- 172.21.15.50:0/3749709632 >> v2:172.21.15.50:3300/0 conn(0x7fbc7c053c30 0x7fbc7c0df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fbc8a4b9640 1 -- 172.21.15.50:0/3749709632 >> v1:172.21.15.50:6789/0 conn(0x7fbc7c033eb0 legacy=0x7fbc7c04fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7fbc8a4b9640 1 -- 172.21.15.50:0/3749709632 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c005ef0 con 0x7fbc7c00c060 2023-12-08T08:18:22.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f27f8977640 1 -- 172.21.15.50:0/2099907532 shutdown_connections 2023-12-08T08:18:22.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f5a00001670 con 0x7f5a10159f80 2023-12-08T08:18:22.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb584159f80 0x7fb58414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2995282828 0 0) 0x7f005c003520 con 0x7f00740cf900 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f007415f4e0 msgr2=0x7f007415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f007415f4e0 0x7f007415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 >> v1:172.21.15.50:6789/0 conn(0x7f00740cd240 legacy=0x7f00740cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007415b820 con 0x7f00740cf900 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f006c0019f0 con 0x7f00740cf900 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 >> v1:172.21.15.170:6789/0 conn(0x7f00740cf900 legacy=0x7f007415edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f00737fe640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f005c0039c0 0x7f005c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f00737fe640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f005c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f00737fe640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c005180 0x7f005c00fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740cd620 con 0x7f005c005180 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c010400 con 0x7f005c0039c0 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0105c0 con 0x7f005c0047c0 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb584159f80 0x7fb58414ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37480/0 (socket says 172.21.15.50:37480) 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 -- 172.21.15.50:0/3643517227 learned_addr learned my addr 172.21.15.50:0/3643517227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5899ee640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb58406e0e0 0x7fb5841606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb58a1ef640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb58415e850 0x7fb58414a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 >> v1:172.21.15.170:6789/0 conn(0x7f5a10159f80 legacy=0x7f5a100cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f8a152b9640 1 --2- 172.21.15.50:0/2917060472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a08057d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a080e7c90 tx=0x7f8a0c02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52075dc37b55258 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59fc004b60 0x7f59fc004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.842+0000 7f13998aa640 1 -- 172.21.15.50:0/4160333124 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380003520 con 0x7f13800047c0 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f139a0ab640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1380003a40 0x7f1380003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f139a8ac640 1 -- 172.21.15.50:0/4160333124 reap_dead start 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f13998aa640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f1380004c40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1384009de0 tx=0x7f13800057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de353427f514fffb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138402c9d0 con 0x7f13800047c0 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138402cb30 con 0x7f13800047c0 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.843+0000 7f13990a9640 1 -- 172.21.15.50:0/4160333124 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384034440 con 0x7f13800047c0 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59fc003760 0x7f59fc003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f59fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1015a360 con 0x7f59fc003760 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0148c0 con 0x7f59fc004b60 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.844+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc014a80 con 0x7f59fc004120 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a157cd640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59fc003760 0x7f59fc003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a167cf640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f59fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a15fce640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59fc004b60 0x7f59fc004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f0078b18640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f005c0039c0 0x7f005c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f139c30f640 1 -- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 msgr2=0x7f1380004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f0073fff640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f005c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f8a07fff640 1 -- 172.21.15.50:0/2917060472 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c030800 con 0x7f8a080e3080 2023-12-08T08:18:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f8a07fff640 1 -- 172.21.15.50:0/2917060472 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c030960 con 0x7f8a080e3080 2023-12-08T08:18:22.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f8a07fff640 1 -- 172.21.15.50:0/2917060472 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c030cf0 con 0x7f8a080e3080 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fbc8a4b9640 1 --2- 172.21.15.50:0/3749709632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c00c060 0x7fbc7c038040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00b060 tx=0x7fbc8002b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa9ed83c3a954a33 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fbc894b7640 1 -- 172.21.15.50:0/3749709632 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80031880 con 0x7fbc7c00c060 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fbc894b7640 1 -- 172.21.15.50:0/3749709632 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc800319e0 con 0x7fbc7c00c060 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f27f8977640 1 -- 172.21.15.50:0/2099907532 wait complete. 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f139c30f640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f1380004c40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1384009de0 tx=0x7f13800057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f139c30f640 1 -- 172.21.15.50:0/4160333124 shutdown_connections 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f139c30f640 1 --2- 172.21.15.50:0/4160333124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f1380004c40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f139c30f640 1 -- 172.21.15.50:0/4160333124 >> 172.21.15.50:0/4160333124 conn(0x7f13940b1860 msgr2=0x7f13940b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f0079319640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c005180 0x7f005c00fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 -- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb58406e0e0 msgr2=0x7fb5841606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb58406e0e0 0x7fb5841606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 -- 172.21.15.50:0/3643517227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb58415e850 msgr2=0x7fb58414a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb58415e850 0x7fb58414a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb5891ed640 1 -- 172.21.15.50:0/3643517227 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574011d70 con 0x7fb584159f80 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7fb58a1ef640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb58415e850 0x7fb58414a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:22.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fb5891ed640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb584159f80 0x7fb58414ab90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb574013240 tx=0x7fb5740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a167cf640 1 -- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59fc004b60 msgr2=0x7f59fc004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a167cf640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59fc004b60 0x7f59fc004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a167cf640 1 -- 172.21.15.50:0/397905149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59fc003760 msgr2=0x7f59fc003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a167cf640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f59fc003760 0x7f59fc003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.845+0000 7f5a167cf640 1 -- 172.21.15.50:0/397905149 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100ce850 con 0x7f59fc004120 2023-12-08T08:18:22.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fbc894b7640 1 -- 172.21.15.50:0/3749709632 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80031d70 con 0x7fbc7c00c060 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f0073fff640 1 -- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f005c0039c0 msgr2=0x7f005c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f0073fff640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f005c0039c0 0x7f005c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f0073fff640 1 -- 172.21.15.50:0/3722368523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c005180 msgr2=0x7f005c00fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f0073fff640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c005180 0x7f005c00fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f0073fff640 1 -- 172.21.15.50:0/3722368523 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c003520 con 0x7f005c0047c0 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fb57a7fc640 1 -- 172.21.15.50:0/3643517227 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574040970 con 0x7fb584159f80 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fb57a7fc640 1 -- 172.21.15.50:0/3643517227 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb574040ad0 con 0x7fb584159f80 2023-12-08T08:18:22.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fb57a7fc640 1 -- 172.21.15.50:0/3643517227 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574040e60 con 0x7fb584159f80 2023-12-08T08:18:22.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/3749709632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c00c060 msgr2=0x7fbc7c038040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fb58bc52640 1 -- 172.21.15.50:0/3643517227 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb584160cd0 con 0x7fb584159f80 2023-12-08T08:18:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7fb58bc52640 1 -- 172.21.15.50:0/3643517227 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb584214700 con 0x7fb584159f80 2023-12-08T08:18:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 msgr2=0x7f8a08057d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f8a1751d640 1 --2- 172.21.15.50:0/2917060472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a08057d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a080e7c90 tx=0x7f8a0c02b940 comp rx=0 tx=0).stop 2023-12-08T08:18:22.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/3749709632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c00c060 0x7fbc7c038040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00b060 tx=0x7fbc8002b920 comp rx=0 tx=0).stop 2023-12-08T08:18:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f0079319640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c005180 0x7f005c00fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.846+0000 7f139c30f640 1 -- 172.21.15.50:0/4160333124 shutdown_connections 2023-12-08T08:18:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f139c30f640 1 -- 172.21.15.50:0/4160333124 wait complete. 2023-12-08T08:18:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/3749709632 shutdown_connections 2023-12-08T08:18:22.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/3749709632 >> v2:172.21.15.50:3300/0 conn(0x7fbc7c053c30 0x7fbc7c0df1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/3749709632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c00c060 0x7fbc7c038040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/3749709632 >> 172.21.15.50:0/3749709632 conn(0x7fbc7c009f70 msgr2=0x7fbc7c00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f5a167cf640 1 -- 172.21.15.50:0/397905149 reap_dead start 2023-12-08T08:18:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 shutdown_connections 2023-12-08T08:18:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f8a1751d640 1 --2- 172.21.15.50:0/2917060472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a08057d50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 >> 172.21.15.50:0/2917060472 conn(0x7f8a080559a0 msgr2=0x7f8a08055db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/3749709632 shutdown_connections 2023-12-08T08:18:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f27f8977640 1 Processor -- start 2023-12-08T08:18:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f27f8977640 1 -- start start 2023-12-08T08:18:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 shutdown_connections 2023-12-08T08:18:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f8a1751d640 1 -- 172.21.15.50:0/2917060472 wait complete. 2023-12-08T08:18:22.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f15f4c71640 1 Processor -- start 2023-12-08T08:18:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f15f4c71640 1 -- start start 2023-12-08T08:18:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f5a167cf640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f59fc00b980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00ba10 tx=0x7f59fc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f222cb6dcfa88d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c032680 con 0x7f59fc004120 2023-12-08T08:18:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c0327e0 con 0x7f59fc004120 2023-12-08T08:18:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7f5a14fcc640 1 -- 172.21.15.50:0/397905149 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c032b90 con 0x7f59fc004120 2023-12-08T08:18:22.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.847+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/3749709632 wait complete. 2023-12-08T08:18:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.848+0000 7fb58bc52640 1 -- 172.21.15.50:0/3643517227 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb584073250 con 0x7fb584159f80 2023-12-08T08:18:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.848+0000 7f27f8977640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b1a50 0x7f27f413f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f5a18232640 1 -- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 msgr2=0x7f59fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15f4c71640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f0070730 0x7f15f00b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15f4c71640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00b39a0 con 0x7f15f006e110 2023-12-08T08:18:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15f4c71640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f00b33e0 con 0x7f15f01423b0 2023-12-08T08:18:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15f4c71640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f006c300 con 0x7f15f0070730 2023-12-08T08:18:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f5a18232640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f59fc00b980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00ba10 tx=0x7f59fc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15ef7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f15f006e110 0x7f15f0070020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35214/0 (socket says 172.21.15.50:35214) 2023-12-08T08:18:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15ef7fe640 1 -- 172.21.15.50:0/890101484 learned_addr learned my addr 172.21.15.50:0/890101484 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:22.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b1a50 0x7f27f413f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b1a50 0x7f27f413f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57306/0 (socket says 172.21.15.50:57306) 2023-12-08T08:18:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f2d9d640 1 -- 172.21.15.50:0/3689725957 learned_addr learned my addr 172.21.15.50:0/3689725957 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f8977640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27f40b1e30 0x7f27f41f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f139c30f640 1 Processor -- start 2023-12-08T08:18:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15eeffd640 1 --2- 172.21.15.50:0/890101484 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f0070730 0x7f15f00b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f139c30f640 1 -- start start 2023-12-08T08:18:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7fbc8b4bb640 1 Processor -- start 2023-12-08T08:18:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15ee7fc640 1 -- 172.21.15.50:0/890101484 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876989638 0 0) 0x7f15f00b39a0 con 0x7f15f006e110 2023-12-08T08:18:22.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7fbc8b4bb640 1 -- start start 2023-12-08T08:18:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15ee7fc640 1 -- 172.21.15.50:0/890101484 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d8003520 con 0x7f15f006e110 2023-12-08T08:18:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15ee7fc640 1 -- 172.21.15.50:0/890101484 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846994554 0 0) 0x7f15f00b33e0 con 0x7f15f01423b0 2023-12-08T08:18:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f259c640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27f40b1e30 0x7f27f41f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f8977640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f41466d0 0x7f27f4160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f8977640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4160cb0 con 0x7f27f40b1a50 2023-12-08T08:18:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f8977640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4146b80 con 0x7f27f41466d0 2023-12-08T08:18:22.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f27f8977640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f413f6f0 con 0x7f27f40b1e30 2023-12-08T08:18:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7fb57a7fc640 1 -- 172.21.15.50:0/3643517227 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb57403e400 con 0x7fb584159f80 2023-12-08T08:18:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f5a18232640 1 -- 172.21.15.50:0/397905149 shutdown_connections 2023-12-08T08:18:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f5a18232640 1 --2- 172.21.15.50:0/397905149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f59fc00b980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f5a18232640 1 -- 172.21.15.50:0/397905149 >> 172.21.15.50:0/397905149 conn(0x7f5a100b1860 msgr2=0x7f5a100b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.849+0000 7f15ee7fc640 1 -- 172.21.15.50:0/890101484 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f00b39a0 con 0x7f15f01423b0 2023-12-08T08:18:22.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f8a1751d640 1 Processor -- start 2023-12-08T08:18:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f15eeffd640 1 -- 172.21.15.50:0/890101484 >> v1:172.21.15.170:6789/0 conn(0x7f15f01423b0 legacy=0x7f15f013f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f8a1751d640 1 -- start start 2023-12-08T08:18:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f15eeffd640 1 -- 172.21.15.50:0/890101484 >> v1:172.21.15.50:6789/0 conn(0x7f15f006e110 legacy=0x7f15f0070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f15eeffd640 1 -- 172.21.15.50:0/890101484 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00b36c0 con 0x7f15f0070730 2023-12-08T08:18:22.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7fb57a7fc640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb56806af10 0x7fb56806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f27f359e640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f41466d0 0x7f27f4160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f27f2d9d640 1 -- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27f40b1e30 msgr2=0x7f27f41f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f27f2d9d640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27f40b1e30 0x7f27f41f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7fb57a7fc640 1 -- 172.21.15.50:0/3643517227 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5740ab630 con 0x7fb584159f80 2023-12-08T08:18:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f27f2d9d640 1 -- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f41466d0 msgr2=0x7f27f4160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f27f2d9d640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f41466d0 0x7f27f4160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f27f2d9d640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec009b30 con 0x7f27f40b1a50 2023-12-08T08:18:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.850+0000 7f27f359e640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f41466d0 0x7f27f4160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:22.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f15eeffd640 1 --2- 172.21.15.50:0/890101484 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f0070730 0x7f15f00b2a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15e40097d0 tx=0x7f15e402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b1e117fb9a5ec78 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8b4bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc7c033eb0 0x7fbc7c178050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8b4bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c053c30 0x7fbc7c04a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139c30f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f139414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f27f2d9d640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b1a50 0x7f27f413f030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d910 tx=0x7f27e400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139c30f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13941514b0 0x7f13940c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f0073fff640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f005c004c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f006c00a370 tx=0x7f005c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9ae627b48d023cb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8b4bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7c0d60c0 0x7fbc7c0d6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f5a18232640 1 -- 172.21.15.50:0/397905149 shutdown_connections 2023-12-08T08:18:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fb5899ee640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb56806af10 0x7fb56806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f5a18232640 1 -- 172.21.15.50:0/397905149 wait complete. 2023-12-08T08:18:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a1751d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0803e800 0x7f8a0804ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139c30f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13940c6080 0x7f13940cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a1751d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a080542c0 0x7f8a080d9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc89cb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c053c30 0x7fbc7c04a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8b4bb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c178f80 con 0x7fbc7c0d60c0 2023-12-08T08:18:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8a4b9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc7c033eb0 0x7fbc7c178050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8b4bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c04a740 con 0x7fbc7c053c30 2023-12-08T08:18:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8b4bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1786e0 con 0x7fbc7c033eb0 2023-12-08T08:18:22.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc89cb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c053c30 0x7fbc7c04a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37946/0 (socket says 172.21.15.50:37946) 2023-12-08T08:18:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc89cb8640 1 -- 172.21.15.50:0/721430432 learned_addr learned my addr 172.21.15.50:0/721430432 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc8acba640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7c0d60c0 0x7fbc7c0d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f13998aa640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13941514b0 0x7f13940c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f13998aa640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13941514b0 0x7f13940c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:37952/0 (socket says 172.21.15.50:37952) 2023-12-08T08:18:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139a0ab640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f139414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a1751d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a080522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f13998aa640 1 -- 172.21.15.50:0/2715727773 learned_addr learned my addr 172.21.15.50:0/2715727773 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139a8ac640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13940c6080 0x7f13940cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394150070 con 0x7f13940c6080 2023-12-08T08:18:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a14ab8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a080542c0 0x7f8a080d9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a152b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0803e800 0x7f8a0804ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a14ab8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a080542c0 0x7f8a080d9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37552/0 (socket says 172.21.15.50:37552) 2023-12-08T08:18:22.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a14ab8640 1 -- 172.21.15.50:0/3309572389 learned_addr learned my addr 172.21.15.50:0/3309572389 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940c6500 con 0x7f13941514b0 2023-12-08T08:18:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13940c6d40 con 0x7f13800047c0 2023-12-08T08:18:22.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a15aba640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a080522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08050fb0 con 0x7f8a0803e800 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080da240 con 0x7f8a080e3080 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc89cb8640 1 -- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc7c033eb0 msgr2=0x7fbc7c178050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7fbc89cb8640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc7c033eb0 0x7fbc7c178050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc89cb8640 1 -- 172.21.15.50:0/721430432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7c0d60c0 msgr2=0x7fbc7c0d6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc89cb8640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7c0d60c0 0x7fbc7c0d6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc89cb8640 1 -- 172.21.15.50:0/721430432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800094d0 con 0x7fbc7c053c30 2023-12-08T08:18:22.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.851+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08051200 con 0x7f8a080542c0 2023-12-08T08:18:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f27db7fe640 1 -- 172.21.15.50:0/3689725957 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4009760 con 0x7f27f40b1a50 2023-12-08T08:18:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f27db7fe640 1 -- 172.21.15.50:0/3689725957 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e40098c0 con 0x7f27f40b1a50 2023-12-08T08:18:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fb5899ee640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb56806af10 0x7fb56806d3d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5800012e0 tx=0x7fb5800016f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc89cb8640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c053c30 0x7fbc7c04a200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400b440 tx=0x7fbc7400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f139a8ac640 1 -- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 msgr2=0x7f139414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f139a8ac640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f139414fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f139a8ac640 1 -- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13941514b0 msgr2=0x7f13940c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f139a8ac640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13941514b0 0x7f13940c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f8a15aba640 1 -- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a080542c0 msgr2=0x7f8a080d9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f8a15aba640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a080542c0 0x7f8a080d9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f139a8ac640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13940c7020 con 0x7f13940c6080 2023-12-08T08:18:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f8a15aba640 1 -- 172.21.15.50:0/3309572389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0803e800 msgr2=0x7f8a0804ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f8a15aba640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0803e800 0x7f8a0804ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f8a15aba640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c009400 con 0x7f8a080e3080 2023-12-08T08:18:22.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f13998aa640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13941514b0 0x7f13940c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:22.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc7affd640 1 -- 172.21.15.50:0/721430432 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011890 con 0x7fbc7c053c30 2023-12-08T08:18:22.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f27db7fe640 1 -- 172.21.15.50:0/3689725957 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4009c50 con 0x7f27f40b1a50 2023-12-08T08:18:22.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f27f8977640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f413f9d0 con 0x7f27f40b1a50 2023-12-08T08:18:22.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f8a15aba640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a080522a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a10050020 tx=0x7f8a10073190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f139a8ac640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13940c6080 0x7f13940cbd90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f13940b17f0 tx=0x7f139000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7f27f8977640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f41f7b40 con 0x7f27f40b1a50 2023-12-08T08:18:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc7affd640 1 -- 172.21.15.50:0/721430432 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc740119f0 con 0x7fbc7c053c30 2023-12-08T08:18:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc7affd640 1 -- 172.21.15.50:0/721430432 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011da0 con 0x7fbc7c053c30 2023-12-08T08:18:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c1789c0 con 0x7fbc7c053c30 2023-12-08T08:18:22.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.852+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c04bcf0 con 0x7fbc7c053c30 2023-12-08T08:18:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f8a05ffb640 1 -- 172.21.15.50:0/3309572389 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1006bc90 con 0x7f8a080e3080 2023-12-08T08:18:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f8a05ffb640 1 -- 172.21.15.50:0/3309572389 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1006be10 con 0x7f8a080e3080 2023-12-08T08:18:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f8a05ffb640 1 -- 172.21.15.50:0/3309572389 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10072400 con 0x7f8a080e3080 2023-12-08T08:18:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a080514e0 con 0x7f8a080e3080 2023-12-08T08:18:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a08051aa0 con 0x7f8a080e3080 2023-12-08T08:18:22.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f5a18232640 1 Processor -- start 2023-12-08T08:18:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f138affd640 1 -- 172.21.15.50:0/2715727773 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390004cd0 con 0x7f13940c6080 2023-12-08T08:18:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f138affd640 1 -- 172.21.15.50:0/2715727773 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1390004e50 con 0x7f13940c6080 2023-12-08T08:18:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f5a18232640 1 -- start start 2023-12-08T08:18:22.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.853+0000 7f138affd640 1 -- 172.21.15.50:0/2715727773 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13900072b0 con 0x7f13940c6080 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c04bb50 con 0x7fbc7c053c30 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f27f8977640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f40673c0 con 0x7f27f40b1a50 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a18232640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f5a1014bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a18232640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a100c9930 0x7f5a10155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a18232640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a100c8ad0 0x7f5a100c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a18232640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1014e070 con 0x7f5a100c8ad0 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a18232640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1014dbe0 con 0x7f5a100c9930 2023-12-08T08:18:22.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a18232640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1014c4e0 con 0x7f59fc004120 2023-12-08T08:18:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13940c7300 con 0x7f13940c6080 2023-12-08T08:18:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13941503a0 con 0x7f13940c6080 2023-12-08T08:18:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a167cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a100c8ad0 0x7f5a100c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a167cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a100c8ad0 0x7f5a100c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57342/0 (socket says 172.21.15.50:57342) 2023-12-08T08:18:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.854+0000 7f5a167cf640 1 -- 172.21.15.50:0/1722275571 learned_addr learned my addr 172.21.15.50:0/1722275571 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a15fce640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f5a1014bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a157cd640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a100c9930 0x7f5a10155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a080057a0 con 0x7f8a080e3080 2023-12-08T08:18:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7fbc7affd640 1 -- 172.21.15.50:0/721430432 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc7401a400 con 0x7fbc7c053c30 2023-12-08T08:18:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f27db7fe640 1 -- 172.21.15.50:0/3689725957 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f27e4014410 con 0x7f27f40b1a50 2023-12-08T08:18:22.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f27db7fe640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f27e006af40 0x7f27e006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13940c6e80 con 0x7f13940c6080 2023-12-08T08:18:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f15ee7fc640 1 -- 172.21.15.50:0/890101484 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4030800 con 0x7f15f0070730 2023-12-08T08:18:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f15ee7fc640 1 -- 172.21.15.50:0/890101484 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e4030960 con 0x7f15f0070730 2023-12-08T08:18:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f15ee7fc640 1 -- 172.21.15.50:0/890101484 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4030cf0 con 0x7f15f0070730 2023-12-08T08:18:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c035920 con 0x7f005c0047c0 2023-12-08T08:18:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c035a80 con 0x7f005c0047c0 2023-12-08T08:18:22.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f00737fe640 1 -- 172.21.15.50:0/3722368523 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c03e470 con 0x7f005c0047c0 2023-12-08T08:18:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7fbc7affd640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc6806af40 0x7fbc6806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f27f259c640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f27e006af40 0x7f27e006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7fbc7affd640 1 -- 172.21.15.50:0/721430432 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc74089bd0 con 0x7fbc7c053c30 2023-12-08T08:18:22.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7fbc8a4b9640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc6806af40 0x7fbc6806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f27db7fe640 1 -- 172.21.15.50:0/3689725957 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27e4089c70 con 0x7f27f40b1a50 2023-12-08T08:18:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f8a05ffb640 1 -- 172.21.15.50:0/3309572389 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a10072560 con 0x7f8a080e3080 2023-12-08T08:18:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a157cd640 1 -- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 msgr2=0x7f5a1014bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a157cd640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f5a1014bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a157cd640 1 -- 172.21.15.50:0/1722275571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a100c8ad0 msgr2=0x7f5a100c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a157cd640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a100c8ad0 0x7f5a100c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a157cd640 1 -- 172.21.15.50:0/1722275571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1014cfd0 con 0x7f5a100c9930 2023-12-08T08:18:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.855+0000 7f5a157cd640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a100c9930 0x7f5a10155be0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a1015ec30 tx=0x7f5a0800f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f27f259c640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f27e006af40 0x7f27e006d400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27ec035000 tx=0x7f27ec030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f8a05ffb640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89f406aec0 0x7f89f406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 msgr2=0x7f005c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f007ad7c640 1 --2- 172.21.15.50:0/3722368523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f005c004c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f006c00a370 tx=0x7f005c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f0079319640 1 -- 172.21.15.50:0/3722368523 reap_dead start 2023-12-08T08:18:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f15f4c71640 1 -- 172.21.15.50:0/890101484 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f0070730 msgr2=0x7f15f00b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f15f4c71640 1 --2- 172.21.15.50:0/890101484 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f0070730 0x7f15f00b2a70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15e40097d0 tx=0x7f15e402b940 comp rx=0 tx=0).stop 2023-12-08T08:18:22.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.856+0000 7f138affd640 1 -- 172.21.15.50:0/2715727773 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1390007410 con 0x7f13940c6080 2023-12-08T08:18:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f8a05ffb640 1 -- 172.21.15.50:0/3309572389 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a10103210 con 0x7f8a080e3080 2023-12-08T08:18:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f15f4c71640 1 -- 172.21.15.50:0/890101484 shutdown_connections 2023-12-08T08:18:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f15f4c71640 1 --2- 172.21.15.50:0/890101484 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f0070730 0x7f15f00b2a70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f15f4c71640 1 -- 172.21.15.50:0/890101484 >> 172.21.15.50:0/890101484 conn(0x7f15f00b0750 msgr2=0x7f15f00b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f8a152b9640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89f406aec0 0x7f89f406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f15f4c71640 1 -- 172.21.15.50:0/890101484 shutdown_connections 2023-12-08T08:18:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7fbc8a4b9640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc6806af40 0x7fbc6806d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbc80036000 tx=0x7fbc8003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f15f4c71640 1 -- 172.21.15.50:0/890101484 wait complete. 2023-12-08T08:18:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 shutdown_connections 2023-12-08T08:18:22.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 >> 172.21.15.50:0/3722368523 conn(0x7f0074099a10 msgr2=0x7f0074099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f138affd640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f137806af30 0x7f137806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f138affd640 1 -- 172.21.15.50:0/2715727773 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1390089020 con 0x7f13940c6080 2023-12-08T08:18:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 shutdown_connections 2023-12-08T08:18:22.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f139a0ab640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f137806af30 0x7f137806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f007ad7c640 1 -- 172.21.15.50:0/3722368523 wait complete. 2023-12-08T08:18:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7fb57a7fc640 1 -- 172.21.15.50:0/3643517227 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb574076510 con 0x7fb584159f80 2023-12-08T08:18:22.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.857+0000 7f8a152b9640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89f406aec0 0x7f89f406d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c036000 tx=0x7f8a0c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.858+0000 7f139a0ab640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f137806af30 0x7f137806d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f138c0124b0 tx=0x7f138c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.858+0000 7f15f4c71640 1 Processor -- start 2023-12-08T08:18:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.859+0000 7f007ad7c640 1 Processor -- start 2023-12-08T08:18:22.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.859+0000 7f15f4c71640 1 -- start start 2023-12-08T08:18:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.859+0000 7f007ad7c640 1 -- start start 2023-12-08T08:18:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.859+0000 7f15f4c71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f006e110 0x7f15f01f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.859+0000 7f15f4c71640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15f0070730 0x7f15f01f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.859+0000 7f007ad7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f00740b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f007ad7c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00740cbd50 0x7f00740cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15f4c71640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f01423b0 0x7f15f01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f007ad7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00740b59f0 0x7f00740b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15f4c71640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f01321e0 con 0x7f15f006e110 2023-12-08T08:18:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15f4c71640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0131660 con 0x7f15f0070730 2023-12-08T08:18:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f007ad7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074154ca0 con 0x7f00740b59f0 2023-12-08T08:18:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f007ad7c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740cc710 con 0x7f00740cbd50 2023-12-08T08:18:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f007ad7c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740c84a0 con 0x7f005c0047c0 2023-12-08T08:18:22.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15f4c71640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f0131940 con 0x7f15f01423b0 2023-12-08T08:18:22.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f00740b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f006e110 0x7f15f01f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15eeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15f0070730 0x7f15f01f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f006e110 0x7f15f01f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57354/0 (socket says 172.21.15.50:57354) 2023-12-08T08:18:22.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 -- 172.21.15.50:0/3058997835 learned_addr learned my addr 172.21.15.50:0/3058997835 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f00740b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37572/0 (socket says 172.21.15.50:37572) 2023-12-08T08:18:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 -- 172.21.15.50:0/505774999 learned_addr learned my addr 172.21.15.50:0/505774999 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15effff640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f01423b0 0x7f15f01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0079319640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00740b59f0 0x7f00740b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 -- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00740cbd50 msgr2=0x7f00740cc1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00740cbd50 0x7f00740cc1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 -- 172.21.15.50:0/505774999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00740b59f0 msgr2=0x7f00740b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00740b59f0 0x7f00740b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f0078b18640 1 -- 172.21.15.50:0/505774999 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740b3740 con 0x7f005c0047c0 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 -- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f01423b0 msgr2=0x7f15f01598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f01423b0 0x7f15f01598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 -- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15f0070730 msgr2=0x7f15f01f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15f0070730 0x7f15f01f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15ef7fe640 1 -- 172.21.15.50:0/3058997835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e4009400 con 0x7f15f006e110 2023-12-08T08:18:22.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f15eeffd640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15f0070730 0x7f15f01f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f5a067fc640 1 -- 172.21.15.50:0/1722275571 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08007ab0 con 0x7f5a100c9930 2023-12-08T08:18:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.860+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1014d2b0 con 0x7f5a100c9930 2023-12-08T08:18:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.861+0000 7f15ef7fe640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f006e110 0x7f15f01f6570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c410 tx=0x7f15e800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.861+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1014d870 con 0x7f5a100c9930 2023-12-08T08:18:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.861+0000 7fbc7affd640 1 -- 172.21.15.50:0/721430432 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc7c04bb50 con 0x7fbc7c053c30 2023-12-08T08:18:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.861+0000 7f0078b18640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f00740b3200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f006400f4f0 tx=0x7f006400f9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.862+0000 7f00717fa640 1 -- 172.21.15.50:0/505774999 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640052e0 con 0x7f005c0047c0 2023-12-08T08:18:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.862+0000 7f00717fa640 1 -- 172.21.15.50:0/505774999 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064005440 con 0x7f005c0047c0 2023-12-08T08:18:22.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.862+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a10073250 con 0x7f5a100c9930 2023-12-08T08:18:22.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.862+0000 7f00717fa640 1 -- 172.21.15.50:0/505774999 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064003830 con 0x7f005c0047c0 2023-12-08T08:18:22.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.862+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00740c7e70 con 0x7f005c0047c0 2023-12-08T08:18:22.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.862+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00740b6a20 con 0x7f005c0047c0 2023-12-08T08:18:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.863+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074067ad0 con 0x7f005c0047c0 2023-12-08T08:18:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.864+0000 7f00717fa640 1 -- 172.21.15.50:0/505774999 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0064003990 con 0x7f005c0047c0 2023-12-08T08:18:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.864+0000 7f00717fa640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f006006af10 0x7f006006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.864+0000 7f00717fa640 1 -- 172.21.15.50:0/505774999 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f00640896c0 con 0x7f005c0047c0 2023-12-08T08:18:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.865+0000 7f27db7fe640 1 -- 172.21.15.50:0/3689725957 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f27e4054a10 con 0x7f27f40b1a50 2023-12-08T08:18:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.865+0000 7f0073fff640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f006006af10 0x7f006006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.865+0000 7f5a067fc640 1 -- 172.21.15.50:0/1722275571 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0800fe30 con 0x7f5a100c9930 2023-12-08T08:18:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.865+0000 7f8a05ffb640 1 -- 172.21.15.50:0/3309572389 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a100ce060 con 0x7f8a080e3080 2023-12-08T08:18:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.865+0000 7f5a067fc640 1 -- 172.21.15.50:0/1722275571 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0801d660 con 0x7f5a100c9930 2023-12-08T08:18:22.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.867+0000 7f5a067fc640 1 -- 172.21.15.50:0/1722275571 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a0801d7c0 con 0x7f5a100c9930 2023-12-08T08:18:22.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.867+0000 7f0073fff640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f006006af10 0x7f006006d3d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f006c03d000 tx=0x7f006c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.867+0000 7f5a067fc640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f59f406ae70 0x7f59f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.867+0000 7f5a067fc640 1 -- 172.21.15.50:0/1722275571 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a0808a980 con 0x7f5a100c9930 2023-12-08T08:18:22.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.867+0000 7f5a15fce640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f59f406ae70 0x7f59f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.868+0000 7f5a15fce640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f59f406ae70 0x7f59f406d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a00001bf0 tx=0x7f5a00001b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.869+0000 7f00717fa640 1 -- 172.21.15.50:0/505774999 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0064054460 con 0x7f005c0047c0 2023-12-08T08:18:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.872+0000 7f5a067fc640 1 -- 172.21.15.50:0/1722275571 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a080558d0 con 0x7f5a100c9930 2023-12-08T08:18:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.873+0000 7f15d7fff640 1 -- 172.21.15.50:0/3058997835 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8005ce0 con 0x7f15f006e110 2023-12-08T08:18:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.873+0000 7f15d7fff640 1 -- 172.21.15.50:0/3058997835 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8005e40 con 0x7f15f006e110 2023-12-08T08:18:22.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.873+0000 7f15d7fff640 1 -- 172.21.15.50:0/3058997835 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80072d0 con 0x7f15f006e110 2023-12-08T08:18:22.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.874+0000 7f138affd640 1 -- 172.21.15.50:0/2715727773 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13940c6e80 con 0x7f13940c6080 2023-12-08T08:18:22.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.874+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f0131c20 con 0x7f15f006e110 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.874+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f01f6ff0 con 0x7f15f006e110 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.875+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f00b1060 con 0x7f15f006e110 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.886+0000 7f15d7fff640 1 -- 172.21.15.50:0/3058997835 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15e8007430 con 0x7f15f006e110 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.887+0000 7f15d7fff640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f15dc06af10 0x7f15dc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.887+0000 7f15d7fff640 1 -- 172.21.15.50:0/3058997835 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15e8088de0 con 0x7f15f006e110 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.888+0000 7f15d7fff640 1 -- 172.21.15.50:0/3058997835 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15e8053d80 con 0x7f15f006e110 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.888+0000 7f15eeffd640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f15dc06af10 0x7f15dc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:22.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:22.906+0000 7f15eeffd640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f15dc06af10 0x7f15dc06d3d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15e4036000 tx=0x7f15e4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:23.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.263+0000 7fb58bc52640 1 -- 172.21.15.50:0/3643517227 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb584067ad0 con 0x7fb584159f80 2023-12-08T08:18:23.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.263+0000 7fb57a7fc640 1 -- 172.21.15.50:0/3643517227 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb574079b30 con 0x7fb584159f80 2023-12-08T08:18:23.266 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-08T08:18:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.267+0000 7fb567fff640 1 -- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb56806af10 msgr2=0x7fb56806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.267+0000 7fb567fff640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb56806af10 0x7fb56806d3d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5800012e0 tx=0x7fb5800016f0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.267+0000 7fb567fff640 1 -- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb584159f80 msgr2=0x7fb58414ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.270 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.267+0000 7fb567fff640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb584159f80 0x7fb58414ab90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb574013240 tx=0x7fb5740046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 -- 172.21.15.50:0/3643517227 shutdown_connections 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb56806af10 0x7fb56806d3d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb58415e850 0x7fb58414a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb584159f80 0x7fb58414ab90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 --2- 172.21.15.50:0/3643517227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb58406e0e0 0x7fb5841606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 -- 172.21.15.50:0/3643517227 >> 172.21.15.50:0/3643517227 conn(0x7fb5840b1860 msgr2=0x7fb584071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 -- 172.21.15.50:0/3643517227 shutdown_connections 2023-12-08T08:18:23.271 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.268+0000 7fb567fff640 1 -- 172.21.15.50:0/3643517227 wait complete. 2023-12-08T08:18:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.276+0000 7f27f8977640 1 -- 172.21.15.50:0/3689725957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f27f406c090 con 0x7f27f40b1a50 2023-12-08T08:18:23.278 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.276+0000 7f27db7fe640 1 -- 172.21.15.50:0/3689725957 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27e4058030 con 0x7f27f40b1a50 2023-12-08T08:18:23.279 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-08T08:18:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.280+0000 7f27d97fa640 1 -- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f27e006af40 msgr2=0x7f27e006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.280+0000 7f27d97fa640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f27e006af40 0x7f27e006d400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f27ec035000 tx=0x7f27ec030000 comp rx=0 tx=0).stop 2023-12-08T08:18:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.280+0000 7f27d97fa640 1 -- 172.21.15.50:0/3689725957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b1a50 msgr2=0x7f27f413f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.280+0000 7f27d97fa640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b1a50 0x7f27f413f030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d910 tx=0x7f27e400ddd0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.280+0000 7f27d97fa640 1 -- 172.21.15.50:0/3689725957 shutdown_connections 2023-12-08T08:18:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.280+0000 7f27d97fa640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f27e006af40 0x7f27e006d400 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.281+0000 7f27d97fa640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27f41466d0 0x7f27f4160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.281+0000 7f27d97fa640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27f40b1e30 0x7f27f41f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.281+0000 7f27d97fa640 1 --2- 172.21.15.50:0/3689725957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f27f40b1a50 0x7f27f413f030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.281+0000 7f27d97fa640 1 -- 172.21.15.50:0/3689725957 >> 172.21.15.50:0/3689725957 conn(0x7f27f406a6b0 msgr2=0x7f27f40b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.281+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbc7c04bb50 con 0x7fbc7c053c30 2023-12-08T08:18:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.281+0000 7f27d97fa640 1 -- 172.21.15.50:0/3689725957 shutdown_connections 2023-12-08T08:18:23.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.281+0000 7f27d97fa640 1 -- 172.21.15.50:0/3689725957 wait complete. 2023-12-08T08:18:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.282+0000 7fbc7affd640 1 -- 172.21.15.50:0/721430432 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc7c04bb50 con 0x7fbc7c053c30 2023-12-08T08:18:23.285 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-08T08:18:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.283+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8a080da470 con 0x7f8a080e3080 2023-12-08T08:18:23.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.283+0000 7f8a05ffb640 1 -- 172.21.15.50:0/3309572389 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a100d1680 con 0x7f8a080e3080 2023-12-08T08:18:23.290 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:23.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc6806af40 msgr2=0x7fbc6806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc6806af40 0x7fbc6806d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbc80036000 tx=0x7fbc8003c040 comp rx=0 tx=0).stop 2023-12-08T08:18:23.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c053c30 msgr2=0x7fbc7c04a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c053c30 0x7fbc7c04a200 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400b440 tx=0x7fbc7400b900 comp rx=0 tx=0).stop 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 shutdown_connections 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc6806af40 0x7fbc6806d400 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc7c0d60c0 0x7fbc7c0d6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc7c053c30 0x7fbc7c04a200 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400b440 tx=0x7fbc7400b900 comp rx=0 tx=0).stop 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 --2- 172.21.15.50:0/721430432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc7c033eb0 0x7fbc7c178050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.285+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 >> 172.21.15.50:0/721430432 conn(0x7fbc7c009f70 msgr2=0x7fbc7c0dfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.286+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 shutdown_connections 2023-12-08T08:18:23.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.286+0000 7fbc8b4bb640 1 -- 172.21.15.50:0/721430432 wait complete. 2023-12-08T08:18:23.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89f406aec0 msgr2=0x7f89f406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89f406aec0 0x7f89f406d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c036000 tx=0x7f8a0c008030 comp rx=0 tx=0).stop 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 msgr2=0x7f8a080522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a080522a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8a10050020 tx=0x7f8a10073190 comp rx=0 tx=0).stop 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 shutdown_connections 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89f406aec0 0x7f89f406d380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a080e3080 0x7f8a080522a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a080542c0 0x7f8a080d9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 --2- 172.21.15.50:0/3309572389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a0803e800 0x7f8a0804ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 >> 172.21.15.50:0/3309572389 conn(0x7f8a080559a0 msgr2=0x7f8a08039dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 shutdown_connections 2023-12-08T08:18:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.287+0000 7f8a1751d640 1 -- 172.21.15.50:0/3309572389 wait complete. 2023-12-08T08:18:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.289+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00740cedc0 con 0x7f005c0047c0 2023-12-08T08:18:23.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.290+0000 7f00717fa640 1 -- 172.21.15.50:0/505774999 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0064057a80 con 0x7f005c0047c0 2023-12-08T08:18:23.295 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-08T08:18:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.292+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5a1014da00 con 0x7f5a100c9930 2023-12-08T08:18:23.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f5a067fc640 1 -- 172.21.15.50:0/1722275571 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a08058ef0 con 0x7f5a100c9930 2023-12-08T08:18:23.296 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f006006af10 msgr2=0x7f006006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f006006af10 0x7f006006d3d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f006c03d000 tx=0x7f006c009030 comp rx=0 tx=0).stop 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 msgr2=0x7f00740b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f00740b3200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f006400f4f0 tx=0x7f006400f9b0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 shutdown_connections 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f006006af10 0x7f006006d3d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00740b59f0 0x7f00740b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00740cbd50 0x7f00740cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.293+0000 7f007ad7c640 1 --2- 172.21.15.50:0/505774999 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f005c0047c0 0x7f00740b3200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.294+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 >> 172.21.15.50:0/505774999 conn(0x7f0074099a10 msgr2=0x7f007406b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.294+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 shutdown_connections 2023-12-08T08:18:23.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.294+0000 7f007ad7c640 1 -- 172.21.15.50:0/505774999 wait complete. 2023-12-08T08:18:23.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.294+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15f00673c0 con 0x7f15f006e110 2023-12-08T08:18:23.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.295+0000 7f15d7fff640 1 -- 172.21.15.50:0/3058997835 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15e8017090 con 0x7f15f006e110 2023-12-08T08:18:23.298 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:23.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.296+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f13940c7820 con 0x7f13940c6080 2023-12-08T08:18:23.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.296+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f59f406ae70 msgr2=0x7f59f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.296+0000 7f5a18232640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f59f406ae70 0x7f59f406d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a00001bf0 tx=0x7f5a00001b80 comp rx=0 tx=0).stop 2023-12-08T08:18:23.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.296+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a100c9930 msgr2=0x7f5a10155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.296+0000 7f5a18232640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a100c9930 0x7f5a10155be0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a1015ec30 tx=0x7f5a0800f5a0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f138affd640 1 -- 172.21.15.50:0/2715727773 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13940c7820 con 0x7f13940c6080 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 shutdown_connections 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f59f406ae70 0x7f59f406d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5a100c8ad0 0x7f5a100c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a100c9930 0x7f5a10155be0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 --2- 172.21.15.50:0/1722275571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59fc004120 0x7f5a1014bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 >> 172.21.15.50:0/1722275571 conn(0x7f5a100b1860 msgr2=0x7f5a100b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 shutdown_connections 2023-12-08T08:18:23.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.297+0000 7f5a18232640 1 -- 172.21.15.50:0/1722275571 wait complete. 2023-12-08T08:18:23.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f15dc06af10 msgr2=0x7f15dc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f15dc06af10 0x7f15dc06d3d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f15e4036000 tx=0x7f15e4008030 comp rx=0 tx=0).stop 2023-12-08T08:18:23.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f006e110 msgr2=0x7f15f01f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f006e110 0x7f15f01f6570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c410 tx=0x7f15e800c8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 shutdown_connections 2023-12-08T08:18:23.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f15dc06af10 0x7f15dc06d3d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15f01423b0 0x7f15f01598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15f0070730 0x7f15f01f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 --2- 172.21.15.50:0/3058997835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15f006e110 0x7f15f01f6570 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 >> 172.21.15.50:0/3058997835 conn(0x7f15f00b0750 msgr2=0x7f15f0133190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.298+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 shutdown_connections 2023-12-08T08:18:23.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.299+0000 7f15f4c71640 1 -- 172.21.15.50:0/3058997835 wait complete. 2023-12-08T08:18:23.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.300+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f137806af30 msgr2=0x7f137806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.300+0000 7f139c30f640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f137806af30 0x7f137806d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f138c0124b0 tx=0x7f138c00b040 comp rx=0 tx=0).stop 2023-12-08T08:18:23.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.300+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13940c6080 msgr2=0x7f13940cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:23.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.300+0000 7f139c30f640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13940c6080 0x7f13940cbd90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f13940b17f0 tx=0x7f139000c8e0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-12-08T08:18:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.302+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 shutdown_connections 2023-12-08T08:18:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.302+0000 7f139c30f640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f137806af30 0x7f137806d3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.302+0000 7f139c30f640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13940c6080 0x7f13940cbd90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.302+0000 7f139c30f640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13941514b0 0x7f13940c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.302+0000 7f139c30f640 1 --2- 172.21.15.50:0/2715727773 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13800047c0 0x7f139414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:23.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.302+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 >> 172.21.15.50:0/2715727773 conn(0x7f13940b1860 msgr2=0x7f1394158000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:23.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.304+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 shutdown_connections 2023-12-08T08:18:23.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:23.304+0000 7f139c30f640 1 -- 172.21.15.50:0/2715727773 wait complete. 2023-12-08T08:18:23.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-12-08T08:18:23.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-12-08T08:18:23.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-12-08T08:18:23.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-12-08T08:18:23.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-12-08T08:18:23.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-12-08T08:18:24.294 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:18:24.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-08T08:18:24.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-08T08:18:24.311 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-08T08:18:24.317 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-08T08:18:24.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-08T08:18:24.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-08T08:18:24.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-08T08:18:24.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:24.427 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:24.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.480+0000 7f5b1ca9b640 1 Processor -- start 2023-12-08T08:18:24.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.480+0000 7f5b1ca9b640 1 -- start start 2023-12-08T08:18:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.482+0000 7f5b1ca9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b180cf3d0 0x7f5b18161970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.482+0000 7f5b1ca9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5b1814b000 0x7f5b18161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.482+0000 7f5b1ca9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1806c830 con 0x7f5b1814ac20 2023-12-08T08:18:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.482+0000 7f5b1ca9b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b181629d0 con 0x7f5b1814b000 2023-12-08T08:18:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.482+0000 7f5b1ca9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181626f0 con 0x7f5b180cf3d0 2023-12-08T08:18:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.482+0000 7f5b1659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b1814ac20 0x7f5b180cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35216/0 (socket says 172.21.15.50:35216) 2023-12-08T08:18:24.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.482+0000 7f5b1659c640 1 -- 172.21.15.50:0/3729551045 learned_addr learned my addr 172.21.15.50:0/3729551045 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:24.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.486+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336834276 0 0) 0x7f5b1806c830 con 0x7f5b1814ac20 2023-12-08T08:18:24.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.486+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b00003520 con 0x7f5b1814ac20 2023-12-08T08:18:24.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480643211 0 0) 0x7f5b00003520 con 0x7f5b1814ac20 2023-12-08T08:18:24.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b180cf3d0 msgr2=0x7f5b18161970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:18:24.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b180cf3d0 0x7f5b18161970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 >> v2:172.21.15.170:3300/0 conn(0x7f5b1814b000 msgr2=0x7f5b18161eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 --2- 172.21.15.50:0/3729551045 >> v2:172.21.15.170:3300/0 conn(0x7f5b1814b000 0x7f5b18161eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1806c1e0 con 0x7f5b1814ac20 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f5b08001670 con 0x7f5b1814ac20 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 >> v1:172.21.15.50:6789/0 conn(0x7f5b1814ac20 legacy=0x7f5b180cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000047c0 0x7f5b00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b000052a0 0x7f5b0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181629d0 con 0x7f5b000047c0 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181626f0 con 0x7f5b000052a0 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.487+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0000c1d0 con 0x7f5b00003970 2023-12-08T08:18:24.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.488+0000 7f5b1659c640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.489+0000 7f5b16d9d640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b000052a0 0x7f5b0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.489+0000 7f5b1659c640 1 -- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b000052a0 msgr2=0x7f5b0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.489+0000 7f5b1659c640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b000052a0 0x7f5b0000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.489+0000 7f5b1659c640 1 -- 172.21.15.50:0/3729551045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000047c0 msgr2=0x7f5b00004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-08T08:18:24.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.490+0000 7f5b15d9b640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000047c0 0x7f5b00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.490+0000 7f5b1659c640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000047c0 0x7f5b00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.490+0000 7f5b1659c640 1 -- 172.21.15.50:0/3729551045 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b00003520 con 0x7f5b00003970 2023-12-08T08:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.491+0000 7f5b15d9b640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b000047c0 0x7f5b00004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:24.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.491+0000 7f5b1659c640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b00003d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c190 tx=0x7f5b000057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67aa53eaa02ef3dd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.491+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08005ad0 con 0x7f5b00003970 2023-12-08T08:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.492+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08005c30 con 0x7f5b00003970 2023-12-08T08:18:24.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.492+0000 7f5b1559a640 1 -- 172.21.15.50:0/3729551045 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0802ca70 con 0x7f5b00003970 2023-12-08T08:18:24.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.493+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 msgr2=0x7f5b00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.493+0000 7f5b1ca9b640 1 --2- 172.21.15.50:0/3729551045 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b00003d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c190 tx=0x7f5b000057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.493+0000 7f5b16d9d640 1 -- 172.21.15.50:0/3729551045 reap_dead start 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.493+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/3729551045 shutdown_connections 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.493+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/3729551045 >> 172.21.15.50:0/3729551045 conn(0x7f5b1806a4d0 msgr2=0x7f5b1806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.494+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/3729551045 shutdown_connections 2023-12-08T08:18:24.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.494+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/3729551045 wait complete. 2023-12-08T08:18:24.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.496+0000 7f5b1ca9b640 1 Processor -- start 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.496+0000 7f5b1ca9b640 1 -- start start 2023-12-08T08:18:24.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.497+0000 7f5b1ca9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b180b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.497+0000 7f5b1ca9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b180af730 0x7f5b18157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.497+0000 7f5b1ca9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b18144f30 0x7f5b181453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.500+0000 7f5b16d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b18144f30 0x7f5b181453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.500+0000 7f5b16d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b18144f30 0x7f5b181453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57378/0 (socket says 172.21.15.50:57378) 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.500+0000 7f5b16d9d640 1 -- 172.21.15.50:0/905321902 learned_addr learned my addr 172.21.15.50:0/905321902 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.500+0000 7f5b1659c640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b180b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181458f0 con 0x7f5b18144f30 2023-12-08T08:18:24.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18158590 con 0x7f5b180af730 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181f6db0 con 0x7f5b00003970 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b16d9d640 1 -- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 msgr2=0x7f5b180b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b16d9d640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b180b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b16d9d640 1 -- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b180af730 msgr2=0x7f5b18157d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b16d9d640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b180af730 0x7f5b18157d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.501+0000 7f5b16d9d640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b181587c0 con 0x7f5b18144f30 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.502+0000 7f5b16d9d640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b18144f30 0x7f5b181453b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b180b35d0 tx=0x7f5b1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.502+0000 7f5b1659c640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b180b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:24.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.503+0000 7f5b06ffd640 1 -- 172.21.15.50:0/905321902 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000cd50 con 0x7f5b18144f30 2023-12-08T08:18:24.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.503+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b18158aa0 con 0x7f5b18144f30 2023-12-08T08:18:24.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.503+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b18159060 con 0x7f5b18144f30 2023-12-08T08:18:24.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.505+0000 7f5b06ffd640 1 -- 172.21.15.50:0/905321902 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1000ced0 con 0x7f5b18144f30 2023-12-08T08:18:24.508 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.505+0000 7f5b06ffd640 1 -- 172.21.15.50:0/905321902 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10017680 con 0x7f5b18144f30 2023-12-08T08:18:24.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.507+0000 7f5b06ffd640 1 -- 172.21.15.50:0/905321902 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b10020430 con 0x7f5b18144f30 2023-12-08T08:18:24.509 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.507+0000 7f5b06ffd640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5af806af10 0x7f5af806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.508+0000 7f5b1659c640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5af806af10 0x7f5af806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.508+0000 7f5b06ffd640 1 -- 172.21.15.50:0/905321902 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b10008070 con 0x7f5b18144f30 2023-12-08T08:18:24.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.508+0000 7f5b1659c640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5af806af10 0x7f5af806d3d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b08034000 tx=0x7f5b08007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.509+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc005250 con 0x7f5b18144f30 2023-12-08T08:18:24.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.518+0000 7f5b06ffd640 1 -- 172.21.15.50:0/905321902 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b10058a00 con 0x7f5b18144f30 2023-12-08T08:18:24.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.523+0000 7f3318db5640 1 Processor -- start 2023-12-08T08:18:24.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.523+0000 7f3318db5640 1 -- start start 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.524+0000 7f3318db5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f330c0df7c0 0x7f330c055cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.524+0000 7f3318db5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c04fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.524+0000 7f3318db5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c006bf0 con 0x7f330c03a060 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.524+0000 7f3318db5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c006ed0 con 0x7f330c0df7c0 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.524+0000 7f3318db5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0071b0 con 0x7f330c036660 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f3312ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c04fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f3312ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c04fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37606/0 (socket says 172.21.15.50:37606) 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f3312ffd640 1 -- 172.21.15.50:0/3123059950 learned_addr learned my addr 172.21.15.50:0/3123059950 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f33137fe640 1 --2- 172.21.15.50:0/3123059950 >> v2:172.21.15.170:3300/0 conn(0x7f330c0df7c0 0x7f330c055cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f3312ffd640 1 -- 172.21.15.50:0/3123059950 >> v2:172.21.15.170:3300/0 conn(0x7f330c0df7c0 msgr2=0x7f330c055cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f3312ffd640 1 --2- 172.21.15.50:0/3123059950 >> v2:172.21.15.170:3300/0 conn(0x7f330c0df7c0 0x7f330c055cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f3312ffd640 1 -- 172.21.15.50:0/3123059950 >> v1:172.21.15.170:6789/0 conn(0x7f330c03a060 legacy=0x7f330c0079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.525+0000 7f3312ffd640 1 -- 172.21.15.50:0/3123059950 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c007490 con 0x7f330c036660 2023-12-08T08:18:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.526+0000 7f3312ffd640 1 --2- 172.21.15.50:0/3123059950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c04fa00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f330800b970 tx=0x7f330802c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d91ac35f768db5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.526+0000 7f33127fc640 1 -- 172.21.15.50:0/3123059950 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308036400 con 0x7f330c036660 2023-12-08T08:18:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.527+0000 7f33127fc640 1 -- 172.21.15.50:0/3123059950 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3308030070 con 0x7f330c036660 2023-12-08T08:18:24.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.527+0000 7f33127fc640 1 -- 172.21.15.50:0/3123059950 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33080367c0 con 0x7f330c036660 2023-12-08T08:18:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 -- 172.21.15.50:0/3123059950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 msgr2=0x7f330c04fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f1381ddb640 1 Processor -- start 2023-12-08T08:18:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 --2- 172.21.15.50:0/3123059950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c04fa00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f330800b970 tx=0x7f330802c260 comp rx=0 tx=0).stop 2023-12-08T08:18:24.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 -- 172.21.15.50:0/3123059950 shutdown_connections 2023-12-08T08:18:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.527+0000 7f684882a640 1 Processor -- start 2023-12-08T08:18:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.527+0000 7f684882a640 1 -- start start 2023-12-08T08:18:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 --2- 172.21.15.50:0/3123059950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c04fa00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 --2- 172.21.15.50:0/3123059950 >> v2:172.21.15.170:3300/0 conn(0x7f330c0df7c0 0x7f330c055cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 -- 172.21.15.50:0/3123059950 >> 172.21.15.50:0/3123059950 conn(0x7f330c01e680 msgr2=0x7f330c0553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7fa26a460640 1 Processor -- start 2023-12-08T08:18:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7fa26a460640 1 -- start start 2023-12-08T08:18:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f1381ddb640 1 -- start start 2023-12-08T08:18:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 -- 172.21.15.50:0/3123059950 shutdown_connections 2023-12-08T08:18:24.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.528+0000 7f3318db5640 1 -- 172.21.15.50:0/3123059950 wait complete. 2023-12-08T08:18:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1381ddb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137400aa60 0x7f137404fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1381ddb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f137404ff90 0x7f13740e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1381ddb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1374006860 con 0x7f13740df350 2023-12-08T08:18:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1381ddb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1374007730 con 0x7f137404ff90 2023-12-08T08:18:24.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7fa26a460640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa26415e360 0x7fa2640710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1381ddb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1374050420 con 0x7f137400aa60 2023-12-08T08:18:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f684882a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f683c0e11d0 0x7f683c0360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f684882a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c038710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f684882a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683c0545b0 con 0x7f683c0521c0 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f684882a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683c0392e0 con 0x7f683c0e11d0 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f684882a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0395c0 con 0x7f683c051d60 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f6842d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f683c0e11d0 0x7f683c0360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f6842d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f683c0e11d0 0x7f683c0360f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:38036/0 (socket says 172.21.15.50:38036) 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f6842d9d640 1 -- 172.21.15.50:0/2426468423 learned_addr learned my addr 172.21.15.50:0/2426468423 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.529+0000 7f684259c640 1 --2- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c038710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f6842d9d640 1 -- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 msgr2=0x7f683c038710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f6842d9d640 1 --2- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c038710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f6842d9d640 1 -- 172.21.15.50:0/2426468423 >> v1:172.21.15.170:6789/0 conn(0x7f683c0521c0 legacy=0x7f683c039ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f6842d9d640 1 -- 172.21.15.50:0/2426468423 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c051580 con 0x7f683c0e11d0 2023-12-08T08:18:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7fa26a460640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa26415a940 0x7fa26406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1380dd9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137400aa60 0x7f137404fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7fa268c5d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa264071630 0x7fa26415a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51778/0 (socket says 172.21.15.50:51778) 2023-12-08T08:18:24.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7fa268c5d640 1 -- 172.21.15.50:0/822698125 learned_addr learned my addr 172.21.15.50:0/822698125 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1380dd9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137400aa60 0x7f137404fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37632/0 (socket says 172.21.15.50:37632) 2023-12-08T08:18:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f1380dd9640 1 -- 172.21.15.50:0/1476785687 learned_addr learned my addr 172.21.15.50:0/1476785687 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.530+0000 7f13815da640 1 --2- 172.21.15.50:0/1476785687 >> v2:172.21.15.170:3300/0 conn(0x7f137404ff90 0x7f13740e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26415e740 con 0x7fa264071630 2023-12-08T08:18:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7f1380dd9640 1 -- 172.21.15.50:0/1476785687 >> v2:172.21.15.170:3300/0 conn(0x7f137404ff90 msgr2=0x7f13740e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7f1380dd9640 1 --2- 172.21.15.50:0/1476785687 >> v2:172.21.15.170:3300/0 conn(0x7f137404ff90 0x7f13740e9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7f1380dd9640 1 -- 172.21.15.50:0/1476785687 >> v1:172.21.15.50:6789/0 conn(0x7f13740df350 legacy=0x7f1374053220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7f1380dd9640 1 -- 172.21.15.50:0/1476785687 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374006ab0 con 0x7f137400aa60 2023-12-08T08:18:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7fa26945e640 1 --2- 172.21.15.50:0/822698125 >> v2:172.21.15.50:3300/0 conn(0x7fa26415e360 0x7fa2640710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7fa269c5f640 1 --2- 172.21.15.50:0/822698125 >> v2:172.21.15.170:3300/0 conn(0x7fa26415a940 0x7fa26406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26415dbd0 con 0x7fa26415e360 2023-12-08T08:18:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa264071ac0 con 0x7fa26415a940 2023-12-08T08:18:24.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7f6842d9d640 1 --2- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0e11d0 0x7f683c0360f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f683400ffd0 tx=0x7f683403d120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b84fea7e2c2e8a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7f3318db5640 1 Processor -- start 2023-12-08T08:18:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.531+0000 7f3318db5640 1 -- start start 2023-12-08T08:18:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7fa269c5f640 1 -- 172.21.15.50:0/822698125 >> v2:172.21.15.50:3300/0 conn(0x7fa26415e360 msgr2=0x7fa2640710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7fa269c5f640 1 --2- 172.21.15.50:0/822698125 >> v2:172.21.15.50:3300/0 conn(0x7fa26415e360 0x7fa2640710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7fa269c5f640 1 -- 172.21.15.50:0/822698125 >> v1:172.21.15.170:6789/0 conn(0x7fa264071630 legacy=0x7fa26415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7fa269c5f640 1 -- 172.21.15.50:0/822698125 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26415aeb0 con 0x7fa26415a940 2023-12-08T08:18:24.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f1380dd9640 1 --2- 172.21.15.50:0/1476785687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137400aa60 0x7f137404fa50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1368009870 tx=0x7f136802ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409afa2bfad1dbf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f6841d9b640 1 -- 172.21.15.50:0/2426468423 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834045440 con 0x7f683c0e11d0 2023-12-08T08:18:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f6841d9b640 1 -- 172.21.15.50:0/2426468423 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68340455a0 con 0x7f683c0e11d0 2023-12-08T08:18:24.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f6841d9b640 1 -- 172.21.15.50:0/2426468423 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834045930 con 0x7f683c0e11d0 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f137b7fe640 1 -- 172.21.15.50:0/1476785687 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136802f830 con 0x7f137400aa60 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f137b7fe640 1 -- 172.21.15.50:0/1476785687 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136802f990 con 0x7f137400aa60 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f137b7fe640 1 -- 172.21.15.50:0/1476785687 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136802f830 con 0x7f137400aa60 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f3318db5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c0d7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f3318db5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f330c03a060 0x7f330c04a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.532+0000 7f3318db5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f330c0df7c0 0x7f330c0540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f330c03a060 0x7f330c04a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3318db5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c04a750 con 0x7f330c03a060 2023-12-08T08:18:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f330c03a060 0x7f330c04a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57394/0 (socket says 172.21.15.50:57394) 2023-12-08T08:18:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c033ed0 con 0x7f330c0df7c0 2023-12-08T08:18:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 -- 172.21.15.50:0/902103193 learned_addr learned my addr 172.21.15.50:0/902103193 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c049450 con 0x7f330c036660 2023-12-08T08:18:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 -- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0e11d0 msgr2=0x7f683c0360f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 --2- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0e11d0 0x7f683c0360f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f683400ffd0 tx=0x7f683403d120 comp rx=0 tx=0).stop 2023-12-08T08:18:24.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f33137fe640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c0d7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f1381ddb640 1 -- 172.21.15.50:0/1476785687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137400aa60 msgr2=0x7f137404fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f1381ddb640 1 --2- 172.21.15.50:0/1476785687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137400aa60 0x7f137404fa50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1368009870 tx=0x7f136802ba10 comp rx=0 tx=0).stop 2023-12-08T08:18:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 -- 172.21.15.50:0/2426468423 shutdown_connections 2023-12-08T08:18:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 --2- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c038710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 --2- 172.21.15.50:0/2426468423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0e11d0 0x7f683c0360f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 -- 172.21.15.50:0/2426468423 >> 172.21.15.50:0/2426468423 conn(0x7f683c053710 msgr2=0x7f683c053b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 -- 172.21.15.50:0/2426468423 shutdown_connections 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f684882a640 1 -- 172.21.15.50:0/2426468423 wait complete. 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3313fff640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f330c0df7c0 0x7f330c0540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 -- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 msgr2=0x7f330c0d7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c0d7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 -- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f330c0df7c0 msgr2=0x7f330c0540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f330c0df7c0 0x7f330c0540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 -- 172.21.15.50:0/902103193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330800b5d0 con 0x7f330c03a060 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7f3312ffd640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f330c03a060 0x7f330c04a210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f330802c2a0 tx=0x7f33080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f32fffff640 1 -- 172.21.15.50:0/902103193 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308041680 con 0x7f330c03a060 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f32fffff640 1 -- 172.21.15.50:0/902103193 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33080417e0 con 0x7f330c03a060 2023-12-08T08:18:24.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f32fffff640 1 -- 172.21.15.50:0/902103193 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3308041b50 con 0x7f330c03a060 2023-12-08T08:18:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7fa269c5f640 1 --2- 172.21.15.50:0/822698125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415a940 0x7fa26406dc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa2640b48e0 tx=0x7fa25c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90befc7192656d53 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c049730 con 0x7f330c03a060 2023-12-08T08:18:24.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f1381ddb640 1 -- 172.21.15.50:0/1476785687 shutdown_connections 2023-12-08T08:18:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c049cf0 con 0x7f330c03a060 2023-12-08T08:18:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7fa25bfff640 1 -- 172.21.15.50:0/822698125 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c02cc90 con 0x7fa26415a940 2023-12-08T08:18:24.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7fa25bfff640 1 -- 172.21.15.50:0/822698125 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c02cdf0 con 0x7fa26415a940 2023-12-08T08:18:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f1381ddb640 1 --2- 172.21.15.50:0/1476785687 >> v2:172.21.15.170:3300/0 conn(0x7f137404ff90 0x7f13740e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f1381ddb640 1 --2- 172.21.15.50:0/1476785687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137400aa60 0x7f137404fa50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7f1381ddb640 1 -- 172.21.15.50:0/1476785687 >> 172.21.15.50:0/1476785687 conn(0x7f1374009f70 msgr2=0x7f137400a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.533+0000 7fa25bfff640 1 -- 172.21.15.50:0/822698125 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c034660 con 0x7fa26415a940 2023-12-08T08:18:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415a940 msgr2=0x7fa26406dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.534+0000 7fa26a460640 1 --2- 172.21.15.50:0/822698125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415a940 0x7fa26406dc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa2640b48e0 tx=0x7fa25c02bee0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7f1381ddb640 1 -- 172.21.15.50:0/1476785687 shutdown_connections 2023-12-08T08:18:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 shutdown_connections 2023-12-08T08:18:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7fa26a460640 1 --2- 172.21.15.50:0/822698125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415a940 0x7fa26406dc90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7fa26a460640 1 --2- 172.21.15.50:0/822698125 >> v2:172.21.15.50:3300/0 conn(0x7fa26415e360 0x7fa2640710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 >> 172.21.15.50:0/822698125 conn(0x7fa2640b1860 msgr2=0x7fa2640b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7f1381ddb640 1 -- 172.21.15.50:0/1476785687 wait complete. 2023-12-08T08:18:24.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7fe595f27640 1 Processor -- start 2023-12-08T08:18:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7f684882a640 1 Processor -- start 2023-12-08T08:18:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 shutdown_connections 2023-12-08T08:18:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.535+0000 7fe595f27640 1 -- start start 2023-12-08T08:18:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe595f27640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5880362c0 0x7fe58800dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.536+0000 7f684882a640 1 -- start start 2023-12-08T08:18:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f684882a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c0e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f1381ddb640 1 Processor -- start 2023-12-08T08:18:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe595f27640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe588049bd0 0x7fe58800e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f684882a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0521c0 0x7f683c04a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f1381ddb640 1 -- start start 2023-12-08T08:18:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f6842d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c0e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f6842d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c0e3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37650/0 (socket says 172.21.15.50:37650) 2023-12-08T08:18:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe595f27640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe588055920 con 0x7fe588056750 2023-12-08T08:18:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe595f27640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe588055490 con 0x7fe588049bd0 2023-12-08T08:18:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe595f27640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe588054880 con 0x7fe5880362c0 2023-12-08T08:18:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe594f25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5880362c0 0x7fe58800dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe594f25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5880362c0 0x7fe58800dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:38072/0 (socket says 172.21.15.50:38072) 2023-12-08T08:18:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe594f25640 1 -- 172.21.15.50:0/3481627523 learned_addr learned my addr 172.21.15.50:0/3481627523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f6842d9d640 1 -- 172.21.15.50:0/2197642948 learned_addr learned my addr 172.21.15.50:0/2197642948 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fe595726640 1 --2- 172.21.15.50:0/3481627523 >> v2:172.21.15.50:3300/0 conn(0x7fe588049bd0 0x7fe58800e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f684882a640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f683c0e11d0 0x7f683c0d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f684882a640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0e4300 con 0x7f683c0e11d0 2023-12-08T08:18:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f684882a640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c04ad00 con 0x7f683c0521c0 2023-12-08T08:18:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f684882a640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0d55e0 con 0x7f683c051d60 2023-12-08T08:18:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f684259c640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0521c0 0x7f683c04a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7fe594f25640 1 -- 172.21.15.50:0/3481627523 >> v2:172.21.15.50:3300/0 conn(0x7fe588049bd0 msgr2=0x7fe58800e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7fe594f25640 1 --2- 172.21.15.50:0/3481627523 >> v2:172.21.15.50:3300/0 conn(0x7fe588049bd0 0x7fe58800e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7fe594f25640 1 -- 172.21.15.50:0/3481627523 >> v1:172.21.15.50:6789/0 conn(0x7fe588056750 legacy=0x7fe5880eb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7fe594f25640 1 -- 172.21.15.50:0/3481627523 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588054b60 con 0x7fe5880362c0 2023-12-08T08:18:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f684359e640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f683c0e11d0 0x7f683c0d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f32fffff640 1 -- 172.21.15.50:0/902103193 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3308041cb0 con 0x7f330c03a060 2023-12-08T08:18:24.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c049ee0 con 0x7f330c03a060 2023-12-08T08:18:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f1381ddb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137400aa60 0x7f1374039940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.538+0000 7f1381ddb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137404ff90 0x7f13740ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f1381ddb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13740df350 0x7f13740344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f684359e640 1 -- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 msgr2=0x7f683c0e3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f684359e640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c0e3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f684359e640 1 -- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0521c0 msgr2=0x7f683c04a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f684359e640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0521c0 0x7f683c04a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f684359e640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683400fd00 con 0x7f683c0e11d0 2023-12-08T08:18:24.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f1381ddb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740ce310 con 0x7f137400aa60 2023-12-08T08:18:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f1381ddb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1374039e80 con 0x7f13740df350 2023-12-08T08:18:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f1381ddb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137404bb50 con 0x7f137404ff90 2023-12-08T08:18:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f684359e640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f683c0e11d0 0x7f683c0d50a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6844068ee0 tx=0x7f6844073190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.537+0000 7fa26a460640 1 -- 172.21.15.50:0/822698125 wait complete. 2023-12-08T08:18:24.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f13815da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13740df350 0x7f13740344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7fa26a460640 1 Processor -- start 2023-12-08T08:18:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f1380dd9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137400aa60 0x7f1374039940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f32fffff640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f32f806af10 0x7f32f806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f13815da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13740df350 0x7f13740344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:38104/0 (socket says 172.21.15.50:38104) 2023-12-08T08:18:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f13815da640 1 -- 172.21.15.50:0/558719377 learned_addr learned my addr 172.21.15.50:0/558719377 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f1380dd9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137400aa60 0x7f1374039940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57426/0 (socket says 172.21.15.50:57426) 2023-12-08T08:18:24.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f32fffff640 1 -- 172.21.15.50:0/902103193 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33080aca80 con 0x7f330c03a060 2023-12-08T08:18:24.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.539+0000 7f137bfff640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137404ff90 0x7f13740ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7fe594f25640 1 --2- 172.21.15.50:0/3481627523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5880362c0 0x7fe58800dc30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe58800e8f0 tx=0x7fe58402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eca4160a5ed5357 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f13815da640 1 -- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137404ff90 msgr2=0x7f13740ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f13815da640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137404ff90 0x7f13740ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f13815da640 1 -- 172.21.15.50:0/558719377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137400aa60 msgr2=0x7f1374039940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f13815da640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137400aa60 0x7f1374039940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f13815da640 1 -- 172.21.15.50:0/558719377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680094d0 con 0x7f13740df350 2023-12-08T08:18:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7fe58f7fe640 1 -- 172.21.15.50:0/3481627523 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584030860 con 0x7fe5880362c0 2023-12-08T08:18:24.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7fe58f7fe640 1 -- 172.21.15.50:0/3481627523 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5840309c0 con 0x7fe5880362c0 2023-12-08T08:18:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7f13815da640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13740df350 0x7f13740344e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f137c064180 tx=0x7f137c073190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fe58f7fe640 1 -- 172.21.15.50:0/3481627523 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584030d50 con 0x7fe5880362c0 2023-12-08T08:18:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.540+0000 7fa26a460640 1 -- start start 2023-12-08T08:18:24.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7f13797fa640 1 -- 172.21.15.50:0/558719377 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c06bc90 con 0x7f13740df350 2023-12-08T08:18:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7f33137fe640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f32f806af10 0x7f32f806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7f13797fa640 1 -- 172.21.15.50:0/558719377 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c071050 con 0x7f13740df350 2023-12-08T08:18:24.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7f13797fa640 1 -- 172.21.15.50:0/558719377 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c072400 con 0x7f13740df350 2023-12-08T08:18:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26a460640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa264071630 0x7fa264141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26a460640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26415a940 0x7fa2641499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26945e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa264071630 0x7fa264141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7f1381ddb640 1 -- 172.21.15.50:0/558719377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13740cd2b0 con 0x7f13740df350 2023-12-08T08:18:24.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26945e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa264071630 0x7fa264141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37680/0 (socket says 172.21.15.50:37680) 2023-12-08T08:18:24.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fe595f27640 1 -- 172.21.15.50:0/3481627523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5880362c0 msgr2=0x7fe58800dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fe595f27640 1 --2- 172.21.15.50:0/3481627523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5880362c0 0x7fe58800dc30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe58800e8f0 tx=0x7fe58402b9a0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa268c5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26415a940 0x7fa2641499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa268c5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26415a940 0x7fa2641499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57428/0 (socket says 172.21.15.50:57428) 2023-12-08T08:18:24.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26a460640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415e360 0x7fa26406db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fe595f27640 1 -- 172.21.15.50:0/3481627523 shutdown_connections 2023-12-08T08:18:24.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fe595f27640 1 --2- 172.21.15.50:0/3481627523 >> v2:172.21.15.50:3300/0 conn(0x7fe588049bd0 0x7fe58800e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fe595f27640 1 --2- 172.21.15.50:0/3481627523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5880362c0 0x7fe58800dc30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fe595f27640 1 -- 172.21.15.50:0/3481627523 >> 172.21.15.50:0/3481627523 conn(0x7fe588056cb0 msgr2=0x7fe5880570c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7f1381ddb640 1 -- 172.21.15.50:0/558719377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374038b20 con 0x7f13740df350 2023-12-08T08:18:24.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.542+0000 7fe595f27640 1 -- 172.21.15.50:0/3481627523 shutdown_connections 2023-12-08T08:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.542+0000 7fe595f27640 1 -- 172.21.15.50:0/3481627523 wait complete. 2023-12-08T08:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26a460640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa264142000 con 0x7fa26415a940 2023-12-08T08:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26a460640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26414a3d0 con 0x7fa26415e360 2023-12-08T08:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.541+0000 7fa26a460640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26414a6b0 con 0x7fa264071630 2023-12-08T08:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.542+0000 7fa268c5d640 1 -- 172.21.15.50:0/2215876948 learned_addr learned my addr 172.21.15.50:0/2215876948 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.542+0000 7fa269c5f640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415e360 0x7fa26406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.542+0000 7f33137fe640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f32f806af10 0x7f32f806d3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f330000dc30 tx=0x7f330000f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7fa268c5d640 1 -- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa264071630 msgr2=0x7fa264141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7fa268c5d640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa264071630 0x7fa264141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7f1381ddb640 1 -- 172.21.15.50:0/558719377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137404f8c0 con 0x7f13740df350 2023-12-08T08:18:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7fa268c5d640 1 -- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415e360 msgr2=0x7fa26406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7fa268c5d640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415e360 0x7fa26406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7fa268c5d640 1 -- 172.21.15.50:0/2215876948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c009a70 con 0x7fa26415a940 2023-12-08T08:18:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7fa268c5d640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26415a940 0x7fa2641499f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c700 tx=0x7fa26000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7f13797fa640 1 -- 172.21.15.50:0/558719377 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f137c090070 con 0x7f13740df350 2023-12-08T08:18:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.543+0000 7fe595f27640 1 Processor -- start 2023-12-08T08:18:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.544+0000 7fe595f27640 1 -- start start 2023-12-08T08:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.544+0000 7f13797fa640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f136006af10 0x7f136006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.544+0000 7f13797fa640 1 -- 172.21.15.50:0/558719377 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f137c103530 con 0x7f13740df350 2023-12-08T08:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.544+0000 7f1380dd9640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f136006af10 0x7f136006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7f1380dd9640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f136006af10 0x7f136006d3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1368036000 tx=0x7f1368008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe595f27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5880362c0 0x7fe5880366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe595f27640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe588049bd0 0x7fe5880e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe594f25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5880362c0 0x7fe5880366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe594f25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5880362c0 0x7fe5880366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57444/0 (socket says 172.21.15.50:57444) 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe594f25640 1 -- 172.21.15.50:0/4177780468 learned_addr learned my addr 172.21.15.50:0/4177780468 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe595f27640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe588056750 0x7fe58804cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58804b320 con 0x7fe5880362c0 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58804e830 con 0x7fe588049bd0 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58804eb10 con 0x7fe588056750 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.545+0000 7fe58ffff640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe588049bd0 0x7fe5880e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe595726640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe588056750 0x7fe58804cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe58ffff640 1 -- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe588056750 msgr2=0x7fe58804cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe58ffff640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe588056750 0x7fe58804cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe58ffff640 1 -- 172.21.15.50:0/4177780468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5880362c0 msgr2=0x7fe5880366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe58ffff640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5880362c0 0x7fe5880366a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe58ffff640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840094d0 con 0x7fe588049bd0 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe594f25640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5880362c0 0x7fe5880366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7fe58ffff640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe588049bd0 0x7fe5880e6010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c340 tx=0x7fe57c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.546+0000 7f682b7fe640 1 -- 172.21.15.50:0/2197642948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684406bc90 con 0x7f683c0e11d0 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.547+0000 7f684882a640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c0e4550 con 0x7f683c0e11d0 2023-12-08T08:18:24.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.547+0000 7f684882a640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683c0dd540 con 0x7f683c0e11d0 2023-12-08T08:18:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.547+0000 7fa259ffb640 1 -- 172.21.15.50:0/2215876948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260005ab0 con 0x7fa26415a940 2023-12-08T08:18:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.547+0000 7fa259ffb640 1 -- 172.21.15.50:0/2215876948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa260005c10 con 0x7fa26415a940 2023-12-08T08:18:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.547+0000 7fa259ffb640 1 -- 172.21.15.50:0/2215876948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000ce10 con 0x7fa26415a940 2023-12-08T08:18:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.548+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26414a990 con 0x7fa26415a940 2023-12-08T08:18:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.548+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26414af50 con 0x7fa26415a940 2023-12-08T08:18:24.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.547+0000 7f32fffff640 1 -- 172.21.15.50:0/902103193 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33080778b0 con 0x7f330c03a060 2023-12-08T08:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.548+0000 7fb971a85640 1 Processor -- start 2023-12-08T08:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.548+0000 7fb971a85640 1 -- start start 2023-12-08T08:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.548+0000 7f682b7fe640 1 -- 172.21.15.50:0/2197642948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684406bdf0 con 0x7f683c0e11d0 2023-12-08T08:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.548+0000 7f682b7fe640 1 -- 172.21.15.50:0/2197642948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68440723e0 con 0x7f683c0e11d0 2023-12-08T08:18:24.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.549+0000 7f13797fa640 1 -- 172.21.15.50:0/558719377 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f137c0ce2f0 con 0x7f13740df350 2023-12-08T08:18:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.549+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6824005250 con 0x7f683c0e11d0 2023-12-08T08:18:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.549+0000 7fe58d7fa640 1 -- 172.21.15.50:0/4177780468 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0052d0 con 0x7fe588049bd0 2023-12-08T08:18:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7f78a642e640 1 Processor -- start 2023-12-08T08:18:24.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26414b160 con 0x7fa26415a940 2023-12-08T08:18:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb971a85640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb96c0cf1f0 0x7fb96c0cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb971a85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0aeaa0 0x7fb96c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb970a83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb96c0cf1f0 0x7fb96c0cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7f682b7fe640 1 -- 172.21.15.50:0/2197642948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6844072540 con 0x7f683c0e11d0 2023-12-08T08:18:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58804b5c0 con 0x7fe588049bd0 2023-12-08T08:18:24.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58804edf0 con 0x7fe588049bd0 2023-12-08T08:18:24.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fe58d7fa640 1 -- 172.21.15.50:0/4177780468 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c005450 con 0x7fe588049bd0 2023-12-08T08:18:24.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb970a83640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb96c0cf1f0 0x7fb96c0cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57456/0 (socket says 172.21.15.50:57456) 2023-12-08T08:18:24.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb970a83640 1 -- 172.21.15.50:0/2316096623 learned_addr learned my addr 172.21.15.50:0/2316096623 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c073bc0 con 0x7fb96c0cd470 2023-12-08T08:18:24.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c06d420 con 0x7fb96c0cf1f0 2023-12-08T08:18:24.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0b1bd0 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7f682b7fe640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f683006ae40 0x7f683006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.550+0000 7f78a642e640 1 -- start start 2023-12-08T08:18:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.551+0000 7f6842d9d640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f683006ae40 0x7f683006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.551+0000 7f682b7fe640 1 -- 172.21.15.50:0/2197642948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6844103060 con 0x7f683c0e11d0 2023-12-08T08:18:24.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.551+0000 7fe58d7fa640 1 -- 172.21.15.50:0/4177780468 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c007260 con 0x7fe588049bd0 2023-12-08T08:18:24.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f6842d9d640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f683006ae40 0x7f683006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f683403d160 tx=0x7f6834041000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7fb963fff640 1 --2- 172.21.15.50:0/2316096623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0aeaa0 0x7fb96c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a642e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a0144340 0x7f78a00cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a642e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00cf600 con 0x7f78a00cf1a0 2023-12-08T08:18:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a642e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a0164ff0 con 0x7f78a0162110 2023-12-08T08:18:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a642e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a01625a0 con 0x7f78a0144340 2023-12-08T08:18:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a542c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a0144340 0x7f78a00cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a542c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a0144340 0x7f78a00cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37704/0 (socket says 172.21.15.50:37704) 2023-12-08T08:18:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a542c640 1 -- 172.21.15.50:0/1036618954 learned_addr learned my addr 172.21.15.50:0/1036618954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7fb970a83640 1 -- 172.21.15.50:0/2316096623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0aeaa0 msgr2=0x7fb96c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7fb970a83640 1 --2- 172.21.15.50:0/2316096623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0aeaa0 0x7fb96c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7fb970a83640 1 -- 172.21.15.50:0/2316096623 >> v1:172.21.15.50:6789/0 conn(0x7fb96c0cd470 legacy=0x7fb96c06d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7fb970a83640 1 -- 172.21.15.50:0/2316096623 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c06cda0 con 0x7fb96c0cf1f0 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a542c640 1 -- 172.21.15.50:0/1036618954 >> v1:172.21.15.170:6789/0 conn(0x7f78a0162110 legacy=0x7f78a0146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a542c640 1 -- 172.21.15.50:0/1036618954 >> v1:172.21.15.50:6789/0 conn(0x7f78a00cf1a0 legacy=0x7f78a0161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7f78a542c640 1 -- 172.21.15.50:0/1036618954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a01627c0 con 0x7f78a0144340 2023-12-08T08:18:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7fa259ffb640 1 -- 172.21.15.50:0/2215876948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa260007070 con 0x7fa26415a940 2023-12-08T08:18:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.552+0000 7fa259ffb640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa24806ae40 0x7fa24806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.553+0000 7fa259ffb640 1 -- 172.21.15.50:0/2215876948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa260088da0 con 0x7fa26415a940 2023-12-08T08:18:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.553+0000 7fa26945e640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa24806ae40 0x7fa24806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.553+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe570005250 con 0x7fe588049bd0 2023-12-08T08:18:24.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.554+0000 7fa26945e640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa24806ae40 0x7fa24806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa254009aa0 tx=0x7fa254009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.554+0000 7fb970a83640 1 --2- 172.21.15.50:0/2316096623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0cf1f0 0x7fb96c0cf5d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009870 tx=0x7fb95c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311dedd3835aaf51 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.554+0000 7f78a542c640 1 --2- 172.21.15.50:0/1036618954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a0144340 0x7f78a00cec60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7898009e80 tx=0x7f789802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23582b8f55c76be3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.554+0000 7f7897fff640 1 -- 172.21.15.50:0/1036618954 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789802c9c0 con 0x7f78a0144340 2023-12-08T08:18:24.587 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.554+0000 7f7897fff640 1 -- 172.21.15.50:0/1036618954 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789802cb20 con 0x7f78a0144340 2023-12-08T08:18:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.554+0000 7fe58d7fa640 1 -- 172.21.15.50:0/4177780468 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe57c0073c0 con 0x7fe588049bd0 2023-12-08T08:18:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.554+0000 7fe58d7fa640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe57406ae90 0x7fe57406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f7897fff640 1 -- 172.21.15.50:0/1036618954 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980343f0 con 0x7f78a0144340 2023-12-08T08:18:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7fe594f25640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe57406ae90 0x7fe57406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7fe58d7fa640 1 -- 172.21.15.50:0/4177780468 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe57c088c00 con 0x7fe588049bd0 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f78a642e640 1 -- 172.21.15.50:0/1036618954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a0144340 msgr2=0x7f78a00cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f78a642e640 1 --2- 172.21.15.50:0/1036618954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a0144340 0x7f78a00cec60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7898009e80 tx=0x7f789802be20 comp rx=0 tx=0).stop 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f78a642e640 1 -- 172.21.15.50:0/1036618954 shutdown_connections 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f78a642e640 1 --2- 172.21.15.50:0/1036618954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a0144340 0x7f78a00cec60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f78a642e640 1 -- 172.21.15.50:0/1036618954 >> 172.21.15.50:0/1036618954 conn(0x7f78a006a6b0 msgr2=0x7f78a006aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f78a642e640 1 -- 172.21.15.50:0/1036618954 shutdown_connections 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7f78a642e640 1 -- 172.21.15.50:0/1036618954 wait complete. 2023-12-08T08:18:24.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.555+0000 7fe594f25640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe57406ae90 0x7fe57406d350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe58402b9e0 tx=0x7fe584008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.557+0000 7f78a642e640 1 Processor -- start 2023-12-08T08:18:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.557+0000 7f78a642e640 1 -- start start 2023-12-08T08:18:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.558+0000 7f78a642e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a00cf1a0 0x7f78a015f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a642e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0144340 0x7f78a01f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a642e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a0162110 0x7f78a01f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a642e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a015fd50 con 0x7f78a0162110 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a642e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a01f8030 con 0x7f78a0144340 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a642e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a01f8310 con 0x7f78a00cf1a0 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a542c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a00cf1a0 0x7f78a015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a5c2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a0162110 0x7f78a01f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a542c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a00cf1a0 0x7f78a015f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:37716/0 (socket says 172.21.15.50:37716) 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a542c640 1 -- 172.21.15.50:0/2093888916 learned_addr learned my addr 172.21.15.50:0/2093888916 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7fe58d7fa640 1 -- 172.21.15.50:0/4177780468 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe57c053a40 con 0x7fe588049bd0 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a4c2b640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0144340 0x7f78a01f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a4c2b640 1 -- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a00cf1a0 msgr2=0x7f78a015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a4c2b640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a00cf1a0 0x7f78a015f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.559+0000 7f78a4c2b640 1 -- 172.21.15.50:0/2093888916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a0162110 msgr2=0x7f78a01f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.561+0000 7f78a4c2b640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a0162110 0x7f78a01f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.561+0000 7f78a4c2b640 1 -- 172.21.15.50:0/2093888916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009b30 con 0x7f78a0144340 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.561+0000 7f78a542c640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a00cf1a0 0x7f78a015f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:24.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.561+0000 7f78a5c2d640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a0162110 0x7f78a01f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:24.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.561+0000 7f682b7fe640 1 -- 172.21.15.50:0/2197642948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68440cdd30 con 0x7f683c0e11d0 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.562+0000 7f78a4c2b640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0144340 0x7f78a01f7450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c410 tx=0x7f789c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.562+0000 7f7895ffb640 1 -- 172.21.15.50:0/2093888916 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c0035f0 con 0x7f78a0144340 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.562+0000 7f7895ffb640 1 -- 172.21.15.50:0/2093888916 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c003770 con 0x7f78a0144340 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.562+0000 7f7895ffb640 1 -- 172.21.15.50:0/2093888916 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c003b60 con 0x7f78a0144340 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.562+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a01f85f0 con 0x7f78a0144340 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.563+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a01f8bb0 con 0x7f78a0144340 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.564+0000 7f7895ffb640 1 -- 172.21.15.50:0/2093888916 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f789c003cc0 con 0x7f78a0144340 2023-12-08T08:18:24.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.564+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a00673c0 con 0x7f78a0144340 2023-12-08T08:18:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.565+0000 7f7895ffb640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f788406ae40 0x7f788406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.565+0000 7f7895ffb640 1 -- 172.21.15.50:0/2093888916 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f789c088a70 con 0x7f78a0144340 2023-12-08T08:18:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.565+0000 7f78a542c640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f788406ae40 0x7f788406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.566+0000 7f78a542c640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f788406ae40 0x7f788406d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f789802be60 tx=0x7f7898030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.569+0000 7f7895ffb640 1 -- 172.21.15.50:0/2093888916 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f789c053990 con 0x7f78a0144340 2023-12-08T08:18:24.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.571+0000 7fa259ffb640 1 -- 172.21.15.50:0/2215876948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa260053c10 con 0x7fa26415a940 2023-12-08T08:18:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.571+0000 7fb9637fe640 1 -- 172.21.15.50:0/2316096623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c030840 con 0x7fb96c0cf1f0 2023-12-08T08:18:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.571+0000 7fb9637fe640 1 -- 172.21.15.50:0/2316096623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0309a0 con 0x7fb96c0cf1f0 2023-12-08T08:18:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.571+0000 7fb9637fe640 1 -- 172.21.15.50:0/2316096623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c030d30 con 0x7fb96c0cf1f0 2023-12-08T08:18:24.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.572+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0cf1f0 msgr2=0x7fb96c0cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.572+0000 7fb971a85640 1 --2- 172.21.15.50:0/2316096623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0cf1f0 0x7fb96c0cf5d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009870 tx=0x7fb95c02b980 comp rx=0 tx=0).stop 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.573+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 shutdown_connections 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.573+0000 7fb971a85640 1 --2- 172.21.15.50:0/2316096623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0aeaa0 0x7fb96c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.573+0000 7fb971a85640 1 --2- 172.21.15.50:0/2316096623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0cf1f0 0x7fb96c0cf5d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.573+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 >> 172.21.15.50:0/2316096623 conn(0x7fb96c0b0f30 msgr2=0x7fb96c0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.573+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 shutdown_connections 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.573+0000 7fb971a85640 1 -- 172.21.15.50:0/2316096623 wait complete. 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.575+0000 7fb971a85640 1 Processor -- start 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.575+0000 7fb971a85640 1 -- start start 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb971a85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0aeaa0 0x7fb96c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb970a83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0aeaa0 0x7fb96c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb970a83640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0aeaa0 0x7fb96c0ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57476/0 (socket says 172.21.15.50:57476) 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb970a83640 1 -- 172.21.15.50:0/1171522688 learned_addr learned my addr 172.21.15.50:0/1171522688 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb96c0cd470 0x7fb96c09bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0cf1f0 0x7fb96c09c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c09c850 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c09d2e0 con 0x7fb96c0cd470 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.577+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c159810 con 0x7fb96c0cf1f0 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb971284640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0cf1f0 0x7fb96c09c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb963fff640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb96c0cd470 0x7fb96c09bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb970a83640 1 -- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0cf1f0 msgr2=0x7fb96c09c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb970a83640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0cf1f0 0x7fb96c09c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb970a83640 1 -- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb96c0cd470 msgr2=0x7fb96c09bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb970a83640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb96c0cd470 0x7fb96c09bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb970a83640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c0094d0 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb971284640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0cf1f0 0x7fb96c09c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb963fff640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb96c0cd470 0x7fb96c09bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.578+0000 7fb970a83640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0aeaa0 0x7fb96c0ce150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009990 tx=0x7fb95c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.579+0000 7fb9617fa640 1 -- 172.21.15.50:0/1171522688 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c039c90 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.579+0000 7fb9617fa640 1 -- 172.21.15.50:0/1171522688 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c039df0 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.580+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c09ca40 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.582+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c09d000 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.583+0000 7fb9617fa640 1 -- 172.21.15.50:0/1171522688 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0446c0 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.583+0000 7fb9617fa640 1 -- 172.21.15.50:0/1171522688 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb95c04d3b0 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.584+0000 7fb9617fa640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb95806af90 0x7fb95806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.584+0000 7fb9617fa640 1 -- 172.21.15.50:0/1171522688 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb95c03e070 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.586+0000 7fb963fff640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb95806af90 0x7fb95806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.585+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c005250 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.595+0000 7fb9617fa640 1 -- 172.21.15.50:0/1171522688 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb95c0b1060 con 0x7fb96c0aeaa0 2023-12-08T08:18:24.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.605+0000 7fb963fff640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb95806af90 0x7fb95806d450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0b9b10 tx=0x7fb968008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.922+0000 7f5b1ca9b640 1 -- 172.21.15.50:0/905321902 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5afc005500 con 0x7f5b18144f30 2023-12-08T08:18:24.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.922+0000 7f5b06ffd640 1 -- 172.21.15.50:0/905321902 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b10058590 con 0x7f5b18144f30 2023-12-08T08:18:24.925 INFO:teuthology.orchestra.run.smithi050.stdout:55834574857 2023-12-08T08:18:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 -- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5af806af10 msgr2=0x7f5af806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5af806af10 0x7f5af806d3d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b08034000 tx=0x7f5b08007000 comp rx=0 tx=0).stop 2023-12-08T08:18:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 -- 172.21.15.50:0/905321902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b18144f30 msgr2=0x7f5b181453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b18144f30 0x7f5b181453b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b180b35d0 tx=0x7f5b1000edf0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 -- 172.21.15.50:0/905321902 shutdown_connections 2023-12-08T08:18:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5af806af10 0x7f5af806d3d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b18144f30 0x7f5b181453b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b180af730 0x7f5b18157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 --2- 172.21.15.50:0/905321902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b00003970 0x7f5b180b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 -- 172.21.15.50:0/905321902 >> 172.21.15.50:0/905321902 conn(0x7f5b1806a4d0 msgr2=0x7f5b1806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 -- 172.21.15.50:0/905321902 shutdown_connections 2023-12-08T08:18:24.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.932+0000 7f5b04ff9640 1 -- 172.21.15.50:0/905321902 wait complete. 2023-12-08T08:18:24.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-12-08T08:18:24.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.960+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f330c0057a0 con 0x7f330c03a060 2023-12-08T08:18:24.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.961+0000 7f32fffff640 1 -- 172.21.15.50:0/902103193 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f330807aed0 con 0x7f330c03a060 2023-12-08T08:18:24.963 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2023-12-08T08:18:24.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.964+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f32f806af10 msgr2=0x7f32f806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.964+0000 7f1381ddb640 1 -- 172.21.15.50:0/558719377 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13740ce450 con 0x7f13740df350 2023-12-08T08:18:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.964+0000 7f3318db5640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f32f806af10 0x7f32f806d3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f330000dc30 tx=0x7f330000f040 comp rx=0 tx=0).stop 2023-12-08T08:18:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.964+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f330c03a060 msgr2=0x7f330c04a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.964+0000 7f3318db5640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f330c03a060 0x7f330c04a210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f330802c2a0 tx=0x7f33080046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.965+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 shutdown_connections 2023-12-08T08:18:24.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.965+0000 7f3318db5640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f32f806af10 0x7f32f806d3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.965+0000 7f3318db5640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f330c03a060 0x7f330c04a210 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.965+0000 7f3318db5640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f330c0df7c0 0x7f330c0540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.965+0000 7f3318db5640 1 --2- 172.21.15.50:0/902103193 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f330c036660 0x7f330c0d7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.965+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 >> 172.21.15.50:0/902103193 conn(0x7f330c01e680 msgr2=0x7f330c0078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.965+0000 7f13797fa640 1 -- 172.21.15.50:0/558719377 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13740ce450 con 0x7f13740df350 2023-12-08T08:18:24.972 INFO:teuthology.orchestra.run.smithi050.stdout:55834574859 2023-12-08T08:18:24.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.966+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 shutdown_connections 2023-12-08T08:18:24.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.966+0000 7f3318db5640 1 -- 172.21.15.50:0/902103193 wait complete. 2023-12-08T08:18:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 -- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f136006af10 msgr2=0x7f136006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f136006af10 0x7f136006d3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1368036000 tx=0x7f1368008030 comp rx=0 tx=0).stop 2023-12-08T08:18:24.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 -- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13740df350 msgr2=0x7f13740344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13740df350 0x7f13740344e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f137c064180 tx=0x7f137c073190 comp rx=0 tx=0).stop 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 -- 172.21.15.50:0/558719377 shutdown_connections 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f136006af10 0x7f136006d3d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13740df350 0x7f13740344e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f137404ff90 0x7f13740ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 --2- 172.21.15.50:0/558719377 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f137400aa60 0x7f1374039940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 -- 172.21.15.50:0/558719377 >> 172.21.15.50:0/558719377 conn(0x7f1374009f70 msgr2=0x7f1374035c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 -- 172.21.15.50:0/558719377 shutdown_connections 2023-12-08T08:18:24.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.969+0000 7f1366ffd640 1 -- 172.21.15.50:0/558719377 wait complete. 2023-12-08T08:18:24.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.978+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6824005500 con 0x7f683c0e11d0 2023-12-08T08:18:24.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.979+0000 7f682b7fe640 1 -- 172.21.15.50:0/2197642948 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68440d1350 con 0x7f683c0e11d0 2023-12-08T08:18:24.982 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f683006ae40 msgr2=0x7f683006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f683006ae40 0x7f683006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f683403d160 tx=0x7f6834041000 comp rx=0 tx=0).stop 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f683c0e11d0 msgr2=0x7f683c0d50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f683c0e11d0 0x7f683c0d50a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6844068ee0 tx=0x7f6844073190 comp rx=0 tx=0).stop 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 shutdown_connections 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f683006ae40 0x7f683006d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f683c0e11d0 0x7f683c0d50a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f683c0521c0 0x7f683c04a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 --2- 172.21.15.50:0/2197642948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f683c051d60 0x7f683c0e3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.983+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 >> 172.21.15.50:0/2197642948 conn(0x7f683c053710 msgr2=0x7f683c03c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.984+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 shutdown_connections 2023-12-08T08:18:24.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.984+0000 7f68297fa640 1 -- 172.21.15.50:0/2197642948 wait complete. 2023-12-08T08:18:24.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-12-08T08:18:24.988 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:24.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-12-08T08:18:24.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.986+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe5700057d0 con 0x7fe588049bd0 2023-12-08T08:18:24.989 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:24.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.987+0000 7fe58d7fa640 1 -- 172.21.15.50:0/4177780468 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe57c057060 con 0x7fe588049bd0 2023-12-08T08:18:24.990 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.989+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe57406ae90 msgr2=0x7fe57406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.989+0000 7fe595f27640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe57406ae90 0x7fe57406d350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe58402b9e0 tx=0x7fe584008030 comp rx=0 tx=0).stop 2023-12-08T08:18:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.989+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe588049bd0 msgr2=0x7fe5880e6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:24.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe588049bd0 0x7fe5880e6010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c340 tx=0x7fe57c00c800 comp rx=0 tx=0).stop 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 shutdown_connections 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe57406ae90 0x7fe57406d350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe588056750 0x7fe58804cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe588049bd0 0x7fe5880e6010 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 --2- 172.21.15.50:0/4177780468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe5880362c0 0x7fe5880366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 >> 172.21.15.50:0/4177780468 conn(0x7fe588056cb0 msgr2=0x7fe5880e7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 shutdown_connections 2023-12-08T08:18:24.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:24.990+0000 7fe595f27640 1 -- 172.21.15.50:0/4177780468 wait complete. 2023-12-08T08:18:25.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-12-08T08:18:25.000 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:25.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-12-08T08:18:25.004 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.004+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb94c0057d0 con 0x7fb96c0aeaa0 2023-12-08T08:18:25.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.004+0000 7fb9617fa640 1 -- 172.21.15.50:0/1171522688 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb95c077140 con 0x7fb96c0aeaa0 2023-12-08T08:18:25.006 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb95806af90 msgr2=0x7fb95806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb95806af90 0x7fb95806d450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0b9b10 tx=0x7fb968008040 comp rx=0 tx=0).stop 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0aeaa0 msgr2=0x7fb96c0ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0aeaa0 0x7fb96c0ce150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009990 tx=0x7fb95c004730 comp rx=0 tx=0).stop 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 shutdown_connections 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb95806af90 0x7fb95806d450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb96c0cf1f0 0x7fb96c09c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb96c0cd470 0x7fb96c09bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.007+0000 7fb971a85640 1 --2- 172.21.15.50:0/1171522688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb96c0aeaa0 0x7fb96c0ce150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.008+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 >> 172.21.15.50:0/1171522688 conn(0x7fb96c0b0f30 msgr2=0x7fb96c0aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.008+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 shutdown_connections 2023-12-08T08:18:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.008+0000 7fb971a85640 1 -- 172.21.15.50:0/1171522688 wait complete. 2023-12-08T08:18:25.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-12-08T08:18:25.025 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:25.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.047+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78a01f8d70 con 0x7f78a0144340 2023-12-08T08:18:25.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.047+0000 7f7895ffb640 1 -- 172.21.15.50:0/2093888916 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f789c017090 con 0x7f78a0144340 2023-12-08T08:18:25.050 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f788406ae40 msgr2=0x7f788406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f788406ae40 0x7f788406d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f789802be60 tx=0x7f7898030000 comp rx=0 tx=0).stop 2023-12-08T08:18:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0144340 msgr2=0x7f78a01f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0144340 0x7f78a01f7450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c410 tx=0x7f789c00c810 comp rx=0 tx=0).stop 2023-12-08T08:18:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 shutdown_connections 2023-12-08T08:18:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f788406ae40 0x7f788406d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78a0162110 0x7f78a01f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78a0144340 0x7f78a01f7450 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.049+0000 7f78a642e640 1 --2- 172.21.15.50:0/2093888916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f78a00cf1a0 0x7f78a015f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.050+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 >> 172.21.15.50:0/2093888916 conn(0x7f78a006a6b0 msgr2=0x7f78a006c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.050+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 shutdown_connections 2023-12-08T08:18:25.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.050+0000 7f78a642e640 1 -- 172.21.15.50:0/2093888916 wait complete. 2023-12-08T08:18:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.056+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa264067ad0 con 0x7fa26415a940 2023-12-08T08:18:25.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.056+0000 7fa259ffb640 1 -- 172.21.15.50:0/2215876948 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa260017090 con 0x7fa26415a940 2023-12-08T08:18:25.058 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa24806ae40 msgr2=0x7fa24806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa24806ae40 0x7fa24806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa254009aa0 tx=0x7fa254009190 comp rx=0 tx=0).stop 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26415a940 msgr2=0x7fa2641499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26415a940 0x7fa2641499f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c700 tx=0x7fa26000cbc0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 shutdown_connections 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa24806ae40 0x7fa24806d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa26415a940 0x7fa2641499f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26415e360 0x7fa26406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 --2- 172.21.15.50:0/2215876948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa264071630 0x7fa264141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:25.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 >> 172.21.15.50:0/2215876948 conn(0x7fa2640b1860 msgr2=0x7fa26414c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 shutdown_connections 2023-12-08T08:18:25.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:25.058+0000 7fa26a460640 1 -- 172.21.15.50:0/2215876948 wait complete. 2023-12-08T08:18:25.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-12-08T08:18:25.063 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:25.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-12-08T08:18:25.071 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:25.955 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-08T08:18:26.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.065+0000 7f35dc032640 1 Processor -- start 2023-12-08T08:18:26.068 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.065+0000 7f35dc032640 1 -- start start 2023-12-08T08:18:26.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.066+0000 7f35dc032640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 0x7f35d406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.066+0000 7f35dc032640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d406dc40 con 0x7f35d4157ba0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.066+0000 7f35dc032640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d415b410 con 0x7f35d40b38b0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.066+0000 7f35dc032640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d415ae50 con 0x7f35d406d2a0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.066+0000 7f35d9dce640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f35d4157ba0 0x7f35d415a420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35256/0 (socket says 172.21.15.50:35256) 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.066+0000 7f35d9dce640 1 -- 172.21.15.50:0/3156397062 learned_addr learned my addr 172.21.15.50:0/3156397062 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d95cd640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 0x7f35d406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334445637 0 0) 0x7f35d406dc40 con 0x7f35d4157ba0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c0003520 con 0x7f35d4157ba0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263018637 0 0) 0x7f35c0003520 con 0x7f35d4157ba0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 msgr2=0x7f35d406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 0x7f35d406d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 >> v1:172.21.15.170:6789/0 conn(0x7f35d40b38b0 legacy=0x7f35d40b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d415b130 con 0x7f35d4157ba0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f35c8001670 con 0x7f35d4157ba0 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 >> v1:172.21.15.50:6789/0 conn(0x7f35d4157ba0 legacy=0x7f35d415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35c0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 0x7f35c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35c0004d00 0x7f35c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d415ae50 con 0x7f35c00039a0 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c000ba30 con 0x7f35c0004d00 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c000bbf0 con 0x7f35d406d2a0 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d9dce640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35c0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d95cd640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 0x7f35c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35da5cf640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35c0004d00 0x7f35c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d9dce640 1 -- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 msgr2=0x7f35c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d9dce640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d406d2a0 0x7f35c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d9dce640 1 -- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35c0004d00 msgr2=0x7f35c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d9dce640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35c0004d00 0x7f35c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.067+0000 7f35d9dce640 1 -- 172.21.15.50:0/3156397062 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0003520 con 0x7f35c00039a0 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.068+0000 7f35da5cf640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35c0004d00 0x7f35c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:26.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.068+0000 7f35d9dce640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35c0003d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c210 tx=0x7f35c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3367cf58fb57aaa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.068+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c802cae0 con 0x7f35c00039a0 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.068+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c802cc60 con 0x7f35c00039a0 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.068+0000 7f35d8dcc640 1 -- 172.21.15.50:0/3156397062 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c80058d0 con 0x7f35c00039a0 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.069+0000 7f35dc032640 1 -- 172.21.15.50:0/3156397062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 msgr2=0x7f35c0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.069+0000 7f35dc032640 1 --2- 172.21.15.50:0/3156397062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35c0003d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c210 tx=0x7f35c00057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.069+0000 7f35da5cf640 1 -- 172.21.15.50:0/3156397062 reap_dead start 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.069+0000 7f35dc032640 1 -- 172.21.15.50:0/3156397062 shutdown_connections 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.069+0000 7f35dc032640 1 -- 172.21.15.50:0/3156397062 >> 172.21.15.50:0/3156397062 conn(0x7f35d40cff90 msgr2=0x7f35d40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.069+0000 7f35dc032640 1 -- 172.21.15.50:0/3156397062 shutdown_connections 2023-12-08T08:18:26.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.069+0000 7f35dc032640 1 -- 172.21.15.50:0/3156397062 wait complete. 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.070+0000 7f35dc032640 1 Processor -- start 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.070+0000 7f35dc032640 1 -- start start 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35dc032640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35d415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35dc032640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d40c9300 0x7f35d414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35dc032640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35d414da10 0x7f35d415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35dc032640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d415bab0 con 0x7f35c00039a0 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35dc032640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40c9ae0 con 0x7f35d414da10 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35dc032640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40c9dc0 con 0x7f35d40c9300 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35d9dce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35d415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35d9dce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35d415d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57492/0 (socket says 172.21.15.50:57492) 2023-12-08T08:18:26.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.071+0000 7f35d9dce640 1 -- 172.21.15.50:0/1495309459 learned_addr learned my addr 172.21.15.50:0/1495309459 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d95cd640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d40c9300 0x7f35d414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35da5cf640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35d414da10 0x7f35d415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d9dce640 1 -- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d40c9300 msgr2=0x7f35d414c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d9dce640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d40c9300 0x7f35d414c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d9dce640 1 -- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35d414da10 msgr2=0x7f35d415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d9dce640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35d414da10 0x7f35d415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d9dce640 1 -- 172.21.15.50:0/1495309459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d415b6d0 con 0x7f35c00039a0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35da5cf640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35d414da10 0x7f35d415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d95cd640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d40c9300 0x7f35d414c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35d9dce640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35d415d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35c802c480 tx=0x7f35c8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35c67fc640 1 -- 172.21.15.50:0/1495309459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8039070 con 0x7f35c00039a0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35c67fc640 1 -- 172.21.15.50:0/1495309459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c802caf0 con 0x7f35c00039a0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d40ca0a0 con 0x7f35c00039a0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35c67fc640 1 -- 172.21.15.50:0/1495309459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c803c040 con 0x7f35c00039a0 2023-12-08T08:18:26.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.072+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d414cd00 con 0x7f35c00039a0 2023-12-08T08:18:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.073+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d415ab10 con 0x7f35c00039a0 2023-12-08T08:18:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.073+0000 7f35c67fc640 1 -- 172.21.15.50:0/1495309459 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35c8032070 con 0x7f35c00039a0 2023-12-08T08:18:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.074+0000 7f35c67fc640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35b806ae40 0x7f35b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.074+0000 7f35c67fc640 1 -- 172.21.15.50:0/1495309459 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35c80aab30 con 0x7f35c00039a0 2023-12-08T08:18:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.074+0000 7f35d95cd640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35b806ae40 0x7f35b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.075+0000 7f35d95cd640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35b806ae40 0x7f35b806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35d40afd70 tx=0x7f35d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.078+0000 7f35c67fc640 1 -- 172.21.15.50:0/1495309459 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35d415ab10 con 0x7f35c00039a0 2023-12-08T08:18:26.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.258+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f35d40c9f00 con 0x7f35c00039a0 2023-12-08T08:18:26.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.258+0000 7f35c67fc640 1 -- 172.21.15.50:0/1495309459 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35d40c9f00 con 0x7f35c00039a0 2023-12-08T08:18:26.261 INFO:teuthology.orchestra.run.smithi050.stdout:55834574858 2023-12-08T08:18:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35b806ae40 msgr2=0x7f35b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35b806ae40 0x7f35b806d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35d40afd70 tx=0x7f35d0008040 comp rx=0 tx=0).stop 2023-12-08T08:18:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 msgr2=0x7f35d415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35d415d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35c802c480 tx=0x7f35c8001a00 comp rx=0 tx=0).stop 2023-12-08T08:18:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 shutdown_connections 2023-12-08T08:18:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35b806ae40 0x7f35b806d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35d414da10 0x7f35d415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35d40c9300 0x7f35d414c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 --2- 172.21.15.50:0/1495309459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35c00039a0 0x7f35d415d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.260+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 >> 172.21.15.50:0/1495309459 conn(0x7f35d40cff90 msgr2=0x7f35d40b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.261+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 shutdown_connections 2023-12-08T08:18:26.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.261+0000 7f35dc032640 1 -- 172.21.15.50:0/1495309459 wait complete. 2023-12-08T08:18:26.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-12-08T08:18:26.274 DEBUG:teuthology.parallel:result is None 2023-12-08T08:18:26.274 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T08:18:26.274 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:26.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.377+0000 7f781731d640 1 Processor -- start 2023-12-08T08:18:26.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.378+0000 7f781731d640 1 -- start start 2023-12-08T08:18:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.378+0000 7f781731d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f78100ce270 0x7f781006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.378+0000 7f781731d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 0x7f781015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.378+0000 7f781731d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100ce6f0 con 0x7f78100ccd70 2023-12-08T08:18:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.378+0000 7f781731d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100d0a60 con 0x7f78100ce270 2023-12-08T08:18:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.378+0000 7f781731d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781006c910 con 0x7f781006c480 2023-12-08T08:18:26.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f78150b9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f78100ccd70 0x7f78100cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35270/0 (socket says 172.21.15.50:35270) 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f78150b9640 1 -- 172.21.15.50:0/80674714 learned_addr learned my addr 172.21.15.50:0/80674714 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f78148b8640 1 --2- 172.21.15.50:0/80674714 >> v2:172.21.15.170:3300/0 conn(0x7f78100ce270 0x7f781006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f78158ba640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 0x7f781015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174978338 0 0) 0x7f78100ce6f0 con 0x7f78100ccd70 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77fc003520 con 0x7f78100ccd70 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871921273 0 0) 0x7f77fc003520 con 0x7f78100ccd70 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 msgr2=0x7f781015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 0x7f781015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 >> v2:172.21.15.170:3300/0 conn(0x7f78100ce270 msgr2=0x7f781006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 --2- 172.21.15.50:0/80674714 >> v2:172.21.15.170:3300/0 conn(0x7f78100ce270 0x7f781006bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100cf9c0 con 0x7f78100ccd70 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f780c001670 con 0x7f78100ccd70 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 >> v1:172.21.15.50:6789/0 conn(0x7f78100ccd70 legacy=0x7f78100cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc0039a0 0x7f77fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 0x7f77fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77fc004d00 0x7f77fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781006c910 con 0x7f77fc0039a0 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc00b980 con 0x7f77fc004d00 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc00bac0 con 0x7f781006c480 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.379+0000 7f78150b9640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc0039a0 0x7f77fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.380+0000 7f78148b8640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 0x7f77fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.380+0000 7f78158ba640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77fc004d00 0x7f77fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.380+0000 7f78150b9640 1 -- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 msgr2=0x7f77fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.380+0000 7f78150b9640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f781006c480 0x7f77fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.380+0000 7f78150b9640 1 -- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77fc004d00 msgr2=0x7f77fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.380+0000 7f78150b9640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77fc004d00 0x7f77fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.380+0000 7f78150b9640 1 -- 172.21.15.50:0/80674714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc003520 con 0x7f77fc0039a0 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f78150b9640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc0039a0 0x7f77fc003dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f780c001050 tx=0x7f77fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ef062cb3444a4d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c005ad0 con 0x7f77fc0039a0 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c005c30 con 0x7f77fc0039a0 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f7807fff640 1 -- 172.21.15.50:0/80674714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c02c870 con 0x7f77fc0039a0 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f781731d640 1 -- 172.21.15.50:0/80674714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc0039a0 msgr2=0x7f77fc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f781731d640 1 --2- 172.21.15.50:0/80674714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc0039a0 0x7f77fc003dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f780c001050 tx=0x7f77fc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f78158ba640 1 -- 172.21.15.50:0/80674714 reap_dead start 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f781731d640 1 -- 172.21.15.50:0/80674714 shutdown_connections 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f781731d640 1 -- 172.21.15.50:0/80674714 >> 172.21.15.50:0/80674714 conn(0x7f78100d0de0 msgr2=0x7f78100d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f781731d640 1 -- 172.21.15.50:0/80674714 shutdown_connections 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.381+0000 7f781731d640 1 -- 172.21.15.50:0/80674714 wait complete. 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.382+0000 7f781731d640 1 Processor -- start 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f781731d640 1 -- start start 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f781731d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77fc0039a0 0x7f781014c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f781731d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78100c88c0 0x7f78100c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f781731d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100cb350 0x7f78100cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f781731d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781009e340 con 0x7f78100cb350 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f781731d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781014ca90 con 0x7f78100c88c0 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f781731d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781009cfc0 con 0x7f77fc0039a0 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f78158ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100cb350 0x7f78100cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f78158ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100cb350 0x7f78100cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57512/0 (socket says 172.21.15.50:57512) 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.383+0000 7f78158ba640 1 -- 172.21.15.50:0/1570519713 learned_addr learned my addr 172.21.15.50:0/1570519713 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78158ba640 1 -- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77fc0039a0 msgr2=0x7f781014c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78158ba640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77fc0039a0 0x7f781014c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78148b8640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78100c88c0 0x7f78100c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78158ba640 1 -- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78100c88c0 msgr2=0x7f78100c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78158ba640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78100c88c0 0x7f78100c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78158ba640 1 -- 172.21.15.50:0/1570519713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781009d2a0 con 0x7f78100cb350 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78148b8640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78100c88c0 0x7f78100c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f78158ba640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100cb350 0x7f78100cb7d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f78100721f0 tx=0x7f780800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f7805ffb640 1 -- 172.21.15.50:0/1570519713 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800e040 con 0x7f78100cb350 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f7805ffb640 1 -- 172.21.15.50:0/1570519713 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800f040 con 0x7f78100cb350 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781009d580 con 0x7f78100cb350 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f7805ffb640 1 -- 172.21.15.50:0/1570519713 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808015430 con 0x7f78100cb350 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.384+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781009db40 con 0x7f78100cb350 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.385+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7810067430 con 0x7f78100cb350 2023-12-08T08:18:26.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.386+0000 7f7805ffb640 1 -- 172.21.15.50:0/1570519713 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7808015590 con 0x7f78100cb350 2023-12-08T08:18:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.386+0000 7f7805ffb640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77f406ae40 0x7f77f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.386+0000 7f7805ffb640 1 -- 172.21.15.50:0/1570519713 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f780808a080 con 0x7f78100cb350 2023-12-08T08:18:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.386+0000 7f78150b9640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77f406ae40 0x7f77f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.387+0000 7f78150b9640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77f406ae40 0x7f77f406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f780c034000 tx=0x7f780c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.390+0000 7f7805ffb640 1 -- 172.21.15.50:0/1570519713 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7808054e40 con 0x7f78100cb350 2023-12-08T08:18:26.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.562+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78100cc220 con 0x7f77f406ae40 2023-12-08T08:18:26.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.571+0000 7f7805ffb640 1 -- 172.21.15.50:0/1570519713 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345299 (secure 0 0 0) 0x7f78100cc220 con 0x7f77f406ae40 2023-12-08T08:18:26.581 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:26.583 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:18:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.574+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77f406ae40 msgr2=0x7f77f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.574+0000 7f781731d640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77f406ae40 0x7f77f406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f780c034000 tx=0x7f780c02e000 comp rx=0 tx=0).stop 2023-12-08T08:18:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.574+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100cb350 msgr2=0x7f78100cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.574+0000 7f781731d640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100cb350 0x7f78100cb7d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f78100721f0 tx=0x7f780800f580 comp rx=0 tx=0).stop 2023-12-08T08:18:26.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 shutdown_connections 2023-12-08T08:18:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77f406ae40 0x7f77f406d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78100cb350 0x7f78100cb7d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78100c88c0 0x7f78100c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 --2- 172.21.15.50:0/1570519713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77fc0039a0 0x7f781014c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 >> 172.21.15.50:0/1570519713 conn(0x7f78100d0de0 msgr2=0x7f78100adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 shutdown_connections 2023-12-08T08:18:26.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.575+0000 7f781731d640 1 -- 172.21.15.50:0/1570519713 wait complete. 2023-12-08T08:18:26.587 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-08T08:18:26.118924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252652,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722068,"statfs":{"total":773094113280,"available":772835397632,"internally_reserved":0,"allocated":3280896,"data_stored":1987327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003741"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872492+0000","last_change":"2023-12-08T08:17:56.842906+0000","last_active":"2023-12-08T08:18:01.872492+0000","last_peered":"2023-12-08T08:18:01.872492+0000","last_clean":"2023-12-08T08:18:01.872492+0000","last_became_active":"2023-12-08T08:17:56.842598+0000","last_became_peered":"2023-12-08T08:17:56.842598+0000","last_unstale":"2023-12-08T08:18:01.872492+0000","last_undegraded":"2023-12-08T08:18:01.872492+0000","last_fullsized":"2023-12-08T08:18:01.872492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867626+0000","last_change":"2023-12-08T08:17:57.870410+0000","last_active":"2023-12-08T08:18:01.867626+0000","last_peered":"2023-12-08T08:18:01.867626+0000","last_clean":"2023-12-08T08:18:01.867626+0000","last_became_active":"2023-12-08T08:17:57.870101+0000","last_became_peered":"2023-12-08T08:17:57.870101+0000","last_unstale":"2023-12-08T08:18:01.867626+0000","last_undegraded":"2023-12-08T08:18:01.867626+0000","last_fullsized":"2023-12-08T08:18:01.867626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567811+0000","last_change":"2023-12-08T08:18:01.878712+0000","last_active":"2023-12-08T08:18:03.567811+0000","last_peered":"2023-12-08T08:18:03.567811+0000","last_clean":"2023-12-08T08:18:03.567811+0000","last_became_active":"2023-12-08T08:18:01.878261+0000","last_became_peered":"2023-12-08T08:18:01.878261+0000","last_unstale":"2023-12-08T08:18:03.567811+0000","last_undegraded":"2023-12-08T08:18:03.567811+0000","last_fullsized":"2023-12-08T08:18:03.567811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:07:23.896888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867824+0000","last_change":"2023-12-08T08:17:56.843766+0000","last_active":"2023-12-08T08:18:01.867824+0000","last_peered":"2023-12-08T08:18:01.867824+0000","last_clean":"2023-12-08T08:18:01.867824+0000","last_became_active":"2023-12-08T08:17:56.843478+0000","last_became_peered":"2023-12-08T08:17:56.843478+0000","last_unstale":"2023-12-08T08:18:01.867824+0000","last_undegraded":"2023-12-08T08:18:01.867824+0000","last_fullsized":"2023-12-08T08:18:01.867824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872240+0000","last_change":"2023-12-08T08:17:57.855561+0000","last_active":"2023-12-08T08:18:01.872240+0000","last_peered":"2023-12-08T08:18:01.872240+0000","last_clean":"2023-12-08T08:18:01.872240+0000","last_became_active":"2023-12-08T08:17:57.855268+0000","last_became_peered":"2023-12-08T08:17:57.855268+0000","last_unstale":"2023-12-08T08:18:01.872240+0000","last_undegraded":"2023-12-08T08:18:01.872240+0000","last_fullsized":"2023-12-08T08:18:01.872240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568140+0000","last_change":"2023-12-08T08:18:01.889314+0000","last_active":"2023-12-08T08:18:03.568140+0000","last_peered":"2023-12-08T08:18:03.568140+0000","last_clean":"2023-12-08T08:18:03.568140+0000","last_became_active":"2023-12-08T08:18:01.888906+0000","last_became_peered":"2023-12-08T08:18:01.888906+0000","last_unstale":"2023-12-08T08:18:03.568140+0000","last_undegraded":"2023-12-08T08:18:03.568140+0000","last_fullsized":"2023-12-08T08:18:03.568140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:01.114329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868720+0000","last_change":"2023-12-08T08:17:56.842810+0000","last_active":"2023-12-08T08:18:01.868720+0000","last_peered":"2023-12-08T08:18:01.868720+0000","last_clean":"2023-12-08T08:18:01.868720+0000","last_became_active":"2023-12-08T08:17:56.842480+0000","last_became_peered":"2023-12-08T08:17:56.842480+0000","last_unstale":"2023-12-08T08:18:01.868720+0000","last_undegraded":"2023-12-08T08:18:01.868720+0000","last_fullsized":"2023-12-08T08:18:01.868720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869147+0000","last_change":"2023-12-08T08:17:57.859900+0000","last_active":"2023-12-08T08:18:01.869147+0000","last_peered":"2023-12-08T08:18:01.869147+0000","last_clean":"2023-12-08T08:18:01.869147+0000","last_became_active":"2023-12-08T08:17:57.859600+0000","last_became_peered":"2023-12-08T08:17:57.859600+0000","last_unstale":"2023-12-08T08:18:01.869147+0000","last_undegraded":"2023-12-08T08:18:01.869147+0000","last_fullsized":"2023-12-08T08:18:01.869147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568611+0000","last_change":"2023-12-08T08:18:01.889433+0000","last_active":"2023-12-08T08:18:03.568611+0000","last_peered":"2023-12-08T08:18:03.568611+0000","last_clean":"2023-12-08T08:18:03.568611+0000","last_became_active":"2023-12-08T08:18:01.888357+0000","last_became_peered":"2023-12-08T08:18:01.888357+0000","last_unstale":"2023-12-08T08:18:03.568611+0000","last_undegraded":"2023-12-08T08:18:03.568611+0000","last_fullsized":"2023-12-08T08:18:03.568611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:46.554041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868282+0000","last_change":"2023-12-08T08:17:56.840379+0000","last_active":"2023-12-08T08:18:01.868282+0000","last_peered":"2023-12-08T08:18:01.868282+0000","last_clean":"2023-12-08T08:18:01.868282+0000","last_became_active":"2023-12-08T08:17:56.840103+0000","last_became_peered":"2023-12-08T08:17:56.840103+0000","last_unstale":"2023-12-08T08:18:01.868282+0000","last_undegraded":"2023-12-08T08:18:01.868282+0000","last_fullsized":"2023-12-08T08:18:01.868282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870159+0000","last_change":"2023-12-08T08:17:57.858103+0000","last_active":"2023-12-08T08:18:01.870159+0000","last_peered":"2023-12-08T08:18:01.870159+0000","last_clean":"2023-12-08T08:18:01.870159+0000","last_became_active":"2023-12-08T08:17:57.857699+0000","last_became_peered":"2023-12-08T08:17:57.857699+0000","last_unstale":"2023-12-08T08:18:01.870159+0000","last_undegraded":"2023-12-08T08:18:01.870159+0000","last_fullsized":"2023-12-08T08:18:01.870159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568317+0000","last_change":"2023-12-08T08:18:01.885166+0000","last_active":"2023-12-08T08:18:03.568317+0000","last_peered":"2023-12-08T08:18:03.568317+0000","last_clean":"2023-12-08T08:18:03.568317+0000","last_became_active":"2023-12-08T08:18:01.884779+0000","last_became_peered":"2023-12-08T08:18:01.884779+0000","last_unstale":"2023-12-08T08:18:03.568317+0000","last_undegraded":"2023-12-08T08:18:03.568317+0000","last_fullsized":"2023-12-08T08:18:03.568317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:57.811272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880413+0000","last_change":"2023-12-08T08:17:57.865810+0000","last_active":"2023-12-08T08:18:01.880413+0000","last_peered":"2023-12-08T08:18:01.880413+0000","last_clean":"2023-12-08T08:18:01.880413+0000","last_became_active":"2023-12-08T08:17:57.865552+0000","last_became_peered":"2023-12-08T08:17:57.865552+0000","last_unstale":"2023-12-08T08:18:01.880413+0000","last_undegraded":"2023-12-08T08:18:01.880413+0000","last_fullsized":"2023-12-08T08:18:01.880413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868484+0000","last_change":"2023-12-08T08:17:56.840140+0000","last_active":"2023-12-08T08:18:01.868484+0000","last_peered":"2023-12-08T08:18:01.868484+0000","last_clean":"2023-12-08T08:18:01.868484+0000","last_became_active":"2023-12-08T08:17:56.839795+0000","last_became_peered":"2023-12-08T08:17:56.839795+0000","last_unstale":"2023-12-08T08:18:01.868484+0000","last_undegraded":"2023-12-08T08:18:01.868484+0000","last_fullsized":"2023-12-08T08:18:01.868484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:56.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569186+0000","last_change":"2023-12-08T08:18:01.891012+0000","last_active":"2023-12-08T08:18:03.569186+0000","last_peered":"2023-12-08T08:18:03.569186+0000","last_clean":"2023-12-08T08:18:03.569186+0000","last_became_active":"2023-12-08T08:18:01.890400+0000","last_became_peered":"2023-12-08T08:18:01.890400+0000","last_unstale":"2023-12-08T08:18:03.569186+0000","last_undegraded":"2023-12-08T08:18:03.569186+0000","last_fullsized":"2023-12-08T08:18:03.569186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:16.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867759+0000","last_change":"2023-12-08T08:17:57.864890+0000","last_active":"2023-12-08T08:18:01.867759+0000","last_peered":"2023-12-08T08:18:01.867759+0000","last_clean":"2023-12-08T08:18:01.867759+0000","last_became_active":"2023-12-08T08:17:57.864513+0000","last_became_peered":"2023-12-08T08:17:57.864513+0000","last_unstale":"2023-12-08T08:18:01.867759+0000","last_undegraded":"2023-12-08T08:18:01.867759+0000","last_fullsized":"2023-12-08T08:18:01.867759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885708+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.885708+0000","last_peered":"2023-12-08T08:18:01.885708+0000","last_clean":"2023-12-08T08:18:01.885708+0000","last_became_active":"2023-12-08T08:17:56.832192+0000","last_became_peered":"2023-12-08T08:17:56.832192+0000","last_unstale":"2023-12-08T08:18:01.885708+0000","last_undegraded":"2023-12-08T08:18:01.885708+0000","last_fullsized":"2023-12-08T08:18:01.885708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:09.417617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568758+0000","last_change":"2023-12-08T08:18:01.892174+0000","last_active":"2023-12-08T08:18:03.568758+0000","last_peered":"2023-12-08T08:18:03.568758+0000","last_clean":"2023-12-08T08:18:03.568758+0000","last_became_active":"2023-12-08T08:18:01.891139+0000","last_became_peered":"2023-12-08T08:18:01.891139+0000","last_unstale":"2023-12-08T08:18:03.568758+0000","last_undegraded":"2023-12-08T08:18:03.568758+0000","last_fullsized":"2023-12-08T08:18:03.568758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:06.144172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869779+0000","last_change":"2023-12-08T08:17:57.853306+0000","last_active":"2023-12-08T08:18:01.869779+0000","last_peered":"2023-12-08T08:18:01.869779+0000","last_clean":"2023-12-08T08:18:01.869779+0000","last_became_active":"2023-12-08T08:17:57.852939+0000","last_became_peered":"2023-12-08T08:17:57.852939+0000","last_unstale":"2023-12-08T08:18:01.869779+0000","last_undegraded":"2023-12-08T08:18:01.869779+0000","last_fullsized":"2023-12-08T08:18:01.869779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885213+0000","last_change":"2023-12-08T08:17:56.837763+0000","last_active":"2023-12-08T08:18:01.885213+0000","last_peered":"2023-12-08T08:18:01.885213+0000","last_clean":"2023-12-08T08:18:01.885213+0000","last_became_active":"2023-12-08T08:17:56.837469+0000","last_became_peered":"2023-12-08T08:17:56.837469+0000","last_unstale":"2023-12-08T08:18:01.885213+0000","last_undegraded":"2023-12-08T08:18:01.885213+0000","last_fullsized":"2023-12-08T08:18:01.885213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569232+0000","last_change":"2023-12-08T08:18:01.892151+0000","last_active":"2023-12-08T08:18:03.569232+0000","last_peered":"2023-12-08T08:18:03.569232+0000","last_clean":"2023-12-08T08:18:03.569232+0000","last_became_active":"2023-12-08T08:18:01.891748+0000","last_became_peered":"2023-12-08T08:18:01.891748+0000","last_unstale":"2023-12-08T08:18:03.569232+0000","last_undegraded":"2023-12-08T08:18:03.569232+0000","last_fullsized":"2023-12-08T08:18:03.569232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.874659+0000","last_change":"2023-12-08T08:17:57.856848+0000","last_active":"2023-12-08T08:18:01.874659+0000","last_peered":"2023-12-08T08:18:01.874659+0000","last_clean":"2023-12-08T08:18:01.874659+0000","last_became_active":"2023-12-08T08:17:57.856604+0000","last_became_peered":"2023-12-08T08:17:57.856604+0000","last_unstale":"2023-12-08T08:18:01.874659+0000","last_undegraded":"2023-12-08T08:18:01.874659+0000","last_fullsized":"2023-12-08T08:18:01.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867949+0000","last_change":"2023-12-08T08:17:56.842489+0000","last_active":"2023-12-08T08:18:01.867949+0000","last_peered":"2023-12-08T08:18:01.867949+0000","last_clean":"2023-12-08T08:18:01.867949+0000","last_became_active":"2023-12-08T08:17:56.842218+0000","last_became_peered":"2023-12-08T08:17:56.842218+0000","last_unstale":"2023-12-08T08:18:01.867949+0000","last_undegraded":"2023-12-08T08:18:01.867949+0000","last_fullsized":"2023-12-08T08:18:01.867949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569378+0000","last_change":"2023-12-08T08:18:01.891618+0000","last_active":"2023-12-08T08:18:03.569378+0000","last_peered":"2023-12-08T08:18:03.569378+0000","last_clean":"2023-12-08T08:18:03.569378+0000","last_became_active":"2023-12-08T08:18:01.891182+0000","last_became_peered":"2023-12-08T08:18:01.891182+0000","last_unstale":"2023-12-08T08:18:03.569378+0000","last_undegraded":"2023-12-08T08:18:03.569378+0000","last_fullsized":"2023-12-08T08:18:03.569378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:52.932114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873203+0000","last_change":"2023-12-08T08:17:57.853709+0000","last_active":"2023-12-08T08:18:01.873203+0000","last_peered":"2023-12-08T08:18:01.873203+0000","last_clean":"2023-12-08T08:18:01.873203+0000","last_became_active":"2023-12-08T08:17:57.853422+0000","last_became_peered":"2023-12-08T08:17:57.853422+0000","last_unstale":"2023-12-08T08:18:01.873203+0000","last_undegraded":"2023-12-08T08:18:01.873203+0000","last_fullsized":"2023-12-08T08:18:01.873203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881686+0000","last_change":"2023-12-08T08:17:56.838162+0000","last_active":"2023-12-08T08:18:01.881686+0000","last_peered":"2023-12-08T08:18:01.881686+0000","last_clean":"2023-12-08T08:18:01.881686+0000","last_became_active":"2023-12-08T08:17:56.837914+0000","last_became_peered":"2023-12-08T08:17:56.837914+0000","last_unstale":"2023-12-08T08:18:01.881686+0000","last_undegraded":"2023-12-08T08:18:01.881686+0000","last_fullsized":"2023-12-08T08:18:01.881686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568391+0000","last_change":"2023-12-08T08:18:01.886684+0000","last_active":"2023-12-08T08:18:03.568391+0000","last_peered":"2023-12-08T08:18:03.568391+0000","last_clean":"2023-12-08T08:18:03.568391+0000","last_became_active":"2023-12-08T08:18:01.886257+0000","last_became_peered":"2023-12-08T08:18:01.886257+0000","last_unstale":"2023-12-08T08:18:03.568391+0000","last_undegraded":"2023-12-08T08:18:03.568391+0000","last_fullsized":"2023-12-08T08:18:03.568391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868425+0000","last_change":"2023-12-08T08:17:57.864189+0000","last_active":"2023-12-08T08:18:01.868425+0000","last_peered":"2023-12-08T08:18:01.868425+0000","last_clean":"2023-12-08T08:18:01.868425+0000","last_became_active":"2023-12-08T08:17:57.863656+0000","last_became_peered":"2023-12-08T08:17:57.863656+0000","last_unstale":"2023-12-08T08:18:01.868425+0000","last_undegraded":"2023-12-08T08:18:01.868425+0000","last_fullsized":"2023-12-08T08:18:01.868425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885512+0000","last_change":"2023-12-08T08:17:56.835325+0000","last_active":"2023-12-08T08:18:01.885512+0000","last_peered":"2023-12-08T08:18:01.885512+0000","last_clean":"2023-12-08T08:18:01.885512+0000","last_became_active":"2023-12-08T08:17:56.834877+0000","last_became_peered":"2023-12-08T08:17:56.834877+0000","last_unstale":"2023-12-08T08:18:01.885512+0000","last_undegraded":"2023-12-08T08:18:01.885512+0000","last_fullsized":"2023-12-08T08:18:01.885512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567624+0000","last_change":"2023-12-08T08:18:01.891058+0000","last_active":"2023-12-08T08:18:03.567624+0000","last_peered":"2023-12-08T08:18:03.567624+0000","last_clean":"2023-12-08T08:18:03.567624+0000","last_became_active":"2023-12-08T08:18:01.890653+0000","last_became_peered":"2023-12-08T08:18:01.890653+0000","last_unstale":"2023-12-08T08:18:03.567624+0000","last_undegraded":"2023-12-08T08:18:03.567624+0000","last_fullsized":"2023-12-08T08:18:03.567624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885917+0000","last_change":"2023-12-08T08:17:57.851573+0000","last_active":"2023-12-08T08:18:01.885917+0000","last_peered":"2023-12-08T08:18:01.885917+0000","last_clean":"2023-12-08T08:18:01.885917+0000","last_became_active":"2023-12-08T08:17:57.851275+0000","last_became_peered":"2023-12-08T08:17:57.851275+0000","last_unstale":"2023-12-08T08:18:01.885917+0000","last_undegraded":"2023-12-08T08:18:01.885917+0000","last_fullsized":"2023-12-08T08:18:01.885917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868821+0000","last_change":"2023-12-08T08:17:56.842419+0000","last_active":"2023-12-08T08:18:01.868821+0000","last_peered":"2023-12-08T08:18:01.868821+0000","last_clean":"2023-12-08T08:18:01.868821+0000","last_became_active":"2023-12-08T08:17:56.842113+0000","last_became_peered":"2023-12-08T08:17:56.842113+0000","last_unstale":"2023-12-08T08:18:01.868821+0000","last_undegraded":"2023-12-08T08:18:01.868821+0000","last_fullsized":"2023-12-08T08:18:01.868821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569320+0000","last_change":"2023-12-08T08:18:01.896199+0000","last_active":"2023-12-08T08:18:03.569320+0000","last_peered":"2023-12-08T08:18:03.569320+0000","last_clean":"2023-12-08T08:18:03.569320+0000","last_became_active":"2023-12-08T08:18:01.895808+0000","last_became_peered":"2023-12-08T08:18:01.895808+0000","last_unstale":"2023-12-08T08:18:03.569320+0000","last_undegraded":"2023-12-08T08:18:03.569320+0000","last_fullsized":"2023-12-08T08:18:03.569320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870316+0000","last_change":"2023-12-08T08:17:57.865891+0000","last_active":"2023-12-08T08:18:01.870316+0000","last_peered":"2023-12-08T08:18:01.870316+0000","last_clean":"2023-12-08T08:18:01.870316+0000","last_became_active":"2023-12-08T08:17:57.865615+0000","last_became_peered":"2023-12-08T08:17:57.865615+0000","last_unstale":"2023-12-08T08:18:01.870316+0000","last_undegraded":"2023-12-08T08:18:01.870316+0000","last_fullsized":"2023-12-08T08:18:01.870316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.886007+0000","last_change":"2023-12-08T08:17:56.841200+0000","last_active":"2023-12-08T08:18:01.886007+0000","last_peered":"2023-12-08T08:18:01.886007+0000","last_clean":"2023-12-08T08:18:01.886007+0000","last_became_active":"2023-12-08T08:17:56.840931+0000","last_became_peered":"2023-12-08T08:17:56.840931+0000","last_unstale":"2023-12-08T08:18:01.886007+0000","last_undegraded":"2023-12-08T08:18:01.886007+0000","last_fullsized":"2023-12-08T08:18:01.886007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569499+0000","last_change":"2023-12-08T08:18:01.891062+0000","last_active":"2023-12-08T08:18:03.569499+0000","last_peered":"2023-12-08T08:18:03.569499+0000","last_clean":"2023-12-08T08:18:03.569499+0000","last_became_active":"2023-12-08T08:18:01.889897+0000","last_became_peered":"2023-12-08T08:18:01.889897+0000","last_unstale":"2023-12-08T08:18:03.569499+0000","last_undegraded":"2023-12-08T08:18:03.569499+0000","last_fullsized":"2023-12-08T08:18:03.569499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875197+0000","last_change":"2023-12-08T08:17:57.858835+0000","last_active":"2023-12-08T08:18:01.875197+0000","last_peered":"2023-12-08T08:18:01.875197+0000","last_clean":"2023-12-08T08:18:01.875197+0000","last_became_active":"2023-12-08T08:17:57.857435+0000","last_became_peered":"2023-12-08T08:17:57.857435+0000","last_unstale":"2023-12-08T08:18:01.875197+0000","last_undegraded":"2023-12-08T08:18:01.875197+0000","last_fullsized":"2023-12-08T08:18:01.875197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:23:20.987641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869458+0000","last_change":"2023-12-08T08:17:56.837734+0000","last_active":"2023-12-08T08:18:01.869458+0000","last_peered":"2023-12-08T08:18:01.869458+0000","last_clean":"2023-12-08T08:18:01.869458+0000","last_became_active":"2023-12-08T08:17:56.837449+0000","last_became_peered":"2023-12-08T08:17:56.837449+0000","last_unstale":"2023-12-08T08:18:01.869458+0000","last_undegraded":"2023-12-08T08:18:01.869458+0000","last_fullsized":"2023-12-08T08:18:01.869458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568865+0000","last_change":"2023-12-08T08:18:01.890850+0000","last_active":"2023-12-08T08:18:03.568865+0000","last_peered":"2023-12-08T08:18:03.568865+0000","last_clean":"2023-12-08T08:18:03.568865+0000","last_became_active":"2023-12-08T08:18:01.890183+0000","last_became_peered":"2023-12-08T08:18:01.890183+0000","last_unstale":"2023-12-08T08:18:03.568865+0000","last_undegraded":"2023-12-08T08:18:03.568865+0000","last_fullsized":"2023-12-08T08:18:03.568865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885216+0000","last_change":"2023-12-08T08:17:57.851203+0000","last_active":"2023-12-08T08:18:01.885216+0000","last_peered":"2023-12-08T08:18:01.885216+0000","last_clean":"2023-12-08T08:18:01.885216+0000","last_became_active":"2023-12-08T08:17:57.850672+0000","last_became_peered":"2023-12-08T08:17:57.850672+0000","last_unstale":"2023-12-08T08:18:01.885216+0000","last_undegraded":"2023-12-08T08:18:01.885216+0000","last_fullsized":"2023-12-08T08:18:01.885216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873056+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.873056+0000","last_peered":"2023-12-08T08:18:01.873056+0000","last_clean":"2023-12-08T08:18:01.873056+0000","last_became_active":"2023-12-08T08:17:56.832238+0000","last_became_peered":"2023-12-08T08:17:56.832238+0000","last_unstale":"2023-12-08T08:18:01.873056+0000","last_undegraded":"2023-12-08T08:18:01.873056+0000","last_fullsized":"2023-12-08T08:18:01.873056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569367+0000","last_change":"2023-12-08T08:18:01.894980+0000","last_active":"2023-12-08T08:18:03.569367+0000","last_peered":"2023-12-08T08:18:03.569367+0000","last_clean":"2023-12-08T08:18:03.569367+0000","last_became_active":"2023-12-08T08:18:01.894588+0000","last_became_peered":"2023-12-08T08:18:01.894588+0000","last_unstale":"2023-12-08T08:18:03.569367+0000","last_undegraded":"2023-12-08T08:18:03.569367+0000","last_fullsized":"2023-12-08T08:18:03.569367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871709+0000","last_change":"2023-12-08T08:17:57.848723+0000","last_active":"2023-12-08T08:18:01.871709+0000","last_peered":"2023-12-08T08:18:01.871709+0000","last_clean":"2023-12-08T08:18:01.871709+0000","last_became_active":"2023-12-08T08:17:57.848474+0000","last_became_peered":"2023-12-08T08:17:57.848474+0000","last_unstale":"2023-12-08T08:18:01.871709+0000","last_undegraded":"2023-12-08T08:18:01.871709+0000","last_fullsized":"2023-12-08T08:18:01.871709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:23.681343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867954+0000","last_change":"2023-12-08T08:17:56.839808+0000","last_active":"2023-12-08T08:18:01.867954+0000","last_peered":"2023-12-08T08:18:01.867954+0000","last_clean":"2023-12-08T08:18:01.867954+0000","last_became_active":"2023-12-08T08:17:56.839540+0000","last_became_peered":"2023-12-08T08:17:56.839540+0000","last_unstale":"2023-12-08T08:18:01.867954+0000","last_undegraded":"2023-12-08T08:18:01.867954+0000","last_fullsized":"2023-12-08T08:18:01.867954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569746+0000","last_change":"2023-12-08T08:18:01.897047+0000","last_active":"2023-12-08T08:18:03.569746+0000","last_peered":"2023-12-08T08:18:03.569746+0000","last_clean":"2023-12-08T08:18:03.569746+0000","last_became_active":"2023-12-08T08:18:01.896673+0000","last_became_peered":"2023-12-08T08:18:01.896673+0000","last_unstale":"2023-12-08T08:18:03.569746+0000","last_undegraded":"2023-12-08T08:18:03.569746+0000","last_fullsized":"2023-12-08T08:18:03.569746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868108+0000","last_change":"2023-12-08T08:17:57.863988+0000","last_active":"2023-12-08T08:18:01.868108+0000","last_peered":"2023-12-08T08:18:01.868108+0000","last_clean":"2023-12-08T08:18:01.868108+0000","last_became_active":"2023-12-08T08:17:57.863672+0000","last_became_peered":"2023-12-08T08:17:57.863672+0000","last_unstale":"2023-12-08T08:18:01.868108+0000","last_undegraded":"2023-12-08T08:18:01.868108+0000","last_fullsized":"2023-12-08T08:18:01.868108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868596+0000","last_change":"2023-12-08T08:17:56.838442+0000","last_active":"2023-12-08T08:18:01.868596+0000","last_peered":"2023-12-08T08:18:01.868596+0000","last_clean":"2023-12-08T08:18:01.868596+0000","last_became_active":"2023-12-08T08:17:56.838200+0000","last_became_peered":"2023-12-08T08:17:56.838200+0000","last_unstale":"2023-12-08T08:18:01.868596+0000","last_undegraded":"2023-12-08T08:18:01.868596+0000","last_fullsized":"2023-12-08T08:18:01.868596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:05.691540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868065+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:18:01.868065+0000","last_peered":"2023-12-08T08:18:01.868065+0000","last_clean":"2023-12-08T08:18:01.868065+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:18:01.868065+0000","last_undegraded":"2023-12-08T08:18:01.868065+0000","last_fullsized":"2023-12-08T08:18:01.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880838+0000","last_change":"2023-12-08T08:18:01.888488+0000","last_active":"2023-12-08T08:18:02.880838+0000","last_peered":"2023-12-08T08:18:02.880838+0000","last_clean":"2023-12-08T08:18:02.880838+0000","last_became_active":"2023-12-08T08:18:01.888094+0000","last_became_peered":"2023-12-08T08:18:01.888094+0000","last_unstale":"2023-12-08T08:18:02.880838+0000","last_undegraded":"2023-12-08T08:18:02.880838+0000","last_fullsized":"2023-12-08T08:18:02.880838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868680+0000","last_change":"2023-12-08T08:17:57.857404+0000","last_active":"2023-12-08T08:18:01.868680+0000","last_peered":"2023-12-08T08:18:01.868680+0000","last_clean":"2023-12-08T08:18:01.868680+0000","last_became_active":"2023-12-08T08:17:57.857153+0000","last_became_peered":"2023-12-08T08:17:57.857153+0000","last_unstale":"2023-12-08T08:18:01.868680+0000","last_undegraded":"2023-12-08T08:18:01.868680+0000","last_fullsized":"2023-12-08T08:18:01.868680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873513+0000","last_change":"2023-12-08T08:17:56.839948+0000","last_active":"2023-12-08T08:18:01.873513+0000","last_peered":"2023-12-08T08:18:01.873513+0000","last_clean":"2023-12-08T08:18:01.873513+0000","last_became_active":"2023-12-08T08:17:56.839635+0000","last_became_peered":"2023-12-08T08:17:56.839635+0000","last_unstale":"2023-12-08T08:18:01.873513+0000","last_undegraded":"2023-12-08T08:18:01.873513+0000","last_fullsized":"2023-12-08T08:18:01.873513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.879318+0000","last_change":"2023-12-08T08:18:01.896627+0000","last_active":"2023-12-08T08:18:02.879318+0000","last_peered":"2023-12-08T08:18:02.879318+0000","last_clean":"2023-12-08T08:18:02.879318+0000","last_became_active":"2023-12-08T08:18:01.896206+0000","last_became_peered":"2023-12-08T08:18:01.896206+0000","last_unstale":"2023-12-08T08:18:02.879318+0000","last_undegraded":"2023-12-08T08:18:02.879318+0000","last_fullsized":"2023-12-08T08:18:02.879318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:10.446350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869237+0000","last_change":"2023-12-08T08:17:57.868521+0000","last_active":"2023-12-08T08:18:01.869237+0000","last_peered":"2023-12-08T08:18:01.869237+0000","last_clean":"2023-12-08T08:18:01.869237+0000","last_became_active":"2023-12-08T08:17:57.866204+0000","last_became_peered":"2023-12-08T08:17:57.866204+0000","last_unstale":"2023-12-08T08:18:01.869237+0000","last_undegraded":"2023-12-08T08:18:01.869237+0000","last_fullsized":"2023-12-08T08:18:01.869237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885415+0000","last_change":"2023-12-08T08:17:56.831155+0000","last_active":"2023-12-08T08:18:01.885415+0000","last_peered":"2023-12-08T08:18:01.885415+0000","last_clean":"2023-12-08T08:18:01.885415+0000","last_became_active":"2023-12-08T08:17:56.830810+0000","last_became_peered":"2023-12-08T08:17:56.830810+0000","last_unstale":"2023-12-08T08:18:01.885415+0000","last_undegraded":"2023-12-08T08:18:01.885415+0000","last_fullsized":"2023-12-08T08:18:01.885415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569993+0000","last_change":"2023-12-08T08:18:01.888765+0000","last_active":"2023-12-08T08:18:03.569993+0000","last_peered":"2023-12-08T08:18:03.569993+0000","last_clean":"2023-12-08T08:18:03.569993+0000","last_became_active":"2023-12-08T08:18:01.888409+0000","last_became_peered":"2023-12-08T08:18:01.888409+0000","last_unstale":"2023-12-08T08:18:03.569993+0000","last_undegraded":"2023-12-08T08:18:03.569993+0000","last_fullsized":"2023-12-08T08:18:03.569993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868755+0000","last_change":"2023-12-08T08:17:57.862594+0000","last_active":"2023-12-08T08:18:01.868755+0000","last_peered":"2023-12-08T08:18:01.868755+0000","last_clean":"2023-12-08T08:18:01.868755+0000","last_became_active":"2023-12-08T08:17:57.862124+0000","last_became_peered":"2023-12-08T08:17:57.862124+0000","last_unstale":"2023-12-08T08:18:01.868755+0000","last_undegraded":"2023-12-08T08:18:01.868755+0000","last_fullsized":"2023-12-08T08:18:01.868755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:34.877529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875757+0000","last_change":"2023-12-08T08:17:56.838532+0000","last_active":"2023-12-08T08:18:01.875757+0000","last_peered":"2023-12-08T08:18:01.875757+0000","last_clean":"2023-12-08T08:18:01.875757+0000","last_became_active":"2023-12-08T08:17:56.838220+0000","last_became_peered":"2023-12-08T08:17:56.838220+0000","last_unstale":"2023-12-08T08:18:01.875757+0000","last_undegraded":"2023-12-08T08:18:01.875757+0000","last_fullsized":"2023-12-08T08:18:01.875757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568060+0000","last_change":"2023-12-08T08:18:01.882801+0000","last_active":"2023-12-08T08:18:03.568060+0000","last_peered":"2023-12-08T08:18:03.568060+0000","last_clean":"2023-12-08T08:18:03.568060+0000","last_became_active":"2023-12-08T08:18:01.882438+0000","last_became_peered":"2023-12-08T08:18:01.882438+0000","last_unstale":"2023-12-08T08:18:03.568060+0000","last_undegraded":"2023-12-08T08:18:03.568060+0000","last_fullsized":"2023-12-08T08:18:03.568060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868362+0000","last_change":"2023-12-08T08:17:57.854674+0000","last_active":"2023-12-08T08:18:01.868362+0000","last_peered":"2023-12-08T08:18:01.868362+0000","last_clean":"2023-12-08T08:18:01.868362+0000","last_became_active":"2023-12-08T08:17:57.854400+0000","last_became_peered":"2023-12-08T08:17:57.854400+0000","last_unstale":"2023-12-08T08:18:01.868362+0000","last_undegraded":"2023-12-08T08:18:01.868362+0000","last_fullsized":"2023-12-08T08:18:01.868362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871957+0000","last_change":"2023-12-08T08:17:56.833827+0000","last_active":"2023-12-08T08:18:01.871957+0000","last_peered":"2023-12-08T08:18:01.871957+0000","last_clean":"2023-12-08T08:18:01.871957+0000","last_became_active":"2023-12-08T08:17:56.833544+0000","last_became_peered":"2023-12-08T08:17:56.833544+0000","last_unstale":"2023-12-08T08:18:01.871957+0000","last_undegraded":"2023-12-08T08:18:01.871957+0000","last_fullsized":"2023-12-08T08:18:01.871957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:30:08.734416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568098+0000","last_change":"2023-12-08T08:18:01.890953+0000","last_active":"2023-12-08T08:18:03.568098+0000","last_peered":"2023-12-08T08:18:03.568098+0000","last_clean":"2023-12-08T08:18:03.568098+0000","last_became_active":"2023-12-08T08:18:01.890169+0000","last_became_peered":"2023-12-08T08:18:01.890169+0000","last_unstale":"2023-12-08T08:18:03.568098+0000","last_undegraded":"2023-12-08T08:18:03.568098+0000","last_fullsized":"2023-12-08T08:18:03.568098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:14.643740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868180+0000","last_change":"2023-12-08T08:17:57.858656+0000","last_active":"2023-12-08T08:18:01.868180+0000","last_peered":"2023-12-08T08:18:01.868180+0000","last_clean":"2023-12-08T08:18:01.868180+0000","last_became_active":"2023-12-08T08:17:57.858335+0000","last_became_peered":"2023-12-08T08:17:57.858335+0000","last_unstale":"2023-12-08T08:18:01.868180+0000","last_undegraded":"2023-12-08T08:18:01.868180+0000","last_fullsized":"2023-12-08T08:18:01.868180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872816+0000","last_change":"2023-12-08T08:17:56.828427+0000","last_active":"2023-12-08T08:18:01.872816+0000","last_peered":"2023-12-08T08:18:01.872816+0000","last_clean":"2023-12-08T08:18:01.872816+0000","last_became_active":"2023-12-08T08:17:56.828104+0000","last_became_peered":"2023-12-08T08:17:56.828104+0000","last_unstale":"2023-12-08T08:18:01.872816+0000","last_undegraded":"2023-12-08T08:18:01.872816+0000","last_fullsized":"2023-12-08T08:18:01.872816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:35.770309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569594+0000","last_change":"2023-12-08T08:18:01.882325+0000","last_active":"2023-12-08T08:18:03.569594+0000","last_peered":"2023-12-08T08:18:03.569594+0000","last_clean":"2023-12-08T08:18:03.569594+0000","last_became_active":"2023-12-08T08:18:01.881811+0000","last_became_peered":"2023-12-08T08:18:01.881811+0000","last_unstale":"2023-12-08T08:18:03.569594+0000","last_undegraded":"2023-12-08T08:18:03.569594+0000","last_fullsized":"2023-12-08T08:18:03.569594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881194+0000","last_change":"2023-12-08T08:17:57.868472+0000","last_active":"2023-12-08T08:18:01.881194+0000","last_peered":"2023-12-08T08:18:01.881194+0000","last_clean":"2023-12-08T08:18:01.881194+0000","last_became_active":"2023-12-08T08:17:57.867557+0000","last_became_peered":"2023-12-08T08:17:57.867557+0000","last_unstale":"2023-12-08T08:18:01.881194+0000","last_undegraded":"2023-12-08T08:18:01.881194+0000","last_fullsized":"2023-12-08T08:18:01.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880481+0000","last_change":"2023-12-08T08:17:56.834501+0000","last_active":"2023-12-08T08:18:01.880481+0000","last_peered":"2023-12-08T08:18:01.880481+0000","last_clean":"2023-12-08T08:18:01.880481+0000","last_became_active":"2023-12-08T08:17:56.834216+0000","last_became_peered":"2023-12-08T08:17:56.834216+0000","last_unstale":"2023-12-08T08:18:01.880481+0000","last_undegraded":"2023-12-08T08:18:01.880481+0000","last_fullsized":"2023-12-08T08:18:01.880481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568473+0000","last_change":"2023-12-08T08:18:01.891154+0000","last_active":"2023-12-08T08:18:03.568473+0000","last_peered":"2023-12-08T08:18:03.568473+0000","last_clean":"2023-12-08T08:18:03.568473+0000","last_became_active":"2023-12-08T08:18:01.890734+0000","last_became_peered":"2023-12-08T08:18:01.890734+0000","last_unstale":"2023-12-08T08:18:03.568473+0000","last_undegraded":"2023-12-08T08:18:03.568473+0000","last_fullsized":"2023-12-08T08:18:03.568473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:18:11.033301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868378+0000","last_change":"2023-12-08T08:17:57.861535+0000","last_active":"2023-12-08T08:18:01.868378+0000","last_peered":"2023-12-08T08:18:01.868378+0000","last_clean":"2023-12-08T08:18:01.868378+0000","last_became_active":"2023-12-08T08:17:57.860529+0000","last_became_peered":"2023-12-08T08:17:57.860529+0000","last_unstale":"2023-12-08T08:18:01.868378+0000","last_undegraded":"2023-12-08T08:18:01.868378+0000","last_fullsized":"2023-12-08T08:18:01.868378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869270+0000","last_change":"2023-12-08T08:17:56.838952+0000","last_active":"2023-12-08T08:18:01.869270+0000","last_peered":"2023-12-08T08:18:01.869270+0000","last_clean":"2023-12-08T08:18:01.869270+0000","last_became_active":"2023-12-08T08:17:56.838708+0000","last_became_peered":"2023-12-08T08:17:56.838708+0000","last_unstale":"2023-12-08T08:18:01.869270+0000","last_undegraded":"2023-12-08T08:18:01.869270+0000","last_fullsized":"2023-12-08T08:18:01.869270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568624+0000","last_change":"2023-12-08T08:18:01.893574+0000","last_active":"2023-12-08T08:18:03.568624+0000","last_peered":"2023-12-08T08:18:03.568624+0000","last_clean":"2023-12-08T08:18:03.568624+0000","last_became_active":"2023-12-08T08:18:01.892008+0000","last_became_peered":"2023-12-08T08:18:01.892008+0000","last_unstale":"2023-12-08T08:18:03.568624+0000","last_undegraded":"2023-12-08T08:18:03.568624+0000","last_fullsized":"2023-12-08T08:18:03.568624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:59:58.367917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873150+0000","last_change":"2023-12-08T08:17:57.858464+0000","last_active":"2023-12-08T08:18:01.873150+0000","last_peered":"2023-12-08T08:18:01.873150+0000","last_clean":"2023-12-08T08:18:01.873150+0000","last_became_active":"2023-12-08T08:17:57.857748+0000","last_became_peered":"2023-12-08T08:17:57.857748+0000","last_unstale":"2023-12-08T08:18:01.873150+0000","last_undegraded":"2023-12-08T08:18:01.873150+0000","last_fullsized":"2023-12-08T08:18:01.873150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872709+0000","last_change":"2023-12-08T08:17:56.834818+0000","last_active":"2023-12-08T08:18:01.872709+0000","last_peered":"2023-12-08T08:18:01.872709+0000","last_clean":"2023-12-08T08:18:01.872709+0000","last_became_active":"2023-12-08T08:17:56.834412+0000","last_became_peered":"2023-12-08T08:17:56.834412+0000","last_unstale":"2023-12-08T08:18:01.872709+0000","last_undegraded":"2023-12-08T08:18:01.872709+0000","last_fullsized":"2023-12-08T08:18:01.872709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569218+0000","last_change":"2023-12-08T08:18:01.879603+0000","last_active":"2023-12-08T08:18:03.569218+0000","last_peered":"2023-12-08T08:18:03.569218+0000","last_clean":"2023-12-08T08:18:03.569218+0000","last_became_active":"2023-12-08T08:18:01.879223+0000","last_became_peered":"2023-12-08T08:18:01.879223+0000","last_unstale":"2023-12-08T08:18:03.569218+0000","last_undegraded":"2023-12-08T08:18:03.569218+0000","last_fullsized":"2023-12-08T08:18:03.569218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868610+0000","last_change":"2023-12-08T08:17:57.867653+0000","last_active":"2023-12-08T08:18:01.868610+0000","last_peered":"2023-12-08T08:18:01.868610+0000","last_clean":"2023-12-08T08:18:01.868610+0000","last_became_active":"2023-12-08T08:17:57.867361+0000","last_became_peered":"2023-12-08T08:17:57.867361+0000","last_unstale":"2023-12-08T08:18:01.868610+0000","last_undegraded":"2023-12-08T08:18:01.868610+0000","last_fullsized":"2023-12-08T08:18:01.868610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:07.193843+0000","last_change":"2023-12-08T08:17:56.841032+0000","last_active":"2023-12-08T08:18:07.193843+0000","last_peered":"2023-12-08T08:18:07.193843+0000","last_clean":"2023-12-08T08:18:07.193843+0000","last_became_active":"2023-12-08T08:17:56.840787+0000","last_became_peered":"2023-12-08T08:17:56.840787+0000","last_unstale":"2023-12-08T08:18:07.193843+0000","last_undegraded":"2023-12-08T08:18:07.193843+0000","last_fullsized":"2023-12-08T08:18:07.193843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569636+0000","last_change":"2023-12-08T08:18:01.891258+0000","last_active":"2023-12-08T08:18:03.569636+0000","last_peered":"2023-12-08T08:18:03.569636+0000","last_clean":"2023-12-08T08:18:03.569636+0000","last_became_active":"2023-12-08T08:18:01.889956+0000","last_became_peered":"2023-12-08T08:18:01.889956+0000","last_unstale":"2023-12-08T08:18:03.569636+0000","last_undegraded":"2023-12-08T08:18:03.569636+0000","last_fullsized":"2023-12-08T08:18:03.569636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873425+0000","last_change":"2023-12-08T08:17:57.855938+0000","last_active":"2023-12-08T08:18:01.873425+0000","last_peered":"2023-12-08T08:18:01.873425+0000","last_clean":"2023-12-08T08:18:01.873425+0000","last_became_active":"2023-12-08T08:17:57.855668+0000","last_became_peered":"2023-12-08T08:17:57.855668+0000","last_unstale":"2023-12-08T08:18:01.873425+0000","last_undegraded":"2023-12-08T08:18:01.873425+0000","last_fullsized":"2023-12-08T08:18:01.873425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:53.755384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885215+0000","last_change":"2023-12-08T08:17:56.840188+0000","last_active":"2023-12-08T08:18:01.885215+0000","last_peered":"2023-12-08T08:18:01.885215+0000","last_clean":"2023-12-08T08:18:01.885215+0000","last_became_active":"2023-12-08T08:17:56.839837+0000","last_became_peered":"2023-12-08T08:17:56.839837+0000","last_unstale":"2023-12-08T08:18:01.885215+0000","last_undegraded":"2023-12-08T08:18:01.885215+0000","last_fullsized":"2023-12-08T08:18:01.885215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568880+0000","last_change":"2023-12-08T08:18:01.891860+0000","last_active":"2023-12-08T08:18:03.568880+0000","last_peered":"2023-12-08T08:18:03.568880+0000","last_clean":"2023-12-08T08:18:03.568880+0000","last_became_active":"2023-12-08T08:18:01.890853+0000","last_became_peered":"2023-12-08T08:18:01.890853+0000","last_unstale":"2023-12-08T08:18:03.568880+0000","last_undegraded":"2023-12-08T08:18:03.568880+0000","last_fullsized":"2023-12-08T08:18:03.568880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:30.071394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872334+0000","last_change":"2023-12-08T08:17:57.855509+0000","last_active":"2023-12-08T08:18:01.872334+0000","last_peered":"2023-12-08T08:18:01.872334+0000","last_clean":"2023-12-08T08:18:01.872334+0000","last_became_active":"2023-12-08T08:17:57.855195+0000","last_became_peered":"2023-12-08T08:17:57.855195+0000","last_unstale":"2023-12-08T08:18:01.872334+0000","last_undegraded":"2023-12-08T08:18:01.872334+0000","last_fullsized":"2023-12-08T08:18:01.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868832+0000","last_change":"2023-12-08T08:17:56.838218+0000","last_active":"2023-12-08T08:18:01.868832+0000","last_peered":"2023-12-08T08:18:01.868832+0000","last_clean":"2023-12-08T08:18:01.868832+0000","last_became_active":"2023-12-08T08:17:56.837942+0000","last_became_peered":"2023-12-08T08:17:56.837942+0000","last_unstale":"2023-12-08T08:18:01.868832+0000","last_undegraded":"2023-12-08T08:18:01.868832+0000","last_fullsized":"2023-12-08T08:18:01.868832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:12.171098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567801+0000","last_change":"2023-12-08T08:18:01.888958+0000","last_active":"2023-12-08T08:18:03.567801+0000","last_peered":"2023-12-08T08:18:03.567801+0000","last_clean":"2023-12-08T08:18:03.567801+0000","last_became_active":"2023-12-08T08:18:01.888522+0000","last_became_peered":"2023-12-08T08:18:01.888522+0000","last_unstale":"2023-12-08T08:18:03.567801+0000","last_undegraded":"2023-12-08T08:18:03.567801+0000","last_fullsized":"2023-12-08T08:18:03.567801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868748+0000","last_change":"2023-12-08T08:17:57.859464+0000","last_active":"2023-12-08T08:18:01.868748+0000","last_peered":"2023-12-08T08:18:01.868748+0000","last_clean":"2023-12-08T08:18:01.868748+0000","last_became_active":"2023-12-08T08:17:57.857871+0000","last_became_peered":"2023-12-08T08:17:57.857871+0000","last_unstale":"2023-12-08T08:18:01.868748+0000","last_undegraded":"2023-12-08T08:18:01.868748+0000","last_fullsized":"2023-12-08T08:18:01.868748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881565+0000","last_change":"2023-12-08T08:17:56.840338+0000","last_active":"2023-12-08T08:18:01.881565+0000","last_peered":"2023-12-08T08:18:01.881565+0000","last_clean":"2023-12-08T08:18:01.881565+0000","last_became_active":"2023-12-08T08:17:56.838415+0000","last_became_peered":"2023-12-08T08:17:56.838415+0000","last_unstale":"2023-12-08T08:18:01.881565+0000","last_undegraded":"2023-12-08T08:18:01.881565+0000","last_fullsized":"2023-12-08T08:18:01.881565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567966+0000","last_change":"2023-12-08T08:18:01.886353+0000","last_active":"2023-12-08T08:18:03.567966+0000","last_peered":"2023-12-08T08:18:03.567966+0000","last_clean":"2023-12-08T08:18:03.567966+0000","last_became_active":"2023-12-08T08:18:01.885733+0000","last_became_peered":"2023-12-08T08:18:01.885733+0000","last_unstale":"2023-12-08T08:18:03.567966+0000","last_undegraded":"2023-12-08T08:18:03.567966+0000","last_fullsized":"2023-12-08T08:18:03.567966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:42:20.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569455+0000","last_change":"2023-12-08T08:18:01.898257+0000","last_active":"2023-12-08T08:18:03.569455+0000","last_peered":"2023-12-08T08:18:03.569455+0000","last_clean":"2023-12-08T08:18:03.569455+0000","last_became_active":"2023-12-08T08:18:01.897895+0000","last_became_peered":"2023-12-08T08:18:01.897895+0000","last_unstale":"2023-12-08T08:18:03.569455+0000","last_undegraded":"2023-12-08T08:18:03.569455+0000","last_fullsized":"2023-12-08T08:18:03.569455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885110+0000","last_change":"2023-12-08T08:17:57.852450+0000","last_active":"2023-12-08T08:18:01.885110+0000","last_peered":"2023-12-08T08:18:01.885110+0000","last_clean":"2023-12-08T08:18:01.885110+0000","last_became_active":"2023-12-08T08:17:57.852146+0000","last_became_peered":"2023-12-08T08:17:57.852146+0000","last_unstale":"2023-12-08T08:18:01.885110+0000","last_undegraded":"2023-12-08T08:18:01.885110+0000","last_fullsized":"2023-12-08T08:18:01.885110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870056+0000","last_change":"2023-12-08T08:17:56.834758+0000","last_active":"2023-12-08T08:18:01.870056+0000","last_peered":"2023-12-08T08:18:01.870056+0000","last_clean":"2023-12-08T08:18:01.870056+0000","last_became_active":"2023-12-08T08:17:56.834493+0000","last_became_peered":"2023-12-08T08:17:56.834493+0000","last_unstale":"2023-12-08T08:18:01.870056+0000","last_undegraded":"2023-12-08T08:18:01.870056+0000","last_fullsized":"2023-12-08T08:18:01.870056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880773+0000","last_change":"2023-12-08T08:18:01.897055+0000","last_active":"2023-12-08T08:18:02.880773+0000","last_peered":"2023-12-08T08:18:02.880773+0000","last_clean":"2023-12-08T08:18:02.880773+0000","last_became_active":"2023-12-08T08:18:01.896646+0000","last_became_peered":"2023-12-08T08:18:01.896646+0000","last_unstale":"2023-12-08T08:18:02.880773+0000","last_undegraded":"2023-12-08T08:18:02.880773+0000","last_fullsized":"2023-12-08T08:18:02.880773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:29.043747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869691+0000","last_change":"2023-12-08T08:17:57.864805+0000","last_active":"2023-12-08T08:18:01.869691+0000","last_peered":"2023-12-08T08:18:01.869691+0000","last_clean":"2023-12-08T08:18:01.869691+0000","last_became_active":"2023-12-08T08:17:57.864486+0000","last_became_peered":"2023-12-08T08:17:57.864486+0000","last_unstale":"2023-12-08T08:18:01.869691+0000","last_undegraded":"2023-12-08T08:18:01.869691+0000","last_fullsized":"2023-12-08T08:18:01.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870461+0000","last_change":"2023-12-08T08:17:56.836827+0000","last_active":"2023-12-08T08:18:01.870461+0000","last_peered":"2023-12-08T08:18:01.870461+0000","last_clean":"2023-12-08T08:18:01.870461+0000","last_became_active":"2023-12-08T08:17:56.836562+0000","last_became_peered":"2023-12-08T08:17:56.836562+0000","last_unstale":"2023-12-08T08:18:01.870461+0000","last_undegraded":"2023-12-08T08:18:01.870461+0000","last_fullsized":"2023-12-08T08:18:01.870461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880545+0000","last_change":"2023-12-08T08:17:56.831417+0000","last_active":"2023-12-08T08:18:01.880545+0000","last_peered":"2023-12-08T08:18:01.880545+0000","last_clean":"2023-12-08T08:18:01.880545+0000","last_became_active":"2023-12-08T08:17:56.830988+0000","last_became_peered":"2023-12-08T08:17:56.830988+0000","last_unstale":"2023-12-08T08:18:01.880545+0000","last_undegraded":"2023-12-08T08:18:01.880545+0000","last_fullsized":"2023-12-08T08:18:01.880545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872623+0000","last_change":"2023-12-08T08:17:57.848661+0000","last_active":"2023-12-08T08:18:01.872623+0000","last_peered":"2023-12-08T08:18:01.872623+0000","last_clean":"2023-12-08T08:18:01.872623+0000","last_became_active":"2023-12-08T08:17:57.848371+0000","last_became_peered":"2023-12-08T08:17:57.848371+0000","last_unstale":"2023-12-08T08:18:01.872623+0000","last_undegraded":"2023-12-08T08:18:01.872623+0000","last_fullsized":"2023-12-08T08:18:01.872623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.878886+0000","last_change":"2023-12-08T08:18:01.892612+0000","last_active":"2023-12-08T08:18:02.878886+0000","last_peered":"2023-12-08T08:18:02.878886+0000","last_clean":"2023-12-08T08:18:02.878886+0000","last_became_active":"2023-12-08T08:18:01.892204+0000","last_became_peered":"2023-12-08T08:18:01.892204+0000","last_unstale":"2023-12-08T08:18:02.878886+0000","last_undegraded":"2023-12-08T08:18:02.878886+0000","last_fullsized":"2023-12-08T08:18:02.878886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:27.724596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867878+0000","last_change":"2023-12-08T08:17:56.842132+0000","last_active":"2023-12-08T08:18:01.867878+0000","last_peered":"2023-12-08T08:18:01.867878+0000","last_clean":"2023-12-08T08:18:01.867878+0000","last_became_active":"2023-12-08T08:17:56.841864+0000","last_became_peered":"2023-12-08T08:17:56.841864+0000","last_unstale":"2023-12-08T08:18:01.867878+0000","last_undegraded":"2023-12-08T08:18:01.867878+0000","last_fullsized":"2023-12-08T08:18:01.867878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872976+0000","last_change":"2023-12-08T08:17:57.851016+0000","last_active":"2023-12-08T08:18:01.872976+0000","last_peered":"2023-12-08T08:18:01.872976+0000","last_clean":"2023-12-08T08:18:01.872976+0000","last_became_active":"2023-12-08T08:17:57.850755+0000","last_became_peered":"2023-12-08T08:17:57.850755+0000","last_unstale":"2023-12-08T08:18:01.872976+0000","last_undegraded":"2023-12-08T08:18:01.872976+0000","last_fullsized":"2023-12-08T08:18:01.872976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:31.989844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569175+0000","last_change":"2023-12-08T08:18:01.894077+0000","last_active":"2023-12-08T08:18:03.569175+0000","last_peered":"2023-12-08T08:18:03.569175+0000","last_clean":"2023-12-08T08:18:03.569175+0000","last_became_active":"2023-12-08T08:18:01.893598+0000","last_became_peered":"2023-12-08T08:18:01.893598+0000","last_unstale":"2023-12-08T08:18:03.569175+0000","last_undegraded":"2023-12-08T08:18:03.569175+0000","last_fullsized":"2023-12-08T08:18:03.569175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:42:43.972716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880217+0000","last_change":"2023-12-08T08:17:57.867998+0000","last_active":"2023-12-08T08:18:01.880217+0000","last_peered":"2023-12-08T08:18:01.880217+0000","last_clean":"2023-12-08T08:18:01.880217+0000","last_became_active":"2023-12-08T08:17:57.867727+0000","last_became_peered":"2023-12-08T08:17:57.867727+0000","last_unstale":"2023-12-08T08:18:01.880217+0000","last_undegraded":"2023-12-08T08:18:01.880217+0000","last_fullsized":"2023-12-08T08:18:01.880217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872963+0000","last_change":"2023-12-08T08:17:57.858911+0000","last_active":"2023-12-08T08:18:01.872963+0000","last_peered":"2023-12-08T08:18:01.872963+0000","last_clean":"2023-12-08T08:18:01.872963+0000","last_became_active":"2023-12-08T08:17:57.857682+0000","last_became_peered":"2023-12-08T08:17:57.857682+0000","last_unstale":"2023-12-08T08:18:01.872963+0000","last_undegraded":"2023-12-08T08:18:01.872963+0000","last_fullsized":"2023-12-08T08:18:01.872963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:20.413569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869275+0000","last_change":"2023-12-08T08:17:57.854413+0000","last_active":"2023-12-08T08:18:01.869275+0000","last_peered":"2023-12-08T08:18:01.869275+0000","last_clean":"2023-12-08T08:18:01.869275+0000","last_became_active":"2023-12-08T08:17:57.854156+0000","last_became_peered":"2023-12-08T08:17:57.854156+0000","last_unstale":"2023-12-08T08:18:01.869275+0000","last_undegraded":"2023-12-08T08:18:01.869275+0000","last_fullsized":"2023-12-08T08:18:01.869275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872542+0000","last_change":"2023-12-08T08:17:57.853043+0000","last_active":"2023-12-08T08:18:01.872542+0000","last_peered":"2023-12-08T08:18:01.872542+0000","last_clean":"2023-12-08T08:18:01.872542+0000","last_became_active":"2023-12-08T08:17:57.852710+0000","last_became_peered":"2023-12-08T08:17:57.852710+0000","last_unstale":"2023-12-08T08:18:01.872542+0000","last_undegraded":"2023-12-08T08:18:01.872542+0000","last_fullsized":"2023-12-08T08:18:01.872542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868777+0000","last_change":"2023-12-08T08:17:57.862525+0000","last_active":"2023-12-08T08:18:01.868777+0000","last_peered":"2023-12-08T08:18:01.868777+0000","last_clean":"2023-12-08T08:18:01.868777+0000","last_became_active":"2023-12-08T08:17:57.862274+0000","last_became_peered":"2023-12-08T08:17:57.862274+0000","last_unstale":"2023-12-08T08:18:01.868777+0000","last_undegraded":"2023-12-08T08:18:01.868777+0000","last_fullsized":"2023-12-08T08:18:01.868777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885096+0000","last_change":"2023-12-08T08:17:57.850983+0000","last_active":"2023-12-08T08:18:01.885096+0000","last_peered":"2023-12-08T08:18:01.885096+0000","last_clean":"2023-12-08T08:18:01.885096+0000","last_became_active":"2023-12-08T08:17:57.850648+0000","last_became_peered":"2023-12-08T08:17:57.850648+0000","last_unstale":"2023-12-08T08:18:01.885096+0000","last_undegraded":"2023-12-08T08:18:01.885096+0000","last_fullsized":"2023-12-08T08:18:01.885096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880266+0000","last_change":"2023-12-08T08:17:57.871856+0000","last_active":"2023-12-08T08:18:01.880266+0000","last_peered":"2023-12-08T08:18:01.880266+0000","last_clean":"2023-12-08T08:18:01.880266+0000","last_became_active":"2023-12-08T08:17:57.871436+0000","last_became_peered":"2023-12-08T08:17:57.871436+0000","last_unstale":"2023-12-08T08:18:01.880266+0000","last_undegraded":"2023-12-08T08:18:01.880266+0000","last_fullsized":"2023-12-08T08:18:01.880266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868325+0000","last_change":"2023-12-08T08:17:57.861903+0000","last_active":"2023-12-08T08:18:01.868325+0000","last_peered":"2023-12-08T08:18:01.868325+0000","last_clean":"2023-12-08T08:18:01.868325+0000","last_became_active":"2023-12-08T08:17:57.861604+0000","last_became_peered":"2023-12-08T08:17:57.861604+0000","last_unstale":"2023-12-08T08:18:01.868325+0000","last_undegraded":"2023-12-08T08:18:01.868325+0000","last_fullsized":"2023-12-08T08:18:01.868325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869960+0000","last_change":"2023-12-08T08:17:57.853217+0000","last_active":"2023-12-08T08:18:01.869960+0000","last_peered":"2023-12-08T08:18:01.869960+0000","last_clean":"2023-12-08T08:18:01.869960+0000","last_became_active":"2023-12-08T08:17:57.852944+0000","last_became_peered":"2023-12-08T08:17:57.852944+0000","last_unstale":"2023-12-08T08:18:01.869960+0000","last_undegraded":"2023-12-08T08:18:01.869960+0000","last_fullsized":"2023-12-08T08:18:01.869960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869655+0000","last_change":"2023-12-08T08:17:57.861199+0000","last_active":"2023-12-08T08:18:01.869655+0000","last_peered":"2023-12-08T08:18:01.869655+0000","last_clean":"2023-12-08T08:18:01.869655+0000","last_became_active":"2023-12-08T08:17:57.860929+0000","last_became_peered":"2023-12-08T08:17:57.860929+0000","last_unstale":"2023-12-08T08:18:01.869655+0000","last_undegraded":"2023-12-08T08:18:01.869655+0000","last_fullsized":"2023-12-08T08:18:01.869655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869190+0000","last_change":"2023-12-08T08:17:57.857515+0000","last_active":"2023-12-08T08:18:01.869190+0000","last_peered":"2023-12-08T08:18:01.869190+0000","last_clean":"2023-12-08T08:18:01.869190+0000","last_became_active":"2023-12-08T08:17:57.857211+0000","last_became_peered":"2023-12-08T08:17:57.857211+0000","last_unstale":"2023-12-08T08:18:01.869190+0000","last_undegraded":"2023-12-08T08:18:01.869190+0000","last_fullsized":"2023-12-08T08:18:01.869190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872446+0000","last_change":"2023-12-08T08:17:57.858919+0000","last_active":"2023-12-08T08:18:01.872446+0000","last_peered":"2023-12-08T08:18:01.872446+0000","last_clean":"2023-12-08T08:18:01.872446+0000","last_became_active":"2023-12-08T08:17:57.858591+0000","last_became_peered":"2023-12-08T08:17:57.858591+0000","last_unstale":"2023-12-08T08:18:01.872446+0000","last_undegraded":"2023-12-08T08:18:01.872446+0000","last_fullsized":"2023-12-08T08:18:01.872446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880097+0000","last_change":"2023-12-08T08:17:57.867005+0000","last_active":"2023-12-08T08:18:01.880097+0000","last_peered":"2023-12-08T08:18:01.880097+0000","last_clean":"2023-12-08T08:18:01.880097+0000","last_became_active":"2023-12-08T08:17:57.866755+0000","last_became_peered":"2023-12-08T08:17:57.866755+0000","last_unstale":"2023-12-08T08:18:01.880097+0000","last_undegraded":"2023-12-08T08:18:01.880097+0000","last_fullsized":"2023-12-08T08:18:01.880097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868792+0000","last_change":"2023-12-08T08:17:57.857239+0000","last_active":"2023-12-08T08:18:01.868792+0000","last_peered":"2023-12-08T08:18:01.868792+0000","last_clean":"2023-12-08T08:18:01.868792+0000","last_became_active":"2023-12-08T08:17:57.856974+0000","last_became_peered":"2023-12-08T08:17:57.856974+0000","last_unstale":"2023-12-08T08:18:01.868792+0000","last_undegraded":"2023-12-08T08:18:01.868792+0000","last_fullsized":"2023-12-08T08:18:01.868792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875617+0000","last_change":"2023-12-08T08:17:57.870364+0000","last_active":"2023-12-08T08:18:01.875617+0000","last_peered":"2023-12-08T08:18:01.875617+0000","last_clean":"2023-12-08T08:18:01.875617+0000","last_became_active":"2023-12-08T08:17:57.870055+0000","last_became_peered":"2023-12-08T08:17:57.870055+0000","last_unstale":"2023-12-08T08:18:01.875617+0000","last_undegraded":"2023-12-08T08:18:01.875617+0000","last_fullsized":"2023-12-08T08:18:01.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869535+0000","last_change":"2023-12-08T08:17:57.856731+0000","last_active":"2023-12-08T08:18:01.869535+0000","last_peered":"2023-12-08T08:18:01.869535+0000","last_clean":"2023-12-08T08:18:01.869535+0000","last_became_active":"2023-12-08T08:17:57.856474+0000","last_became_peered":"2023-12-08T08:17:57.856474+0000","last_unstale":"2023-12-08T08:18:01.869535+0000","last_undegraded":"2023-12-08T08:18:01.869535+0000","last_fullsized":"2023-12-08T08:18:01.869535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869853+0000","last_change":"2023-12-08T08:17:57.863405+0000","last_active":"2023-12-08T08:18:01.869853+0000","last_peered":"2023-12-08T08:18:01.869853+0000","last_clean":"2023-12-08T08:18:01.869853+0000","last_became_active":"2023-12-08T08:17:57.863134+0000","last_became_peered":"2023-12-08T08:17:57.863134+0000","last_unstale":"2023-12-08T08:18:01.869853+0000","last_undegraded":"2023-12-08T08:18:01.869853+0000","last_fullsized":"2023-12-08T08:18:01.869853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885204+0000","last_change":"2023-12-08T08:17:57.860480+0000","last_active":"2023-12-08T08:18:01.885204+0000","last_peered":"2023-12-08T08:18:01.885204+0000","last_clean":"2023-12-08T08:18:01.885204+0000","last_became_active":"2023-12-08T08:17:57.860188+0000","last_became_peered":"2023-12-08T08:17:57.860188+0000","last_unstale":"2023-12-08T08:18:01.885204+0000","last_undegraded":"2023-12-08T08:18:01.885204+0000","last_fullsized":"2023-12-08T08:18:01.885204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873034+0000","last_change":"2023-12-08T08:17:57.852445+0000","last_active":"2023-12-08T08:18:01.873034+0000","last_peered":"2023-12-08T08:18:01.873034+0000","last_clean":"2023-12-08T08:18:01.873034+0000","last_became_active":"2023-12-08T08:17:57.852166+0000","last_became_peered":"2023-12-08T08:17:57.852166+0000","last_unstale":"2023-12-08T08:18:01.873034+0000","last_undegraded":"2023-12-08T08:18:01.873034+0000","last_fullsized":"2023-12-08T08:18:01.873034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:13.038005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867672+0000","last_change":"2023-12-08T08:17:57.869784+0000","last_active":"2023-12-08T08:18:01.867672+0000","last_peered":"2023-12-08T08:18:01.867672+0000","last_clean":"2023-12-08T08:18:01.867672+0000","last_became_active":"2023-12-08T08:17:57.869480+0000","last_became_peered":"2023-12-08T08:17:57.869480+0000","last_unstale":"2023-12-08T08:18:01.867672+0000","last_undegraded":"2023-12-08T08:18:01.867672+0000","last_fullsized":"2023-12-08T08:18:01.867672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873259+0000","last_change":"2023-12-08T08:17:57.870844+0000","last_active":"2023-12-08T08:18:01.873259+0000","last_peered":"2023-12-08T08:18:01.873259+0000","last_clean":"2023-12-08T08:18:01.873259+0000","last_became_active":"2023-12-08T08:17:57.870537+0000","last_became_peered":"2023-12-08T08:17:57.870537+0000","last_unstale":"2023-12-08T08:18:01.873259+0000","last_undegraded":"2023-12-08T08:18:01.873259+0000","last_fullsized":"2023-12-08T08:18:01.873259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:35.384529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880776+0000","last_change":"2023-12-08T08:17:57.867745+0000","last_active":"2023-12-08T08:18:01.880776+0000","last_peered":"2023-12-08T08:18:01.880776+0000","last_clean":"2023-12-08T08:18:01.880776+0000","last_became_active":"2023-12-08T08:17:57.867492+0000","last_became_peered":"2023-12-08T08:17:57.867492+0000","last_unstale":"2023-12-08T08:18:01.880776+0000","last_undegraded":"2023-12-08T08:18:01.880776+0000","last_fullsized":"2023-12-08T08:18:01.880776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880175+0000","last_change":"2023-12-08T08:17:57.866534+0000","last_active":"2023-12-08T08:18:01.880175+0000","last_peered":"2023-12-08T08:18:01.880175+0000","last_clean":"2023-12-08T08:18:01.880175+0000","last_became_active":"2023-12-08T08:17:57.866280+0000","last_became_peered":"2023-12-08T08:17:57.866280+0000","last_unstale":"2023-12-08T08:18:01.880175+0000","last_undegraded":"2023-12-08T08:18:01.880175+0000","last_fullsized":"2023-12-08T08:18:01.880175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868651+0000","last_change":"2023-12-08T08:17:57.862123+0000","last_active":"2023-12-08T08:18:01.868651+0000","last_peered":"2023-12-08T08:18:01.868651+0000","last_clean":"2023-12-08T08:18:01.868651+0000","last_became_active":"2023-12-08T08:17:57.859905+0000","last_became_peered":"2023-12-08T08:17:57.859905+0000","last_unstale":"2023-12-08T08:18:01.868651+0000","last_undegraded":"2023-12-08T08:18:01.868651+0000","last_fullsized":"2023-12-08T08:18:01.868651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:02.076263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869059+0000","last_change":"2023-12-08T08:17:57.864037+0000","last_active":"2023-12-08T08:18:01.869059+0000","last_peered":"2023-12-08T08:18:01.869059+0000","last_clean":"2023-12-08T08:18:01.869059+0000","last_became_active":"2023-12-08T08:17:57.862943+0000","last_became_peered":"2023-12-08T08:17:57.862943+0000","last_unstale":"2023-12-08T08:18:01.869059+0000","last_undegraded":"2023-12-08T08:18:01.869059+0000","last_fullsized":"2023-12-08T08:18:01.869059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868564+0000","last_change":"2023-12-08T08:17:57.863052+0000","last_active":"2023-12-08T08:18:01.868564+0000","last_peered":"2023-12-08T08:18:01.868564+0000","last_clean":"2023-12-08T08:18:01.868564+0000","last_became_active":"2023-12-08T08:17:57.862762+0000","last_became_peered":"2023-12-08T08:17:57.862762+0000","last_unstale":"2023-12-08T08:18:01.868564+0000","last_undegraded":"2023-12-08T08:18:01.868564+0000","last_fullsized":"2023-12-08T08:18:01.868564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869100+0000","last_change":"2023-12-08T08:17:57.863846+0000","last_active":"2023-12-08T08:18:01.869100+0000","last_peered":"2023-12-08T08:18:01.869100+0000","last_clean":"2023-12-08T08:18:01.869100+0000","last_became_active":"2023-12-08T08:17:57.863582+0000","last_became_peered":"2023-12-08T08:17:57.863582+0000","last_unstale":"2023-12-08T08:18:01.869100+0000","last_undegraded":"2023-12-08T08:18:01.869100+0000","last_fullsized":"2023-12-08T08:18:01.869100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868290+0000","last_change":"2023-12-08T08:17:57.860800+0000","last_active":"2023-12-08T08:18:01.868290+0000","last_peered":"2023-12-08T08:18:01.868290+0000","last_clean":"2023-12-08T08:18:01.868290+0000","last_became_active":"2023-12-08T08:17:57.859933+0000","last_became_peered":"2023-12-08T08:17:57.859933+0000","last_unstale":"2023-12-08T08:18:01.868290+0000","last_undegraded":"2023-12-08T08:18:01.868290+0000","last_fullsized":"2023-12-08T08:18:01.868290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869044+0000","last_change":"2023-12-08T08:17:57.866870+0000","last_active":"2023-12-08T08:18:01.869044+0000","last_peered":"2023-12-08T08:18:01.869044+0000","last_clean":"2023-12-08T08:18:01.869044+0000","last_became_active":"2023-12-08T08:17:57.866242+0000","last_became_peered":"2023-12-08T08:17:57.866242+0000","last_unstale":"2023-12-08T08:18:01.869044+0000","last_undegraded":"2023-12-08T08:18:01.869044+0000","last_fullsized":"2023-12-08T08:18:01.869044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872306+0000","last_change":"2023-12-08T08:17:57.853244+0000","last_active":"2023-12-08T08:18:01.872306+0000","last_peered":"2023-12-08T08:18:01.872306+0000","last_clean":"2023-12-08T08:18:01.872306+0000","last_became_active":"2023-12-08T08:17:57.852962+0000","last_became_peered":"2023-12-08T08:17:57.852962+0000","last_unstale":"2023-12-08T08:18:01.872306+0000","last_undegraded":"2023-12-08T08:18:01.872306+0000","last_fullsized":"2023-12-08T08:18:01.872306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885422+0000","last_change":"2023-12-08T08:17:57.861311+0000","last_active":"2023-12-08T08:18:01.885422+0000","last_peered":"2023-12-08T08:18:01.885422+0000","last_clean":"2023-12-08T08:18:01.885422+0000","last_became_active":"2023-12-08T08:17:57.860997+0000","last_became_peered":"2023-12-08T08:17:57.860997+0000","last_unstale":"2023-12-08T08:18:01.885422+0000","last_undegraded":"2023-12-08T08:18:01.885422+0000","last_fullsized":"2023-12-08T08:18:01.885422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868647+0000","last_change":"2023-12-08T08:17:57.869587+0000","last_active":"2023-12-08T08:18:01.868647+0000","last_peered":"2023-12-08T08:18:01.868647+0000","last_clean":"2023-12-08T08:18:01.868647+0000","last_became_active":"2023-12-08T08:17:57.869269+0000","last_became_peered":"2023-12-08T08:17:57.869269+0000","last_unstale":"2023-12-08T08:18:01.868647+0000","last_undegraded":"2023-12-08T08:18:01.868647+0000","last_fullsized":"2023-12-08T08:18:01.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:41.285450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:26.594 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:18:26.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.732+0000 7f57e947c640 1 Processor -- start 2023-12-08T08:18:26.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.732+0000 7f57e947c640 1 -- start start 2023-12-08T08:18:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.732+0000 7f57e947c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 0x7f57e40d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.732+0000 7f57e947c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e415ee90 con 0x7f57e415d580 2023-12-08T08:18:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.732+0000 7f57e947c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e40d0fe0 con 0x7f57e40d1d60 2023-12-08T08:18:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.732+0000 7f57e947c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e415ffa0 con 0x7f57e415e970 2023-12-08T08:18:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e2ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f57e415d580 0x7f57e415f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35276/0 (socket says 172.21.15.50:35276) 2023-12-08T08:18:26.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e2ffd640 1 -- 172.21.15.50:0/2654873319 learned_addr learned my addr 172.21.15.50:0/2654873319 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e37fe640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 0x7f57e40d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002562165 0 0) 0x7f57e415ee90 con 0x7f57e415d580 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57cc003520 con 0x7f57e415d580 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984199738 0 0) 0x7f57cc003520 con 0x7f57e415d580 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 msgr2=0x7f57e40d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 0x7f57e40d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 >> v1:172.21.15.170:6789/0 conn(0x7f57e40d1d60 legacy=0x7f57e415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40d1280 con 0x7f57e415d580 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f57dc001670 con 0x7f57e415d580 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 >> v1:172.21.15.50:6789/0 conn(0x7f57e415d580 legacy=0x7f57e415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 0x7f57cc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57cc003f20 0x7f57cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57cc004d00 0x7f57cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e415ffa0 con 0x7f57cc003f20 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc00bb10 con 0x7f57cc004d00 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc00bcd0 con 0x7f57e415e970 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e27fc640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57cc003f20 0x7f57cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e2ffd640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 0x7f57cc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.733+0000 7f57e37fe640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57cc004d00 0x7f57cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e27fc640 1 -- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 msgr2=0x7f57cc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e27fc640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57e415e970 0x7f57cc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e27fc640 1 -- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57cc004d00 msgr2=0x7f57cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e27fc640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57cc004d00 0x7f57cc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e27fc640 1 -- 172.21.15.50:0/2654873319 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc003520 con 0x7f57cc003f20 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e37fe640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57cc004d00 0x7f57cc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e27fc640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57cc003f20 0x7f57cc0047c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f57d8001750 tx=0x7f57cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7b40cad9cb57be server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80052d0 con 0x7f57cc003f20 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d802e050 con 0x7f57cc003f20 2023-12-08T08:18:26.739 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.734+0000 7f57e1ffb640 1 -- 172.21.15.50:0/2654873319 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80035f0 con 0x7f57cc003f20 2023-12-08T08:18:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.735+0000 7f57e947c640 1 -- 172.21.15.50:0/2654873319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57cc003f20 msgr2=0x7f57cc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.735+0000 7f57e947c640 1 --2- 172.21.15.50:0/2654873319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57cc003f20 0x7f57cc0047c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f57d8001750 tx=0x7f57cc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.735+0000 7f57e37fe640 1 -- 172.21.15.50:0/2654873319 reap_dead start 2023-12-08T08:18:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.735+0000 7f57e947c640 1 -- 172.21.15.50:0/2654873319 shutdown_connections 2023-12-08T08:18:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.735+0000 7f57e947c640 1 -- 172.21.15.50:0/2654873319 >> 172.21.15.50:0/2654873319 conn(0x7f57e40d2fb0 msgr2=0x7f57e40d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.735+0000 7f57e947c640 1 -- 172.21.15.50:0/2654873319 shutdown_connections 2023-12-08T08:18:26.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.735+0000 7f57e947c640 1 -- 172.21.15.50:0/2654873319 wait complete. 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.736+0000 7f57e947c640 1 Processor -- start 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.736+0000 7f57e947c640 1 -- start start 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e947c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57cc003f20 0x7f57e415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e947c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e40b7c00 0x7f57e40cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e947c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e40ce100 0x7f57e40cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e947c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e415b8e0 con 0x7f57e40b7c00 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e947c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40ce580 con 0x7f57e40ce100 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e947c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40c6a40 con 0x7f57cc003f20 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e40b7c00 0x7f57e40cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e40b7c00 0x7f57e40cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57520/0 (socket says 172.21.15.50:57520) 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e27fc640 1 -- 172.21.15.50:0/2316665823 learned_addr learned my addr 172.21.15.50:0/2316665823 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e2ffd640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57cc003f20 0x7f57e415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.737+0000 7f57e37fe640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e40ce100 0x7f57e40cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e27fc640 1 -- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57cc003f20 msgr2=0x7f57e415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e27fc640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57cc003f20 0x7f57e415b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e27fc640 1 -- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e40ce100 msgr2=0x7f57e40cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e27fc640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e40ce100 0x7f57e40cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e27fc640 1 -- 172.21.15.50:0/2316665823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e41f6470 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e27fc640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e40b7c00 0x7f57e40cdbc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57d802bc30 tx=0x7f57d8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57cb7fe640 1 -- 172.21.15.50:0/2316665823 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80076c0 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57cb7fe640 1 -- 172.21.15.50:0/2316665823 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8007a30 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e41f6750 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57cb7fe640 1 -- 172.21.15.50:0/2316665823 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8006be0 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.738+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e41f6d10 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.739+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e41e5f20 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.739+0000 7f57cb7fe640 1 -- 172.21.15.50:0/2316665823 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57d8006d40 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.740+0000 7f57cb7fe640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f57d006ae70 0x7f57d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.740+0000 7f57cb7fe640 1 -- 172.21.15.50:0/2316665823 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57d80ab610 con 0x7f57e40b7c00 2023-12-08T08:18:26.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.740+0000 7f57e2ffd640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f57d006ae70 0x7f57d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:26.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.741+0000 7f57e2ffd640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f57d006ae70 0x7f57d006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57e40b7980 tx=0x7f57dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:26.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.744+0000 7f57cb7fe640 1 -- 172.21.15.50:0/2316665823 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57e41e5f20 con 0x7f57e40b7c00 2023-12-08T08:18:26.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.917+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57e40d1840 con 0x7f57d006ae70 2023-12-08T08:18:26.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.926+0000 7f57cb7fe640 1 -- 172.21.15.50:0/2316665823 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345299 (secure 0 0 0) 0x7f57dc001570 con 0x7f57d006ae70 2023-12-08T08:18:26.932 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:26.934 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f57d006ae70 msgr2=0x7f57d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f57d006ae70 0x7f57d006d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f57e40b7980 tx=0x7f57dc009040 comp rx=0 tx=0).stop 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e40b7c00 msgr2=0x7f57e40cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e40b7c00 0x7f57e40cdbc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57d802bc30 tx=0x7f57d8001120 comp rx=0 tx=0).stop 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 shutdown_connections 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f57d006ae70 0x7f57d006d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57e40b7c00 0x7f57e40cdbc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f57e40ce100 0x7f57e40cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 --2- 172.21.15.50:0/2316665823 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f57cc003f20 0x7f57e415b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 >> 172.21.15.50:0/2316665823 conn(0x7f57e40d2fb0 msgr2=0x7f57e40ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 shutdown_connections 2023-12-08T08:18:26.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:26.929+0000 7f57e947c640 1 -- 172.21.15.50:0/2316665823 wait complete. 2023-12-08T08:18:26.942 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-08T08:18:26.118924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252652,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722068,"statfs":{"total":773094113280,"available":772835397632,"internally_reserved":0,"allocated":3280896,"data_stored":1987327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003741"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872492+0000","last_change":"2023-12-08T08:17:56.842906+0000","last_active":"2023-12-08T08:18:01.872492+0000","last_peered":"2023-12-08T08:18:01.872492+0000","last_clean":"2023-12-08T08:18:01.872492+0000","last_became_active":"2023-12-08T08:17:56.842598+0000","last_became_peered":"2023-12-08T08:17:56.842598+0000","last_unstale":"2023-12-08T08:18:01.872492+0000","last_undegraded":"2023-12-08T08:18:01.872492+0000","last_fullsized":"2023-12-08T08:18:01.872492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867626+0000","last_change":"2023-12-08T08:17:57.870410+0000","last_active":"2023-12-08T08:18:01.867626+0000","last_peered":"2023-12-08T08:18:01.867626+0000","last_clean":"2023-12-08T08:18:01.867626+0000","last_became_active":"2023-12-08T08:17:57.870101+0000","last_became_peered":"2023-12-08T08:17:57.870101+0000","last_unstale":"2023-12-08T08:18:01.867626+0000","last_undegraded":"2023-12-08T08:18:01.867626+0000","last_fullsized":"2023-12-08T08:18:01.867626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567811+0000","last_change":"2023-12-08T08:18:01.878712+0000","last_active":"2023-12-08T08:18:03.567811+0000","last_peered":"2023-12-08T08:18:03.567811+0000","last_clean":"2023-12-08T08:18:03.567811+0000","last_became_active":"2023-12-08T08:18:01.878261+0000","last_became_peered":"2023-12-08T08:18:01.878261+0000","last_unstale":"2023-12-08T08:18:03.567811+0000","last_undegraded":"2023-12-08T08:18:03.567811+0000","last_fullsized":"2023-12-08T08:18:03.567811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:07:23.896888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867824+0000","last_change":"2023-12-08T08:17:56.843766+0000","last_active":"2023-12-08T08:18:01.867824+0000","last_peered":"2023-12-08T08:18:01.867824+0000","last_clean":"2023-12-08T08:18:01.867824+0000","last_became_active":"2023-12-08T08:17:56.843478+0000","last_became_peered":"2023-12-08T08:17:56.843478+0000","last_unstale":"2023-12-08T08:18:01.867824+0000","last_undegraded":"2023-12-08T08:18:01.867824+0000","last_fullsized":"2023-12-08T08:18:01.867824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872240+0000","last_change":"2023-12-08T08:17:57.855561+0000","last_active":"2023-12-08T08:18:01.872240+0000","last_peered":"2023-12-08T08:18:01.872240+0000","last_clean":"2023-12-08T08:18:01.872240+0000","last_became_active":"2023-12-08T08:17:57.855268+0000","last_became_peered":"2023-12-08T08:17:57.855268+0000","last_unstale":"2023-12-08T08:18:01.872240+0000","last_undegraded":"2023-12-08T08:18:01.872240+0000","last_fullsized":"2023-12-08T08:18:01.872240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568140+0000","last_change":"2023-12-08T08:18:01.889314+0000","last_active":"2023-12-08T08:18:03.568140+0000","last_peered":"2023-12-08T08:18:03.568140+0000","last_clean":"2023-12-08T08:18:03.568140+0000","last_became_active":"2023-12-08T08:18:01.888906+0000","last_became_peered":"2023-12-08T08:18:01.888906+0000","last_unstale":"2023-12-08T08:18:03.568140+0000","last_undegraded":"2023-12-08T08:18:03.568140+0000","last_fullsized":"2023-12-08T08:18:03.568140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:24:01.114329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868720+0000","last_change":"2023-12-08T08:17:56.842810+0000","last_active":"2023-12-08T08:18:01.868720+0000","last_peered":"2023-12-08T08:18:01.868720+0000","last_clean":"2023-12-08T08:18:01.868720+0000","last_became_active":"2023-12-08T08:17:56.842480+0000","last_became_peered":"2023-12-08T08:17:56.842480+0000","last_unstale":"2023-12-08T08:18:01.868720+0000","last_undegraded":"2023-12-08T08:18:01.868720+0000","last_fullsized":"2023-12-08T08:18:01.868720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869147+0000","last_change":"2023-12-08T08:17:57.859900+0000","last_active":"2023-12-08T08:18:01.869147+0000","last_peered":"2023-12-08T08:18:01.869147+0000","last_clean":"2023-12-08T08:18:01.869147+0000","last_became_active":"2023-12-08T08:17:57.859600+0000","last_became_peered":"2023-12-08T08:17:57.859600+0000","last_unstale":"2023-12-08T08:18:01.869147+0000","last_undegraded":"2023-12-08T08:18:01.869147+0000","last_fullsized":"2023-12-08T08:18:01.869147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568611+0000","last_change":"2023-12-08T08:18:01.889433+0000","last_active":"2023-12-08T08:18:03.568611+0000","last_peered":"2023-12-08T08:18:03.568611+0000","last_clean":"2023-12-08T08:18:03.568611+0000","last_became_active":"2023-12-08T08:18:01.888357+0000","last_became_peered":"2023-12-08T08:18:01.888357+0000","last_unstale":"2023-12-08T08:18:03.568611+0000","last_undegraded":"2023-12-08T08:18:03.568611+0000","last_fullsized":"2023-12-08T08:18:03.568611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:46.554041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868282+0000","last_change":"2023-12-08T08:17:56.840379+0000","last_active":"2023-12-08T08:18:01.868282+0000","last_peered":"2023-12-08T08:18:01.868282+0000","last_clean":"2023-12-08T08:18:01.868282+0000","last_became_active":"2023-12-08T08:17:56.840103+0000","last_became_peered":"2023-12-08T08:17:56.840103+0000","last_unstale":"2023-12-08T08:18:01.868282+0000","last_undegraded":"2023-12-08T08:18:01.868282+0000","last_fullsized":"2023-12-08T08:18:01.868282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870159+0000","last_change":"2023-12-08T08:17:57.858103+0000","last_active":"2023-12-08T08:18:01.870159+0000","last_peered":"2023-12-08T08:18:01.870159+0000","last_clean":"2023-12-08T08:18:01.870159+0000","last_became_active":"2023-12-08T08:17:57.857699+0000","last_became_peered":"2023-12-08T08:17:57.857699+0000","last_unstale":"2023-12-08T08:18:01.870159+0000","last_undegraded":"2023-12-08T08:18:01.870159+0000","last_fullsized":"2023-12-08T08:18:01.870159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568317+0000","last_change":"2023-12-08T08:18:01.885166+0000","last_active":"2023-12-08T08:18:03.568317+0000","last_peered":"2023-12-08T08:18:03.568317+0000","last_clean":"2023-12-08T08:18:03.568317+0000","last_became_active":"2023-12-08T08:18:01.884779+0000","last_became_peered":"2023-12-08T08:18:01.884779+0000","last_unstale":"2023-12-08T08:18:03.568317+0000","last_undegraded":"2023-12-08T08:18:03.568317+0000","last_fullsized":"2023-12-08T08:18:03.568317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:57.811272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880413+0000","last_change":"2023-12-08T08:17:57.865810+0000","last_active":"2023-12-08T08:18:01.880413+0000","last_peered":"2023-12-08T08:18:01.880413+0000","last_clean":"2023-12-08T08:18:01.880413+0000","last_became_active":"2023-12-08T08:17:57.865552+0000","last_became_peered":"2023-12-08T08:17:57.865552+0000","last_unstale":"2023-12-08T08:18:01.880413+0000","last_undegraded":"2023-12-08T08:18:01.880413+0000","last_fullsized":"2023-12-08T08:18:01.880413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868484+0000","last_change":"2023-12-08T08:17:56.840140+0000","last_active":"2023-12-08T08:18:01.868484+0000","last_peered":"2023-12-08T08:18:01.868484+0000","last_clean":"2023-12-08T08:18:01.868484+0000","last_became_active":"2023-12-08T08:17:56.839795+0000","last_became_peered":"2023-12-08T08:17:56.839795+0000","last_unstale":"2023-12-08T08:18:01.868484+0000","last_undegraded":"2023-12-08T08:18:01.868484+0000","last_fullsized":"2023-12-08T08:18:01.868484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:56.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569186+0000","last_change":"2023-12-08T08:18:01.891012+0000","last_active":"2023-12-08T08:18:03.569186+0000","last_peered":"2023-12-08T08:18:03.569186+0000","last_clean":"2023-12-08T08:18:03.569186+0000","last_became_active":"2023-12-08T08:18:01.890400+0000","last_became_peered":"2023-12-08T08:18:01.890400+0000","last_unstale":"2023-12-08T08:18:03.569186+0000","last_undegraded":"2023-12-08T08:18:03.569186+0000","last_fullsized":"2023-12-08T08:18:03.569186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:16.123817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867759+0000","last_change":"2023-12-08T08:17:57.864890+0000","last_active":"2023-12-08T08:18:01.867759+0000","last_peered":"2023-12-08T08:18:01.867759+0000","last_clean":"2023-12-08T08:18:01.867759+0000","last_became_active":"2023-12-08T08:17:57.864513+0000","last_became_peered":"2023-12-08T08:17:57.864513+0000","last_unstale":"2023-12-08T08:18:01.867759+0000","last_undegraded":"2023-12-08T08:18:01.867759+0000","last_fullsized":"2023-12-08T08:18:01.867759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885708+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.885708+0000","last_peered":"2023-12-08T08:18:01.885708+0000","last_clean":"2023-12-08T08:18:01.885708+0000","last_became_active":"2023-12-08T08:17:56.832192+0000","last_became_peered":"2023-12-08T08:17:56.832192+0000","last_unstale":"2023-12-08T08:18:01.885708+0000","last_undegraded":"2023-12-08T08:18:01.885708+0000","last_fullsized":"2023-12-08T08:18:01.885708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:09.417617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568758+0000","last_change":"2023-12-08T08:18:01.892174+0000","last_active":"2023-12-08T08:18:03.568758+0000","last_peered":"2023-12-08T08:18:03.568758+0000","last_clean":"2023-12-08T08:18:03.568758+0000","last_became_active":"2023-12-08T08:18:01.891139+0000","last_became_peered":"2023-12-08T08:18:01.891139+0000","last_unstale":"2023-12-08T08:18:03.568758+0000","last_undegraded":"2023-12-08T08:18:03.568758+0000","last_fullsized":"2023-12-08T08:18:03.568758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:06.144172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869779+0000","last_change":"2023-12-08T08:17:57.853306+0000","last_active":"2023-12-08T08:18:01.869779+0000","last_peered":"2023-12-08T08:18:01.869779+0000","last_clean":"2023-12-08T08:18:01.869779+0000","last_became_active":"2023-12-08T08:17:57.852939+0000","last_became_peered":"2023-12-08T08:17:57.852939+0000","last_unstale":"2023-12-08T08:18:01.869779+0000","last_undegraded":"2023-12-08T08:18:01.869779+0000","last_fullsized":"2023-12-08T08:18:01.869779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885213+0000","last_change":"2023-12-08T08:17:56.837763+0000","last_active":"2023-12-08T08:18:01.885213+0000","last_peered":"2023-12-08T08:18:01.885213+0000","last_clean":"2023-12-08T08:18:01.885213+0000","last_became_active":"2023-12-08T08:17:56.837469+0000","last_became_peered":"2023-12-08T08:17:56.837469+0000","last_unstale":"2023-12-08T08:18:01.885213+0000","last_undegraded":"2023-12-08T08:18:01.885213+0000","last_fullsized":"2023-12-08T08:18:01.885213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569232+0000","last_change":"2023-12-08T08:18:01.892151+0000","last_active":"2023-12-08T08:18:03.569232+0000","last_peered":"2023-12-08T08:18:03.569232+0000","last_clean":"2023-12-08T08:18:03.569232+0000","last_became_active":"2023-12-08T08:18:01.891748+0000","last_became_peered":"2023-12-08T08:18:01.891748+0000","last_unstale":"2023-12-08T08:18:03.569232+0000","last_undegraded":"2023-12-08T08:18:03.569232+0000","last_fullsized":"2023-12-08T08:18:03.569232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.874659+0000","last_change":"2023-12-08T08:17:57.856848+0000","last_active":"2023-12-08T08:18:01.874659+0000","last_peered":"2023-12-08T08:18:01.874659+0000","last_clean":"2023-12-08T08:18:01.874659+0000","last_became_active":"2023-12-08T08:17:57.856604+0000","last_became_peered":"2023-12-08T08:17:57.856604+0000","last_unstale":"2023-12-08T08:18:01.874659+0000","last_undegraded":"2023-12-08T08:18:01.874659+0000","last_fullsized":"2023-12-08T08:18:01.874659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867949+0000","last_change":"2023-12-08T08:17:56.842489+0000","last_active":"2023-12-08T08:18:01.867949+0000","last_peered":"2023-12-08T08:18:01.867949+0000","last_clean":"2023-12-08T08:18:01.867949+0000","last_became_active":"2023-12-08T08:17:56.842218+0000","last_became_peered":"2023-12-08T08:17:56.842218+0000","last_unstale":"2023-12-08T08:18:01.867949+0000","last_undegraded":"2023-12-08T08:18:01.867949+0000","last_fullsized":"2023-12-08T08:18:01.867949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569378+0000","last_change":"2023-12-08T08:18:01.891618+0000","last_active":"2023-12-08T08:18:03.569378+0000","last_peered":"2023-12-08T08:18:03.569378+0000","last_clean":"2023-12-08T08:18:03.569378+0000","last_became_active":"2023-12-08T08:18:01.891182+0000","last_became_peered":"2023-12-08T08:18:01.891182+0000","last_unstale":"2023-12-08T08:18:03.569378+0000","last_undegraded":"2023-12-08T08:18:03.569378+0000","last_fullsized":"2023-12-08T08:18:03.569378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:52.932114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873203+0000","last_change":"2023-12-08T08:17:57.853709+0000","last_active":"2023-12-08T08:18:01.873203+0000","last_peered":"2023-12-08T08:18:01.873203+0000","last_clean":"2023-12-08T08:18:01.873203+0000","last_became_active":"2023-12-08T08:17:57.853422+0000","last_became_peered":"2023-12-08T08:17:57.853422+0000","last_unstale":"2023-12-08T08:18:01.873203+0000","last_undegraded":"2023-12-08T08:18:01.873203+0000","last_fullsized":"2023-12-08T08:18:01.873203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881686+0000","last_change":"2023-12-08T08:17:56.838162+0000","last_active":"2023-12-08T08:18:01.881686+0000","last_peered":"2023-12-08T08:18:01.881686+0000","last_clean":"2023-12-08T08:18:01.881686+0000","last_became_active":"2023-12-08T08:17:56.837914+0000","last_became_peered":"2023-12-08T08:17:56.837914+0000","last_unstale":"2023-12-08T08:18:01.881686+0000","last_undegraded":"2023-12-08T08:18:01.881686+0000","last_fullsized":"2023-12-08T08:18:01.881686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568391+0000","last_change":"2023-12-08T08:18:01.886684+0000","last_active":"2023-12-08T08:18:03.568391+0000","last_peered":"2023-12-08T08:18:03.568391+0000","last_clean":"2023-12-08T08:18:03.568391+0000","last_became_active":"2023-12-08T08:18:01.886257+0000","last_became_peered":"2023-12-08T08:18:01.886257+0000","last_unstale":"2023-12-08T08:18:03.568391+0000","last_undegraded":"2023-12-08T08:18:03.568391+0000","last_fullsized":"2023-12-08T08:18:03.568391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:06.356317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868425+0000","last_change":"2023-12-08T08:17:57.864189+0000","last_active":"2023-12-08T08:18:01.868425+0000","last_peered":"2023-12-08T08:18:01.868425+0000","last_clean":"2023-12-08T08:18:01.868425+0000","last_became_active":"2023-12-08T08:17:57.863656+0000","last_became_peered":"2023-12-08T08:17:57.863656+0000","last_unstale":"2023-12-08T08:18:01.868425+0000","last_undegraded":"2023-12-08T08:18:01.868425+0000","last_fullsized":"2023-12-08T08:18:01.868425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885512+0000","last_change":"2023-12-08T08:17:56.835325+0000","last_active":"2023-12-08T08:18:01.885512+0000","last_peered":"2023-12-08T08:18:01.885512+0000","last_clean":"2023-12-08T08:18:01.885512+0000","last_became_active":"2023-12-08T08:17:56.834877+0000","last_became_peered":"2023-12-08T08:17:56.834877+0000","last_unstale":"2023-12-08T08:18:01.885512+0000","last_undegraded":"2023-12-08T08:18:01.885512+0000","last_fullsized":"2023-12-08T08:18:01.885512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567624+0000","last_change":"2023-12-08T08:18:01.891058+0000","last_active":"2023-12-08T08:18:03.567624+0000","last_peered":"2023-12-08T08:18:03.567624+0000","last_clean":"2023-12-08T08:18:03.567624+0000","last_became_active":"2023-12-08T08:18:01.890653+0000","last_became_peered":"2023-12-08T08:18:01.890653+0000","last_unstale":"2023-12-08T08:18:03.567624+0000","last_undegraded":"2023-12-08T08:18:03.567624+0000","last_fullsized":"2023-12-08T08:18:03.567624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885917+0000","last_change":"2023-12-08T08:17:57.851573+0000","last_active":"2023-12-08T08:18:01.885917+0000","last_peered":"2023-12-08T08:18:01.885917+0000","last_clean":"2023-12-08T08:18:01.885917+0000","last_became_active":"2023-12-08T08:17:57.851275+0000","last_became_peered":"2023-12-08T08:17:57.851275+0000","last_unstale":"2023-12-08T08:18:01.885917+0000","last_undegraded":"2023-12-08T08:18:01.885917+0000","last_fullsized":"2023-12-08T08:18:01.885917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868821+0000","last_change":"2023-12-08T08:17:56.842419+0000","last_active":"2023-12-08T08:18:01.868821+0000","last_peered":"2023-12-08T08:18:01.868821+0000","last_clean":"2023-12-08T08:18:01.868821+0000","last_became_active":"2023-12-08T08:17:56.842113+0000","last_became_peered":"2023-12-08T08:17:56.842113+0000","last_unstale":"2023-12-08T08:18:01.868821+0000","last_undegraded":"2023-12-08T08:18:01.868821+0000","last_fullsized":"2023-12-08T08:18:01.868821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569320+0000","last_change":"2023-12-08T08:18:01.896199+0000","last_active":"2023-12-08T08:18:03.569320+0000","last_peered":"2023-12-08T08:18:03.569320+0000","last_clean":"2023-12-08T08:18:03.569320+0000","last_became_active":"2023-12-08T08:18:01.895808+0000","last_became_peered":"2023-12-08T08:18:01.895808+0000","last_unstale":"2023-12-08T08:18:03.569320+0000","last_undegraded":"2023-12-08T08:18:03.569320+0000","last_fullsized":"2023-12-08T08:18:03.569320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870316+0000","last_change":"2023-12-08T08:17:57.865891+0000","last_active":"2023-12-08T08:18:01.870316+0000","last_peered":"2023-12-08T08:18:01.870316+0000","last_clean":"2023-12-08T08:18:01.870316+0000","last_became_active":"2023-12-08T08:17:57.865615+0000","last_became_peered":"2023-12-08T08:17:57.865615+0000","last_unstale":"2023-12-08T08:18:01.870316+0000","last_undegraded":"2023-12-08T08:18:01.870316+0000","last_fullsized":"2023-12-08T08:18:01.870316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.886007+0000","last_change":"2023-12-08T08:17:56.841200+0000","last_active":"2023-12-08T08:18:01.886007+0000","last_peered":"2023-12-08T08:18:01.886007+0000","last_clean":"2023-12-08T08:18:01.886007+0000","last_became_active":"2023-12-08T08:17:56.840931+0000","last_became_peered":"2023-12-08T08:17:56.840931+0000","last_unstale":"2023-12-08T08:18:01.886007+0000","last_undegraded":"2023-12-08T08:18:01.886007+0000","last_fullsized":"2023-12-08T08:18:01.886007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569499+0000","last_change":"2023-12-08T08:18:01.891062+0000","last_active":"2023-12-08T08:18:03.569499+0000","last_peered":"2023-12-08T08:18:03.569499+0000","last_clean":"2023-12-08T08:18:03.569499+0000","last_became_active":"2023-12-08T08:18:01.889897+0000","last_became_peered":"2023-12-08T08:18:01.889897+0000","last_unstale":"2023-12-08T08:18:03.569499+0000","last_undegraded":"2023-12-08T08:18:03.569499+0000","last_fullsized":"2023-12-08T08:18:03.569499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875197+0000","last_change":"2023-12-08T08:17:57.858835+0000","last_active":"2023-12-08T08:18:01.875197+0000","last_peered":"2023-12-08T08:18:01.875197+0000","last_clean":"2023-12-08T08:18:01.875197+0000","last_became_active":"2023-12-08T08:17:57.857435+0000","last_became_peered":"2023-12-08T08:17:57.857435+0000","last_unstale":"2023-12-08T08:18:01.875197+0000","last_undegraded":"2023-12-08T08:18:01.875197+0000","last_fullsized":"2023-12-08T08:18:01.875197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:23:20.987641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869458+0000","last_change":"2023-12-08T08:17:56.837734+0000","last_active":"2023-12-08T08:18:01.869458+0000","last_peered":"2023-12-08T08:18:01.869458+0000","last_clean":"2023-12-08T08:18:01.869458+0000","last_became_active":"2023-12-08T08:17:56.837449+0000","last_became_peered":"2023-12-08T08:17:56.837449+0000","last_unstale":"2023-12-08T08:18:01.869458+0000","last_undegraded":"2023-12-08T08:18:01.869458+0000","last_fullsized":"2023-12-08T08:18:01.869458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568865+0000","last_change":"2023-12-08T08:18:01.890850+0000","last_active":"2023-12-08T08:18:03.568865+0000","last_peered":"2023-12-08T08:18:03.568865+0000","last_clean":"2023-12-08T08:18:03.568865+0000","last_became_active":"2023-12-08T08:18:01.890183+0000","last_became_peered":"2023-12-08T08:18:01.890183+0000","last_unstale":"2023-12-08T08:18:03.568865+0000","last_undegraded":"2023-12-08T08:18:03.568865+0000","last_fullsized":"2023-12-08T08:18:03.568865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885216+0000","last_change":"2023-12-08T08:17:57.851203+0000","last_active":"2023-12-08T08:18:01.885216+0000","last_peered":"2023-12-08T08:18:01.885216+0000","last_clean":"2023-12-08T08:18:01.885216+0000","last_became_active":"2023-12-08T08:17:57.850672+0000","last_became_peered":"2023-12-08T08:17:57.850672+0000","last_unstale":"2023-12-08T08:18:01.885216+0000","last_undegraded":"2023-12-08T08:18:01.885216+0000","last_fullsized":"2023-12-08T08:18:01.885216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873056+0000","last_change":"2023-12-08T08:17:56.832496+0000","last_active":"2023-12-08T08:18:01.873056+0000","last_peered":"2023-12-08T08:18:01.873056+0000","last_clean":"2023-12-08T08:18:01.873056+0000","last_became_active":"2023-12-08T08:17:56.832238+0000","last_became_peered":"2023-12-08T08:17:56.832238+0000","last_unstale":"2023-12-08T08:18:01.873056+0000","last_undegraded":"2023-12-08T08:18:01.873056+0000","last_fullsized":"2023-12-08T08:18:01.873056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:52.753505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569367+0000","last_change":"2023-12-08T08:18:01.894980+0000","last_active":"2023-12-08T08:18:03.569367+0000","last_peered":"2023-12-08T08:18:03.569367+0000","last_clean":"2023-12-08T08:18:03.569367+0000","last_became_active":"2023-12-08T08:18:01.894588+0000","last_became_peered":"2023-12-08T08:18:01.894588+0000","last_unstale":"2023-12-08T08:18:03.569367+0000","last_undegraded":"2023-12-08T08:18:03.569367+0000","last_fullsized":"2023-12-08T08:18:03.569367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871709+0000","last_change":"2023-12-08T08:17:57.848723+0000","last_active":"2023-12-08T08:18:01.871709+0000","last_peered":"2023-12-08T08:18:01.871709+0000","last_clean":"2023-12-08T08:18:01.871709+0000","last_became_active":"2023-12-08T08:17:57.848474+0000","last_became_peered":"2023-12-08T08:17:57.848474+0000","last_unstale":"2023-12-08T08:18:01.871709+0000","last_undegraded":"2023-12-08T08:18:01.871709+0000","last_fullsized":"2023-12-08T08:18:01.871709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:23.681343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867954+0000","last_change":"2023-12-08T08:17:56.839808+0000","last_active":"2023-12-08T08:18:01.867954+0000","last_peered":"2023-12-08T08:18:01.867954+0000","last_clean":"2023-12-08T08:18:01.867954+0000","last_became_active":"2023-12-08T08:17:56.839540+0000","last_became_peered":"2023-12-08T08:17:56.839540+0000","last_unstale":"2023-12-08T08:18:01.867954+0000","last_undegraded":"2023-12-08T08:18:01.867954+0000","last_fullsized":"2023-12-08T08:18:01.867954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569746+0000","last_change":"2023-12-08T08:18:01.897047+0000","last_active":"2023-12-08T08:18:03.569746+0000","last_peered":"2023-12-08T08:18:03.569746+0000","last_clean":"2023-12-08T08:18:03.569746+0000","last_became_active":"2023-12-08T08:18:01.896673+0000","last_became_peered":"2023-12-08T08:18:01.896673+0000","last_unstale":"2023-12-08T08:18:03.569746+0000","last_undegraded":"2023-12-08T08:18:03.569746+0000","last_fullsized":"2023-12-08T08:18:03.569746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:45.328703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868108+0000","last_change":"2023-12-08T08:17:57.863988+0000","last_active":"2023-12-08T08:18:01.868108+0000","last_peered":"2023-12-08T08:18:01.868108+0000","last_clean":"2023-12-08T08:18:01.868108+0000","last_became_active":"2023-12-08T08:17:57.863672+0000","last_became_peered":"2023-12-08T08:17:57.863672+0000","last_unstale":"2023-12-08T08:18:01.868108+0000","last_undegraded":"2023-12-08T08:18:01.868108+0000","last_fullsized":"2023-12-08T08:18:01.868108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868596+0000","last_change":"2023-12-08T08:17:56.838442+0000","last_active":"2023-12-08T08:18:01.868596+0000","last_peered":"2023-12-08T08:18:01.868596+0000","last_clean":"2023-12-08T08:18:01.868596+0000","last_became_active":"2023-12-08T08:17:56.838200+0000","last_became_peered":"2023-12-08T08:17:56.838200+0000","last_unstale":"2023-12-08T08:18:01.868596+0000","last_undegraded":"2023-12-08T08:18:01.868596+0000","last_fullsized":"2023-12-08T08:18:01.868596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:38:05.691540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868065+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:18:01.868065+0000","last_peered":"2023-12-08T08:18:01.868065+0000","last_clean":"2023-12-08T08:18:01.868065+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:18:01.868065+0000","last_undegraded":"2023-12-08T08:18:01.868065+0000","last_fullsized":"2023-12-08T08:18:01.868065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880838+0000","last_change":"2023-12-08T08:18:01.888488+0000","last_active":"2023-12-08T08:18:02.880838+0000","last_peered":"2023-12-08T08:18:02.880838+0000","last_clean":"2023-12-08T08:18:02.880838+0000","last_became_active":"2023-12-08T08:18:01.888094+0000","last_became_peered":"2023-12-08T08:18:01.888094+0000","last_unstale":"2023-12-08T08:18:02.880838+0000","last_undegraded":"2023-12-08T08:18:02.880838+0000","last_fullsized":"2023-12-08T08:18:02.880838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:05.372880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868680+0000","last_change":"2023-12-08T08:17:57.857404+0000","last_active":"2023-12-08T08:18:01.868680+0000","last_peered":"2023-12-08T08:18:01.868680+0000","last_clean":"2023-12-08T08:18:01.868680+0000","last_became_active":"2023-12-08T08:17:57.857153+0000","last_became_peered":"2023-12-08T08:17:57.857153+0000","last_unstale":"2023-12-08T08:18:01.868680+0000","last_undegraded":"2023-12-08T08:18:01.868680+0000","last_fullsized":"2023-12-08T08:18:01.868680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:57:48.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873513+0000","last_change":"2023-12-08T08:17:56.839948+0000","last_active":"2023-12-08T08:18:01.873513+0000","last_peered":"2023-12-08T08:18:01.873513+0000","last_clean":"2023-12-08T08:18:01.873513+0000","last_became_active":"2023-12-08T08:17:56.839635+0000","last_became_peered":"2023-12-08T08:17:56.839635+0000","last_unstale":"2023-12-08T08:18:01.873513+0000","last_undegraded":"2023-12-08T08:18:01.873513+0000","last_fullsized":"2023-12-08T08:18:01.873513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.879318+0000","last_change":"2023-12-08T08:18:01.896627+0000","last_active":"2023-12-08T08:18:02.879318+0000","last_peered":"2023-12-08T08:18:02.879318+0000","last_clean":"2023-12-08T08:18:02.879318+0000","last_became_active":"2023-12-08T08:18:01.896206+0000","last_became_peered":"2023-12-08T08:18:01.896206+0000","last_unstale":"2023-12-08T08:18:02.879318+0000","last_undegraded":"2023-12-08T08:18:02.879318+0000","last_fullsized":"2023-12-08T08:18:02.879318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:10.446350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869237+0000","last_change":"2023-12-08T08:17:57.868521+0000","last_active":"2023-12-08T08:18:01.869237+0000","last_peered":"2023-12-08T08:18:01.869237+0000","last_clean":"2023-12-08T08:18:01.869237+0000","last_became_active":"2023-12-08T08:17:57.866204+0000","last_became_peered":"2023-12-08T08:17:57.866204+0000","last_unstale":"2023-12-08T08:18:01.869237+0000","last_undegraded":"2023-12-08T08:18:01.869237+0000","last_fullsized":"2023-12-08T08:18:01.869237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885415+0000","last_change":"2023-12-08T08:17:56.831155+0000","last_active":"2023-12-08T08:18:01.885415+0000","last_peered":"2023-12-08T08:18:01.885415+0000","last_clean":"2023-12-08T08:18:01.885415+0000","last_became_active":"2023-12-08T08:17:56.830810+0000","last_became_peered":"2023-12-08T08:17:56.830810+0000","last_unstale":"2023-12-08T08:18:01.885415+0000","last_undegraded":"2023-12-08T08:18:01.885415+0000","last_fullsized":"2023-12-08T08:18:01.885415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569993+0000","last_change":"2023-12-08T08:18:01.888765+0000","last_active":"2023-12-08T08:18:03.569993+0000","last_peered":"2023-12-08T08:18:03.569993+0000","last_clean":"2023-12-08T08:18:03.569993+0000","last_became_active":"2023-12-08T08:18:01.888409+0000","last_became_peered":"2023-12-08T08:18:01.888409+0000","last_unstale":"2023-12-08T08:18:03.569993+0000","last_undegraded":"2023-12-08T08:18:03.569993+0000","last_fullsized":"2023-12-08T08:18:03.569993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868755+0000","last_change":"2023-12-08T08:17:57.862594+0000","last_active":"2023-12-08T08:18:01.868755+0000","last_peered":"2023-12-08T08:18:01.868755+0000","last_clean":"2023-12-08T08:18:01.868755+0000","last_became_active":"2023-12-08T08:17:57.862124+0000","last_became_peered":"2023-12-08T08:17:57.862124+0000","last_unstale":"2023-12-08T08:18:01.868755+0000","last_undegraded":"2023-12-08T08:18:01.868755+0000","last_fullsized":"2023-12-08T08:18:01.868755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:34.877529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875757+0000","last_change":"2023-12-08T08:17:56.838532+0000","last_active":"2023-12-08T08:18:01.875757+0000","last_peered":"2023-12-08T08:18:01.875757+0000","last_clean":"2023-12-08T08:18:01.875757+0000","last_became_active":"2023-12-08T08:17:56.838220+0000","last_became_peered":"2023-12-08T08:17:56.838220+0000","last_unstale":"2023-12-08T08:18:01.875757+0000","last_undegraded":"2023-12-08T08:18:01.875757+0000","last_fullsized":"2023-12-08T08:18:01.875757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568060+0000","last_change":"2023-12-08T08:18:01.882801+0000","last_active":"2023-12-08T08:18:03.568060+0000","last_peered":"2023-12-08T08:18:03.568060+0000","last_clean":"2023-12-08T08:18:03.568060+0000","last_became_active":"2023-12-08T08:18:01.882438+0000","last_became_peered":"2023-12-08T08:18:01.882438+0000","last_unstale":"2023-12-08T08:18:03.568060+0000","last_undegraded":"2023-12-08T08:18:03.568060+0000","last_fullsized":"2023-12-08T08:18:03.568060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868362+0000","last_change":"2023-12-08T08:17:57.854674+0000","last_active":"2023-12-08T08:18:01.868362+0000","last_peered":"2023-12-08T08:18:01.868362+0000","last_clean":"2023-12-08T08:18:01.868362+0000","last_became_active":"2023-12-08T08:17:57.854400+0000","last_became_peered":"2023-12-08T08:17:57.854400+0000","last_unstale":"2023-12-08T08:18:01.868362+0000","last_undegraded":"2023-12-08T08:18:01.868362+0000","last_fullsized":"2023-12-08T08:18:01.868362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:36:01.329627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.871957+0000","last_change":"2023-12-08T08:17:56.833827+0000","last_active":"2023-12-08T08:18:01.871957+0000","last_peered":"2023-12-08T08:18:01.871957+0000","last_clean":"2023-12-08T08:18:01.871957+0000","last_became_active":"2023-12-08T08:17:56.833544+0000","last_became_peered":"2023-12-08T08:17:56.833544+0000","last_unstale":"2023-12-08T08:18:01.871957+0000","last_undegraded":"2023-12-08T08:18:01.871957+0000","last_fullsized":"2023-12-08T08:18:01.871957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:30:08.734416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568098+0000","last_change":"2023-12-08T08:18:01.890953+0000","last_active":"2023-12-08T08:18:03.568098+0000","last_peered":"2023-12-08T08:18:03.568098+0000","last_clean":"2023-12-08T08:18:03.568098+0000","last_became_active":"2023-12-08T08:18:01.890169+0000","last_became_peered":"2023-12-08T08:18:01.890169+0000","last_unstale":"2023-12-08T08:18:03.568098+0000","last_undegraded":"2023-12-08T08:18:03.568098+0000","last_fullsized":"2023-12-08T08:18:03.568098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:14.643740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868180+0000","last_change":"2023-12-08T08:17:57.858656+0000","last_active":"2023-12-08T08:18:01.868180+0000","last_peered":"2023-12-08T08:18:01.868180+0000","last_clean":"2023-12-08T08:18:01.868180+0000","last_became_active":"2023-12-08T08:17:57.858335+0000","last_became_peered":"2023-12-08T08:17:57.858335+0000","last_unstale":"2023-12-08T08:18:01.868180+0000","last_undegraded":"2023-12-08T08:18:01.868180+0000","last_fullsized":"2023-12-08T08:18:01.868180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872816+0000","last_change":"2023-12-08T08:17:56.828427+0000","last_active":"2023-12-08T08:18:01.872816+0000","last_peered":"2023-12-08T08:18:01.872816+0000","last_clean":"2023-12-08T08:18:01.872816+0000","last_became_active":"2023-12-08T08:17:56.828104+0000","last_became_peered":"2023-12-08T08:17:56.828104+0000","last_unstale":"2023-12-08T08:18:01.872816+0000","last_undegraded":"2023-12-08T08:18:01.872816+0000","last_fullsized":"2023-12-08T08:18:01.872816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:19:35.770309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569594+0000","last_change":"2023-12-08T08:18:01.882325+0000","last_active":"2023-12-08T08:18:03.569594+0000","last_peered":"2023-12-08T08:18:03.569594+0000","last_clean":"2023-12-08T08:18:03.569594+0000","last_became_active":"2023-12-08T08:18:01.881811+0000","last_became_peered":"2023-12-08T08:18:01.881811+0000","last_unstale":"2023-12-08T08:18:03.569594+0000","last_undegraded":"2023-12-08T08:18:03.569594+0000","last_fullsized":"2023-12-08T08:18:03.569594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:01:38.920782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881194+0000","last_change":"2023-12-08T08:17:57.868472+0000","last_active":"2023-12-08T08:18:01.881194+0000","last_peered":"2023-12-08T08:18:01.881194+0000","last_clean":"2023-12-08T08:18:01.881194+0000","last_became_active":"2023-12-08T08:17:57.867557+0000","last_became_peered":"2023-12-08T08:17:57.867557+0000","last_unstale":"2023-12-08T08:18:01.881194+0000","last_undegraded":"2023-12-08T08:18:01.881194+0000","last_fullsized":"2023-12-08T08:18:01.881194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880481+0000","last_change":"2023-12-08T08:17:56.834501+0000","last_active":"2023-12-08T08:18:01.880481+0000","last_peered":"2023-12-08T08:18:01.880481+0000","last_clean":"2023-12-08T08:18:01.880481+0000","last_became_active":"2023-12-08T08:17:56.834216+0000","last_became_peered":"2023-12-08T08:17:56.834216+0000","last_unstale":"2023-12-08T08:18:01.880481+0000","last_undegraded":"2023-12-08T08:18:01.880481+0000","last_fullsized":"2023-12-08T08:18:01.880481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568473+0000","last_change":"2023-12-08T08:18:01.891154+0000","last_active":"2023-12-08T08:18:03.568473+0000","last_peered":"2023-12-08T08:18:03.568473+0000","last_clean":"2023-12-08T08:18:03.568473+0000","last_became_active":"2023-12-08T08:18:01.890734+0000","last_became_peered":"2023-12-08T08:18:01.890734+0000","last_unstale":"2023-12-08T08:18:03.568473+0000","last_undegraded":"2023-12-08T08:18:03.568473+0000","last_fullsized":"2023-12-08T08:18:03.568473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:18:11.033301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868378+0000","last_change":"2023-12-08T08:17:57.861535+0000","last_active":"2023-12-08T08:18:01.868378+0000","last_peered":"2023-12-08T08:18:01.868378+0000","last_clean":"2023-12-08T08:18:01.868378+0000","last_became_active":"2023-12-08T08:17:57.860529+0000","last_became_peered":"2023-12-08T08:17:57.860529+0000","last_unstale":"2023-12-08T08:18:01.868378+0000","last_undegraded":"2023-12-08T08:18:01.868378+0000","last_fullsized":"2023-12-08T08:18:01.868378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:29:12.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869270+0000","last_change":"2023-12-08T08:17:56.838952+0000","last_active":"2023-12-08T08:18:01.869270+0000","last_peered":"2023-12-08T08:18:01.869270+0000","last_clean":"2023-12-08T08:18:01.869270+0000","last_became_active":"2023-12-08T08:17:56.838708+0000","last_became_peered":"2023-12-08T08:17:56.838708+0000","last_unstale":"2023-12-08T08:18:01.869270+0000","last_undegraded":"2023-12-08T08:18:01.869270+0000","last_fullsized":"2023-12-08T08:18:01.869270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568624+0000","last_change":"2023-12-08T08:18:01.893574+0000","last_active":"2023-12-08T08:18:03.568624+0000","last_peered":"2023-12-08T08:18:03.568624+0000","last_clean":"2023-12-08T08:18:03.568624+0000","last_became_active":"2023-12-08T08:18:01.892008+0000","last_became_peered":"2023-12-08T08:18:01.892008+0000","last_unstale":"2023-12-08T08:18:03.568624+0000","last_undegraded":"2023-12-08T08:18:03.568624+0000","last_fullsized":"2023-12-08T08:18:03.568624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:59:58.367917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873150+0000","last_change":"2023-12-08T08:17:57.858464+0000","last_active":"2023-12-08T08:18:01.873150+0000","last_peered":"2023-12-08T08:18:01.873150+0000","last_clean":"2023-12-08T08:18:01.873150+0000","last_became_active":"2023-12-08T08:17:57.857748+0000","last_became_peered":"2023-12-08T08:17:57.857748+0000","last_unstale":"2023-12-08T08:18:01.873150+0000","last_undegraded":"2023-12-08T08:18:01.873150+0000","last_fullsized":"2023-12-08T08:18:01.873150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:43:10.419496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872709+0000","last_change":"2023-12-08T08:17:56.834818+0000","last_active":"2023-12-08T08:18:01.872709+0000","last_peered":"2023-12-08T08:18:01.872709+0000","last_clean":"2023-12-08T08:18:01.872709+0000","last_became_active":"2023-12-08T08:17:56.834412+0000","last_became_peered":"2023-12-08T08:17:56.834412+0000","last_unstale":"2023-12-08T08:18:01.872709+0000","last_undegraded":"2023-12-08T08:18:01.872709+0000","last_fullsized":"2023-12-08T08:18:01.872709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569218+0000","last_change":"2023-12-08T08:18:01.879603+0000","last_active":"2023-12-08T08:18:03.569218+0000","last_peered":"2023-12-08T08:18:03.569218+0000","last_clean":"2023-12-08T08:18:03.569218+0000","last_became_active":"2023-12-08T08:18:01.879223+0000","last_became_peered":"2023-12-08T08:18:01.879223+0000","last_unstale":"2023-12-08T08:18:03.569218+0000","last_undegraded":"2023-12-08T08:18:03.569218+0000","last_fullsized":"2023-12-08T08:18:03.569218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868610+0000","last_change":"2023-12-08T08:17:57.867653+0000","last_active":"2023-12-08T08:18:01.868610+0000","last_peered":"2023-12-08T08:18:01.868610+0000","last_clean":"2023-12-08T08:18:01.868610+0000","last_became_active":"2023-12-08T08:17:57.867361+0000","last_became_peered":"2023-12-08T08:17:57.867361+0000","last_unstale":"2023-12-08T08:18:01.868610+0000","last_undegraded":"2023-12-08T08:18:01.868610+0000","last_fullsized":"2023-12-08T08:18:01.868610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:07.193843+0000","last_change":"2023-12-08T08:17:56.841032+0000","last_active":"2023-12-08T08:18:07.193843+0000","last_peered":"2023-12-08T08:18:07.193843+0000","last_clean":"2023-12-08T08:18:07.193843+0000","last_became_active":"2023-12-08T08:17:56.840787+0000","last_became_peered":"2023-12-08T08:17:56.840787+0000","last_unstale":"2023-12-08T08:18:07.193843+0000","last_undegraded":"2023-12-08T08:18:07.193843+0000","last_fullsized":"2023-12-08T08:18:07.193843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:16.263290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569636+0000","last_change":"2023-12-08T08:18:01.891258+0000","last_active":"2023-12-08T08:18:03.569636+0000","last_peered":"2023-12-08T08:18:03.569636+0000","last_clean":"2023-12-08T08:18:03.569636+0000","last_became_active":"2023-12-08T08:18:01.889956+0000","last_became_peered":"2023-12-08T08:18:01.889956+0000","last_unstale":"2023-12-08T08:18:03.569636+0000","last_undegraded":"2023-12-08T08:18:03.569636+0000","last_fullsized":"2023-12-08T08:18:03.569636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:36:56.204254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873425+0000","last_change":"2023-12-08T08:17:57.855938+0000","last_active":"2023-12-08T08:18:01.873425+0000","last_peered":"2023-12-08T08:18:01.873425+0000","last_clean":"2023-12-08T08:18:01.873425+0000","last_became_active":"2023-12-08T08:17:57.855668+0000","last_became_peered":"2023-12-08T08:17:57.855668+0000","last_unstale":"2023-12-08T08:18:01.873425+0000","last_undegraded":"2023-12-08T08:18:01.873425+0000","last_fullsized":"2023-12-08T08:18:01.873425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:53.755384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885215+0000","last_change":"2023-12-08T08:17:56.840188+0000","last_active":"2023-12-08T08:18:01.885215+0000","last_peered":"2023-12-08T08:18:01.885215+0000","last_clean":"2023-12-08T08:18:01.885215+0000","last_became_active":"2023-12-08T08:17:56.839837+0000","last_became_peered":"2023-12-08T08:17:56.839837+0000","last_unstale":"2023-12-08T08:18:01.885215+0000","last_undegraded":"2023-12-08T08:18:01.885215+0000","last_fullsized":"2023-12-08T08:18:01.885215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:54:45.145325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.568880+0000","last_change":"2023-12-08T08:18:01.891860+0000","last_active":"2023-12-08T08:18:03.568880+0000","last_peered":"2023-12-08T08:18:03.568880+0000","last_clean":"2023-12-08T08:18:03.568880+0000","last_became_active":"2023-12-08T08:18:01.890853+0000","last_became_peered":"2023-12-08T08:18:01.890853+0000","last_unstale":"2023-12-08T08:18:03.568880+0000","last_undegraded":"2023-12-08T08:18:03.568880+0000","last_fullsized":"2023-12-08T08:18:03.568880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:30.071394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872334+0000","last_change":"2023-12-08T08:17:57.855509+0000","last_active":"2023-12-08T08:18:01.872334+0000","last_peered":"2023-12-08T08:18:01.872334+0000","last_clean":"2023-12-08T08:18:01.872334+0000","last_became_active":"2023-12-08T08:17:57.855195+0000","last_became_peered":"2023-12-08T08:17:57.855195+0000","last_unstale":"2023-12-08T08:18:01.872334+0000","last_undegraded":"2023-12-08T08:18:01.872334+0000","last_fullsized":"2023-12-08T08:18:01.872334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868832+0000","last_change":"2023-12-08T08:17:56.838218+0000","last_active":"2023-12-08T08:18:01.868832+0000","last_peered":"2023-12-08T08:18:01.868832+0000","last_clean":"2023-12-08T08:18:01.868832+0000","last_became_active":"2023-12-08T08:17:56.837942+0000","last_became_peered":"2023-12-08T08:17:56.837942+0000","last_unstale":"2023-12-08T08:18:01.868832+0000","last_undegraded":"2023-12-08T08:18:01.868832+0000","last_fullsized":"2023-12-08T08:18:01.868832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:12.171098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567801+0000","last_change":"2023-12-08T08:18:01.888958+0000","last_active":"2023-12-08T08:18:03.567801+0000","last_peered":"2023-12-08T08:18:03.567801+0000","last_clean":"2023-12-08T08:18:03.567801+0000","last_became_active":"2023-12-08T08:18:01.888522+0000","last_became_peered":"2023-12-08T08:18:01.888522+0000","last_unstale":"2023-12-08T08:18:03.567801+0000","last_undegraded":"2023-12-08T08:18:03.567801+0000","last_fullsized":"2023-12-08T08:18:03.567801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:43:14.094282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868748+0000","last_change":"2023-12-08T08:17:57.859464+0000","last_active":"2023-12-08T08:18:01.868748+0000","last_peered":"2023-12-08T08:18:01.868748+0000","last_clean":"2023-12-08T08:18:01.868748+0000","last_became_active":"2023-12-08T08:17:57.857871+0000","last_became_peered":"2023-12-08T08:17:57.857871+0000","last_unstale":"2023-12-08T08:18:01.868748+0000","last_undegraded":"2023-12-08T08:18:01.868748+0000","last_fullsized":"2023-12-08T08:18:01.868748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.881565+0000","last_change":"2023-12-08T08:17:56.840338+0000","last_active":"2023-12-08T08:18:01.881565+0000","last_peered":"2023-12-08T08:18:01.881565+0000","last_clean":"2023-12-08T08:18:01.881565+0000","last_became_active":"2023-12-08T08:17:56.838415+0000","last_became_peered":"2023-12-08T08:17:56.838415+0000","last_unstale":"2023-12-08T08:18:01.881565+0000","last_undegraded":"2023-12-08T08:18:01.881565+0000","last_fullsized":"2023-12-08T08:18:01.881565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:22.679464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.567966+0000","last_change":"2023-12-08T08:18:01.886353+0000","last_active":"2023-12-08T08:18:03.567966+0000","last_peered":"2023-12-08T08:18:03.567966+0000","last_clean":"2023-12-08T08:18:03.567966+0000","last_became_active":"2023-12-08T08:18:01.885733+0000","last_became_peered":"2023-12-08T08:18:01.885733+0000","last_unstale":"2023-12-08T08:18:03.567966+0000","last_undegraded":"2023-12-08T08:18:03.567966+0000","last_fullsized":"2023-12-08T08:18:03.567966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:42:20.375531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569455+0000","last_change":"2023-12-08T08:18:01.898257+0000","last_active":"2023-12-08T08:18:03.569455+0000","last_peered":"2023-12-08T08:18:03.569455+0000","last_clean":"2023-12-08T08:18:03.569455+0000","last_became_active":"2023-12-08T08:18:01.897895+0000","last_became_peered":"2023-12-08T08:18:01.897895+0000","last_unstale":"2023-12-08T08:18:03.569455+0000","last_undegraded":"2023-12-08T08:18:03.569455+0000","last_fullsized":"2023-12-08T08:18:03.569455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:06.119516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885110+0000","last_change":"2023-12-08T08:17:57.852450+0000","last_active":"2023-12-08T08:18:01.885110+0000","last_peered":"2023-12-08T08:18:01.885110+0000","last_clean":"2023-12-08T08:18:01.885110+0000","last_became_active":"2023-12-08T08:17:57.852146+0000","last_became_peered":"2023-12-08T08:17:57.852146+0000","last_unstale":"2023-12-08T08:18:01.885110+0000","last_undegraded":"2023-12-08T08:18:01.885110+0000","last_fullsized":"2023-12-08T08:18:01.885110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870056+0000","last_change":"2023-12-08T08:17:56.834758+0000","last_active":"2023-12-08T08:18:01.870056+0000","last_peered":"2023-12-08T08:18:01.870056+0000","last_clean":"2023-12-08T08:18:01.870056+0000","last_became_active":"2023-12-08T08:17:56.834493+0000","last_became_peered":"2023-12-08T08:17:56.834493+0000","last_unstale":"2023-12-08T08:18:01.870056+0000","last_undegraded":"2023-12-08T08:18:01.870056+0000","last_fullsized":"2023-12-08T08:18:01.870056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:30.285535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.880773+0000","last_change":"2023-12-08T08:18:01.897055+0000","last_active":"2023-12-08T08:18:02.880773+0000","last_peered":"2023-12-08T08:18:02.880773+0000","last_clean":"2023-12-08T08:18:02.880773+0000","last_became_active":"2023-12-08T08:18:01.896646+0000","last_became_peered":"2023-12-08T08:18:01.896646+0000","last_unstale":"2023-12-08T08:18:02.880773+0000","last_undegraded":"2023-12-08T08:18:02.880773+0000","last_fullsized":"2023-12-08T08:18:02.880773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:29.043747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869691+0000","last_change":"2023-12-08T08:17:57.864805+0000","last_active":"2023-12-08T08:18:01.869691+0000","last_peered":"2023-12-08T08:18:01.869691+0000","last_clean":"2023-12-08T08:18:01.869691+0000","last_became_active":"2023-12-08T08:17:57.864486+0000","last_became_peered":"2023-12-08T08:17:57.864486+0000","last_unstale":"2023-12-08T08:18:01.869691+0000","last_undegraded":"2023-12-08T08:18:01.869691+0000","last_fullsized":"2023-12-08T08:18:01.869691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.870461+0000","last_change":"2023-12-08T08:17:56.836827+0000","last_active":"2023-12-08T08:18:01.870461+0000","last_peered":"2023-12-08T08:18:01.870461+0000","last_clean":"2023-12-08T08:18:01.870461+0000","last_became_active":"2023-12-08T08:17:56.836562+0000","last_became_peered":"2023-12-08T08:17:56.836562+0000","last_unstale":"2023-12-08T08:18:01.870461+0000","last_undegraded":"2023-12-08T08:18:01.870461+0000","last_fullsized":"2023-12-08T08:18:01.870461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:30.987966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880545+0000","last_change":"2023-12-08T08:17:56.831417+0000","last_active":"2023-12-08T08:18:01.880545+0000","last_peered":"2023-12-08T08:18:01.880545+0000","last_clean":"2023-12-08T08:18:01.880545+0000","last_became_active":"2023-12-08T08:17:56.830988+0000","last_became_peered":"2023-12-08T08:17:56.830988+0000","last_unstale":"2023-12-08T08:18:01.880545+0000","last_undegraded":"2023-12-08T08:18:01.880545+0000","last_fullsized":"2023-12-08T08:18:01.880545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:34.382651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872623+0000","last_change":"2023-12-08T08:17:57.848661+0000","last_active":"2023-12-08T08:18:01.872623+0000","last_peered":"2023-12-08T08:18:01.872623+0000","last_clean":"2023-12-08T08:18:01.872623+0000","last_became_active":"2023-12-08T08:17:57.848371+0000","last_became_peered":"2023-12-08T08:17:57.848371+0000","last_unstale":"2023-12-08T08:18:01.872623+0000","last_undegraded":"2023-12-08T08:18:01.872623+0000","last_fullsized":"2023-12-08T08:18:01.872623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:02.878886+0000","last_change":"2023-12-08T08:18:01.892612+0000","last_active":"2023-12-08T08:18:02.878886+0000","last_peered":"2023-12-08T08:18:02.878886+0000","last_clean":"2023-12-08T08:18:02.878886+0000","last_became_active":"2023-12-08T08:18:01.892204+0000","last_became_peered":"2023-12-08T08:18:01.892204+0000","last_unstale":"2023-12-08T08:18:02.878886+0000","last_undegraded":"2023-12-08T08:18:02.878886+0000","last_fullsized":"2023-12-08T08:18:02.878886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:45:27.724596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867878+0000","last_change":"2023-12-08T08:17:56.842132+0000","last_active":"2023-12-08T08:18:01.867878+0000","last_peered":"2023-12-08T08:18:01.867878+0000","last_clean":"2023-12-08T08:18:01.867878+0000","last_became_active":"2023-12-08T08:17:56.841864+0000","last_became_peered":"2023-12-08T08:17:56.841864+0000","last_unstale":"2023-12-08T08:18:01.867878+0000","last_undegraded":"2023-12-08T08:18:01.867878+0000","last_fullsized":"2023-12-08T08:18:01.867878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:55.814486+0000","last_clean_scrub_stamp":"2023-12-08T08:17:55.814486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:12.036127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872976+0000","last_change":"2023-12-08T08:17:57.851016+0000","last_active":"2023-12-08T08:18:01.872976+0000","last_peered":"2023-12-08T08:18:01.872976+0000","last_clean":"2023-12-08T08:18:01.872976+0000","last_became_active":"2023-12-08T08:17:57.850755+0000","last_became_peered":"2023-12-08T08:17:57.850755+0000","last_unstale":"2023-12-08T08:18:01.872976+0000","last_undegraded":"2023-12-08T08:18:01.872976+0000","last_fullsized":"2023-12-08T08:18:01.872976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:59:31.989844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-08T08:18:03.569175+0000","last_change":"2023-12-08T08:18:01.894077+0000","last_active":"2023-12-08T08:18:03.569175+0000","last_peered":"2023-12-08T08:18:03.569175+0000","last_clean":"2023-12-08T08:18:03.569175+0000","last_became_active":"2023-12-08T08:18:01.893598+0000","last_became_peered":"2023-12-08T08:18:01.893598+0000","last_unstale":"2023-12-08T08:18:03.569175+0000","last_undegraded":"2023-12-08T08:18:03.569175+0000","last_fullsized":"2023-12-08T08:18:03.569175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:18:00.859617+0000","last_clean_scrub_stamp":"2023-12-08T08:18:00.859617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:42:43.972716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880217+0000","last_change":"2023-12-08T08:17:57.867998+0000","last_active":"2023-12-08T08:18:01.880217+0000","last_peered":"2023-12-08T08:18:01.880217+0000","last_clean":"2023-12-08T08:18:01.880217+0000","last_became_active":"2023-12-08T08:17:57.867727+0000","last_became_peered":"2023-12-08T08:17:57.867727+0000","last_unstale":"2023-12-08T08:18:01.880217+0000","last_undegraded":"2023-12-08T08:18:01.880217+0000","last_fullsized":"2023-12-08T08:18:01.880217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872963+0000","last_change":"2023-12-08T08:17:57.858911+0000","last_active":"2023-12-08T08:18:01.872963+0000","last_peered":"2023-12-08T08:18:01.872963+0000","last_clean":"2023-12-08T08:18:01.872963+0000","last_became_active":"2023-12-08T08:17:57.857682+0000","last_became_peered":"2023-12-08T08:17:57.857682+0000","last_unstale":"2023-12-08T08:18:01.872963+0000","last_undegraded":"2023-12-08T08:18:01.872963+0000","last_fullsized":"2023-12-08T08:18:01.872963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:20.413569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869275+0000","last_change":"2023-12-08T08:17:57.854413+0000","last_active":"2023-12-08T08:18:01.869275+0000","last_peered":"2023-12-08T08:18:01.869275+0000","last_clean":"2023-12-08T08:18:01.869275+0000","last_became_active":"2023-12-08T08:17:57.854156+0000","last_became_peered":"2023-12-08T08:17:57.854156+0000","last_unstale":"2023-12-08T08:18:01.869275+0000","last_undegraded":"2023-12-08T08:18:01.869275+0000","last_fullsized":"2023-12-08T08:18:01.869275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872542+0000","last_change":"2023-12-08T08:17:57.853043+0000","last_active":"2023-12-08T08:18:01.872542+0000","last_peered":"2023-12-08T08:18:01.872542+0000","last_clean":"2023-12-08T08:18:01.872542+0000","last_became_active":"2023-12-08T08:17:57.852710+0000","last_became_peered":"2023-12-08T08:17:57.852710+0000","last_unstale":"2023-12-08T08:18:01.872542+0000","last_undegraded":"2023-12-08T08:18:01.872542+0000","last_fullsized":"2023-12-08T08:18:01.872542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868777+0000","last_change":"2023-12-08T08:17:57.862525+0000","last_active":"2023-12-08T08:18:01.868777+0000","last_peered":"2023-12-08T08:18:01.868777+0000","last_clean":"2023-12-08T08:18:01.868777+0000","last_became_active":"2023-12-08T08:17:57.862274+0000","last_became_peered":"2023-12-08T08:17:57.862274+0000","last_unstale":"2023-12-08T08:18:01.868777+0000","last_undegraded":"2023-12-08T08:18:01.868777+0000","last_fullsized":"2023-12-08T08:18:01.868777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885096+0000","last_change":"2023-12-08T08:17:57.850983+0000","last_active":"2023-12-08T08:18:01.885096+0000","last_peered":"2023-12-08T08:18:01.885096+0000","last_clean":"2023-12-08T08:18:01.885096+0000","last_became_active":"2023-12-08T08:17:57.850648+0000","last_became_peered":"2023-12-08T08:17:57.850648+0000","last_unstale":"2023-12-08T08:18:01.885096+0000","last_undegraded":"2023-12-08T08:18:01.885096+0000","last_fullsized":"2023-12-08T08:18:01.885096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880266+0000","last_change":"2023-12-08T08:17:57.871856+0000","last_active":"2023-12-08T08:18:01.880266+0000","last_peered":"2023-12-08T08:18:01.880266+0000","last_clean":"2023-12-08T08:18:01.880266+0000","last_became_active":"2023-12-08T08:17:57.871436+0000","last_became_peered":"2023-12-08T08:17:57.871436+0000","last_unstale":"2023-12-08T08:18:01.880266+0000","last_undegraded":"2023-12-08T08:18:01.880266+0000","last_fullsized":"2023-12-08T08:18:01.880266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868325+0000","last_change":"2023-12-08T08:17:57.861903+0000","last_active":"2023-12-08T08:18:01.868325+0000","last_peered":"2023-12-08T08:18:01.868325+0000","last_clean":"2023-12-08T08:18:01.868325+0000","last_became_active":"2023-12-08T08:17:57.861604+0000","last_became_peered":"2023-12-08T08:17:57.861604+0000","last_unstale":"2023-12-08T08:18:01.868325+0000","last_undegraded":"2023-12-08T08:18:01.868325+0000","last_fullsized":"2023-12-08T08:18:01.868325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869960+0000","last_change":"2023-12-08T08:17:57.853217+0000","last_active":"2023-12-08T08:18:01.869960+0000","last_peered":"2023-12-08T08:18:01.869960+0000","last_clean":"2023-12-08T08:18:01.869960+0000","last_became_active":"2023-12-08T08:17:57.852944+0000","last_became_peered":"2023-12-08T08:17:57.852944+0000","last_unstale":"2023-12-08T08:18:01.869960+0000","last_undegraded":"2023-12-08T08:18:01.869960+0000","last_fullsized":"2023-12-08T08:18:01.869960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:02:02.313064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869655+0000","last_change":"2023-12-08T08:17:57.861199+0000","last_active":"2023-12-08T08:18:01.869655+0000","last_peered":"2023-12-08T08:18:01.869655+0000","last_clean":"2023-12-08T08:18:01.869655+0000","last_became_active":"2023-12-08T08:17:57.860929+0000","last_became_peered":"2023-12-08T08:17:57.860929+0000","last_unstale":"2023-12-08T08:18:01.869655+0000","last_undegraded":"2023-12-08T08:18:01.869655+0000","last_fullsized":"2023-12-08T08:18:01.869655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869190+0000","last_change":"2023-12-08T08:17:57.857515+0000","last_active":"2023-12-08T08:18:01.869190+0000","last_peered":"2023-12-08T08:18:01.869190+0000","last_clean":"2023-12-08T08:18:01.869190+0000","last_became_active":"2023-12-08T08:17:57.857211+0000","last_became_peered":"2023-12-08T08:17:57.857211+0000","last_unstale":"2023-12-08T08:18:01.869190+0000","last_undegraded":"2023-12-08T08:18:01.869190+0000","last_fullsized":"2023-12-08T08:18:01.869190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872446+0000","last_change":"2023-12-08T08:17:57.858919+0000","last_active":"2023-12-08T08:18:01.872446+0000","last_peered":"2023-12-08T08:18:01.872446+0000","last_clean":"2023-12-08T08:18:01.872446+0000","last_became_active":"2023-12-08T08:17:57.858591+0000","last_became_peered":"2023-12-08T08:17:57.858591+0000","last_unstale":"2023-12-08T08:18:01.872446+0000","last_undegraded":"2023-12-08T08:18:01.872446+0000","last_fullsized":"2023-12-08T08:18:01.872446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:53:03.019004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880097+0000","last_change":"2023-12-08T08:17:57.867005+0000","last_active":"2023-12-08T08:18:01.880097+0000","last_peered":"2023-12-08T08:18:01.880097+0000","last_clean":"2023-12-08T08:18:01.880097+0000","last_became_active":"2023-12-08T08:17:57.866755+0000","last_became_peered":"2023-12-08T08:17:57.866755+0000","last_unstale":"2023-12-08T08:18:01.880097+0000","last_undegraded":"2023-12-08T08:18:01.880097+0000","last_fullsized":"2023-12-08T08:18:01.880097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868792+0000","last_change":"2023-12-08T08:17:57.857239+0000","last_active":"2023-12-08T08:18:01.868792+0000","last_peered":"2023-12-08T08:18:01.868792+0000","last_clean":"2023-12-08T08:18:01.868792+0000","last_became_active":"2023-12-08T08:17:57.856974+0000","last_became_peered":"2023-12-08T08:17:57.856974+0000","last_unstale":"2023-12-08T08:18:01.868792+0000","last_undegraded":"2023-12-08T08:18:01.868792+0000","last_fullsized":"2023-12-08T08:18:01.868792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.875617+0000","last_change":"2023-12-08T08:17:57.870364+0000","last_active":"2023-12-08T08:18:01.875617+0000","last_peered":"2023-12-08T08:18:01.875617+0000","last_clean":"2023-12-08T08:18:01.875617+0000","last_became_active":"2023-12-08T08:17:57.870055+0000","last_became_peered":"2023-12-08T08:17:57.870055+0000","last_unstale":"2023-12-08T08:18:01.875617+0000","last_undegraded":"2023-12-08T08:18:01.875617+0000","last_fullsized":"2023-12-08T08:18:01.875617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:10:31.287414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869535+0000","last_change":"2023-12-08T08:17:57.856731+0000","last_active":"2023-12-08T08:18:01.869535+0000","last_peered":"2023-12-08T08:18:01.869535+0000","last_clean":"2023-12-08T08:18:01.869535+0000","last_became_active":"2023-12-08T08:17:57.856474+0000","last_became_peered":"2023-12-08T08:17:57.856474+0000","last_unstale":"2023-12-08T08:18:01.869535+0000","last_undegraded":"2023-12-08T08:18:01.869535+0000","last_fullsized":"2023-12-08T08:18:01.869535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:25.000494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869853+0000","last_change":"2023-12-08T08:17:57.863405+0000","last_active":"2023-12-08T08:18:01.869853+0000","last_peered":"2023-12-08T08:18:01.869853+0000","last_clean":"2023-12-08T08:18:01.869853+0000","last_became_active":"2023-12-08T08:17:57.863134+0000","last_became_peered":"2023-12-08T08:17:57.863134+0000","last_unstale":"2023-12-08T08:18:01.869853+0000","last_undegraded":"2023-12-08T08:18:01.869853+0000","last_fullsized":"2023-12-08T08:18:01.869853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:04:02.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885204+0000","last_change":"2023-12-08T08:17:57.860480+0000","last_active":"2023-12-08T08:18:01.885204+0000","last_peered":"2023-12-08T08:18:01.885204+0000","last_clean":"2023-12-08T08:18:01.885204+0000","last_became_active":"2023-12-08T08:17:57.860188+0000","last_became_peered":"2023-12-08T08:17:57.860188+0000","last_unstale":"2023-12-08T08:18:01.885204+0000","last_undegraded":"2023-12-08T08:18:01.885204+0000","last_fullsized":"2023-12-08T08:18:01.885204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:41:13.172977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873034+0000","last_change":"2023-12-08T08:17:57.852445+0000","last_active":"2023-12-08T08:18:01.873034+0000","last_peered":"2023-12-08T08:18:01.873034+0000","last_clean":"2023-12-08T08:18:01.873034+0000","last_became_active":"2023-12-08T08:17:57.852166+0000","last_became_peered":"2023-12-08T08:17:57.852166+0000","last_unstale":"2023-12-08T08:18:01.873034+0000","last_undegraded":"2023-12-08T08:18:01.873034+0000","last_fullsized":"2023-12-08T08:18:01.873034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:19:13.038005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.867672+0000","last_change":"2023-12-08T08:17:57.869784+0000","last_active":"2023-12-08T08:18:01.867672+0000","last_peered":"2023-12-08T08:18:01.867672+0000","last_clean":"2023-12-08T08:18:01.867672+0000","last_became_active":"2023-12-08T08:17:57.869480+0000","last_became_peered":"2023-12-08T08:17:57.869480+0000","last_unstale":"2023-12-08T08:18:01.867672+0000","last_undegraded":"2023-12-08T08:18:01.867672+0000","last_fullsized":"2023-12-08T08:18:01.867672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:33:53.768019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.873259+0000","last_change":"2023-12-08T08:17:57.870844+0000","last_active":"2023-12-08T08:18:01.873259+0000","last_peered":"2023-12-08T08:18:01.873259+0000","last_clean":"2023-12-08T08:18:01.873259+0000","last_became_active":"2023-12-08T08:17:57.870537+0000","last_became_peered":"2023-12-08T08:17:57.870537+0000","last_unstale":"2023-12-08T08:18:01.873259+0000","last_undegraded":"2023-12-08T08:18:01.873259+0000","last_fullsized":"2023-12-08T08:18:01.873259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:35.384529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880776+0000","last_change":"2023-12-08T08:17:57.867745+0000","last_active":"2023-12-08T08:18:01.880776+0000","last_peered":"2023-12-08T08:18:01.880776+0000","last_clean":"2023-12-08T08:18:01.880776+0000","last_became_active":"2023-12-08T08:17:57.867492+0000","last_became_peered":"2023-12-08T08:17:57.867492+0000","last_unstale":"2023-12-08T08:18:01.880776+0000","last_undegraded":"2023-12-08T08:18:01.880776+0000","last_fullsized":"2023-12-08T08:18:01.880776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.880175+0000","last_change":"2023-12-08T08:17:57.866534+0000","last_active":"2023-12-08T08:18:01.880175+0000","last_peered":"2023-12-08T08:18:01.880175+0000","last_clean":"2023-12-08T08:18:01.880175+0000","last_became_active":"2023-12-08T08:17:57.866280+0000","last_became_peered":"2023-12-08T08:17:57.866280+0000","last_unstale":"2023-12-08T08:18:01.880175+0000","last_undegraded":"2023-12-08T08:18:01.880175+0000","last_fullsized":"2023-12-08T08:18:01.880175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868651+0000","last_change":"2023-12-08T08:17:57.862123+0000","last_active":"2023-12-08T08:18:01.868651+0000","last_peered":"2023-12-08T08:18:01.868651+0000","last_clean":"2023-12-08T08:18:01.868651+0000","last_became_active":"2023-12-08T08:17:57.859905+0000","last_became_peered":"2023-12-08T08:17:57.859905+0000","last_unstale":"2023-12-08T08:18:01.868651+0000","last_undegraded":"2023-12-08T08:18:01.868651+0000","last_fullsized":"2023-12-08T08:18:01.868651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:12:02.076263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869059+0000","last_change":"2023-12-08T08:17:57.864037+0000","last_active":"2023-12-08T08:18:01.869059+0000","last_peered":"2023-12-08T08:18:01.869059+0000","last_clean":"2023-12-08T08:18:01.869059+0000","last_became_active":"2023-12-08T08:17:57.862943+0000","last_became_peered":"2023-12-08T08:17:57.862943+0000","last_unstale":"2023-12-08T08:18:01.869059+0000","last_undegraded":"2023-12-08T08:18:01.869059+0000","last_fullsized":"2023-12-08T08:18:01.869059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:15:26.148572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868564+0000","last_change":"2023-12-08T08:17:57.863052+0000","last_active":"2023-12-08T08:18:01.868564+0000","last_peered":"2023-12-08T08:18:01.868564+0000","last_clean":"2023-12-08T08:18:01.868564+0000","last_became_active":"2023-12-08T08:17:57.862762+0000","last_became_peered":"2023-12-08T08:17:57.862762+0000","last_unstale":"2023-12-08T08:18:01.868564+0000","last_undegraded":"2023-12-08T08:18:01.868564+0000","last_fullsized":"2023-12-08T08:18:01.868564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:42.510788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869100+0000","last_change":"2023-12-08T08:17:57.863846+0000","last_active":"2023-12-08T08:18:01.869100+0000","last_peered":"2023-12-08T08:18:01.869100+0000","last_clean":"2023-12-08T08:18:01.869100+0000","last_became_active":"2023-12-08T08:17:57.863582+0000","last_became_peered":"2023-12-08T08:17:57.863582+0000","last_unstale":"2023-12-08T08:18:01.869100+0000","last_undegraded":"2023-12-08T08:18:01.869100+0000","last_fullsized":"2023-12-08T08:18:01.869100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:24:10.600487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868290+0000","last_change":"2023-12-08T08:17:57.860800+0000","last_active":"2023-12-08T08:18:01.868290+0000","last_peered":"2023-12-08T08:18:01.868290+0000","last_clean":"2023-12-08T08:18:01.868290+0000","last_became_active":"2023-12-08T08:17:57.859933+0000","last_became_peered":"2023-12-08T08:17:57.859933+0000","last_unstale":"2023-12-08T08:18:01.868290+0000","last_undegraded":"2023-12-08T08:18:01.868290+0000","last_fullsized":"2023-12-08T08:18:01.868290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:51:06.403097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.869044+0000","last_change":"2023-12-08T08:17:57.866870+0000","last_active":"2023-12-08T08:18:01.869044+0000","last_peered":"2023-12-08T08:18:01.869044+0000","last_clean":"2023-12-08T08:18:01.869044+0000","last_became_active":"2023-12-08T08:17:57.866242+0000","last_became_peered":"2023-12-08T08:17:57.866242+0000","last_unstale":"2023-12-08T08:18:01.869044+0000","last_undegraded":"2023-12-08T08:18:01.869044+0000","last_fullsized":"2023-12-08T08:18:01.869044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:26.028141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.872306+0000","last_change":"2023-12-08T08:17:57.853244+0000","last_active":"2023-12-08T08:18:01.872306+0000","last_peered":"2023-12-08T08:18:01.872306+0000","last_clean":"2023-12-08T08:18:01.872306+0000","last_became_active":"2023-12-08T08:17:57.852962+0000","last_became_peered":"2023-12-08T08:17:57.852962+0000","last_unstale":"2023-12-08T08:18:01.872306+0000","last_undegraded":"2023-12-08T08:18:01.872306+0000","last_fullsized":"2023-12-08T08:18:01.872306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:08:01.969119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.885422+0000","last_change":"2023-12-08T08:17:57.861311+0000","last_active":"2023-12-08T08:18:01.885422+0000","last_peered":"2023-12-08T08:18:01.885422+0000","last_clean":"2023-12-08T08:18:01.885422+0000","last_became_active":"2023-12-08T08:17:57.860997+0000","last_became_peered":"2023-12-08T08:17:57.860997+0000","last_unstale":"2023-12-08T08:18:01.885422+0000","last_undegraded":"2023-12-08T08:18:01.885422+0000","last_fullsized":"2023-12-08T08:18:01.885422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:23:57.071076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-08T08:18:01.868647+0000","last_change":"2023-12-08T08:17:57.869587+0000","last_active":"2023-12-08T08:18:01.868647+0000","last_peered":"2023-12-08T08:18:01.868647+0000","last_clean":"2023-12-08T08:18:01.868647+0000","last_became_active":"2023-12-08T08:17:57.869269+0000","last_became_peered":"2023-12-08T08:17:57.869269+0000","last_unstale":"2023-12-08T08:18:01.868647+0000","last_undegraded":"2023-12-08T08:18:01.868647+0000","last_fullsized":"2023-12-08T08:18:01.868647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:56.816364+0000","last_clean_scrub_stamp":"2023-12-08T08:17:56.816364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:37:41.285450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":856064,"data_stored":689779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:18:26.948 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T08:18:26.949 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-08T08:18:26.949 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-08T08:18:26.949 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-08T08:18:27.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.086+0000 7f564e49b640 1 Processor -- start 2023-12-08T08:18:27.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.087+0000 7f564e49b640 1 -- start start 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.087+0000 7f564e49b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f56480cef30 0x7f56480d3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.087+0000 7f564e49b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480cdd80 con 0x7f564815e7f0 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.087+0000 7f564e49b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5648161ed0 con 0x7f56480cff60 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.087+0000 7f564e49b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56480d04d0 con 0x7f56480cef30 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.087+0000 7f5647fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f564815e7f0 0x7f56480b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35280/0 (socket says 172.21.15.50:35280) 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.087+0000 7f5647fff640 1 -- 172.21.15.50:0/43197749 learned_addr learned my addr 172.21.15.50:0/43197749 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190762562 0 0) 0x7f56480cdd80 con 0x7f564815e7f0 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5630003520 con 0x7f564815e7f0 2023-12-08T08:18:27.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f564ca38640 1 --2- 172.21.15.50:0/43197749 >> v2:172.21.15.170:3300/0 conn(0x7f56480cef30 0x7f56480d3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930563682 0 0) 0x7f5630003520 con 0x7f564815e7f0 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 >> v2:172.21.15.170:3300/0 conn(0x7f56480cef30 msgr2=0x7f56480d3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 --2- 172.21.15.50:0/43197749 >> v2:172.21.15.170:3300/0 conn(0x7f56480cef30 0x7f56480d3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 >> v1:172.21.15.170:6789/0 conn(0x7f56480cff60 legacy=0x7f56480ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480ce020 con 0x7f564815e7f0 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f5638001670 con 0x7f564815e7f0 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 >> v1:172.21.15.50:6789/0 conn(0x7f564815e7f0 legacy=0x7f56480b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5630003970 0x7f5630003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56300047c0 0x7f5630004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f563000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480d04d0 con 0x7f5630005180 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563000c020 con 0x7f56300047c0 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563000c1e0 con 0x7f5630003970 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f564ca38640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f563000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f5647fff640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5630003970 0x7f5630003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f56477fe640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56300047c0 0x7f5630004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f564ca38640 1 -- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5630003970 msgr2=0x7f5630003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f564ca38640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5630003970 0x7f5630003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f564ca38640 1 -- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56300047c0 msgr2=0x7f5630004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f564ca38640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56300047c0 0x7f5630004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.088+0000 7f564ca38640 1 -- 172.21.15.50:0/43197749 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630003520 con 0x7f5630005180 2023-12-08T08:18:27.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.089+0000 7f564ca38640 1 -- 172.21.15.50:0/43197749 reap_dead start 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.089+0000 7f564ca38640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f563000b980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5648161060 tx=0x7f56300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18737825a7dc87b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.089+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564002cbd0 con 0x7f5630005180 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.089+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564000f040 con 0x7f5630005180 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.089+0000 7f5646ffd640 1 -- 172.21.15.50:0/43197749 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640034440 con 0x7f5630005180 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.090+0000 7f564e49b640 1 -- 172.21.15.50:0/43197749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 msgr2=0x7f563000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.090+0000 7f564e49b640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f563000b980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5648161060 tx=0x7f56300057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.090+0000 7f564e49b640 1 -- 172.21.15.50:0/43197749 shutdown_connections 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.090+0000 7f564e49b640 1 --2- 172.21.15.50:0/43197749 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f563000b980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.090+0000 7f564e49b640 1 -- 172.21.15.50:0/43197749 >> 172.21.15.50:0/43197749 conn(0x7f56480d3010 msgr2=0x7f56480d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.090+0000 7f564e49b640 1 -- 172.21.15.50:0/43197749 shutdown_connections 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.090+0000 7f564e49b640 1 -- 172.21.15.50:0/43197749 wait complete. 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.091+0000 7f564e49b640 1 Processor -- start 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.091+0000 7f564e49b640 1 -- start start 2023-12-08T08:18:27.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f564e49b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f5648160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f564e49b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f564814f570 0x7f5648157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f564e49b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5648158290 0x7f564815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f564e49b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648158710 con 0x7f5630005180 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f564e49b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564815dff0 con 0x7f5648158290 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f564e49b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564815d3e0 con 0x7f564814f570 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f5648160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f5648160a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57534/0 (socket says 172.21.15.50:57534) 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 -- 172.21.15.50:0/1856257083 learned_addr learned my addr 172.21.15.50:0/1856257083 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f564ca38640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5648158290 0x7f564815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f56477fe640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f564814f570 0x7f5648157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 -- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f564814f570 msgr2=0x7f5648157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f564814f570 0x7f5648157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 -- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5648158290 msgr2=0x7f564815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5648158290 0x7f564815ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.092+0000 7f5647fff640 1 -- 172.21.15.50:0/1856257083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564815d6c0 con 0x7f5630005180 2023-12-08T08:18:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.093+0000 7f5647fff640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f5648160a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5638007290 tx=0x7f5638007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.093+0000 7f5644ff9640 1 -- 172.21.15.50:0/1856257083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800f8c0 con 0x7f5630005180 2023-12-08T08:18:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.093+0000 7f5644ff9640 1 -- 172.21.15.50:0/1856257083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800fa60 con 0x7f5630005180 2023-12-08T08:18:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.093+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564815d9a0 con 0x7f5630005180 2023-12-08T08:18:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.093+0000 7f5644ff9640 1 -- 172.21.15.50:0/1856257083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800fe10 con 0x7f5630005180 2023-12-08T08:18:27.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.093+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564815d020 con 0x7f5630005180 2023-12-08T08:18:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.094+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56480b4900 con 0x7f5630005180 2023-12-08T08:18:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.094+0000 7f5644ff9640 1 -- 172.21.15.50:0/1856257083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f563801d460 con 0x7f5630005180 2023-12-08T08:18:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.095+0000 7f5644ff9640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f563406ae40 0x7f563406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.095+0000 7f5644ff9640 1 -- 172.21.15.50:0/1856257083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5638089a70 con 0x7f5630005180 2023-12-08T08:18:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.095+0000 7f56477fe640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f563406ae40 0x7f563406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.095+0000 7f56477fe640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f563406ae40 0x7f563406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f563c000c00 tx=0x7f563c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.099+0000 7f5644ff9640 1 -- 172.21.15.50:0/1856257083 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5638054830 con 0x7f5630005180 2023-12-08T08:18:27.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.311+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f56480cd4b0 con 0x7f5630005180 2023-12-08T08:18:27.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.311+0000 7f5644ff9640 1 -- 172.21.15.50:0/1856257083 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5638057e50 con 0x7f5630005180 2023-12-08T08:18:27.314 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:27.314 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f563406ae40 msgr2=0x7f563406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f563406ae40 0x7f563406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f563c000c00 tx=0x7f563c009040 comp rx=0 tx=0).stop 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 msgr2=0x7f5648160a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f5648160a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5638007290 tx=0x7f5638007750 comp rx=0 tx=0).stop 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 shutdown_connections 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f563406ae40 0x7f563406d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5648158290 0x7f564815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f564814f570 0x7f5648157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 --2- 172.21.15.50:0/1856257083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5630005180 0x7f5648160a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 >> 172.21.15.50:0/1856257083 conn(0x7f56480d3010 msgr2=0x7f56480d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 shutdown_connections 2023-12-08T08:18:27.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.313+0000 7f564e49b640 1 -- 172.21.15.50:0/1856257083 wait complete. 2023-12-08T08:18:27.326 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-08T08:18:27.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:27.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.430+0000 7fe62c333640 1 Processor -- start 2023-12-08T08:18:27.432 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.430+0000 7fe62c333640 1 -- start start 2023-12-08T08:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62c333640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6240ce3e0 0x7fe6240b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62c333640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe624071e50 0x7fe6240b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62c333640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6240b29b0 con 0x7fe624140a10 2023-12-08T08:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62c333640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe624070ba0 con 0x7fe624071e50 2023-12-08T08:18:27.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62c333640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe624070db0 con 0x7fe6240ce3e0 2023-12-08T08:18:27.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62a8d0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe624071e50 0x7fe6240b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62a0cf640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe624140a10 0x7fe6240cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:51830/0 (socket says 172.21.15.50:51830) 2023-12-08T08:18:27.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62a0cf640 1 -- 172.21.15.50:0/668255137 learned_addr learned my addr 172.21.15.50:0/668255137 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:27.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe6298ce640 1 --2- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6240ce3e0 0x7fe6240b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe6290cd640 1 -- 172.21.15.50:0/668255137 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943919566 0 0) 0x7fe6240b29b0 con 0x7fe624140a10 2023-12-08T08:18:27.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe6290cd640 1 -- 172.21.15.50:0/668255137 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe610003520 con 0x7fe624140a10 2023-12-08T08:18:27.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.431+0000 7fe62a8d0640 1 -- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6240ce3e0 msgr2=0x7fe6240b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:27.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.432+0000 7fe62a8d0640 1 --2- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6240ce3e0 0x7fe6240b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.432+0000 7fe62a8d0640 1 -- 172.21.15.50:0/668255137 >> v1:172.21.15.170:6789/0 conn(0x7fe624140a10 legacy=0x7fe6240cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.432+0000 7fe62a8d0640 1 -- 172.21.15.50:0/668255137 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe624071090 con 0x7fe624071e50 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.432+0000 7fe6298ce640 1 --2- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6240ce3e0 0x7fe6240b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.432+0000 7fe62a8d0640 1 --2- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe624071e50 0x7fe6240b2470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009d90 tx=0x7fe61c02bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d581e447af60404f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.432+0000 7fe6290cd640 1 -- 172.21.15.50:0/668255137 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c02cce0 con 0x7fe624071e50 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe6290cd640 1 -- 172.21.15.50:0/668255137 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c02ce40 con 0x7fe624071e50 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe6290cd640 1 -- 172.21.15.50:0/668255137 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c034640 con 0x7fe624071e50 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 -- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe624071e50 msgr2=0x7fe6240b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 --2- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe624071e50 0x7fe6240b2470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009d90 tx=0x7fe61c02bf30 comp rx=0 tx=0).stop 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 -- 172.21.15.50:0/668255137 shutdown_connections 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 --2- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe624071e50 0x7fe6240b2470 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 --2- 172.21.15.50:0/668255137 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6240ce3e0 0x7fe6240b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 -- 172.21.15.50:0/668255137 >> 172.21.15.50:0/668255137 conn(0x7fe6240b09f0 msgr2=0x7fe6240b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 -- 172.21.15.50:0/668255137 shutdown_connections 2023-12-08T08:18:27.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.433+0000 7fe62c333640 1 -- 172.21.15.50:0/668255137 wait complete. 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.434+0000 7fe62c333640 1 Processor -- start 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.434+0000 7fe62c333640 1 -- start start 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62c333640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe624071e50 0x7fe624166570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62c333640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6240ce3e0 0x7fe624140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62c333640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe624140a10 0x7fe624142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62c333640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240ad2d0 con 0x7fe624071e50 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62c333640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240ac9a0 con 0x7fe6240ce3e0 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62c333640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6240acc80 con 0x7fe624140a10 2023-12-08T08:18:27.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62a0cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe624071e50 0x7fe624166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62a0cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe624071e50 0x7fe624166570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57544/0 (socket says 172.21.15.50:57544) 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62a0cf640 1 -- 172.21.15.50:0/468797332 learned_addr learned my addr 172.21.15.50:0/468797332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe6298ce640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6240ce3e0 0x7fe624140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.435+0000 7fe62a8d0640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe624140a10 0x7fe624142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62a0cf640 1 -- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe624140a10 msgr2=0x7fe624142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62a0cf640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe624140a10 0x7fe624142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62a0cf640 1 -- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6240ce3e0 msgr2=0x7fe624140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62a0cf640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6240ce3e0 0x7fe624140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62a0cf640 1 -- 172.21.15.50:0/468797332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009400 con 0x7fe624071e50 2023-12-08T08:18:27.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe6298ce640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6240ce3e0 0x7fe624140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62a0cf640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe624071e50 0x7fe624166570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe61400c390 tx=0x7fe61400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe61affd640 1 -- 172.21.15.50:0/468797332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614005ce0 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe61affd640 1 -- 172.21.15.50:0/468797332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614005e40 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe61affd640 1 -- 172.21.15.50:0/468797332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6140072f0 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c009a70 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.436+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6240ac650 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.437+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe624067430 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.437+0000 7fe61affd640 1 -- 172.21.15.50:0/468797332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe614007450 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.438+0000 7fe61affd640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe60806ae40 0x7fe60806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.438+0000 7fe61affd640 1 -- 172.21.15.50:0/468797332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe614088fb0 con 0x7fe624071e50 2023-12-08T08:18:27.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.438+0000 7fe6298ce640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe60806ae40 0x7fe60806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.438+0000 7fe6298ce640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe60806ae40 0x7fe60806d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe624166db0 tx=0x7fe620008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.442+0000 7fe61affd640 1 -- 172.21.15.50:0/468797332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6140bbe90 con 0x7fe624071e50 2023-12-08T08:18:27.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.619+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe624154280 con 0x7fe624071e50 2023-12-08T08:18:27.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.621+0000 7fe61affd640 1 -- 172.21.15.50:0/468797332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fe614017070 con 0x7fe624071e50 2023-12-08T08:18:27.623 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:27.624 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:27.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.622+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe60806ae40 msgr2=0x7fe60806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.622+0000 7fe62c333640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe60806ae40 0x7fe60806d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe624166db0 tx=0x7fe620008040 comp rx=0 tx=0).stop 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.622+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe624071e50 msgr2=0x7fe624166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.622+0000 7fe62c333640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe624071e50 0x7fe624166570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe61400c390 tx=0x7fe61400c850 comp rx=0 tx=0).stop 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.622+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 shutdown_connections 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.622+0000 7fe62c333640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe60806ae40 0x7fe60806d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.623+0000 7fe62c333640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe624140a10 0x7fe624142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.623+0000 7fe62c333640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6240ce3e0 0x7fe624140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.623+0000 7fe62c333640 1 --2- 172.21.15.50:0/468797332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe624071e50 0x7fe624166570 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.623+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 >> 172.21.15.50:0/468797332 conn(0x7fe6240b09f0 msgr2=0x7fe6240ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.623+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 shutdown_connections 2023-12-08T08:18:27.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.623+0000 7fe62c333640 1 -- 172.21.15.50:0/468797332 wait complete. 2023-12-08T08:18:27.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:27.636 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:27.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.743+0000 7f96dda9b640 1 Processor -- start 2023-12-08T08:18:27.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.743+0000 7f96dda9b640 1 -- start start 2023-12-08T08:18:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.744+0000 7f96dda9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80cfa80 0x7f96d80d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.744+0000 7f96dda9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d80b5ec0 con 0x7f96d80ce690 2023-12-08T08:18:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.744+0000 7f96dda9b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d80cede0 con 0x7f96d80b6bf0 2023-12-08T08:18:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.744+0000 7f96dda9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80b6110 con 0x7f96d80cfa80 2023-12-08T08:18:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.744+0000 7f96d6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f96d80ce690 0x7f96d80cfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35290/0 (socket says 172.21.15.50:35290) 2023-12-08T08:18:27.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.744+0000 7f96d6ffd640 1 -- 172.21.15.50:0/151393081 learned_addr learned my addr 172.21.15.50:0/151393081 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.744+0000 7f96d77fe640 1 --2- 172.21.15.50:0/151393081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80cfa80 0x7f96d80d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.745+0000 7f96d67fc640 1 -- 172.21.15.50:0/151393081 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846478314 0 0) 0x7f96d80b5ec0 con 0x7f96d80ce690 2023-12-08T08:18:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.745+0000 7f96d67fc640 1 -- 172.21.15.50:0/151393081 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96c0003520 con 0x7f96d80ce690 2023-12-08T08:18:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.745+0000 7f96d67fc640 1 -- 172.21.15.50:0/151393081 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814909545 0 0) 0x7f96d80cede0 con 0x7f96d80b6bf0 2023-12-08T08:18:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.745+0000 7f96d77fe640 1 -- 172.21.15.50:0/151393081 >> v1:172.21.15.170:6789/0 conn(0x7f96d80b6bf0 legacy=0x7f96d80b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.745+0000 7f96d77fe640 1 -- 172.21.15.50:0/151393081 >> v1:172.21.15.50:6789/0 conn(0x7f96d80ce690 legacy=0x7f96d80cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.745+0000 7f96d77fe640 1 -- 172.21.15.50:0/151393081 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80b63f0 con 0x7f96d80cfa80 2023-12-08T08:18:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.746+0000 7f96d77fe640 1 --2- 172.21.15.50:0/151393081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80cfa80 0x7f96d80d3b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96c80097d0 tx=0x7f96c802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c81e97f4809d67f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.746+0000 7f96d67fc640 1 -- 172.21.15.50:0/151393081 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8031800 con 0x7f96d80cfa80 2023-12-08T08:18:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.746+0000 7f96d67fc640 1 -- 172.21.15.50:0/151393081 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8031960 con 0x7f96d80cfa80 2023-12-08T08:18:27.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.746+0000 7f96d67fc640 1 -- 172.21.15.50:0/151393081 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8031cf0 con 0x7f96d80cfa80 2023-12-08T08:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.746+0000 7f96dda9b640 1 -- 172.21.15.50:0/151393081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80cfa80 msgr2=0x7f96d80d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.746+0000 7f96dda9b640 1 --2- 172.21.15.50:0/151393081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80cfa80 0x7f96d80d3b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f96c80097d0 tx=0x7f96c802b8a0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.747+0000 7f96dda9b640 1 -- 172.21.15.50:0/151393081 shutdown_connections 2023-12-08T08:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.747+0000 7f96dda9b640 1 --2- 172.21.15.50:0/151393081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80cfa80 0x7f96d80d3b80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.747+0000 7f96dda9b640 1 -- 172.21.15.50:0/151393081 >> 172.21.15.50:0/151393081 conn(0x7f96d809c340 msgr2=0x7f96d80d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.747+0000 7f96dda9b640 1 -- 172.21.15.50:0/151393081 shutdown_connections 2023-12-08T08:18:27.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.747+0000 7f96dda9b640 1 -- 172.21.15.50:0/151393081 wait complete. 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.748+0000 7f96dda9b640 1 Processor -- start 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.748+0000 7f96dda9b640 1 -- start start 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96dda9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80b6bf0 0x7f96d80cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96dda9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80ce690 0x7f96d80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96dda9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96d80cfa80 0x7f96d8158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96dda9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80cc580 con 0x7f96d80b6bf0 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96dda9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80cb900 con 0x7f96d80cfa80 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96dda9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80cbbe0 con 0x7f96d80ce690 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80b6bf0 0x7f96d80cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80b6bf0 0x7f96d80cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57554/0 (socket says 172.21.15.50:57554) 2023-12-08T08:18:27.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 -- 172.21.15.50:0/410277915 learned_addr learned my addr 172.21.15.50:0/410277915 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d6ffd640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80ce690 0x7f96d80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d7fff640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96d80cfa80 0x7f96d8158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 -- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80ce690 msgr2=0x7f96d80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80ce690 0x7f96d80cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 -- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96d80cfa80 msgr2=0x7f96d8158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96d80cfa80 0x7f96d8158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 -- 172.21.15.50:0/410277915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8009400 con 0x7f96d80b6bf0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96d77fe640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80b6bf0 0x7f96d80cb320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96c80097d0 tx=0x7f96c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96bffff640 1 -- 172.21.15.50:0/410277915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8004230 con 0x7f96d80b6bf0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96bffff640 1 -- 172.21.15.50:0/410277915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8004390 con 0x7f96d80b6bf0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d80cbec0 con 0x7f96d80b6bf0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.749+0000 7f96bffff640 1 -- 172.21.15.50:0/410277915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c803ba20 con 0x7f96d80b6bf0 2023-12-08T08:18:27.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.750+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d8159060 con 0x7f96d80b6bf0 2023-12-08T08:18:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.750+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d80cc7f0 con 0x7f96d80b6bf0 2023-12-08T08:18:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.751+0000 7f96bffff640 1 -- 172.21.15.50:0/410277915 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96c8043070 con 0x7f96d80b6bf0 2023-12-08T08:18:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.751+0000 7f96bffff640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f96c406ae40 0x7f96c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.752+0000 7f96bffff640 1 -- 172.21.15.50:0/410277915 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96c802e070 con 0x7f96d80b6bf0 2023-12-08T08:18:27.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.752+0000 7f96d6ffd640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f96c406ae40 0x7f96c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:27.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.752+0000 7f96d6ffd640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f96c406ae40 0x7f96c406d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96d80b7fe0 tx=0x7f96cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:27.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.756+0000 7f96bffff640 1 -- 172.21.15.50:0/410277915 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96c8076460 con 0x7f96d80b6bf0 2023-12-08T08:18:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.930+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96d8067430 con 0x7f96d80b6bf0 2023-12-08T08:18:27.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.931+0000 7f96bffff640 1 -- 172.21.15.50:0/410277915 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96c8079a80 con 0x7f96d80b6bf0 2023-12-08T08:18:27.933 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.932+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f96c406ae40 msgr2=0x7f96c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.932+0000 7f96dda9b640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f96c406ae40 0x7f96c406d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96d80b7fe0 tx=0x7f96cc009040 comp rx=0 tx=0).stop 2023-12-08T08:18:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.932+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80b6bf0 msgr2=0x7f96d80cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.932+0000 7f96dda9b640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80b6bf0 0x7f96d80cb320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96c80097d0 tx=0x7f96c80046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 shutdown_connections 2023-12-08T08:18:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f96c406ae40 0x7f96c406d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96d80cfa80 0x7f96d8158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96d80ce690 0x7f96d80cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 --2- 172.21.15.50:0/410277915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f96d80b6bf0 0x7f96d80cb320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 >> 172.21.15.50:0/410277915 conn(0x7f96d809c340 msgr2=0x7f96d80cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 shutdown_connections 2023-12-08T08:18:27.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:27.933+0000 7f96dda9b640 1 -- 172.21.15.50:0/410277915 wait complete. 2023-12-08T08:18:27.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.052+0000 7f2a66c48640 1 Processor -- start 2023-12-08T08:18:28.055 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.052+0000 7f2a66c48640 1 -- start start 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a66c48640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caae0 0x7f2a60161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a66c48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a600caec0 0x7f2a6015d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a66c48640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6015e600 con 0x7f2a6015dbc0 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a66c48640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6015e040 con 0x7f2a600caec0 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a66c48640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6015e320 con 0x7f2a600caae0 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a5ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a600caec0 0x7f2a6015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a651e5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2a6015dbc0 0x7f2a6006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35306/0 (socket says 172.21.15.50:35306) 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.053+0000 7f2a651e5640 1 -- 172.21.15.50:0/2467793289 learned_addr learned my addr 172.21.15.50:0/2467793289 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:28.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a649e4640 1 --2- 172.21.15.50:0/2467793289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caae0 0x7f2a60161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a5f7fe640 1 -- 172.21.15.50:0/2467793289 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962578467 0 0) 0x7f2a6015e600 con 0x7f2a6015dbc0 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a5f7fe640 1 -- 172.21.15.50:0/2467793289 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a4c003520 con 0x7f2a6015dbc0 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a5ffff640 1 -- 172.21.15.50:0/2467793289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caae0 msgr2=0x7f2a60161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a5ffff640 1 --2- 172.21.15.50:0/2467793289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caae0 0x7f2a60161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a5ffff640 1 -- 172.21.15.50:0/2467793289 >> v1:172.21.15.50:6789/0 conn(0x7f2a6015dbc0 legacy=0x7f2a6006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a5ffff640 1 -- 172.21.15.50:0/2467793289 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a60160d10 con 0x7f2a600caec0 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.054+0000 7f2a649e4640 1 --2- 172.21.15.50:0/2467793289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caae0 0x7f2a60161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a5ffff640 1 --2- 172.21.15.50:0/2467793289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a600caec0 0x7f2a6015d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a500097a0 tx=0x7f2a5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f680498766b966a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a5f7fe640 1 -- 172.21.15.50:0/2467793289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50031830 con 0x7f2a600caec0 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a5f7fe640 1 -- 172.21.15.50:0/2467793289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50031990 con 0x7f2a600caec0 2023-12-08T08:18:28.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a5f7fe640 1 -- 172.21.15.50:0/2467793289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50031d20 con 0x7f2a600caec0 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 -- 172.21.15.50:0/2467793289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a600caec0 msgr2=0x7f2a6015d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 --2- 172.21.15.50:0/2467793289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a600caec0 0x7f2a6015d680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2a500097a0 tx=0x7f2a5002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 -- 172.21.15.50:0/2467793289 shutdown_connections 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 --2- 172.21.15.50:0/2467793289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a600caec0 0x7f2a6015d680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 --2- 172.21.15.50:0/2467793289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caae0 0x7f2a60161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 -- 172.21.15.50:0/2467793289 >> 172.21.15.50:0/2467793289 conn(0x7f2a600cfcd0 msgr2=0x7f2a600d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 -- 172.21.15.50:0/2467793289 shutdown_connections 2023-12-08T08:18:28.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.055+0000 7f2a66c48640 1 -- 172.21.15.50:0/2467793289 wait complete. 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.056+0000 7f2a66c48640 1 Processor -- start 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a66c48640 1 -- start start 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a66c48640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600caae0 0x7f2a601f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a66c48640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caec0 0x7f2a600c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a66c48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6015dbc0 0x7f2a6006e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a66c48640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c9380 con 0x7f2a6015dbc0 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a66c48640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c8ab0 con 0x7f2a600caae0 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a66c48640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c88d0 con 0x7f2a600caec0 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.057+0000 7f2a651e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6015dbc0 0x7f2a6006e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6015dbc0 0x7f2a6006e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57576/0 (socket says 172.21.15.50:57576) 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 -- 172.21.15.50:0/1480759827 learned_addr learned my addr 172.21.15.50:0/1480759827 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a5ffff640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caec0 0x7f2a600c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a649e4640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600caae0 0x7f2a601f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 -- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caec0 msgr2=0x7f2a600c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caec0 0x7f2a600c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 -- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600caae0 msgr2=0x7f2a601f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600caae0 0x7f2a601f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 -- 172.21.15.50:0/1480759827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009400 con 0x7f2a6015dbc0 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a651e5640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6015dbc0 0x7f2a6006e7b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c390 tx=0x7f2a4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a5d7fa640 1 -- 172.21.15.50:0/1480759827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48005ce0 con 0x7f2a6015dbc0 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a5d7fa640 1 -- 172.21.15.50:0/1480759827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48005e40 con 0x7f2a6015dbc0 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a60161bd0 con 0x7f2a6015dbc0 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a5d7fa640 1 -- 172.21.15.50:0/1480759827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48007310 con 0x7f2a6015dbc0 2023-12-08T08:18:28.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.058+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600c9ce0 con 0x7f2a6015dbc0 2023-12-08T08:18:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.059+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a60067ad0 con 0x7f2a6015dbc0 2023-12-08T08:18:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.060+0000 7f2a5d7fa640 1 -- 172.21.15.50:0/1480759827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a48007470 con 0x7f2a6015dbc0 2023-12-08T08:18:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.060+0000 7f2a5d7fa640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a4006ae40 0x7f2a4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.060+0000 7f2a5d7fa640 1 -- 172.21.15.50:0/1480759827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a48088de0 con 0x7f2a6015dbc0 2023-12-08T08:18:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.060+0000 7f2a649e4640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a4006ae40 0x7f2a4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.061+0000 7f2a649e4640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a4006ae40 0x7f2a4006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a58003b80 tx=0x7f2a58009890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.064+0000 7f2a5d7fa640 1 -- 172.21.15.50:0/1480759827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a48053ce0 con 0x7f2a6015dbc0 2023-12-08T08:18:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.240+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a600c3670 con 0x7f2a6015dbc0 2023-12-08T08:18:28.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.240+0000 7f2a5d7fa640 1 -- 172.21.15.50:0/1480759827 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a48017020 con 0x7f2a6015dbc0 2023-12-08T08:18:28.243 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a4006ae40 msgr2=0x7f2a4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a4006ae40 0x7f2a4006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a58003b80 tx=0x7f2a58009890 comp rx=0 tx=0).stop 2023-12-08T08:18:28.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6015dbc0 msgr2=0x7f2a6006e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6015dbc0 0x7f2a6006e7b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c390 tx=0x7f2a4800c850 comp rx=0 tx=0).stop 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 shutdown_connections 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a4006ae40 0x7f2a4006d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a6015dbc0 0x7f2a6006e7b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a600caec0 0x7f2a600c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 --2- 172.21.15.50:0/1480759827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a600caae0 0x7f2a601f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 >> 172.21.15.50:0/1480759827 conn(0x7f2a600cfcd0 msgr2=0x7f2a6006a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 shutdown_connections 2023-12-08T08:18:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.242+0000 7f2a66c48640 1 -- 172.21.15.50:0/1480759827 wait complete. 2023-12-08T08:18:28.255 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:28.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.362+0000 7fd11e3ce640 1 Processor -- start 2023-12-08T08:18:28.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.362+0000 7fd11e3ce640 1 -- start start 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.362+0000 7fd11e3ce640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd1180cfa30 0x7fd1180b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.362+0000 7fd11e3ce640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180c6be0 con 0x7fd1180cfe10 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.362+0000 7fd11e3ce640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180d3ff0 con 0x7fd1180b4150 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.362+0000 7fd11e3ce640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1180b4860 con 0x7fd1180cfa30 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd11c96b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1180cfe10 0x7fd1180cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35308/0 (socket says 172.21.15.50:35308) 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd11c96b640 1 -- 172.21.15.50:0/1178851486 learned_addr learned my addr 172.21.15.50:0/1178851486 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd117fff640 1 --2- 172.21.15.50:0/1178851486 >> v2:172.21.15.170:3300/0 conn(0x7fd1180cfa30 0x7fd1180b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591566754 0 0) 0x7fd1180c6be0 con 0x7fd1180cfe10 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd104003520 con 0x7fd1180cfe10 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466123812 0 0) 0x7fd1180d3ff0 con 0x7fd1180b4150 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1180c6be0 con 0x7fd1180b4150 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd117fff640 1 -- 172.21.15.50:0/1178851486 >> v1:172.21.15.170:6789/0 conn(0x7fd1180b4150 legacy=0x7fd1180b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd117fff640 1 -- 172.21.15.50:0/1178851486 >> v1:172.21.15.50:6789/0 conn(0x7fd1180cfe10 legacy=0x7fd1180cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570766974 0 0) 0x7fd104003520 con 0x7fd1180cfe10 2023-12-08T08:18:28.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.363+0000 7fd117fff640 1 -- 172.21.15.50:0/1178851486 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180d3d50 con 0x7fd1180cfa30 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.364+0000 7fd117fff640 1 --2- 172.21.15.50:0/1178851486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfa30 0x7fd1180b2f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd1080097a0 tx=0x7fd10802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a95cd31cf4df984c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.364+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100019f0 con 0x7fd1180cfa30 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.364+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10802e050 con 0x7fd1180cfa30 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.364+0000 7fd116ffd640 1 -- 172.21.15.50:0/1178851486 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108030730 con 0x7fd1180cfa30 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.365+0000 7fd11e3ce640 1 -- 172.21.15.50:0/1178851486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfa30 msgr2=0x7fd1180b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.365+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/1178851486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfa30 0x7fd1180b2f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd1080097a0 tx=0x7fd10802b790 comp rx=0 tx=0).stop 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.365+0000 7fd11e3ce640 1 -- 172.21.15.50:0/1178851486 shutdown_connections 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.365+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/1178851486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfa30 0x7fd1180b2f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.365+0000 7fd11e3ce640 1 -- 172.21.15.50:0/1178851486 >> 172.21.15.50:0/1178851486 conn(0x7fd1180d3090 msgr2=0x7fd1180d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.365+0000 7fd11e3ce640 1 -- 172.21.15.50:0/1178851486 shutdown_connections 2023-12-08T08:18:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.365+0000 7fd11e3ce640 1 -- 172.21.15.50:0/1178851486 wait complete. 2023-12-08T08:18:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.366+0000 7fd11e3ce640 1 Processor -- start 2023-12-08T08:18:28.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.366+0000 7fd11e3ce640 1 -- start start 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd11e3ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1180b4150 0x7fd1180caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd11e3ce640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1180cfa30 0x7fd118153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd11e3ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfe10 0x7fd11815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd11e3ce640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180cc1c0 con 0x7fd1180b4150 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd11e3ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11815e3d0 con 0x7fd1180cfe10 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd11e3ce640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180cb5b0 con 0x7fd1180cfa30 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1180b4150 0x7fd1180caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1180b4150 0x7fd1180caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57586/0 (socket says 172.21.15.50:57586) 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 -- 172.21.15.50:0/4117045636 learned_addr learned my addr 172.21.15.50:0/4117045636 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd1177fe640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1180cfa30 0x7fd118153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd11c96b640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfe10 0x7fd11815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 -- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1180cfa30 msgr2=0x7fd118153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1180cfa30 0x7fd118153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.371 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 -- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfe10 msgr2=0x7fd11815e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfe10 0x7fd11815e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 -- 172.21.15.50:0/4117045636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108009400 con 0x7fd1180b4150 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd117fff640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1180b4150 0x7fd1180caf20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd10802b7d0 tx=0x7fd1080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.367+0000 7fd114ff9640 1 -- 172.21.15.50:0/4117045636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10803c620 con 0x7fd1180b4150 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.368+0000 7fd114ff9640 1 -- 172.21.15.50:0/4117045636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10803c780 con 0x7fd1180b4150 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.368+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180cb890 con 0x7fd1180b4150 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.368+0000 7fd114ff9640 1 -- 172.21.15.50:0/4117045636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10803cb30 con 0x7fd1180b4150 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.368+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1180cbe50 con 0x7fd1180b4150 2023-12-08T08:18:28.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.369+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd118067430 con 0x7fd1180b4150 2023-12-08T08:18:28.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.369+0000 7fd114ff9640 1 -- 172.21.15.50:0/4117045636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd108039070 con 0x7fd1180b4150 2023-12-08T08:18:28.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.370+0000 7fd114ff9640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd0f806ae70 0x7fd0f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.370+0000 7fd114ff9640 1 -- 172.21.15.50:0/4117045636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1080aab10 con 0x7fd1180b4150 2023-12-08T08:18:28.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.370+0000 7fd1177fe640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd0f806ae70 0x7fd0f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.370+0000 7fd1177fe640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd0f806ae70 0x7fd0f806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd100007fd0 tx=0x7fd100009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.374+0000 7fd114ff9640 1 -- 172.21.15.50:0/4117045636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd108075980 con 0x7fd1180b4150 2023-12-08T08:18:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.550+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1180743e0 con 0x7fd1180b4150 2023-12-08T08:18:28.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.551+0000 7fd114ff9640 1 -- 172.21.15.50:0/4117045636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1080400a0 con 0x7fd1180b4150 2023-12-08T08:18:28.553 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:28.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd0f806ae70 msgr2=0x7fd0f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd0f806ae70 0x7fd0f806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd100007fd0 tx=0x7fd100009040 comp rx=0 tx=0).stop 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1180b4150 msgr2=0x7fd1180caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1180b4150 0x7fd1180caf20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd10802b7d0 tx=0x7fd1080046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 shutdown_connections 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd0f806ae70 0x7fd0f806d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1180cfe10 0x7fd11815e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1180cfa30 0x7fd118153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 --2- 172.21.15.50:0/4117045636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1180b4150 0x7fd1180caf20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 >> 172.21.15.50:0/4117045636 conn(0x7fd1180d3090 msgr2=0x7fd1180c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 shutdown_connections 2023-12-08T08:18:28.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.553+0000 7fd11e3ce640 1 -- 172.21.15.50:0/4117045636 wait complete. 2023-12-08T08:18:28.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.673+0000 7feef0997640 1 Processor -- start 2023-12-08T08:18:28.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.673+0000 7feef0997640 1 -- start start 2023-12-08T08:18:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feef0997640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feeec15d4f0 0x7feeec0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feef0997640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec0b2280 con 0x7feeec0b0920 2023-12-08T08:18:28.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feef0997640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec0b1430 con 0x7feeec0cef90 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feef0997640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec06bb40 con 0x7feeec15d4f0 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feeea59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feeec15d4f0 0x7feeec0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feee1d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feeec0b0920 0x7feeec0b0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35316/0 (socket says 172.21.15.50:35316) 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feee1d9b640 1 -- 172.21.15.50:0/3486240275 learned_addr learned my addr 172.21.15.50:0/3486240275 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feeea59c640 1 -- 172.21.15.50:0/3486240275 >> v1:172.21.15.170:6789/0 conn(0x7feeec0cef90 legacy=0x7feeec0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feeea59c640 1 -- 172.21.15.50:0/3486240275 >> v1:172.21.15.50:6789/0 conn(0x7feeec0b0920 legacy=0x7feeec0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.674+0000 7feeea59c640 1 -- 172.21.15.50:0/3486240275 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0b2710 con 0x7feeec15d4f0 2023-12-08T08:18:28.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.675+0000 7feeea59c640 1 --2- 172.21.15.50:0/3486240275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec15d4f0 0x7feeec0b03e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feedc0097a0 tx=0x7feedc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdcafab43b24ba8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.675+0000 7feee9d9b640 1 -- 172.21.15.50:0/3486240275 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc031830 con 0x7feeec15d4f0 2023-12-08T08:18:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.675+0000 7feee9d9b640 1 -- 172.21.15.50:0/3486240275 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc031990 con 0x7feeec15d4f0 2023-12-08T08:18:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.675+0000 7feee9d9b640 1 -- 172.21.15.50:0/3486240275 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc031d20 con 0x7feeec15d4f0 2023-12-08T08:18:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.675+0000 7feef0997640 1 -- 172.21.15.50:0/3486240275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec15d4f0 msgr2=0x7feeec0b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.675+0000 7feef0997640 1 --2- 172.21.15.50:0/3486240275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec15d4f0 0x7feeec0b03e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feedc0097a0 tx=0x7feedc02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.676+0000 7feef0997640 1 -- 172.21.15.50:0/3486240275 shutdown_connections 2023-12-08T08:18:28.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.676+0000 7feef0997640 1 --2- 172.21.15.50:0/3486240275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec15d4f0 0x7feeec0b03e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.676+0000 7feef0997640 1 -- 172.21.15.50:0/3486240275 >> 172.21.15.50:0/3486240275 conn(0x7feeec0d0e00 msgr2=0x7feeec0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.676+0000 7feef0997640 1 -- 172.21.15.50:0/3486240275 shutdown_connections 2023-12-08T08:18:28.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.676+0000 7feef0997640 1 -- 172.21.15.50:0/3486240275 wait complete. 2023-12-08T08:18:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.677+0000 7feef0997640 1 Processor -- start 2023-12-08T08:18:28.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.677+0000 7feef0997640 1 -- start start 2023-12-08T08:18:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feef0997640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec0b0920 0x7feeec157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feef0997640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0cef90 0x7feeec0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feef0997640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeec15d4f0 0x7feeec157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feef0997640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c8290 con 0x7feeec0b0920 2023-12-08T08:18:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feef0997640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c8570 con 0x7feeec0cef90 2023-12-08T08:18:28.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feef0997640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0c8850 con 0x7feeec15d4f0 2023-12-08T08:18:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec0b0920 0x7feeec157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec0b0920 0x7feeec157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57604/0 (socket says 172.21.15.50:57604) 2023-12-08T08:18:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 -- 172.21.15.50:0/4142533963 learned_addr learned my addr 172.21.15.50:0/4142533963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 -- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeec15d4f0 msgr2=0x7feeec157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeead9d640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeec15d4f0 0x7feeec157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feee1d9b640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0cef90 0x7feeec0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeec15d4f0 0x7feeec157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 -- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0cef90 msgr2=0x7feeec0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0cef90 0x7feeec0af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 -- 172.21.15.50:0/4142533963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc009400 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feeea59c640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec0b0920 0x7feeec157fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feedc000c00 tx=0x7feedc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.678+0000 7feee37fe640 1 -- 172.21.15.50:0/4142533963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc03aa60 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.679+0000 7feee37fe640 1 -- 172.21.15.50:0/4142533963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc03abc0 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.679+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec0c8b30 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.679+0000 7feee37fe640 1 -- 172.21.15.50:0/4142533963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0443f0 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.679+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0c7ed0 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.680+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec067430 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.680+0000 7feee37fe640 1 -- 172.21.15.50:0/4142533963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feedc04d450 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.680+0000 7feee37fe640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feecc06ae40 0x7feecc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.681+0000 7feee37fe640 1 -- 172.21.15.50:0/4142533963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feedc0abb00 con 0x7feeec0b0920 2023-12-08T08:18:28.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.681+0000 7feee1d9b640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feecc06ae40 0x7feecc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.681+0000 7feee1d9b640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feecc06ae40 0x7feecc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ce3f0 tx=0x7feed4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.685+0000 7feee37fe640 1 -- 172.21.15.50:0/4142533963 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feedc0768c0 con 0x7feeec0b0920 2023-12-08T08:18:28.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.862+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feeec06bdd0 con 0x7feeec0b0920 2023-12-08T08:18:28.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.862+0000 7feee37fe640 1 -- 172.21.15.50:0/4142533963 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7feedc035020 con 0x7feeec0b0920 2023-12-08T08:18:28.865 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feecc06ae40 msgr2=0x7feecc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feecc06ae40 0x7feecc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ce3f0 tx=0x7feed4009040 comp rx=0 tx=0).stop 2023-12-08T08:18:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec0b0920 msgr2=0x7feeec157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec0b0920 0x7feeec157fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feedc000c00 tx=0x7feedc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 shutdown_connections 2023-12-08T08:18:28.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feecc06ae40 0x7feecc06d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeec15d4f0 0x7feeec157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0cef90 0x7feeec0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 --2- 172.21.15.50:0/4142533963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feeec0b0920 0x7feeec157fc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 >> 172.21.15.50:0/4142533963 conn(0x7feeec0d0e00 msgr2=0x7feeec1e5910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 shutdown_connections 2023-12-08T08:18:28.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.865+0000 7feef0997640 1 -- 172.21.15.50:0/4142533963 wait complete. 2023-12-08T08:18:28.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:28.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.982+0000 7fd6dfa90640 1 Processor -- start 2023-12-08T08:18:28.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.982+0000 7fd6dfa90640 1 -- start start 2023-12-08T08:18:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dfa90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 0x7fd6d80d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dfa90640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd6d80b0cf0 0x7fd6d80cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dfa90640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80d20b0 con 0x7fd6d80b1d70 2023-12-08T08:18:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dfa90640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80d0620 con 0x7fd6d80b0cf0 2023-12-08T08:18:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dfa90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80d1b80 con 0x7fd6d81608a0 2023-12-08T08:18:28.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dd02b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd6d80b1d70 0x7fd6d80d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35320/0 (socket says 172.21.15.50:35320) 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dd02b640 1 -- 172.21.15.50:0/4190325758 learned_addr learned my addr 172.21.15.50:0/4190325758 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531267355 0 0) 0x7fd6d80d20b0 con 0x7fd6d80b1d70 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.983+0000 7fd6dd82c640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 0x7fd6d80d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c4003520 con 0x7fd6d80b1d70 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6de02d640 1 --2- 172.21.15.50:0/4190325758 >> v2:172.21.15.170:3300/0 conn(0x7fd6d80b0cf0 0x7fd6d80cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789614242 0 0) 0x7fd6c4003520 con 0x7fd6d80b1d70 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 msgr2=0x7fd6d80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 0x7fd6d80d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 >> v2:172.21.15.170:3300/0 conn(0x7fd6d80b0cf0 msgr2=0x7fd6d80cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 --2- 172.21.15.50:0/4190325758 >> v2:172.21.15.170:3300/0 conn(0x7fd6d80b0cf0 0x7fd6d80cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80d1dd0 con 0x7fd6d80b1d70 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fd6c8001670 con 0x7fd6d80b1d70 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6de02d640 1 --2- 172.21.15.50:0/4190325758 >> v2:172.21.15.170:3300/0 conn(0x7fd6d80b0cf0 0x7fd6d80cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 >> v1:172.21.15.50:6789/0 conn(0x7fd6d80b1d70 legacy=0x7fd6d80d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c4003970 0x7fd6c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c40047c0 0x7fd6c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 0x7fd6c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80d0620 con 0x7fd6c40047c0 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80d1b80 con 0x7fd6c4003970 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c400ba30 con 0x7fd6d81608a0 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dd02b640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c40047c0 0x7fd6c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dd82c640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c4003970 0x7fd6c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6de02d640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 0x7fd6c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dd02b640 1 -- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 msgr2=0x7fd6c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dd02b640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 0x7fd6c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dd02b640 1 -- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c4003970 msgr2=0x7fd6c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dd02b640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c4003970 0x7fd6c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6dd02b640 1 -- 172.21.15.50:0/4190325758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4003520 con 0x7fd6c40047c0 2023-12-08T08:18:28.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.984+0000 7fd6de02d640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6d81608a0 0x7fd6c4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.985+0000 7fd6dd02b640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c40047c0 0x7fd6c4004c40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8001050 tx=0x7fd6c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe7df85606b6340 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.985+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8005ad0 con 0x7fd6c40047c0 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.985+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c8005c30 con 0x7fd6c40047c0 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.985+0000 7fd6dc82a640 1 -- 172.21.15.50:0/4190325758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c802c7c0 con 0x7fd6c40047c0 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.986+0000 7fd6dfa90640 1 -- 172.21.15.50:0/4190325758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c40047c0 msgr2=0x7fd6c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.986+0000 7fd6dfa90640 1 --2- 172.21.15.50:0/4190325758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6c40047c0 0x7fd6c4004c40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8001050 tx=0x7fd6c40057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.986+0000 7fd6de02d640 1 -- 172.21.15.50:0/4190325758 reap_dead start 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.986+0000 7fd6dfa90640 1 -- 172.21.15.50:0/4190325758 shutdown_connections 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.986+0000 7fd6dfa90640 1 -- 172.21.15.50:0/4190325758 >> 172.21.15.50:0/4190325758 conn(0x7fd6d80d3030 msgr2=0x7fd6d80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.986+0000 7fd6dfa90640 1 -- 172.21.15.50:0/4190325758 shutdown_connections 2023-12-08T08:18:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.986+0000 7fd6dfa90640 1 -- 172.21.15.50:0/4190325758 wait complete. 2023-12-08T08:18:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.987+0000 7fd6dfa90640 1 Processor -- start 2023-12-08T08:18:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.987+0000 7fd6dfa90640 1 -- start start 2023-12-08T08:18:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dfa90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c40047c0 0x7fd6d815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dfa90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d815c2d0 0x7fd6d8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dfa90640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6d80b7e20 0x7fd6d80b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dfa90640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80b87e0 con 0x7fd6d815c2d0 2023-12-08T08:18:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dfa90640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80cf000 con 0x7fd6d80b7e20 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dfa90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80c9470 con 0x7fd6c40047c0 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d815c2d0 0x7fd6d8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d815c2d0 0x7fd6d8153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57622/0 (socket says 172.21.15.50:57622) 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 -- 172.21.15.50:0/2499839092 learned_addr learned my addr 172.21.15.50:0/2499839092 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd82c640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c40047c0 0x7fd6d815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6de02d640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6d80b7e20 0x7fd6d80b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 -- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c40047c0 msgr2=0x7fd6d815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c40047c0 0x7fd6d815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 -- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6d80b7e20 msgr2=0x7fd6d80b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6d80b7e20 0x7fd6d80b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:28.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 -- 172.21.15.50:0/2499839092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80c9750 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6de02d640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6d80b7e20 0x7fd6d80b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6dd02b640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d815c2d0 0x7fd6d8153230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd6c802c430 tx=0x7fd6d80b26a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.988+0000 7fd6ce7fc640 1 -- 172.21.15.50:0/2499839092 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c802cbd0 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.989+0000 7fd6ce7fc640 1 -- 172.21.15.50:0/2499839092 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c802cd30 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.989+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80c9a30 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.989+0000 7fd6ce7fc640 1 -- 172.21.15.50:0/2499839092 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c802cea0 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.989+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80cf2e0 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.990+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d8067430 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.990+0000 7fd6ce7fc640 1 -- 172.21.15.50:0/2499839092 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6c8032070 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.990+0000 7fd6ce7fc640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.990+0000 7fd6ce7fc640 1 -- 172.21.15.50:0/2499839092 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6c803c040 con 0x7fd6d815c2d0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.991+0000 7fd6dd82c640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:28.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.991+0000 7fd6dd82c640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd6bc06ae70 0x7fd6bc06d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009ae0 tx=0x7fd6d4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:28.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:28.995+0000 7fd6ce7fc640 1 -- 172.21.15.50:0/2499839092 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6c8075b40 con 0x7fd6d815c2d0 2023-12-08T08:18:29.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.205+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6d806cbb0 con 0x7fd6d815c2d0 2023-12-08T08:18:29.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.206+0000 7fd6ce7fc640 1 -- 172.21.15.50:0/2499839092 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fd6c8045020 con 0x7fd6d815c2d0 2023-12-08T08:18:29.208 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:29.208 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:18:29.209 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:18:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd6bc06ae70 msgr2=0x7fd6bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd6bc06ae70 0x7fd6bc06d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009ae0 tx=0x7fd6d4009190 comp rx=0 tx=0).stop 2023-12-08T08:18:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d815c2d0 msgr2=0x7fd6d8153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d815c2d0 0x7fd6d8153230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd6c802c430 tx=0x7fd6d80b26a0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 shutdown_connections 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd6bc06ae70 0x7fd6bc06d330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd6d815c2d0 0x7fd6d8153230 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6d80b7e20 0x7fd6d80b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 --2- 172.21.15.50:0/2499839092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c40047c0 0x7fd6d815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 >> 172.21.15.50:0/2499839092 conn(0x7fd6d80d3030 msgr2=0x7fd6d80d3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 shutdown_connections 2023-12-08T08:18:29.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.208+0000 7fd6dfa90640 1 -- 172.21.15.50:0/2499839092 wait complete. 2023-12-08T08:18:29.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.325+0000 7fdb6990c640 1 Processor -- start 2023-12-08T08:18:29.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.325+0000 7fdb6990c640 1 -- start start 2023-12-08T08:18:29.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb6990c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 0x7fdb640b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb6990c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb64070db0 con 0x7fdb64140a10 2023-12-08T08:18:29.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb6990c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb64071090 con 0x7fdb64071e50 2023-12-08T08:18:29.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb6990c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64070ba0 con 0x7fdb640ce3e0 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb62ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdb64140a10 0x7fdb640cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:35326/0 (socket says 172.21.15.50:35326) 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb62ffd640 1 -- 172.21.15.50:0/2566898522 learned_addr learned my addr 172.21.15.50:0/2566898522 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb627fc640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 0x7fdb640b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505407738 0 0) 0x7fdb64070db0 con 0x7fdb64140a10 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb4c003520 con 0x7fdb64140a10 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299434681 0 0) 0x7fdb4c003520 con 0x7fdb64140a10 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 msgr2=0x7fdb640b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 0x7fdb640b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 >> v1:172.21.15.170:6789/0 conn(0x7fdb64071e50 legacy=0x7fdb6406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64071370 con 0x7fdb64140a10 2023-12-08T08:18:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fdb54001670 con 0x7fdb64140a10 2023-12-08T08:18:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 >> v1:172.21.15.50:6789/0 conn(0x7fdb64140a10 legacy=0x7fdb640cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 0x7fdb4c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb4c003ee0 0x7fdb4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c004d00 0x7fdb4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.326+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64070ba0 con 0x7fdb4c004d00 2023-12-08T08:18:29.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c00b9e0 con 0x7fdb4c003ee0 2023-12-08T08:18:29.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c00ddb0 con 0x7fdb640ce3e0 2023-12-08T08:18:29.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb637fe640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c004d00 0x7fdb4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb62ffd640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 0x7fdb4c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb627fc640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb4c003ee0 0x7fdb4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb637fe640 1 -- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 msgr2=0x7fdb4c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb637fe640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb640ce3e0 0x7fdb4c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb637fe640 1 -- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb4c003ee0 msgr2=0x7fdb4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb637fe640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb4c003ee0 0x7fdb4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.327+0000 7fdb637fe640 1 -- 172.21.15.50:0/2566898522 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c003520 con 0x7fdb4c004d00 2023-12-08T08:18:29.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb637fe640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c004d00 0x7fdb4c005180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c001f60 tx=0x7fdb4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12d20c1ced18102 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c02d6f0 con 0x7fdb4c004d00 2023-12-08T08:18:29.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c02d870 con 0x7fdb4c004d00 2023-12-08T08:18:29.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb61ffb640 1 -- 172.21.15.50:0/2566898522 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c02dc20 con 0x7fdb4c004d00 2023-12-08T08:18:29.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb6990c640 1 -- 172.21.15.50:0/2566898522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c004d00 msgr2=0x7fdb4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb6990c640 1 --2- 172.21.15.50:0/2566898522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb4c004d00 0x7fdb4c005180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c001f60 tx=0x7fdb4c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb637fe640 1 -- 172.21.15.50:0/2566898522 reap_dead start 2023-12-08T08:18:29.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb6990c640 1 -- 172.21.15.50:0/2566898522 shutdown_connections 2023-12-08T08:18:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb6990c640 1 -- 172.21.15.50:0/2566898522 >> 172.21.15.50:0/2566898522 conn(0x7fdb640b09f0 msgr2=0x7fdb640b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb6990c640 1 -- 172.21.15.50:0/2566898522 shutdown_connections 2023-12-08T08:18:29.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.328+0000 7fdb6990c640 1 -- 172.21.15.50:0/2566898522 wait complete. 2023-12-08T08:18:29.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.330+0000 7fdb6990c640 1 Processor -- start 2023-12-08T08:18:29.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.330+0000 7fdb6990c640 1 -- start start 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.330+0000 7fdb6990c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb6414eb50 0x7fdb6414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.330+0000 7fdb6990c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb6414c100 0x7fdb6406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.330+0000 7fdb6990c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb6406d940 0x7fdb640acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb6990c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6406ddc0 con 0x7fdb6414c100 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb6990c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6414bc70 con 0x7fdb6406d940 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb6990c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641ef750 con 0x7fdb6414eb50 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb6414c100 0x7fdb6406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb6414c100 0x7fdb6406d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57638/0 (socket says 172.21.15.50:57638) 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 -- 172.21.15.50:0/1189597745 learned_addr learned my addr 172.21.15.50:0/1189597745 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb62ffd640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb6414eb50 0x7fdb6414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb637fe640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb6406d940 0x7fdb640acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 -- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb6414eb50 msgr2=0x7fdb6414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb6414eb50 0x7fdb6414ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 -- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb6406d940 msgr2=0x7fdb640acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb6406d940 0x7fdb640acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 -- 172.21.15.50:0/1189597745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6414b620 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb627fc640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb6414c100 0x7fdb6406d400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdb58011910 tx=0x7fdb58011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb4bfff640 1 -- 172.21.15.50:0/1189597745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58009590 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb4bfff640 1 -- 172.21.15.50:0/1189597745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb58004240 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6414b900 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb4bfff640 1 -- 172.21.15.50:0/1189597745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800f880 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.331+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb640ad4b0 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.332+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6414b480 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.333+0000 7fdb4bfff640 1 -- 172.21.15.50:0/1189597745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb5800f9e0 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.333+0000 7fdb4bfff640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb5006ae40 0x7fdb5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.333+0000 7fdb4bfff640 1 -- 172.21.15.50:0/1189597745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb58089f40 con 0x7fdb6414c100 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.333+0000 7fdb62ffd640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb5006ae40 0x7fdb5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.334+0000 7fdb62ffd640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb5006ae40 0x7fdb5006d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb54004840 tx=0x7fdb54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.337+0000 7fdb4bfff640 1 -- 172.21.15.50:0/1189597745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb6414b480 con 0x7fdb6414c100 2023-12-08T08:18:29.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.513+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb6414b480 con 0x7fdb6414c100 2023-12-08T08:18:29.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.514+0000 7fdb4bfff640 1 -- 172.21.15.50:0/1189597745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fdb6414b480 con 0x7fdb6414c100 2023-12-08T08:18:29.517 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:29.517 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb5006ae40 msgr2=0x7fdb5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb5006ae40 0x7fdb5006d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb54004840 tx=0x7fdb54009040 comp rx=0 tx=0).stop 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb6414c100 msgr2=0x7fdb6406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb6414c100 0x7fdb6406d400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdb58011910 tx=0x7fdb58011dd0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 shutdown_connections 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb5006ae40 0x7fdb5006d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb6414c100 0x7fdb6406d400 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb6406d940 0x7fdb640acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 --2- 172.21.15.50:0/1189597745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb6414eb50 0x7fdb6414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 >> 172.21.15.50:0/1189597745 conn(0x7fdb640b09f0 msgr2=0x7fdb640b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 shutdown_connections 2023-12-08T08:18:29.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.516+0000 7fdb6990c640 1 -- 172.21.15.50:0/1189597745 wait complete. 2023-12-08T08:18:29.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:29.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.636+0000 7f6672173640 1 Processor -- start 2023-12-08T08:18:29.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f6672173640 1 -- start start 2023-12-08T08:18:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f6672173640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c160980 0x7f666c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f6672173640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f666c06b6e0 0x7f666c06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f6672173640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f666c0d0000 0x7f666c06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f6672173640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0d04f0 con 0x7f666c0d0000 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f6672173640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0b1260 con 0x7f666c06b6e0 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f6672173640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0b0930 con 0x7f666c160980 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f666bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f666c0d0000 0x7f666c06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f666bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f666c0d0000 0x7f666c06c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57642/0 (socket says 172.21.15.50:57642) 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.637+0000 7f666bfff640 1 -- 172.21.15.50:0/2581439098 learned_addr learned my addr 172.21.15.50:0/2581439098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.638+0000 7f666b7fe640 1 --2- 172.21.15.50:0/2581439098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c160980 0x7f666c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.638+0000 7f666affd640 1 --2- 172.21.15.50:0/2581439098 >> v2:172.21.15.170:3300/0 conn(0x7f666c06b6e0 0x7f666c06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.638+0000 7f666bfff640 1 -- 172.21.15.50:0/2581439098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c160980 msgr2=0x7f666c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.638+0000 7f666bfff640 1 --2- 172.21.15.50:0/2581439098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c160980 0x7f666c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.638+0000 7f666bfff640 1 -- 172.21.15.50:0/2581439098 >> v2:172.21.15.170:3300/0 conn(0x7f666c06b6e0 msgr2=0x7f666c06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.638+0000 7f666bfff640 1 --2- 172.21.15.50:0/2581439098 >> v2:172.21.15.170:3300/0 conn(0x7f666c06b6e0 0x7f666c06bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.638+0000 7f666bfff640 1 -- 172.21.15.50:0/2581439098 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0b0c10 con 0x7f666c0d0000 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f666bfff640 1 --2- 172.21.15.50:0/2581439098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c0d0000 0x7f666c06c1e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f666c071ca0 tx=0x7f666402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7a87e20ef5a4d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f666a7fc640 1 -- 172.21.15.50:0/2581439098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666402cb00 con 0x7f666c0d0000 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f666a7fc640 1 -- 172.21.15.50:0/2581439098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666402cc60 con 0x7f666c0d0000 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f666a7fc640 1 -- 172.21.15.50:0/2581439098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640343f0 con 0x7f666c0d0000 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 -- 172.21.15.50:0/2581439098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c0d0000 msgr2=0x7f666c06c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 --2- 172.21.15.50:0/2581439098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c0d0000 0x7f666c06c1e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f666c071ca0 tx=0x7f666402bf60 comp rx=0 tx=0).stop 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 -- 172.21.15.50:0/2581439098 shutdown_connections 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 --2- 172.21.15.50:0/2581439098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c0d0000 0x7f666c06c1e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 --2- 172.21.15.50:0/2581439098 >> v2:172.21.15.170:3300/0 conn(0x7f666c06b6e0 0x7f666c06bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 --2- 172.21.15.50:0/2581439098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c160980 0x7f666c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 -- 172.21.15.50:0/2581439098 >> 172.21.15.50:0/2581439098 conn(0x7f666c0d0e30 msgr2=0x7f666c0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 -- 172.21.15.50:0/2581439098 shutdown_connections 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.639+0000 7f6672173640 1 -- 172.21.15.50:0/2581439098 wait complete. 2023-12-08T08:18:29.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.640+0000 7f6672173640 1 Processor -- start 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f6672173640 1 -- start start 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f6672173640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c06b6e0 0x7f666c0c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f6672173640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c0d0000 0x7f666c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f6672173640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f666c160980 0x7f666c157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f6672173640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c157250 con 0x7f666c06b6e0 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f6672173640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0c7910 con 0x7f666c160980 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f6672173640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c156660 con 0x7f666c0d0000 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f666b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c06b6e0 0x7f666c0c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f666b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c06b6e0 0x7f666c0c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57644/0 (socket says 172.21.15.50:57644) 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.641+0000 7f666b7fe640 1 -- 172.21.15.50:0/224046948 learned_addr learned my addr 172.21.15.50:0/224046948 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666bfff640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f666c160980 0x7f666c157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666affd640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c0d0000 0x7f666c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666b7fe640 1 -- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c0d0000 msgr2=0x7f666c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666b7fe640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c0d0000 0x7f666c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666b7fe640 1 -- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f666c160980 msgr2=0x7f666c157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666b7fe640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f666c160980 0x7f666c157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666b7fe640 1 -- 172.21.15.50:0/224046948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6664009b30 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666bfff640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f666c160980 0x7f666c157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f666b7fe640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c06b6e0 0x7f666c0c6740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f665c00d5f0 tx=0x7f665c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f6653fff640 1 -- 172.21.15.50:0/224046948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c0125f0 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f6653fff640 1 -- 172.21.15.50:0/224046948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c012750 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c1568b0 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f6653fff640 1 -- 172.21.15.50:0/224046948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c012b00 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.642+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c156e70 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.643+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c1574c0 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.643+0000 7f6653fff640 1 -- 172.21.15.50:0/224046948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f665c012c60 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.644+0000 7f6653fff640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f665806ae40 0x7f665806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.644+0000 7f6653fff640 1 -- 172.21.15.50:0/224046948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f665c089de0 con 0x7f666c06b6e0 2023-12-08T08:18:29.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.644+0000 7f666affd640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f665806ae40 0x7f665806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.645+0000 7f666affd640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f665806ae40 0x7f665806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f666c153190 tx=0x7f6660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.651 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.648+0000 7f6653fff640 1 -- 172.21.15.50:0/224046948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f665c054b90 con 0x7f666c06b6e0 2023-12-08T08:18:29.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.822+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f666c067ad0 con 0x7f666c06b6e0 2023-12-08T08:18:29.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.822+0000 7f6653fff640 1 -- 172.21.15.50:0/224046948 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f665c0581b0 con 0x7f666c06b6e0 2023-12-08T08:18:29.825 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f665806ae40 msgr2=0x7f665806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f665806ae40 0x7f665806d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f666c153190 tx=0x7f6660008040 comp rx=0 tx=0).stop 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c06b6e0 msgr2=0x7f666c0c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c06b6e0 0x7f666c0c6740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f665c00d5f0 tx=0x7f665c00dab0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 shutdown_connections 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f665806ae40 0x7f665806d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f666c160980 0x7f666c157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f666c0d0000 0x7f666c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 --2- 172.21.15.50:0/224046948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f666c06b6e0 0x7f666c0c6740 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 >> 172.21.15.50:0/224046948 conn(0x7f666c0d0e30 msgr2=0x7f666c066400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 shutdown_connections 2023-12-08T08:18:29.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.824+0000 7f6672173640 1 -- 172.21.15.50:0/224046948 wait complete. 2023-12-08T08:18:29.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:29.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.945+0000 7f5fcab0f640 1 Processor -- start 2023-12-08T08:18:29.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fcab0f640 1 -- start start 2023-12-08T08:18:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fcab0f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fc40cf900 0x7f5fc40cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fcab0f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5fc4160c00 0x7f5fc40cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fcab0f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40b1f00 con 0x7f5fc40d0220 2023-12-08T08:18:29.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fcab0f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc40b2150 con 0x7f5fc40cf900 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fcab0f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc40d3b80 con 0x7f5fc4160c00 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fc88ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5fc40cf900 0x7f5fc40cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fc3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5fc40d0220 0x7f5fc41604f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45296/0 (socket says 172.21.15.50:45296) 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.946+0000 7f5fc3fff640 1 -- 172.21.15.50:0/2582593063 learned_addr learned my addr 172.21.15.50:0/2582593063 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.947+0000 7f5fc90ac640 1 --2- 172.21.15.50:0/2582593063 >> v2:172.21.15.170:3300/0 conn(0x7f5fc4160c00 0x7f5fc40cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.947+0000 7f5fc88ab640 1 -- 172.21.15.50:0/2582593063 >> v2:172.21.15.170:3300/0 conn(0x7f5fc4160c00 msgr2=0x7f5fc40cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.947+0000 7f5fc88ab640 1 --2- 172.21.15.50:0/2582593063 >> v2:172.21.15.170:3300/0 conn(0x7f5fc4160c00 0x7f5fc40cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.947+0000 7f5fc88ab640 1 -- 172.21.15.50:0/2582593063 >> v1:172.21.15.50:6789/0 conn(0x7f5fc40d0220 legacy=0x7f5fc41604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.947+0000 7f5fc88ab640 1 -- 172.21.15.50:0/2582593063 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40d3e60 con 0x7f5fc40cf900 2023-12-08T08:18:29.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.947+0000 7f5fc37fe640 1 -- 172.21.15.50:0/2582593063 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148161226 0 0) 0x7f5fc40b1f00 con 0x7f5fc40d0220 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fc88ab640 1 --2- 172.21.15.50:0/2582593063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc40cf900 0x7f5fc40cfce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40d3030 tx=0x7f5fb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1512f3dcca44ec27 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fc37fe640 1 -- 172.21.15.50:0/2582593063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb802e070 con 0x7f5fc40cf900 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fc37fe640 1 -- 172.21.15.50:0/2582593063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb80315a0 con 0x7f5fc40cf900 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fc37fe640 1 -- 172.21.15.50:0/2582593063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8031930 con 0x7f5fc40cf900 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 -- 172.21.15.50:0/2582593063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc40cf900 msgr2=0x7f5fc40cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/2582593063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc40cf900 0x7f5fc40cfce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40d3030 tx=0x7f5fb802b840 comp rx=0 tx=0).stop 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 -- 172.21.15.50:0/2582593063 shutdown_connections 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/2582593063 >> v2:172.21.15.170:3300/0 conn(0x7f5fc4160c00 0x7f5fc40cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/2582593063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc40cf900 0x7f5fc40cfce0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 -- 172.21.15.50:0/2582593063 >> 172.21.15.50:0/2582593063 conn(0x7f5fc40d3060 msgr2=0x7f5fc40d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:29.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 -- 172.21.15.50:0/2582593063 shutdown_connections 2023-12-08T08:18:29.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.948+0000 7f5fcab0f640 1 -- 172.21.15.50:0/2582593063 wait complete. 2023-12-08T08:18:29.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.949+0000 7f5fcab0f640 1 Processor -- start 2023-12-08T08:18:29.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fcab0f640 1 -- start start 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fcab0f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fc40cf900 0x7f5fc41f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fcab0f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc4160c00 0x7f5fc40b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fcab0f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fc415f390 0x7f5fc40b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fcab0f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41f2b60 con 0x7f5fc4160c00 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fcab0f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41f6dd0 con 0x7f5fc40cf900 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fcab0f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41f6530 con 0x7f5fc415f390 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.950+0000 7f5fc3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc4160c00 0x7f5fc40b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc4160c00 0x7f5fc40b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53426/0 (socket says 172.21.15.50:53426) 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 -- 172.21.15.50:0/809789443 learned_addr learned my addr 172.21.15.50:0/809789443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:29.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc90ac640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fc415f390 0x7f5fc40b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc88ab640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fc40cf900 0x7f5fc41f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 -- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fc415f390 msgr2=0x7f5fc40b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fc415f390 0x7f5fc40b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 -- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fc40cf900 msgr2=0x7f5fc41f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fc40cf900 0x7f5fc41f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 -- 172.21.15.50:0/809789443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb8009400 con 0x7f5fc4160c00 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc88ab640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fc40cf900 0x7f5fc41f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc90ac640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fc415f390 0x7f5fc40b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc3fff640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc4160c00 0x7f5fc40b5b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c4d0 tx=0x7f5fb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc17fa640 1 -- 172.21.15.50:0/809789443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00074e0 con 0x7f5fc4160c00 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc17fa640 1 -- 172.21.15.50:0/809789443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb0007660 con 0x7f5fc4160c00 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc41f6810 con 0x7f5fc4160c00 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fc17fa640 1 -- 172.21.15.50:0/809789443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0004a20 con 0x7f5fc4160c00 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.951+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc40b6040 con 0x7f5fc4160c00 2023-12-08T08:18:29.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.952+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc41f2cd0 con 0x7f5fc4160c00 2023-12-08T08:18:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.953+0000 7f5fc17fa640 1 -- 172.21.15.50:0/809789443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fb0004b80 con 0x7f5fc4160c00 2023-12-08T08:18:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.953+0000 7f5fc17fa640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5fa806ae40 0x7f5fa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.953+0000 7f5fc17fa640 1 -- 172.21.15.50:0/809789443 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fb0088e60 con 0x7f5fc4160c00 2023-12-08T08:18:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.954+0000 7f5fc88ab640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5fa806ae40 0x7f5fa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:29.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.954+0000 7f5fc88ab640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5fa806ae40 0x7f5fa806d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8036000 tx=0x7f5fb8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:29.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:29.958+0000 7f5fc17fa640 1 -- 172.21.15.50:0/809789443 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fb0053c20 con 0x7f5fc4160c00 2023-12-08T08:18:30.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.133+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fc4067ad0 con 0x7f5fc4160c00 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.133+0000 7f5fc17fa640 1 -- 172.21.15.50:0/809789443 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fb00180a0 con 0x7f5fc4160c00 2023-12-08T08:18:30.136 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5fa806ae40 msgr2=0x7f5fa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5fa806ae40 0x7f5fa806d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8036000 tx=0x7f5fb8008030 comp rx=0 tx=0).stop 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc4160c00 msgr2=0x7f5fc40b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc4160c00 0x7f5fc40b5b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c4d0 tx=0x7f5fb000c990 comp rx=0 tx=0).stop 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 shutdown_connections 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5fa806ae40 0x7f5fa806d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fc4160c00 0x7f5fc40b5b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5fc415f390 0x7f5fc40b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 --2- 172.21.15.50:0/809789443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5fc40cf900 0x7f5fc41f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 >> 172.21.15.50:0/809789443 conn(0x7f5fc40d3060 msgr2=0x7f5fc40d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 shutdown_connections 2023-12-08T08:18:30.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.135+0000 7f5fcab0f640 1 -- 172.21.15.50:0/809789443 wait complete. 2023-12-08T08:18:30.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.255+0000 7f44dc70c640 1 Processor -- start 2023-12-08T08:18:30.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.255+0000 7f44dc70c640 1 -- start start 2023-12-08T08:18:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44dc70c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40b4150 0x7f44d40b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44dc70c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44d40cfe10 0x7f44d40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44dc70c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d40c6be0 con 0x7f44d40cfa30 2023-12-08T08:18:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44dc70c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d40d3ff0 con 0x7f44d40cfe10 2023-12-08T08:18:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44dc70c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40b4860 con 0x7f44d40b4150 2023-12-08T08:18:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44daca9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44d40cfe10 0x7f44d40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44daca9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f44d40cfe10 0x7f44d40cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53428/0 (socket says 172.21.15.50:53428) 2023-12-08T08:18:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44daca9640 1 -- 172.21.15.50:0/4038466954 learned_addr learned my addr 172.21.15.50:0/4038466954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.256+0000 7f44d9ca7640 1 --2- 172.21.15.50:0/4038466954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40b4150 0x7f44d40b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.257+0000 7f44daca9640 1 -- 172.21.15.50:0/4038466954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40b4150 msgr2=0x7f44d40b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.257+0000 7f44daca9640 1 --2- 172.21.15.50:0/4038466954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40b4150 0x7f44d40b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.257+0000 7f44daca9640 1 -- 172.21.15.50:0/4038466954 >> v1:172.21.15.170:6789/0 conn(0x7f44d40cfa30 legacy=0x7f44d40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.257+0000 7f44daca9640 1 -- 172.21.15.50:0/4038466954 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d40d3d50 con 0x7f44d40cfe10 2023-12-08T08:18:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.257+0000 7f44daca9640 1 --2- 172.21.15.50:0/4038466954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40cfe10 0x7f44d40cdf50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009e50 tx=0x7f44d002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa46699860676270 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44d94a6640 1 -- 172.21.15.50:0/4038466954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d002ca70 con 0x7f44d40cfe10 2023-12-08T08:18:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44d94a6640 1 -- 172.21.15.50:0/4038466954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d002cbd0 con 0x7f44d40cfe10 2023-12-08T08:18:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44d94a6640 1 -- 172.21.15.50:0/4038466954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d00343f0 con 0x7f44d40cfe10 2023-12-08T08:18:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 -- 172.21.15.50:0/4038466954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40cfe10 msgr2=0x7f44d40cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 --2- 172.21.15.50:0/4038466954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40cfe10 0x7f44d40cdf50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009e50 tx=0x7f44d002bed0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 -- 172.21.15.50:0/4038466954 shutdown_connections 2023-12-08T08:18:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 --2- 172.21.15.50:0/4038466954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40cfe10 0x7f44d40cdf50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 --2- 172.21.15.50:0/4038466954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40b4150 0x7f44d40b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 -- 172.21.15.50:0/4038466954 >> 172.21.15.50:0/4038466954 conn(0x7f44d40d3090 msgr2=0x7f44d40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 -- 172.21.15.50:0/4038466954 shutdown_connections 2023-12-08T08:18:30.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.258+0000 7f44dc70c640 1 -- 172.21.15.50:0/4038466954 wait complete. 2023-12-08T08:18:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.259+0000 7f44dc70c640 1 Processor -- start 2023-12-08T08:18:30.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.259+0000 7f44dc70c640 1 -- start start 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44dc70c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40b4150 0x7f44d41f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44dc70c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40cfa30 0x7f44d40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44dc70c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40cfe10 0x7f44d40cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44dc70c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40cb750 con 0x7f44d40b4150 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44dc70c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40cbbe0 con 0x7f44d40cfe10 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44dc70c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40cab40 con 0x7f44d40cfa30 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44da4a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40b4150 0x7f44d41f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44da4a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40b4150 0x7f44d41f2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53440/0 (socket says 172.21.15.50:53440) 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.260+0000 7f44da4a8640 1 -- 172.21.15.50:0/3159827454 learned_addr learned my addr 172.21.15.50:0/3159827454 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44da4a8640 1 -- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40cfa30 msgr2=0x7f44d40ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44da4a8640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40cfa30 0x7f44d40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44da4a8640 1 -- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40cfe10 msgr2=0x7f44d40cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44da4a8640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40cfe10 0x7f44d40cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44da4a8640 1 -- 172.21.15.50:0/3159827454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d0009b30 con 0x7f44d40b4150 2023-12-08T08:18:30.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44da4a8640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40b4150 0x7f44d41f2860 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00c450 tx=0x7f44cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44caffd640 1 -- 172.21.15.50:0/3159827454 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0052d0 con 0x7f44d40b4150 2023-12-08T08:18:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44caffd640 1 -- 172.21.15.50:0/3159827454 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc005430 con 0x7f44d40b4150 2023-12-08T08:18:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d40cae20 con 0x7f44d40b4150 2023-12-08T08:18:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44caffd640 1 -- 172.21.15.50:0/3159827454 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc012870 con 0x7f44d40b4150 2023-12-08T08:18:30.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.261+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d40cb3e0 con 0x7f44d40b4150 2023-12-08T08:18:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.262+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d4067430 con 0x7f44d40b4150 2023-12-08T08:18:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.262+0000 7f44caffd640 1 -- 172.21.15.50:0/3159827454 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44cc0129d0 con 0x7f44d40b4150 2023-12-08T08:18:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.263+0000 7f44caffd640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f44b806ae40 0x7f44b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.263+0000 7f44caffd640 1 -- 172.21.15.50:0/3159827454 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44cc089430 con 0x7f44d40b4150 2023-12-08T08:18:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.263+0000 7f44d9ca7640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f44b806ae40 0x7f44b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.264+0000 7f44d9ca7640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f44b806ae40 0x7f44b806d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f44c4006a90 tx=0x7f44c4006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.269 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.267+0000 7f44caffd640 1 -- 172.21.15.50:0/3159827454 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44cc0541f0 con 0x7f44d40b4150 2023-12-08T08:18:30.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.443+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44d40743e0 con 0x7f44d40b4150 2023-12-08T08:18:30.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.443+0000 7f44caffd640 1 -- 172.21.15.50:0/3159827454 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44cc057810 con 0x7f44d40b4150 2023-12-08T08:18:30.447 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f44b806ae40 msgr2=0x7f44b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f44b806ae40 0x7f44b806d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f44c4006a90 tx=0x7f44c4006a20 comp rx=0 tx=0).stop 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40b4150 msgr2=0x7f44d41f2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40b4150 0x7f44d41f2860 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00c450 tx=0x7f44cc00c910 comp rx=0 tx=0).stop 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 shutdown_connections 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f44b806ae40 0x7f44b806d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44d40cfe10 0x7f44d40cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44d40cfa30 0x7f44d40ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 --2- 172.21.15.50:0/3159827454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44d40b4150 0x7f44d41f2860 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 >> 172.21.15.50:0/3159827454 conn(0x7f44d40d3090 msgr2=0x7f44d4161730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 shutdown_connections 2023-12-08T08:18:30.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.445+0000 7f44dc70c640 1 -- 172.21.15.50:0/3159827454 wait complete. 2023-12-08T08:18:30.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:30.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.566+0000 7f42f5ce7640 1 Processor -- start 2023-12-08T08:18:30.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.566+0000 7f42f5ce7640 1 -- start start 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42f5ce7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 0x7f42f00d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42f5ce7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00b5ec0 con 0x7f42f00ce690 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42f5ce7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f00cede0 con 0x7f42f00b6bf0 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42f5ce7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00b6110 con 0x7f42f00cfa80 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42eeffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42f00ce690 0x7f42f00cfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45302/0 (socket says 172.21.15.50:45302) 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42eeffd640 1 -- 172.21.15.50:0/2256004058 learned_addr learned my addr 172.21.15.50:0/2256004058 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ef7fe640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 0x7f42f00d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188622007 0 0) 0x7f42f00b5ec0 con 0x7f42f00ce690 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d8003520 con 0x7f42f00ce690 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279366763 0 0) 0x7f42d8003520 con 0x7f42f00ce690 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 msgr2=0x7f42f00d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 0x7f42f00d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 >> v1:172.21.15.170:6789/0 conn(0x7f42f00b6bf0 legacy=0x7f42f00b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00b63f0 con 0x7f42f00ce690 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f42e4001670 con 0x7f42f00ce690 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 >> v1:172.21.15.50:6789/0 conn(0x7f42f00ce690 legacy=0x7f42f00cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d80039a0 0x7f42d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 0x7f42d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.567+0000 7f42ee7fc640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00b6110 con 0x7f42d8004d00 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d800bab0 con 0x7f42d80039a0 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d800bc70 con 0x7f42f00cfa80 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42effff640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42ef7fe640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d80039a0 0x7f42d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42eeffd640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 0x7f42d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42effff640 1 -- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 msgr2=0x7f42d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42effff640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f00cfa80 0x7f42d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42effff640 1 -- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d80039a0 msgr2=0x7f42d8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42effff640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42d80039a0 0x7f42d8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.568+0000 7f42effff640 1 -- 172.21.15.50:0/2256004058 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8003520 con 0x7f42d8004d00 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42effff640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001e50 tx=0x7f42d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a804059ca03120a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8003b70 con 0x7f42d8004d00 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8003cd0 con 0x7f42d8004d00 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42ee7fc640 1 -- 172.21.15.50:0/2256004058 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8005310 con 0x7f42d8004d00 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42f5ce7640 1 -- 172.21.15.50:0/2256004058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d8004d00 msgr2=0x7f42d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42f5ce7640 1 --2- 172.21.15.50:0/2256004058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d8004d00 0x7f42d8005180 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f42e8001e50 tx=0x7f42d80057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42effff640 1 -- 172.21.15.50:0/2256004058 reap_dead start 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42f5ce7640 1 -- 172.21.15.50:0/2256004058 shutdown_connections 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42f5ce7640 1 -- 172.21.15.50:0/2256004058 >> 172.21.15.50:0/2256004058 conn(0x7f42f009c340 msgr2=0x7f42f00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42f5ce7640 1 -- 172.21.15.50:0/2256004058 shutdown_connections 2023-12-08T08:18:30.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.569+0000 7f42f5ce7640 1 -- 172.21.15.50:0/2256004058 wait complete. 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.570+0000 7f42f5ce7640 1 Processor -- start 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.571+0000 7f42f5ce7640 1 -- start start 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f015b840 0x7f42f015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f00cb540 0x7f42f009cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f009d2f0 0x7f42f015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f009d770 con 0x7f42f00cb540 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00cc680 con 0x7f42f015b840 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00cba70 con 0x7f42f009d2f0 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f00cb540 0x7f42f009cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f00cb540 0x7f42f009cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53450/0 (socket says 172.21.15.50:53450) 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 -- 172.21.15.50:0/3928080833 learned_addr learned my addr 172.21.15.50:0/3928080833 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:30.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42effff640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f009d2f0 0x7f42f015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42ef7fe640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f015b840 0x7f42f015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 -- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f009d2f0 msgr2=0x7f42f015e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f009d2f0 0x7f42f015e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 -- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f015b840 msgr2=0x7f42f015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f015b840 0x7f42f015f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 -- 172.21.15.50:0/3928080833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00cbd50 con 0x7f42f00cb540 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42eeffd640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f00cb540 0x7f42f009cdb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f42e4007290 tx=0x7f42e4007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42d7fff640 1 -- 172.21.15.50:0/3928080833 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400f8e0 con 0x7f42f00cb540 2023-12-08T08:18:30.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42d7fff640 1 -- 172.21.15.50:0/3928080833 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e400fa60 con 0x7f42f00cb540 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f00cc030 con 0x7f42f00cb540 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42d7fff640 1 -- 172.21.15.50:0/3928080833 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400fe10 con 0x7f42f00cb540 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.572+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f015bc20 con 0x7f42f00cb540 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.573+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f0072730 con 0x7f42f00cb540 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.574+0000 7f42d7fff640 1 -- 172.21.15.50:0/3928080833 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42e401d460 con 0x7f42f00cb540 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.574+0000 7f42d7fff640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42dc06ae70 0x7f42dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.575+0000 7f42d7fff640 1 -- 172.21.15.50:0/3928080833 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42e4089930 con 0x7f42f00cb540 2023-12-08T08:18:30.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.575+0000 7f42ef7fe640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42dc06ae70 0x7f42dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.575+0000 7f42ef7fe640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42dc06ae70 0x7f42dc06d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009bc0 tx=0x7f42e0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.579+0000 7f42d7fff640 1 -- 172.21.15.50:0/3928080833 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42e40546f0 con 0x7f42f00cb540 2023-12-08T08:18:30.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.754+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f42f0067430 con 0x7f42f00cb540 2023-12-08T08:18:30.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.754+0000 7f42d7fff640 1 -- 172.21.15.50:0/3928080833 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f42e4057d10 con 0x7f42f00cb540 2023-12-08T08:18:30.759 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42dc06ae70 msgr2=0x7f42dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42dc06ae70 0x7f42dc06d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009bc0 tx=0x7f42e0009190 comp rx=0 tx=0).stop 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f00cb540 msgr2=0x7f42f009cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f00cb540 0x7f42f009cdb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f42e4007290 tx=0x7f42e4007690 comp rx=0 tx=0).stop 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 shutdown_connections 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42dc06ae70 0x7f42dc06d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42f00cb540 0x7f42f009cdb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42f009d2f0 0x7f42f015e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 --2- 172.21.15.50:0/3928080833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f015b840 0x7f42f015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 >> 172.21.15.50:0/3928080833 conn(0x7f42f009c340 msgr2=0x7f42f00b8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 shutdown_connections 2023-12-08T08:18:30.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.756+0000 7f42f5ce7640 1 -- 172.21.15.50:0/3928080833 wait complete. 2023-12-08T08:18:30.770 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.873+0000 7f5977031640 1 Processor -- start 2023-12-08T08:18:30.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.873+0000 7f5977031640 1 -- start start 2023-12-08T08:18:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.874+0000 7f5977031640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f597015b1f0 0x7f59700ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.874+0000 7f5977031640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597015b5d0 con 0x7f59700ceef0 2023-12-08T08:18:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.874+0000 7f5977031640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59700cc710 con 0x7f59700c6140 2023-12-08T08:18:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.874+0000 7f5977031640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700c4d10 con 0x7f597015b1f0 2023-12-08T08:18:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.874+0000 7f596ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59700ceef0 0x7f59700cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45316/0 (socket says 172.21.15.50:45316) 2023-12-08T08:18:30.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.874+0000 7f596ffff640 1 -- 172.21.15.50:0/2088013145 learned_addr learned my addr 172.21.15.50:0/2088013145 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.874+0000 7f5974dcd640 1 --2- 172.21.15.50:0/2088013145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f597015b1f0 0x7f59700ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.875+0000 7f596f7fe640 1 -- 172.21.15.50:0/2088013145 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979867466 0 0) 0x7f597015b5d0 con 0x7f59700ceef0 2023-12-08T08:18:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.875+0000 7f596f7fe640 1 -- 172.21.15.50:0/2088013145 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f595c003520 con 0x7f59700ceef0 2023-12-08T08:18:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.875+0000 7f596f7fe640 1 -- 172.21.15.50:0/2088013145 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153168157 0 0) 0x7f59700cc710 con 0x7f59700c6140 2023-12-08T08:18:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.875+0000 7f5974dcd640 1 -- 172.21.15.50:0/2088013145 >> v1:172.21.15.170:6789/0 conn(0x7f59700c6140 legacy=0x7f59700cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.875+0000 7f5974dcd640 1 -- 172.21.15.50:0/2088013145 >> v1:172.21.15.50:6789/0 conn(0x7f59700ceef0 legacy=0x7f59700cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.875+0000 7f5974dcd640 1 -- 172.21.15.50:0/2088013145 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59700cc9f0 con 0x7f597015b1f0 2023-12-08T08:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5974dcd640 1 --2- 172.21.15.50:0/2088013145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f597015b1f0 0x7f59700ce9b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f59680097d0 tx=0x7f596802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeccfd406cdbf6a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f596f7fe640 1 -- 172.21.15.50:0/2088013145 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968031800 con 0x7f597015b1f0 2023-12-08T08:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f596f7fe640 1 -- 172.21.15.50:0/2088013145 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968031960 con 0x7f597015b1f0 2023-12-08T08:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f596f7fe640 1 -- 172.21.15.50:0/2088013145 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968031cf0 con 0x7f597015b1f0 2023-12-08T08:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5977031640 1 -- 172.21.15.50:0/2088013145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f597015b1f0 msgr2=0x7f59700ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5977031640 1 --2- 172.21.15.50:0/2088013145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f597015b1f0 0x7f59700ce9b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f59680097d0 tx=0x7f596802b8a0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5977031640 1 -- 172.21.15.50:0/2088013145 shutdown_connections 2023-12-08T08:18:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5977031640 1 --2- 172.21.15.50:0/2088013145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f597015b1f0 0x7f59700ce9b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5977031640 1 -- 172.21.15.50:0/2088013145 >> 172.21.15.50:0/2088013145 conn(0x7f59700d0de0 msgr2=0x7f59700d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5977031640 1 -- 172.21.15.50:0/2088013145 shutdown_connections 2023-12-08T08:18:30.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.876+0000 7f5977031640 1 -- 172.21.15.50:0/2088013145 wait complete. 2023-12-08T08:18:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.877+0000 7f5977031640 1 Processor -- start 2023-12-08T08:18:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f5977031640 1 -- start start 2023-12-08T08:18:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f5977031640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59700c6140 0x7f5970159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f5977031640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59700ceef0 0x7f597009ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f5977031640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f597015b1f0 0x7f59700b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f5977031640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700c7eb0 con 0x7f597015b1f0 2023-12-08T08:18:30.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f5977031640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700c8d10 con 0x7f59700c6140 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f5977031640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700c8100 con 0x7f59700ceef0 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.878+0000 7f59755ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f597015b1f0 0x7f59700b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f597015b1f0 0x7f59700b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53458/0 (socket says 172.21.15.50:53458) 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 -- 172.21.15.50:0/3525218324 learned_addr learned my addr 172.21.15.50:0/3525218324 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f5974dcd640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59700c6140 0x7f5970159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f596ffff640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59700ceef0 0x7f597009ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 -- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59700ceef0 msgr2=0x7f597009ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59700ceef0 0x7f597009ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 -- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59700c6140 msgr2=0x7f5970159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59700c6140 0x7f5970159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 -- 172.21.15.50:0/3525218324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968009400 con 0x7f597015b1f0 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f59755ce640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f597015b1f0 0x7f59700b1fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f595800c410 tx=0x7f595800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f596d7fa640 1 -- 172.21.15.50:0/3525218324 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580035f0 con 0x7f597015b1f0 2023-12-08T08:18:30.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f596d7fa640 1 -- 172.21.15.50:0/3525218324 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958003770 con 0x7f597015b1f0 2023-12-08T08:18:30.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59700c83e0 con 0x7f597015b1f0 2023-12-08T08:18:30.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f596d7fa640 1 -- 172.21.15.50:0/3525218324 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958003b20 con 0x7f597015b1f0 2023-12-08T08:18:30.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.879+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59700c89a0 con 0x7f597015b1f0 2023-12-08T08:18:30.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.880+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5970067430 con 0x7f597015b1f0 2023-12-08T08:18:30.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.881+0000 7f596d7fa640 1 -- 172.21.15.50:0/3525218324 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5958003c80 con 0x7f597015b1f0 2023-12-08T08:18:30.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.881+0000 7f596d7fa640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f595006ae70 0x7f595006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:30.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.881+0000 7f596d7fa640 1 -- 172.21.15.50:0/3525218324 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5958088e50 con 0x7f597015b1f0 2023-12-08T08:18:30.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.881+0000 7f5974dcd640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f595006ae70 0x7f595006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:30.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.882+0000 7f5974dcd640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f595006ae70 0x7f595006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5968036000 tx=0x7f596803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:30.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:30.885+0000 7f596d7fa640 1 -- 172.21.15.50:0/3525218324 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5958053c20 con 0x7f597015b1f0 2023-12-08T08:18:31.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.099+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59700c8e80 con 0x7f597015b1f0 2023-12-08T08:18:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.099+0000 7f596d7fa640 1 -- 172.21.15.50:0/3525218324 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f5958057240 con 0x7f597015b1f0 2023-12-08T08:18:31.103 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:31.103 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:18:31.103 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f595006ae70 msgr2=0x7f595006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f595006ae70 0x7f595006d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5968036000 tx=0x7f596803c040 comp rx=0 tx=0).stop 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f597015b1f0 msgr2=0x7f59700b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f597015b1f0 0x7f59700b1fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f595800c410 tx=0x7f595800c8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 shutdown_connections 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f595006ae70 0x7f595006d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f597015b1f0 0x7f59700b1fd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59700ceef0 0x7f597009ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 --2- 172.21.15.50:0/3525218324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59700c6140 0x7f5970159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 >> 172.21.15.50:0/3525218324 conn(0x7f59700d0de0 msgr2=0x7f59700cf310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 shutdown_connections 2023-12-08T08:18:31.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.101+0000 7f5977031640 1 -- 172.21.15.50:0/3525218324 wait complete. 2023-12-08T08:18:31.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.218+0000 7f251cb01640 1 Processor -- start 2023-12-08T08:18:31.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.218+0000 7f251cb01640 1 -- start start 2023-12-08T08:18:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251cb01640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25180b3340 0x7f25180d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251cb01640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f25180b3bf0 0x7f25180b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251cb01640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180cdc20 con 0x7f25180d15f0 2023-12-08T08:18:31.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251cb01640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180d11d0 con 0x7f25180b3340 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251cb01640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180d3a60 con 0x7f25180b3bf0 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f25180b3340 0x7f25180d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f2516d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f25180d15f0 0x7f25180d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45318/0 (socket says 172.21.15.50:45318) 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f2516d9d640 1 -- 172.21.15.50:0/3616414946 learned_addr learned my addr 172.21.15.50:0/3616414946 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f250dd9b640 1 --2- 172.21.15.50:0/3616414946 >> v2:172.21.15.170:3300/0 conn(0x7f25180b3bf0 0x7f25180b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251659c640 1 -- 172.21.15.50:0/3616414946 >> v2:172.21.15.170:3300/0 conn(0x7f25180b3bf0 msgr2=0x7f25180b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251659c640 1 --2- 172.21.15.50:0/3616414946 >> v2:172.21.15.170:3300/0 conn(0x7f25180b3bf0 0x7f25180b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251659c640 1 -- 172.21.15.50:0/3616414946 >> v1:172.21.15.50:6789/0 conn(0x7f25180d15f0 legacy=0x7f25180d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f2515d9b640 1 -- 172.21.15.50:0/3616414946 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880097627 0 0) 0x7f25180cdc20 con 0x7f25180d15f0 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.219+0000 7f251659c640 1 -- 172.21.15.50:0/3616414946 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180d3d40 con 0x7f25180b3340 2023-12-08T08:18:31.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.220+0000 7f251659c640 1 --2- 172.21.15.50:0/3616414946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3340 0x7f25180d00c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f25180cd970 tx=0x7f250802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3494cb7959e42e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.220+0000 7f2515d9b640 1 -- 172.21.15.50:0/3616414946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250802e070 con 0x7f25180b3340 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.220+0000 7f2515d9b640 1 -- 172.21.15.50:0/3616414946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25080315a0 con 0x7f25180b3340 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.220+0000 7f2515d9b640 1 -- 172.21.15.50:0/3616414946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508031930 con 0x7f25180b3340 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 -- 172.21.15.50:0/3616414946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3340 msgr2=0x7f25180d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 --2- 172.21.15.50:0/3616414946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3340 0x7f25180d00c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f25180cd970 tx=0x7f250802b840 comp rx=0 tx=0).stop 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 -- 172.21.15.50:0/3616414946 shutdown_connections 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 --2- 172.21.15.50:0/3616414946 >> v2:172.21.15.170:3300/0 conn(0x7f25180b3bf0 0x7f25180b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 --2- 172.21.15.50:0/3616414946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3340 0x7f25180d00c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 -- 172.21.15.50:0/3616414946 >> 172.21.15.50:0/3616414946 conn(0x7f251809c2f0 msgr2=0x7f25180d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 -- 172.21.15.50:0/3616414946 shutdown_connections 2023-12-08T08:18:31.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.221+0000 7f251cb01640 1 -- 172.21.15.50:0/3616414946 wait complete. 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.222+0000 7f251cb01640 1 Processor -- start 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.222+0000 7f251cb01640 1 -- start start 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251cb01640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25180b3340 0x7f25181f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251cb01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3bf0 0x7f2518157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251cb01640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25180d15f0 0x7f2518157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251cb01640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25181f4050 con 0x7f25180b3bf0 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251cb01640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25181f0c50 con 0x7f25180d15f0 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251cb01640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2518156d90 con 0x7f25180b3340 2023-12-08T08:18:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3bf0 0x7f2518157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3bf0 0x7f2518157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53480/0 (socket says 172.21.15.50:53480) 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 -- 172.21.15.50:0/2997886808 learned_addr learned my addr 172.21.15.50:0/2997886808 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f2516d9d640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25180d15f0 0x7f2518157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251659c640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25180b3340 0x7f25181f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 -- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25180b3340 msgr2=0x7f25181f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25180b3340 0x7f25181f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 -- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25180d15f0 msgr2=0x7f2518157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25180d15f0 0x7f2518157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 -- 172.21.15.50:0/2997886808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2508009400 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f251659c640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25180b3340 0x7f25181f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.223+0000 7f250dd9b640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3bf0 0x7f2518157710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f250000e9b0 tx=0x7f250000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.224+0000 7f250f7fe640 1 -- 172.21.15.50:0/2997886808 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500009670 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.224+0000 7f250f7fe640 1 -- 172.21.15.50:0/2997886808 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250000c9a0 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.224+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25181f31d0 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.224+0000 7f250f7fe640 1 -- 172.21.15.50:0/2997886808 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250000cd50 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.224+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25181f3990 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.225+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25180b0c30 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.225+0000 7f250f7fe640 1 -- 172.21.15.50:0/2997886808 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2500013470 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.226+0000 7f250f7fe640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24f806ae40 0x7f24f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.226+0000 7f250f7fe640 1 -- 172.21.15.50:0/2997886808 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2500089920 con 0x7f25180b3bf0 2023-12-08T08:18:31.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.226+0000 7f251659c640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24f806ae40 0x7f24f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.226+0000 7f251659c640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24f806ae40 0x7f24f806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2508036000 tx=0x7f2508008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.230+0000 7f250f7fe640 1 -- 172.21.15.50:0/2997886808 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2500054790 con 0x7f25180b3bf0 2023-12-08T08:18:31.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.408+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25181f31d0 con 0x7f25180b3bf0 2023-12-08T08:18:31.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.409+0000 7f250f7fe640 1 -- 172.21.15.50:0/2997886808 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f25181f31d0 con 0x7f25180b3bf0 2023-12-08T08:18:31.413 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:31.413 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":24,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:02.243124+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24f806ae40 msgr2=0x7f24f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24f806ae40 0x7f24f806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2508036000 tx=0x7f2508008030 comp rx=0 tx=0).stop 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3bf0 msgr2=0x7f2518157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3bf0 0x7f2518157710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f250000e9b0 tx=0x7f250000ee70 comp rx=0 tx=0).stop 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 shutdown_connections 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24f806ae40 0x7f24f806d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f25180b3bf0 0x7f2518157710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25180d15f0 0x7f2518157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 --2- 172.21.15.50:0/2997886808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25180b3340 0x7f25181f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 >> 172.21.15.50:0/2997886808 conn(0x7f251809c2f0 msgr2=0x7f25181604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 shutdown_connections 2023-12-08T08:18:31.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.411+0000 7f251cb01640 1 -- 172.21.15.50:0/2997886808 wait complete. 2023-12-08T08:18:31.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:18:31.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.529+0000 7f114cd39640 1 Processor -- start 2023-12-08T08:18:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.529+0000 7f114cd39640 1 -- start start 2023-12-08T08:18:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114cd39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480b6ac0 0x7f11480cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114cd39640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f11480cd660 0x7f11480cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114cd39640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11480d0070 con 0x7f11480cdfc0 2023-12-08T08:18:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114cd39640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1148160cb0 con 0x7f11480cd660 2023-12-08T08:18:31.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114cd39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11480cd200 con 0x7f11480b6ac0 2023-12-08T08:18:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114659c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480b6ac0 0x7f11480cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f1145d9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f11480cd660 0x7f11480cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114659c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480b6ac0 0x7f11480cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:36420/0 (socket says 172.21.15.50:36420) 2023-12-08T08:18:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.530+0000 7f114659c640 1 -- 172.21.15.50:0/2915512349 learned_addr learned my addr 172.21.15.50:0/2915512349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.531+0000 7f1145d9b640 1 -- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480b6ac0 msgr2=0x7f11480cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.531+0000 7f1145d9b640 1 --2- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480b6ac0 0x7f11480cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.531+0000 7f1145d9b640 1 -- 172.21.15.50:0/2915512349 >> v1:172.21.15.170:6789/0 conn(0x7f11480cdfc0 legacy=0x7f114806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.531+0000 7f114559a640 1 -- 172.21.15.50:0/2915512349 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272974847 0 0) 0x7f1138001490 con 0x7f11480cdfc0 2023-12-08T08:18:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.531+0000 7f1145d9b640 1 -- 172.21.15.50:0/2915512349 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480d02b0 con 0x7f11480cd660 2023-12-08T08:18:31.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.531+0000 7f114659c640 1 --2- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480b6ac0 0x7f11480cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f1145d9b640 1 --2- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 0x7f11480cda80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f11300097a0 tx=0x7f113002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37ba82008c9ae22 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114559a640 1 -- 172.21.15.50:0/2915512349 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113002f050 con 0x7f11480cd660 2023-12-08T08:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114559a640 1 -- 172.21.15.50:0/2915512349 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130031700 con 0x7f11480cd660 2023-12-08T08:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114559a640 1 -- 172.21.15.50:0/2915512349 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130031a90 con 0x7f11480cd660 2023-12-08T08:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114cd39640 1 -- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 msgr2=0x7f11480cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114cd39640 1 --2- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 0x7f11480cda80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f11300097a0 tx=0x7f113002b7a0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114cd39640 1 -- 172.21.15.50:0/2915512349 shutdown_connections 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114cd39640 1 --2- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 0x7f11480cda80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114cd39640 1 --2- 172.21.15.50:0/2915512349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480b6ac0 0x7f11480cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.532+0000 7f114cd39640 1 -- 172.21.15.50:0/2915512349 >> 172.21.15.50:0/2915512349 conn(0x7f11480d0de0 msgr2=0x7f11480d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.533+0000 7f114cd39640 1 -- 172.21.15.50:0/2915512349 shutdown_connections 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.533+0000 7f114cd39640 1 -- 172.21.15.50:0/2915512349 wait complete. 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.534+0000 7f114cd39640 1 Processor -- start 2023-12-08T08:18:31.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.534+0000 7f114cd39640 1 -- start start 2023-12-08T08:18:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114cd39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11480b6ac0 0x7f114806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114cd39640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 0x7f114809cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114cd39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480cdfc0 0x7f114815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114cd39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480c9910 con 0x7f11480b6ac0 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114cd39640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480ca700 con 0x7f11480cd660 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114cd39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11480c9af0 con 0x7f11480cdfc0 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11480b6ac0 0x7f114806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11480b6ac0 0x7f114806f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53484/0 (socket says 172.21.15.50:53484) 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 -- 172.21.15.50:0/2687078977 learned_addr learned my addr 172.21.15.50:0/2687078977 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f1146d9d640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480cdfc0 0x7f114815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f1145d9b640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 0x7f114809cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 -- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480cdfc0 msgr2=0x7f114815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480cdfc0 0x7f114815c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 -- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 msgr2=0x7f114809cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 0x7f114809cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 -- 172.21.15.50:0/2687078977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400094d0 con 0x7f11480b6ac0 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.535+0000 7f114659c640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11480b6ac0 0x7f114806f3a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f114000e9b0 tx=0x7f114000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.536+0000 7f113effd640 1 -- 172.21.15.50:0/2687078977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000c9a0 con 0x7f11480b6ac0 2023-12-08T08:18:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.536+0000 7f113effd640 1 -- 172.21.15.50:0/2687078977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114000cb00 con 0x7f11480b6ac0 2023-12-08T08:18:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.536+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1130009400 con 0x7f11480b6ac0 2023-12-08T08:18:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.536+0000 7f113effd640 1 -- 172.21.15.50:0/2687078977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114000ce70 con 0x7f11480b6ac0 2023-12-08T08:18:31.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.536+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11480ca0b0 con 0x7f11480b6ac0 2023-12-08T08:18:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.537+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1148067430 con 0x7f11480b6ac0 2023-12-08T08:18:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.537+0000 7f113effd640 1 -- 172.21.15.50:0/2687078977 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1140013470 con 0x7f11480b6ac0 2023-12-08T08:18:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.538+0000 7f113effd640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f112806ae40 0x7f112806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.538+0000 7f113effd640 1 -- 172.21.15.50:0/2687078977 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1140089e60 con 0x7f11480b6ac0 2023-12-08T08:18:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.538+0000 7f1145d9b640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f112806ae40 0x7f112806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:31.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.538+0000 7f1145d9b640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f112806ae40 0x7f112806d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1130035000 tx=0x7f1130008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:31.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.542+0000 7f113effd640 1 -- 172.21.15.50:0/2687078977 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1140054cd0 con 0x7f11480b6ac0 2023-12-08T08:18:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.756+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f114806ff90 con 0x7f11480b6ac0 2023-12-08T08:18:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.756+0000 7f113effd640 1 -- 172.21.15.50:0/2687078977 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f1140017090 con 0x7f11480b6ac0 2023-12-08T08:18:31.760 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:31.760 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:18:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f112806ae40 msgr2=0x7f112806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f112806ae40 0x7f112806d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1130035000 tx=0x7f1130008030 comp rx=0 tx=0).stop 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11480b6ac0 msgr2=0x7f114806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11480b6ac0 0x7f114806f3a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f114000e9b0 tx=0x7f114000ee70 comp rx=0 tx=0).stop 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 shutdown_connections 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f112806ae40 0x7f112806d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11480cdfc0 0x7f114815c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11480cd660 0x7f114809cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 --2- 172.21.15.50:0/2687078977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11480b6ac0 0x7f114806f3a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 >> 172.21.15.50:0/2687078977 conn(0x7f11480d0de0 msgr2=0x7f114806e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 shutdown_connections 2023-12-08T08:18:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:31.758+0000 7f114cd39640 1 -- 172.21.15.50:0/2687078977 wait complete. 2023-12-08T08:18:32.175 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:17:57.193015+0000', 'modified': '2023-12-08T08:18:19.281291+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6837/728540036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6835', 'nonce': 728540036}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 728540036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:18:32.175 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:18:32.175 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-08T08:18:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.284+0000 7f64cc1fc640 1 Processor -- start 2023-12-08T08:18:32.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.284+0000 7f64cc1fc640 1 -- start start 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64cc1fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c406bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64cc1fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c406c8e0 con 0x7f64c406c480 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64cc1fc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c40ce6f0 con 0x7f64c40ccd70 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64cc1fc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40d0a60 con 0x7f64c40ce270 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64ca799640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64c406c480 0x7f64c415ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45322/0 (socket says 172.21.15.50:45322) 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64ca799640 1 -- 172.21.15.50:0/3696861238 learned_addr learned my addr 172.21.15.50:0/3696861238 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c9797640 1 --2- 172.21.15.50:0/3696861238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c406bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716062597 0 0) 0x7f64c406c8e0 con 0x7f64c406c480 2023-12-08T08:18:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b0003520 con 0x7f64c406c480 2023-12-08T08:18:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946899629 0 0) 0x7f64c40ce6f0 con 0x7f64c40ccd70 2023-12-08T08:18:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c406c8e0 con 0x7f64c40ccd70 2023-12-08T08:18:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c9797640 1 -- 172.21.15.50:0/3696861238 >> v1:172.21.15.170:6789/0 conn(0x7f64c40ccd70 legacy=0x7f64c40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c9797640 1 -- 172.21.15.50:0/3696861238 >> v1:172.21.15.50:6789/0 conn(0x7f64c406c480 legacy=0x7f64c415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3588239639 0 0) 0x7f64b0003520 con 0x7f64c406c480 2023-12-08T08:18:32.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.285+0000 7f64c9797640 1 -- 172.21.15.50:0/3696861238 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40cf9c0 con 0x7f64c40ce270 2023-12-08T08:18:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.286+0000 7f64c9797640 1 --2- 172.21.15.50:0/3696861238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c406bf40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64b40097d0 tx=0x7f64b402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fed2e02591c5fb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.286+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0019f0 con 0x7f64c40ce270 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.286+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b402e050 con 0x7f64c40ce270 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.286+0000 7f64c8f96640 1 -- 172.21.15.50:0/3696861238 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4030710 con 0x7f64c40ce270 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.287+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3696861238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 msgr2=0x7f64c406bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.287+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3696861238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c406bf40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64b40097d0 tx=0x7f64b402b800 comp rx=0 tx=0).stop 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.287+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3696861238 shutdown_connections 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.287+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3696861238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c406bf40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.287+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3696861238 >> 172.21.15.50:0/3696861238 conn(0x7f64c40d0de0 msgr2=0x7f64c40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.287+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3696861238 shutdown_connections 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.287+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3696861238 wait complete. 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.288+0000 7f64cc1fc640 1 Processor -- start 2023-12-08T08:18:32.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.288+0000 7f64cc1fc640 1 -- start start 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64cc1fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c406c480 0x7f64c4159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64cc1fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64c40ccd70 0x7f64c40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64cc1fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c4160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64cc1fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41f7310 con 0x7f64c40ccd70 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64cc1fc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41f6550 con 0x7f64c406c480 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64cc1fc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41f6830 con 0x7f64c40ce270 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64c40ccd70 0x7f64c40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64c40ccd70 0x7f64c40c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53496/0 (socket says 172.21.15.50:53496) 2023-12-08T08:18:32.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 -- 172.21.15.50:0/3398400277 learned_addr learned my addr 172.21.15.50:0/3398400277 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64ca799640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c4160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9f98640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c406c480 0x7f64c4159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 -- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 msgr2=0x7f64c4160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c4160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 -- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c406c480 msgr2=0x7f64c4159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c406c480 0x7f64c4159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.289+0000 7f64c9797640 1 -- 172.21.15.50:0/3398400277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b4009400 con 0x7f64c40ccd70 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.290+0000 7f64c9797640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64c40ccd70 0x7f64c40c6c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64b4000c00 tx=0x7f64b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.290+0000 7f64ba7fc640 1 -- 172.21.15.50:0/3398400277 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4006e10 con 0x7f64c40ccd70 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.290+0000 7f64ba7fc640 1 -- 172.21.15.50:0/3398400277 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b403c620 con 0x7f64c40ccd70 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.290+0000 7f64ba7fc640 1 -- 172.21.15.50:0/3398400277 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b403c9b0 con 0x7f64c40ccd70 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.290+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c41f6b10 con 0x7f64c40ccd70 2023-12-08T08:18:32.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.290+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c40c76b0 con 0x7f64c40ccd70 2023-12-08T08:18:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.291+0000 7f64ba7fc640 1 -- 172.21.15.50:0/3398400277 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64b4039070 con 0x7f64c40ccd70 2023-12-08T08:18:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.292+0000 7f64ba7fc640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64a806ae40 0x7f64a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.292+0000 7f64ba7fc640 1 -- 172.21.15.50:0/3398400277 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64b40ab0a0 con 0x7f64c40ccd70 2023-12-08T08:18:32.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.292+0000 7f64c9f98640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64a806ae40 0x7f64a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.292+0000 7f64c9f98640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64a806ae40 0x7f64a806d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64c00011e0 tx=0x7f64c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.293+0000 7f64ced8b740 1 Processor -- start 2023-12-08T08:18:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.293+0000 7f64ced8b740 1 -- start start 2023-12-08T08:18:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee1dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee4d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee1e130 0x558edee4df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64ced8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ededde980 con 0x558edee4b030 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eded90b90 con 0x558edee1e130 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x558eded8e280 con 0x558edee4ac50 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee4d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee4d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53500/0 (socket says 172.21.15.50:53500) 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 -- 172.21.15.50:0/1724733897 learned_addr learned my addr 172.21.15.50:0/1724733897 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9f98640 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee1dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64ca799640 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee1e130 0x558edee4df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 -- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 msgr2=0x558edee1dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee1dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 -- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee1e130 msgr2=0x558edee4df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee1e130 0x558edee4df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 -- 172.21.15.50:0/1724733897 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eded4f500 con 0x558edee4b030 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64c9797640 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee4d9e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f64b4075f80 tx=0x7f64b4079a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70ff3aed4526aad server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64a77fe640 1 -- 172.21.15.50:0/1724733897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4077e20 con 0x558edee4b030 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64a77fe640 1 -- 172.21.15.50:0/1724733897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4076190 con 0x558edee4b030 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.294+0000 7f64a77fe640 1 -- 172.21.15.50:0/1724733897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4091320 con 0x558edee4b030 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 -- 172.21.15.50:0/1724733897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 msgr2=0x558edee4d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee4d9e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f64b4075f80 tx=0x7f64b4079a80 comp rx=0 tx=0).stop 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 -- 172.21.15.50:0/1724733897 shutdown_connections 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee4d9e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee1e130 0x558edee4df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 --2- 172.21.15.50:0/1724733897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee1dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 -- 172.21.15.50:0/1724733897 >> 172.21.15.50:0/1724733897 conn(0x558edee1fe60 msgr2=0x558edee689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 -- 172.21.15.50:0/1724733897 shutdown_connections 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.295+0000 7f64ced8b740 1 -- 172.21.15.50:0/1724733897 wait complete. 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.296+0000 7f64ced8b740 1 -- start start 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.296+0000 7f64ced8b740 1 Processor -- start 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee62910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee62e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eded89b70 con 0x558edee4b030 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eded43e00 con 0x558edee602e0 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x558eded43aa0 con 0x558edee4ac50 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 10 client.0 _ll_register_callbacks cb 0x558edea9bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee62910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee62910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53516/0 (socket says 172.21.15.50:53516) 2023-12-08T08:18:32.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 -- 172.21.15.50:0/831778473 learned_addr learned my addr 172.21.15.50:0/831778473 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9f98640 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ca799640 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee62e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 -- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 msgr2=0x558edee496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 -- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 msgr2=0x558edee62e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee62e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 -- 172.21.15.50:0/831778473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c40c76b0 con 0x558edee4b030 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64c9797640 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee62910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64b4075f80 tx=0x7f64b4006c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4cae44e95862c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64a4ff9640 1 -- 172.21.15.50:0/831778473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4076300 con 0x558edee4b030 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64a4ff9640 1 -- 172.21.15.50:0/831778473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64b4078f70 con 0x558edee4b030 2023-12-08T08:18:32.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558eded82b50 con 0x558edee4b030 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64a4ff9640 1 -- 172.21.15.50:0/831778473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b409d070 con 0x558edee4b030 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 10 client.4833 fetch_fsmap learned FSMap version 9 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.297+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x558eded881f0 con 0x558edee4b030 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64a4ff9640 1 -- 172.21.15.50:0/831778473 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eded82b50 con 0x558edee4b030 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64a4ff9640 1 -- 172.21.15.50:0/831778473 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f64b40818f0 con 0x558edee4b030 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64ced8b740 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64ced8b740 10 client.4833 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64ced8b740 20 client.4833 populate_metadata read hostname 'smithi050' 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64ced8b740 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee78c40 0x558edee4fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64ced8b740 4 client.4833 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 --> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558eded82870 con 0x558edee78c40 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64c9f98640 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee78c40 0x558edee4fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64c9f98640 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee78c40 0x558edee4fa20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc938eef04cf734d server_cookie=9b18a42ff1267082 in_seq=0 out_seq=0 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.298+0000 7f64a4ff9640 10 client.4833 ms_handle_connect on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64a4ff9640 1 -- 172.21.15.50:0/831778473 <== mds.0 v2:172.21.15.170:6835/728540036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x558eded82870 con 0x558edee78c40 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64a4ff9640 10 client.4833 handle_command_reply: tid=0 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 client.4833 shutdown 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 msgr2=0x558edee62910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee62910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64b4075f80 tx=0x7f64b4006c30 comp rx=0 tx=0).stop 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 shutdown_connections 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee78c40 0x558edee4fa20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee62910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee62e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64a4ff9640 0 client.4833 ms_handle_reset on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 --2- 172.21.15.50:0/831778473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 >> 172.21.15.50:0/831778473 conn(0x558edee1e130 msgr2=0x558edee6bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 shutdown_connections 2023-12-08T08:18:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 1 -- 172.21.15.50:0/831778473 wait complete. 2023-12-08T08:18:32.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.299+0000 7f64ced8b740 20 client.4833 trim_cache size 0 max 16384 2023-12-08T08:18:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.315+0000 7f64ced8b740 1 Processor -- start 2023-12-08T08:18:32.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.315+0000 7f64ced8b740 1 -- start start 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee6c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee21750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee21c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64ced8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eded09270 con 0x558edee4b030 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558edee6b0a0 con 0x558edee602e0 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x558eded3ee70 con 0x558edee4ac50 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee21750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee21750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53518/0 (socket says 172.21.15.50:53518) 2023-12-08T08:18:32.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 -- 172.21.15.50:0/3285659706 learned_addr learned my addr 172.21.15.50:0/3285659706 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64ca799640 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee21c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9f98640 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee6c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 -- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 msgr2=0x558edee6c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee6c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 -- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 msgr2=0x558edee21c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee21c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 -- 172.21.15.50:0/3285659706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558edee68df0 con 0x558edee4b030 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64c9797640 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee21750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f64b407dd90 tx=0x7f64b408f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d768e8fef3d80c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64a7fff640 1 -- 172.21.15.50:0/3285659706 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b409d070 con 0x558edee4b030 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64a7fff640 1 -- 172.21.15.50:0/3285659706 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4076300 con 0x558edee4b030 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.316+0000 7f64a7fff640 1 -- 172.21.15.50:0/3285659706 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40818f0 con 0x558edee4b030 2023-12-08T08:18:32.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 -- 172.21.15.50:0/3285659706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 msgr2=0x558edee21750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee21750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f64b407dd90 tx=0x7f64b408f070 comp rx=0 tx=0).stop 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 -- 172.21.15.50:0/3285659706 shutdown_connections 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4b030 0x558edee21750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee602e0 0x558edee21c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3285659706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee4ac50 0x558edee6c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 -- 172.21.15.50:0/3285659706 >> 172.21.15.50:0/3285659706 conn(0x558edee1e130 msgr2=0x558edee46d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 -- 172.21.15.50:0/3285659706 shutdown_connections 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 -- 172.21.15.50:0/3285659706 wait complete. 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.317+0000 7f64ced8b740 1 -- start start 2023-12-08T08:18:32.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.318+0000 7f64ced8b740 1 Processor -- start 2023-12-08T08:18:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.318+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4ac50 0x558edee21750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.318+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee4b030 0x558edee21c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee602e0 0x558edee77030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x558edee77ec0 con 0x558edee4ac50 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558edeed39d0 con 0x558edee4b030 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x558edeed3120 con 0x558edee602e0 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 10 client.0 _ll_register_callbacks cb 0x7f64b4075e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4ac50 0x558edee21750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4ac50 0x558edee21750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53534/0 (socket says 172.21.15.50:53534) 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 -- 172.21.15.50:0/3143292453 learned_addr learned my addr 172.21.15.50:0/3143292453 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ca799640 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee602e0 0x558edee77030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9797640 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee4b030 0x558edee21c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 -- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee602e0 msgr2=0x558edee77030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee602e0 0x558edee77030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 -- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee4b030 msgr2=0x558edee21c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee4b030 0x558edee21c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 -- 172.21.15.50:0/3143292453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558eded881f0 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64c9f98640 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4ac50 0x558edee21750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558edee60bd0 tx=0x7f64c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0cb1e7e6b6779e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64a4ff9640 1 -- 172.21.15.50:0/3143292453 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000ecb0 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64a4ff9640 1 -- 172.21.15.50:0/3143292453 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64c0030de0 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64b4076190 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64a4ff9640 1 -- 172.21.15.50:0/3143292453 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64c000ee10 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 10 client.4839 fetch_fsmap learned FSMap version 9 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.319+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x558eded25d00 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64a4ff9640 1 -- 172.21.15.50:0/3143292453 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4076190 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64a4ff9640 1 -- 172.21.15.50:0/3143292453 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f64c00035f0 con 0x558edee4ac50 2023-12-08T08:18:32.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64ced8b740 10 client.4839 fetch_fsmap finished waiting for FSMap version 9 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64ced8b740 10 client.4839 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64ced8b740 20 client.4839 populate_metadata read hostname 'smithi050' 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee775d0 0x558edee22bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64ced8b740 4 client.4839 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 --> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558edea8a6c0 con 0x558edee775d0 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64c9797640 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee775d0 0x558edee22bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64c9797640 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee775d0 0x558edee22bb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80d884020a257e49 server_cookie=ec37537297b57b08 in_seq=0 out_seq=0 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.320+0000 7f64a4ff9640 10 client.4839 ms_handle_connect on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:32.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64a4ff9640 1 -- 172.21.15.50:0/3143292453 <== mds.0 v2:172.21.15.170:6835/728540036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558edea8a6c0 con 0x558edee775d0 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64a4ff9640 10 client.4839 handle_command_reply: tid=0 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 client.4839 shutdown 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4ac50 msgr2=0x558edee21750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4ac50 0x558edee21750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x558edee60bd0 tx=0x7f64c0000ed0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 shutdown_connections 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:6835/728540036,v1:172.21.15.170:6837/728540036] conn(0x558edee775d0 0x558edee22bb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558edee602e0 0x558edee77030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64a4ff9640 0 client.4839 ms_handle_reset on v2:172.21.15.170:6835/728540036 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558edee4b030 0x558edee21c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 --2- 172.21.15.50:0/3143292453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558edee4ac50 0x558edee21750 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 >> 172.21.15.50:0/3143292453 conn(0x558edee1e130 msgr2=0x558edee63bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 shutdown_connections 2023-12-08T08:18:32.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 1 -- 172.21.15.50:0/3143292453 wait complete. 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64ced8b740 20 client.4839 trim_cache size 0 max 16384 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "e65cfade-ffb6-4f9a-b644-0a4f3f758761", 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4285, 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-08T08:18:32.332 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-08T08:18:32.333 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 34.484280904999999, 2023-12-08T08:18:32.333 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 9, 2023-12-08T08:18:32.333 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 24, 2023-12-08T08:18:32.333 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 24, 2023-12-08T08:18:32.333 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 41.770447781000001 2023-12-08T08:18:32.333 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:18:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64a806ae40 msgr2=0x7f64a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64a806ae40 0x7f64a806d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64c00011e0 tx=0x7f64c0009040 comp rx=0 tx=0).stop 2023-12-08T08:18:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64c40ccd70 msgr2=0x7f64c40c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64c40ccd70 0x7f64c40c6c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64b4000c00 tx=0x7f64b40046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 shutdown_connections 2023-12-08T08:18:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64a806ae40 0x7f64a806d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64c40ccd70 0x7f64c40c6c50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64c40ce270 0x7f64c4160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 --2- 172.21.15.50:0/3398400277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64c406c480 0x7f64c4159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.321+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 >> 172.21.15.50:0/3398400277 conn(0x7f64c40d0de0 msgr2=0x7f64c41606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.322+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 shutdown_connections 2023-12-08T08:18:32.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.322+0000 7f64cc1fc640 1 -- 172.21.15.50:0/3398400277 wait complete. 2023-12-08T08:18:32.336 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-08T08:18:32.348 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-08T08:18:32.349 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-08T08:18:32.349 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-08T08:18:32.349 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:18:32.349 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:32.349 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-08T08:18:32.349 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:18:32.349 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-08T08:18:32.349 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-08T08:18:32.349 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:18:32.349 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:32.349 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-08T08:18:32.350 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-08T08:18:32.350 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-08T08:18:32.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:32.350 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-12-08T08:18:32.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:32.368 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2023-12-08T08:18:32.441 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2023-12-08T08:18:32.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:18:32.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:32.443 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:18:32.458 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-08T08:18:32.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:32.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-08T08:18:32.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:32.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-12-08T08:18:32.635 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-08T08:18:32.635 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:18:32.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.739+0000 7f3210636640 1 Processor -- start 2023-12-08T08:18:32.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.739+0000 7f3210636640 1 -- start start 2023-12-08T08:18:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.740+0000 7f3210636640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3208140a10 0x7f32080cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.740+0000 7f3210636640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f32080b2640 0x7f32080ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.740+0000 7f3210636640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3208070db0 con 0x7f3208071e50 2023-12-08T08:18:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.740+0000 7f3210636640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3208070ba0 con 0x7f3208140a10 2023-12-08T08:18:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.740+0000 7f3210636640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3208071090 con 0x7f32080b2640 2023-12-08T08:18:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320e3d2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3208140a10 0x7f32080cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320dbd1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3208071e50 0x7f32080b1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45330/0 (socket says 172.21.15.50:45330) 2023-12-08T08:18:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320dbd1640 1 -- 172.21.15.50:0/4106771721 learned_addr learned my addr 172.21.15.50:0/4106771721 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320ebd3640 1 --2- 172.21.15.50:0/4106771721 >> v2:172.21.15.170:3300/0 conn(0x7f32080b2640 0x7f32080ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320e3d2640 1 -- 172.21.15.50:0/4106771721 >> v2:172.21.15.170:3300/0 conn(0x7f32080b2640 msgr2=0x7f32080ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320e3d2640 1 --2- 172.21.15.50:0/4106771721 >> v2:172.21.15.170:3300/0 conn(0x7f32080b2640 0x7f32080ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320e3d2640 1 -- 172.21.15.50:0/4106771721 >> v1:172.21.15.50:6789/0 conn(0x7f3208071e50 legacy=0x7f32080b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320e3d2640 1 -- 172.21.15.50:0/4106771721 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208071370 con 0x7f3208140a10 2023-12-08T08:18:32.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.741+0000 7f320d3d0640 1 -- 172.21.15.50:0/4106771721 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267240664 0 0) 0x7f3208070db0 con 0x7f3208071e50 2023-12-08T08:18:32.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f320e3d2640 1 --2- 172.21.15.50:0/4106771721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208140a10 0x7f32080cdcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32080cfd80 tx=0x7f320002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffe3b7697eeee1f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f320d3d0640 1 -- 172.21.15.50:0/4106771721 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200030610 con 0x7f3208140a10 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f320d3d0640 1 -- 172.21.15.50:0/4106771721 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200030770 con 0x7f3208140a10 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f320d3d0640 1 -- 172.21.15.50:0/4106771721 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200030b00 con 0x7f3208140a10 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 -- 172.21.15.50:0/4106771721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208140a10 msgr2=0x7f32080cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 --2- 172.21.15.50:0/4106771721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208140a10 0x7f32080cdcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32080cfd80 tx=0x7f320002b960 comp rx=0 tx=0).stop 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 -- 172.21.15.50:0/4106771721 shutdown_connections 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 --2- 172.21.15.50:0/4106771721 >> v2:172.21.15.170:3300/0 conn(0x7f32080b2640 0x7f32080ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 --2- 172.21.15.50:0/4106771721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208140a10 0x7f32080cdcd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 -- 172.21.15.50:0/4106771721 >> 172.21.15.50:0/4106771721 conn(0x7f32080b09f0 msgr2=0x7f32080b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 -- 172.21.15.50:0/4106771721 shutdown_connections 2023-12-08T08:18:32.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.742+0000 7f3210636640 1 -- 172.21.15.50:0/4106771721 wait complete. 2023-12-08T08:18:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 Processor -- start 2023-12-08T08:18:32.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 -- start start 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208071e50 0x7f32081f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32080b2640 0x7f320813d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3208140a10 0x7f320809a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3208099e20 con 0x7f3208071e50 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32081f4a90 con 0x7f32080b2640 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f3210636640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32081f4d70 con 0x7f3208140a10 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.744+0000 7f320e3d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208071e50 0x7f32081f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208071e50 0x7f32081f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53542/0 (socket says 172.21.15.50:53542) 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 -- 172.21.15.50:0/3017718793 learned_addr learned my addr 172.21.15.50:0/3017718793 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320dbd1640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32080b2640 0x7f320813d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 -- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3208140a10 msgr2=0x7f320809a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3208140a10 0x7f320809a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 -- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32080b2640 msgr2=0x7f320813d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32080b2640 0x7f320813d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 -- 172.21.15.50:0/3017718793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200009400 con 0x7f3208071e50 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320dbd1640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32080b2640 0x7f320813d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f320e3d2640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208071e50 0x7f32081f4190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3200000c00 tx=0x7f32000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f3206ffd640 1 -- 172.21.15.50:0/3017718793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320003f070 con 0x7f3208071e50 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f3206ffd640 1 -- 172.21.15.50:0/3017718793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200006e10 con 0x7f3208071e50 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3208099ab0 con 0x7f3208071e50 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f3206ffd640 1 -- 172.21.15.50:0/3017718793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200004250 con 0x7f3208071e50 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.745+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32081f46d0 con 0x7f3208071e50 2023-12-08T08:18:32.751 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.746+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3208159660 con 0x7f3208071e50 2023-12-08T08:18:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.747+0000 7f3206ffd640 1 -- 172.21.15.50:0/3017718793 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3200043070 con 0x7f3208071e50 2023-12-08T08:18:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.747+0000 7f3206ffd640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31f406ae70 0x7f31f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.747+0000 7f3206ffd640 1 -- 172.21.15.50:0/3017718793 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32000ab660 con 0x7f3208071e50 2023-12-08T08:18:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.747+0000 7f320dbd1640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31f406ae70 0x7f31f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:32.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.748+0000 7f320dbd1640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31f406ae70 0x7f31f406d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f32081f40f0 tx=0x7f31fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:32.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.752+0000 7f3206ffd640 1 -- 172.21.15.50:0/3017718793 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3200076540 con 0x7f3208071e50 2023-12-08T08:18:32.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.964+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3208067430 con 0x7f3208071e50 2023-12-08T08:18:32.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.966+0000 7f3206ffd640 1 -- 172.21.15.50:0/3017718793 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3200034070 con 0x7f3208071e50 2023-12-08T08:18:32.970 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:18:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31f406ae70 msgr2=0x7f31f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31f406ae70 0x7f31f406d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f32081f40f0 tx=0x7f31fc009040 comp rx=0 tx=0).stop 2023-12-08T08:18:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208071e50 msgr2=0x7f32081f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:32.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208071e50 0x7f32081f4190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3200000c00 tx=0x7f32000046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 shutdown_connections 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31f406ae70 0x7f31f406d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3208140a10 0x7f320809a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32080b2640 0x7f320813d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 --2- 172.21.15.50:0/3017718793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3208071e50 0x7f32081f4190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 >> 172.21.15.50:0/3017718793 conn(0x7f32080b09f0 msgr2=0x7f32080cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 shutdown_connections 2023-12-08T08:18:32.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:32.969+0000 7f3210636640 1 -- 172.21.15.50:0/3017718793 wait complete. 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:18:32.983 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:18:32.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:32.983 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:18:32.999 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:32.999 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:32.999 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:32.999 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:32.999 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:32.999 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:32.999 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42461sec preferred_lft 42461sec 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:33.000 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:18:33.001 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:18:33.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.001 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:33.001 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:33.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:18:33.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr flush dev ceph-brx 2023-12-08T08:18:33.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set ceph-brx up 2023-12-08T08:18:33.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:18:33.001 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:33.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.121 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:18:33.151 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:18:33.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.153 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:18:33.210 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:18:33.210 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:18:33.210 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:18:33.210 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:18:33.210 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:18:33.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.211 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:33.211 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:33.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:18:33.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:18:33.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:18:33.211 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:33.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.318 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:18:33.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.335 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-12-08T08:18:33.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.389 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:33.389 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:33.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:33.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-08T08:18:33.390 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:33.478 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-08T08:18:33.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.478 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:33.479 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:33.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-08T08:18:33.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:18:33.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-08T08:18:33.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-08T08:18:33.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-08T08:18:33.479 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:33.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.582 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:33.582 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:33.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:18:33.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:18:33.582 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:33.631 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-08T08:18:33.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:33.631 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:33.646 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:18:33.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:33.646 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:33.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:18:33.773 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:33.829 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:18:33.830 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:18:33.831 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:18:33.832 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:33.832 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:33.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:33.832 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:18:33.885 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:18:33.886 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T08:18:33.931 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:18:33.962 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:34.018 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:18:34.018 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:18:34.018 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:18:34.018 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:34.019 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:34.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.021 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:18:34.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-12-08T08:18:34.022+0000 7f0ac4843480 -1 init, newargv = 0x55b60c9c33c0 newargc=15 2023-12-08T08:18:34.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[99141]: starting ceph client 2023-12-08T08:18:34.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[99141]: starting fuse 2023-12-08T08:18:34.040 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:18:34.040 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:18:34.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:18:34.040 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:18:34.040 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:18:34.040 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:18:34.040 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:18:34.040 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:18:34.041 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:18:34.042 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:18:34.042 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:18:34.042 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:34.042 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-12-08T08:18:34.042 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:18:34.166 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.99141.asok 2023-12-08T08:18:34.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:18:34.176 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.99141.asok 2023-12-08T08:18:34.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.99141.asok status 2023-12-08T08:18:34.318 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:18:34.318 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "99141", 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4854, 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:18:34.319 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4854 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3315423263 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3315423263 2023-12-08T08:18:34.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4854 192.168.0.1:0/3315423263", 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/3315423263", 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 9, 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 24, 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:18:34.321 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:18:34.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:18:34.433 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.430+0000 7f36fe6cf640 1 Processor -- start 2023-12-08T08:18:34.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.430+0000 7f36fe6cf640 1 -- start start 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fe6cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f806bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fe6cf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36f806c480 0x7f36f815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fe6cf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f806c8e0 con 0x7f36f80ccd70 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fe6cf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80d0a60 con 0x7f36f806c480 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fe6cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80ce6f0 con 0x7f36f80ce270 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fcc6c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36f806c480 0x7f36f815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36f7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f36f80ccd70 0x7f36f80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45346/0 (socket says 172.21.15.50:45346) 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fcc6c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f36f806c480 0x7f36f815ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53546/0 (socket says 172.21.15.50:53546) 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36f7fff640 1 -- 172.21.15.50:0/2441546253 learned_addr learned my addr 172.21.15.50:0/2441546253 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36f77fe640 1 --2- 172.21.15.50:0/2441546253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f806bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fcc6c640 1 -- 172.21.15.50:0/2441546253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 msgr2=0x7f36f806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fcc6c640 1 --2- 172.21.15.50:0/2441546253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f806bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.435 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36f6ffd640 1 -- 172.21.15.50:0/2441546253 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428220197 0 0) 0x7f36f806c8e0 con 0x7f36f80ccd70 2023-12-08T08:18:34.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fcc6c640 1 -- 172.21.15.50:0/2441546253 >> v1:172.21.15.50:6789/0 conn(0x7f36f80ccd70 legacy=0x7f36f80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36fcc6c640 1 -- 172.21.15.50:0/2441546253 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80cf9c0 con 0x7f36f806c480 2023-12-08T08:18:34.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.431+0000 7f36f77fe640 1 --2- 172.21.15.50:0/2441546253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f806bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.432+0000 7f36fcc6c640 1 --2- 172.21.15.50:0/2441546253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f815ca50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009d90 tx=0x7f36f002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d91adbd582bacb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.432+0000 7f36f6ffd640 1 -- 172.21.15.50:0/2441546253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f002cc50 con 0x7f36f806c480 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.432+0000 7f36f6ffd640 1 -- 172.21.15.50:0/2441546253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f002cdb0 con 0x7f36f806c480 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.432+0000 7f36f6ffd640 1 -- 172.21.15.50:0/2441546253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0034660 con 0x7f36f806c480 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 -- 172.21.15.50:0/2441546253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 msgr2=0x7f36f815ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/2441546253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f815ca50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009d90 tx=0x7f36f002bea0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 -- 172.21.15.50:0/2441546253 shutdown_connections 2023-12-08T08:18:34.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/2441546253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f815ca50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/2441546253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f806bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 -- 172.21.15.50:0/2441546253 >> 172.21.15.50:0/2441546253 conn(0x7f36f80d0de0 msgr2=0x7f36f80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:34.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 -- 172.21.15.50:0/2441546253 shutdown_connections 2023-12-08T08:18:34.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.433+0000 7f36fe6cf640 1 -- 172.21.15.50:0/2441546253 wait complete. 2023-12-08T08:18:34.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.434+0000 7f36fe6cf640 1 Processor -- start 2023-12-08T08:18:34.438 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.434+0000 7f36fe6cf640 1 -- start start 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36fe6cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f81f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36fe6cf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f80ccd70 0x7f36f815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36fe6cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f815e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36fe6cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f815b520 con 0x7f36f806c480 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36fe6cf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f815b800 con 0x7f36f80ccd70 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36fe6cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f815bae0 con 0x7f36f80ce270 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f81f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f81f2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53560/0 (socket says 172.21.15.50:53560) 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 -- 172.21.15.50:0/1853071930 learned_addr learned my addr 172.21.15.50:0/1853071930 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f77fe640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f80ccd70 0x7f36f815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36fcc6c640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 -- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 msgr2=0x7f36f815e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f815e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 -- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f80ccd70 msgr2=0x7f36f815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f80ccd70 0x7f36f815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 -- 172.21.15.50:0/1853071930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0009a70 con 0x7f36f806c480 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f7fff640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f81f2620 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c4d0 tx=0x7f36ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.435+0000 7f36f4ff9640 1 -- 172.21.15.50:0/1853071930 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0074e0 con 0x7f36f806c480 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.436+0000 7f36f4ff9640 1 -- 172.21.15.50:0/1853071930 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec007660 con 0x7f36f806c480 2023-12-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.436+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f815bdc0 con 0x7f36f806c480 2023-12-08T08:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.436+0000 7f36f4ff9640 1 -- 172.21.15.50:0/1853071930 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec004a20 con 0x7f36f806c480 2023-12-08T08:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.436+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f81f2b60 con 0x7f36f806c480 2023-12-08T08:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.436+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f8067430 con 0x7f36f806c480 2023-12-08T08:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.437+0000 7f36f4ff9640 1 -- 172.21.15.50:0/1853071930 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36ec004b80 con 0x7f36f806c480 2023-12-08T08:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.437+0000 7f36f4ff9640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f36e406ae40 0x7f36e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:34.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.437+0000 7f36f4ff9640 1 -- 172.21.15.50:0/1853071930 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f36ec088db0 con 0x7f36f806c480 2023-12-08T08:18:34.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.438+0000 7f36f77fe640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f36e406ae40 0x7f36e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:34.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.438+0000 7f36f77fe640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f36e406ae40 0x7f36e406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36f80cafd0 tx=0x7f36e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:34.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.442+0000 7f36f4ff9640 1 -- 172.21.15.50:0/1853071930 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36ec053c00 con 0x7f36f806c480 2023-12-08T08:18:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.655+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36f8072520 con 0x7f36f806c480 2023-12-08T08:18:34.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.655+0000 7f36f4ff9640 1 -- 172.21.15.50:0/1853071930 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f36ec018020 con 0x7f36f806c480 2023-12-08T08:18:34.659 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f36e406ae40 msgr2=0x7f36e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f36e406ae40 0x7f36e406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36f80cafd0 tx=0x7f36e8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 msgr2=0x7f36f81f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f81f2620 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00c4d0 tx=0x7f36ec00c990 comp rx=0 tx=0).stop 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 shutdown_connections 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f36e406ae40 0x7f36e406d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36f80ce270 0x7f36f815e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36f80ccd70 0x7f36f815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 --2- 172.21.15.50:0/1853071930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f36f806c480 0x7f36f81f2620 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 >> 172.21.15.50:0/1853071930 conn(0x7f36f80d0de0 msgr2=0x7f36f8160640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 shutdown_connections 2023-12-08T08:18:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:34.657+0000 7f36fe6cf640 1 -- 172.21.15.50:0/1853071930 wait complete. 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:18:34.671 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-08T08:18:34.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.672 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:18:34.687 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:34.687 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:34.687 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:34.687 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42459sec preferred_lft 42459sec 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:18:34.688 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c008:83ff:fe50:e6c0/64 scope link 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::403f:3fff:fee6:f2fc/64 scope link tentative 2023-12-08T08:18:34.689 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:34.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.690 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:18:34.756 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:18:34.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.758 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:18:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:18:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:18:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:18:34.814 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:18:34.815 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:18:34.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.815 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:34.815 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:34.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:18:34.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:18:34.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:18:34.815 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:34.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.920 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:18:34.935 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:18:34.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.935 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list-id 2023-12-08T08:18:34.990 INFO:teuthology.orchestra.run.smithi050.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-08T08:18:34.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:34.991 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:34.991 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:34.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:18:34.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-08T08:18:34.991 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:35.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:35.081 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f2:40:7e:59:cf:ea brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f040:7eff:fe59:cfea/64 scope link tentative 2023-12-08T08:18:35.111 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:35.113 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-08T08:18:35.183 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether f2:40:7e:59:cf:ea brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::f040:7eff:fe59:cfea/64 scope link tentative 2023-12-08T08:18:35.184 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:35.185 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-08T08:18:35.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-08T08:18:35.186 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:35.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:35.328 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:18:35.328 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:18:35.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.1 up 2023-12-08T08:18:35.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set dev brx.1 master ceph-brx 2023-12-08T08:18:35.328 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:18:35.376 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-08T08:18:35.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:35.377 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-08T08:18:35.404 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-08T08:18:35.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:35.404 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-08T08:18:35.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:18:35.532 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:35.589 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:18:35.590 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:18:35.591 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:18:35.592 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:18:35.592 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:35.592 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:35.592 INFO:teuthology.orchestra.run.smithi050.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:35.592 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:18:35.592 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:18:35.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:35.592 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:18:35.645 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:18:35.646 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-12-08T08:18:35.646 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-08T08:18:35.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:18:35.719 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:18:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:18:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:18:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:18:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:18:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:18:35.776 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:18:35.777 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:18:35.778 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:18:35.779 INFO:teuthology.orchestra.run.smithi050.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:18:35.780 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:18:35.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:35.781 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:18:35.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi050.stderr:2023-12-08T08:18:35.778+0000 7fe557341480 -1 init, newargv = 0x5632b5f984a0 newargc=15 2023-12-08T08:18:35.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi050.stderr:ceph-fuse[99634]: starting ceph client 2023-12-08T08:18:35.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi050.stderr:ceph-fuse[99634]: starting fuse 2023-12-08T08:18:35.797 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:18:35.798 INFO:teuthology.orchestra.run.smithi050.stdout:44 2023-12-08T08:18:35.798 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-12-08T08:18:35.798 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:18:35.798 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:18:35.798 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:18:35.798 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:18:35.799 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:18:35.800 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:18:35.800 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:18:35.800 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:18:35.800 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:18:35.800 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:18:35.800 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.2")) 2023-12-08T08:18:35.800 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:18:35.924 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.2.99634.asok 2023-12-08T08:18:35.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:18:35.934 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.99634.asok 2023-12-08T08:18:35.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:35.934 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.99634.asok status 2023-12-08T08:18:36.076 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:18:36.076 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:18:36.076 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:18:36.076 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:18:36.076 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "2", 2023-12-08T08:18:36.076 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "99634", 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4872, 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 4872 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:18:36.077 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.2:0", 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1990581046 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.2:0", 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1990581046 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.4872 192.168.0.2:0/1990581046", 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.2:0/1990581046", 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 9, 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 24, 2023-12-08T08:18:36.078 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:18:36.079 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:18:36.079 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:18:36.079 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:18:36.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:18:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.191+0000 7faf86217640 1 Processor -- start 2023-12-08T08:18:36.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.191+0000 7faf86217640 1 -- start start 2023-12-08T08:18:36.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf86217640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800ccd70 0x7faf800ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf86217640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8006c650 0x7faf8015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf86217640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf800cf9c0 con 0x7faf800cf1e0 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf86217640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf800d0a60 con 0x7faf8006c650 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf86217640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf800ce7b0 con 0x7faf800ccd70 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8006c650 0x7faf8015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7faf8006c650 0x7faf8015ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53562/0 (socket says 172.21.15.50:53562) 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 -- 172.21.15.50:0/3529422915 learned_addr learned my addr 172.21.15.50:0/3529422915 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7f7fe640 1 --2- 172.21.15.50:0/3529422915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800ccd70 0x7faf800ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 -- 172.21.15.50:0/3529422915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800ccd70 msgr2=0x7faf800ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:36.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 --2- 172.21.15.50:0/3529422915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800ccd70 0x7faf800ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 -- 172.21.15.50:0/3529422915 >> v1:172.21.15.170:6789/0 conn(0x7faf800cf1e0 legacy=0x7faf8006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 -- 172.21.15.50:0/3529422915 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800cfca0 con 0x7faf8006c650 2023-12-08T08:18:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7f7fe640 1 --2- 172.21.15.50:0/3529422915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800ccd70 0x7faf800ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7ffff640 1 --2- 172.21.15.50:0/3529422915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf8015ca50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf78009e50 tx=0x7faf7802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44179a07c2cff92 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7e7fc640 1 -- 172.21.15.50:0/3529422915 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7802cb00 con 0x7faf8006c650 2023-12-08T08:18:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7e7fc640 1 -- 172.21.15.50:0/3529422915 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7802cc60 con 0x7faf8006c650 2023-12-08T08:18:36.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.193+0000 7faf7e7fc640 1 -- 172.21.15.50:0/3529422915 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780343f0 con 0x7faf8006c650 2023-12-08T08:18:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 -- 172.21.15.50:0/3529422915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 msgr2=0x7faf8015ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 --2- 172.21.15.50:0/3529422915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf8015ca50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf78009e50 tx=0x7faf7802bf60 comp rx=0 tx=0).stop 2023-12-08T08:18:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 -- 172.21.15.50:0/3529422915 shutdown_connections 2023-12-08T08:18:36.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 --2- 172.21.15.50:0/3529422915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf8015ca50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 --2- 172.21.15.50:0/3529422915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800ccd70 0x7faf800ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 -- 172.21.15.50:0/3529422915 >> 172.21.15.50:0/3529422915 conn(0x7faf800d0de0 msgr2=0x7faf800d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 -- 172.21.15.50:0/3529422915 shutdown_connections 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 -- 172.21.15.50:0/3529422915 wait complete. 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 Processor -- start 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.195+0000 7faf86217640 1 -- start start 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf86217640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf80156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf86217640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf800ccd70 0x7faf800aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf86217640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800cf1e0 0x7faf800af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf86217640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf800afe40 con 0x7faf8006c650 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf86217640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf80159070 con 0x7faf800ccd70 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf86217640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf80159350 con 0x7faf800cf1e0 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf80156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf80156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53570/0 (socket says 172.21.15.50:53570) 2023-12-08T08:18:36.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 -- 172.21.15.50:0/1795646940 learned_addr learned my addr 172.21.15.50:0/1795646940 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7ffff640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800cf1e0 0x7faf800af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7effd640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf800ccd70 0x7faf800aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 -- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800cf1e0 msgr2=0x7faf800af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800cf1e0 0x7faf800af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 -- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf800ccd70 msgr2=0x7faf800aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf800ccd70 0x7faf800aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7f7fe640 1 -- 172.21.15.50:0/1795646940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009b30 con 0x7faf8006c650 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.196+0000 7faf7effd640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf800ccd70 0x7faf800aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.198+0000 7faf7f7fe640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf80156ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf7000e7e0 tx=0x7faf7000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.198+0000 7faf67fff640 1 -- 172.21.15.50:0/1795646940 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70004030 con 0x7faf8006c650 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.198+0000 7faf67fff640 1 -- 172.21.15.50:0/1795646940 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf70004190 con 0x7faf8006c650 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.198+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf800c7f50 con 0x7faf8006c650 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.198+0000 7faf67fff640 1 -- 172.21.15.50:0/1795646940 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70004520 con 0x7faf8006c650 2023-12-08T08:18:36.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.198+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf800c8510 con 0x7faf8006c650 2023-12-08T08:18:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.199+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf80067430 con 0x7faf8006c650 2023-12-08T08:18:36.203 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.199+0000 7faf67fff640 1 -- 172.21.15.50:0/1795646940 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf7000c6d0 con 0x7faf8006c650 2023-12-08T08:18:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.200+0000 7faf67fff640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf6c06ae40 0x7faf6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.200+0000 7faf67fff640 1 -- 172.21.15.50:0/1795646940 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf70089630 con 0x7faf8006c650 2023-12-08T08:18:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.200+0000 7faf7effd640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf6c06ae40 0x7faf6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:36.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.200+0000 7faf7effd640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf6c06ae40 0x7faf6c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faf801f61f0 tx=0x7faf74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:36.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.204+0000 7faf67fff640 1 -- 172.21.15.50:0/1795646940 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf700543f0 con 0x7faf8006c650 2023-12-08T08:18:36.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.417+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf80072520 con 0x7faf8006c650 2023-12-08T08:18:36.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.417+0000 7faf67fff640 1 -- 172.21.15.50:0/1795646940 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7faf70057a10 con 0x7faf8006c650 2023-12-08T08:18:36.420 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:18:36.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.419+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf6c06ae40 msgr2=0x7faf6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.419+0000 7faf86217640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf6c06ae40 0x7faf6c06d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faf801f61f0 tx=0x7faf74009040 comp rx=0 tx=0).stop 2023-12-08T08:18:36.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.419+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 msgr2=0x7faf80156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:36.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.419+0000 7faf86217640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf80156ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf7000e7e0 tx=0x7faf7000eca0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 shutdown_connections 2023-12-08T08:18:36.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf6c06ae40 0x7faf6c06d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf800cf1e0 0x7faf800af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf800ccd70 0x7faf800aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 --2- 172.21.15.50:0/1795646940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf8006c650 0x7faf80156ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:36.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 >> 172.21.15.50:0/1795646940 conn(0x7faf800d0de0 msgr2=0x7faf800b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:36.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 shutdown_connections 2023-12-08T08:18:36.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:36.420+0000 7faf86217640 1 -- 172.21.15.50:0/1795646940 wait complete. 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:18:36.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:18:36.434 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:18:36.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:36.434 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2023-12-08T08:18:36.452 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:36.452 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:18:36.453 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:36.454 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:18:36.454 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42460sec preferred_lft 42460sec 2023-12-08T08:18:36.454 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2023-12-08T08:18:36.454 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:36.454 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-08T08:18:36.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:36.454 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:36.454 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:36.454 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add name ceph-brx type bridge 2023-12-08T08:18:36.455 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr flush dev ceph-brx 2023-12-08T08:18:36.455 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set ceph-brx up 2023-12-08T08:18:36.455 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-08T08:18:36.455 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:36.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:36.664 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:18:36.693 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-12-08T08:18:36.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:36.695 DEBUG:teuthology.orchestra.run.smithi170:> route 2023-12-08T08:18:36.765 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2023-12-08T08:18:36.765 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:18:36.765 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:18:36.765 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:18:36.765 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:18:36.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:36.765 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:36.766 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:36.766 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:18:36.766 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:18:36.766 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:18:36.766 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:37.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.029 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-12-08T08:18:37.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.044 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2023-12-08T08:18:37.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.099 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:37.099 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:37.099 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:37.099 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-08T08:18:37.099 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:37.182 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-08T08:18:37.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.182 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:37.182 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:37.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-08T08:18:37.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-08T08:18:37.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-08T08:18:37.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-08T08:18:37.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-08T08:18:37.183 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:37.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.315 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:37.316 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:37.316 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2023-12-08T08:18:37.316 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.0 master ceph-brx 2023-12-08T08:18:37.316 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:37.357 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-08T08:18:37.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:37.357 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:37.412 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-08T08:18:37.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:37.412 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:37.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-12-08T08:18:37.535 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:37.590 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/selinux 2023-12-08T08:18:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2023-12-08T08:18:37.592 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2023-12-08T08:18:37.593 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2023-12-08T08:18:37.593 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2023-12-08T08:18:37.593 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:37.593 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:37.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.593 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-12-08T08:18:37.645 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:18:37.646 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-08T08:18:37.688 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-12-08T08:18:37.716 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2023-12-08T08:18:37.772 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/selinux 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:37.773 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:37.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.774 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-12-08T08:18:37.776 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:2023-12-08T08:18:37.774+0000 7fac728c9480 -1 init, newargv = 0x56483db6e250 newargc=15 2023-12-08T08:18:37.776 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[94989]: starting ceph client 2023-12-08T08:18:37.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi170.stderr:ceph-fuse[94989]: starting fuse 2023-12-08T08:18:37.790 INFO:teuthology.orchestra.run.smithi170.stdout:42 2023-12-08T08:18:37.791 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> import re 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> import os 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2023-12-08T08:18:37.791 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> return f 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:18:37.792 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:37.793 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.1")) 2023-12-08T08:18:37.793 DEBUG:teuthology.orchestra.run.smithi170:> ' 2023-12-08T08:18:37.912 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.1.94989.asok 2023-12-08T08:18:37.915 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:18:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:18:37.922 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.94989.asok 2023-12-08T08:18:37.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:37.923 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.94989.asok status 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "1", 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "94989", 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:38.064 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4834, 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 4834 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3538905312 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: } 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-12-08T08:18:38.065 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3538905312 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.4834 192.168.0.1:0/3538905312", 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.1:0/3538905312", 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 9, 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 25, 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2023-12-08T08:18:38.066 INFO:teuthology.orchestra.run.smithi170.stdout:} 2023-12-08T08:18:38.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:18:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.191+0000 7f2b0eb68640 1 Processor -- start 2023-12-08T08:18:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.191+0000 7f2b0eb68640 1 -- start start 2023-12-08T08:18:38.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0eb68640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b0815d580 0x7f2b080d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0eb68640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815f890 0x7f2b0815d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0eb68640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0815ee90 con 0x7f2b080d3ad0 2023-12-08T08:18:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0eb68640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b080d0fe0 con 0x7f2b0815d580 2023-12-08T08:18:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0eb68640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080d1280 con 0x7f2b0815f890 2023-12-08T08:18:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0c904640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2b0815d580 0x7f2b080d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b07fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2b080d3ad0 0x7f2b0815f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45358/0 (socket says 172.21.15.50:45358) 2023-12-08T08:18:38.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b07fff640 1 -- 172.21.15.50:0/327552524 learned_addr learned my addr 172.21.15.50:0/327552524 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0c904640 1 --2- 172.21.15.50:0/327552524 >> v2:172.21.15.50:3300/0 conn(0x7f2b0815d580 0x7f2b080d1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53582/0 (socket says 172.21.15.50:53582) 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0d105640 1 --2- 172.21.15.50:0/327552524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815f890 0x7f2b0815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0c904640 1 -- 172.21.15.50:0/327552524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815f890 msgr2=0x7f2b0815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0c904640 1 --2- 172.21.15.50:0/327552524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815f890 0x7f2b0815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0c904640 1 -- 172.21.15.50:0/327552524 >> v1:172.21.15.50:6789/0 conn(0x7f2b080d3ad0 legacy=0x7f2b0815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b077fe640 1 -- 172.21.15.50:0/327552524 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209679865 0 0) 0x7f2b0815ee90 con 0x7f2b080d3ad0 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.192+0000 7f2b0c904640 1 -- 172.21.15.50:0/327552524 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080d1560 con 0x7f2b0815d580 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.193+0000 7f2b0c904640 1 --2- 172.21.15.50:0/327552524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0815d580 0x7f2b080d1d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0097d0 tx=0x7f2afc02b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a776f33846f4540 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.193+0000 7f2b077fe640 1 -- 172.21.15.50:0/327552524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc031770 con 0x7f2b0815d580 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.193+0000 7f2b077fe640 1 -- 172.21.15.50:0/327552524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc0318d0 con 0x7f2b0815d580 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.193+0000 7f2b077fe640 1 -- 172.21.15.50:0/327552524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc031c60 con 0x7f2b0815d580 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 -- 172.21.15.50:0/327552524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0815d580 msgr2=0x7f2b080d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/327552524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0815d580 0x7f2b080d1d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0097d0 tx=0x7f2afc02b810 comp rx=0 tx=0).stop 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 -- 172.21.15.50:0/327552524 shutdown_connections 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/327552524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815f890 0x7f2b0815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/327552524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b0815d580 0x7f2b080d1d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 -- 172.21.15.50:0/327552524 >> 172.21.15.50:0/327552524 conn(0x7f2b080d2fb0 msgr2=0x7f2b080d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:38.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 -- 172.21.15.50:0/327552524 shutdown_connections 2023-12-08T08:18:38.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.194+0000 7f2b0eb68640 1 -- 172.21.15.50:0/327552524 wait complete. 2023-12-08T08:18:38.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.195+0000 7f2b0eb68640 1 Processor -- start 2023-12-08T08:18:38.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.195+0000 7f2b0eb68640 1 -- start start 2023-12-08T08:18:38.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0eb68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b080d3ad0 0x7f2b0814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0eb68640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815d580 0x7f2b080cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0eb68640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0815f890 0x7f2b0815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0eb68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080cfbf0 con 0x7f2b080d3ad0 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0eb68640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080cdcf0 con 0x7f2b0815f890 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0eb68640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080cdf90 con 0x7f2b0815d580 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0c904640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b080d3ad0 0x7f2b0814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0c904640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b080d3ad0 0x7f2b0814ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53592/0 (socket says 172.21.15.50:53592) 2023-12-08T08:18:38.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0c904640 1 -- 172.21.15.50:0/3601783269 learned_addr learned my addr 172.21.15.50:0/3601783269 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b07fff640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815d580 0x7f2b080cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.196+0000 7f2b0d105640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0815f890 0x7f2b0815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0c904640 1 -- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815d580 msgr2=0x7f2b080cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0c904640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815d580 0x7f2b080cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0c904640 1 -- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0815f890 msgr2=0x7f2b0815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0c904640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0815f890 0x7f2b0815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0c904640 1 -- 172.21.15.50:0/3601783269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009400 con 0x7f2b080d3ad0 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0c904640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b080d3ad0 0x7f2b0814ffd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2afc034040 tx=0x7f2afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b057fa640 1 -- 172.21.15.50:0/3601783269 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc032810 con 0x7f2b080d3ad0 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b057fa640 1 -- 172.21.15.50:0/3601783269 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc032970 con 0x7f2b080d3ad0 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b080ce270 con 0x7f2b080d3ad0 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b057fa640 1 -- 172.21.15.50:0/3601783269 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc032d20 con 0x7f2b080d3ad0 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.197+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b08150510 con 0x7f2b080d3ad0 2023-12-08T08:18:38.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.198+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b080ce790 con 0x7f2b080d3ad0 2023-12-08T08:18:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.199+0000 7f2b057fa640 1 -- 172.21.15.50:0/3601783269 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2afc04e440 con 0x7f2b080d3ad0 2023-12-08T08:18:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.199+0000 7f2b057fa640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2aec06ae40 0x7f2aec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.199+0000 7f2b057fa640 1 -- 172.21.15.50:0/3601783269 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2afc0ab790 con 0x7f2b080d3ad0 2023-12-08T08:18:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.199+0000 7f2b07fff640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2aec06ae40 0x7f2aec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.200+0000 7f2b07fff640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2aec06ae40 0x7f2aec06d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007fd0 tx=0x7f2af4007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:38.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.204+0000 7f2b057fa640 1 -- 172.21.15.50:0/3601783269 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b080ce790 con 0x7f2b080d3ad0 2023-12-08T08:18:38.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.415+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b080ce790 con 0x7f2b080d3ad0 2023-12-08T08:18:38.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.416+0000 7f2b057fa640 1 -- 172.21.15.50:0/3601783269 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2b080ce790 con 0x7f2b080d3ad0 2023-12-08T08:18:38.418 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-08T08:18:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2aec06ae40 msgr2=0x7f2aec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2aec06ae40 0x7f2aec06d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2af4007fd0 tx=0x7f2af4007de0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b080d3ad0 msgr2=0x7f2b0814ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:38.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b080d3ad0 0x7f2b0814ffd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2afc034040 tx=0x7f2afc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 shutdown_connections 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2aec06ae40 0x7f2aec06d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b0815f890 0x7f2b0815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2b0815d580 0x7f2b080cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 --2- 172.21.15.50:0/3601783269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2b080d3ad0 0x7f2b0814ffd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 >> 172.21.15.50:0/3601783269 conn(0x7f2b080d2fb0 msgr2=0x7f2b0815f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 shutdown_connections 2023-12-08T08:18:38.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:38.418+0000 7f2b0eb68640 1 -- 172.21.15.50:0/3601783269 wait complete. 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:18:38.431 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-08T08:18:38.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.432 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2023-12-08T08:18:38.448 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42458sec preferred_lft 42458sec 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 16:3e:ba:43:28:59 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.449 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::b019:1fff:fe7c:35a9/64 scope link 2023-12-08T08:18:38.450 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.450 INFO:teuthology.orchestra.run.smithi170.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:18:38.450 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 16:3e:ba:43:28:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:38.450 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::143e:baff:fe43:2859/64 scope link tentative 2023-12-08T08:18:38.450 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.450 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:18:38.514 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-12-08T08:18:38.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.516 DEBUG:teuthology.orchestra.run.smithi170:> route 2023-12-08T08:18:38.572 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2023-12-08T08:18:38.572 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:18:38.572 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-08T08:18:38.573 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-08T08:18:38.573 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:18:38.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.573 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:38.573 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:38.573 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-08T08:18:38.573 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-08T08:18:38.573 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-08T08:18:38.573 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:38.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.669 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-12-08T08:18:38.684 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:18:38.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.684 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2023-12-08T08:18:38.739 INFO:teuthology.orchestra.run.smithi170.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-08T08:18:38.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.740 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:38.740 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:38.740 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-08T08:18:38.740 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-08T08:18:38.740 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:38.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.821 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-08T08:18:38.888 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether ce:ab:8f:22:a3:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ccab:8fff:fe22:a3df/64 scope link 2023-12-08T08:18:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.891 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-08T08:18:38.958 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:18:38.958 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:18:38.958 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:18:38.958 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.958 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2023-12-08T08:18:38.958 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.958 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:18:38.959 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether ce:ab:8f:22:a3:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-08T08:18:38.959 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-08T08:18:38.959 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.959 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ccab:8fff:fe22:a3df/64 scope link 2023-12-08T08:18:38.959 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:18:38.961 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-08T08:18:38.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-08T08:18:38.961 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:39.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.087 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2023-12-08T08:18:39.087 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2023-12-08T08:18:39.087 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.1 up 2023-12-08T08:18:39.087 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.1 master ceph-brx 2023-12-08T08:18:39.087 DEBUG:teuthology.orchestra.run.smithi170:> ') 2023-12-08T08:18:39.129 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-08T08:18:39.129 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:39.129 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-08T08:18:39.185 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-08T08:18:39.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:18:39.185 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-08T08:18:39.240 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-12-08T08:18:39.307 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2023-12-08T08:18:39.363 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/selinux 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2023-12-08T08:18:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-08T08:18:39.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.365 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-12-08T08:18:39.418 INFO:teuthology.orchestra.run.smithi170.stdout:42 2023-12-08T08:18:39.418 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-12-08T08:18:39.418 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-08T08:18:39.460 DEBUG:teuthology.orchestra.run.smithi170:> sudo modprobe fuse 2023-12-08T08:18:39.487 DEBUG:teuthology.orchestra.run.smithi170:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/proc 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/sys 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/dev 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/security 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/shm 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/pts 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/run 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/cgroup 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/pstore 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/bpf 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/ 2023-12-08T08:18:39.543 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/selinux 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/mqueue 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/debug 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/dev/hugepages 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/tracing 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/fs/fuse/connections 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:18:39.544 INFO:teuthology.orchestra.run.smithi170.stdout:/sys/kernel/config 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/run/user/1000 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-4 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-5 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-6 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/var/lib/ceph/osd/ceph-7 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns 2023-12-08T08:18:39.545 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:39.546 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:18:39.546 INFO:teuthology.orchestra.run.smithi170.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:39.546 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-08T08:18:39.546 INFO:teuthology.orchestra.run.smithi170.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-08T08:18:39.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.546 DEBUG:teuthology.orchestra.run.smithi170:> ls /sys/fs/fuse/connections 2023-12-08T08:18:39.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:2023-12-08T08:18:39.542+0000 7f8e5fa3a480 -1 init, newargv = 0x556d703134c0 newargc=15 2023-12-08T08:18:39.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:ceph-fuse[95441]: starting ceph client 2023-12-08T08:18:39.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi170.stderr:ceph-fuse[95441]: starting fuse 2023-12-08T08:18:39.561 INFO:teuthology.orchestra.run.smithi170.stdout:42 2023-12-08T08:18:39.561 INFO:teuthology.orchestra.run.smithi170.stdout:44 2023-12-08T08:18:39.561 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-12-08T08:18:39.561 DEBUG:teuthology.orchestra.run.smithi170:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:18:39.561 DEBUG:teuthology.orchestra.run.smithi170:> import glob 2023-12-08T08:18:39.561 DEBUG:teuthology.orchestra.run.smithi170:> import re 2023-12-08T08:18:39.561 DEBUG:teuthology.orchestra.run.smithi170:> import os 2023-12-08T08:18:39.561 DEBUG:teuthology.orchestra.run.smithi170:> import subprocess 2023-12-08T08:18:39.561 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> def _find_admin_socket(client_name): 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> files = glob.glob(asok_path) 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> # Given a non-glob path, it better be there 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> if "*" not in asok_path: 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> assert(len(files) == 1) 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> return files[0] 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> for f in files: 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:18:39.562 DEBUG:teuthology.orchestra.run.smithi170:> contents = proc_f.read() 2023-12-08T08:18:39.563 DEBUG:teuthology.orchestra.run.smithi170:> if mountpoint in contents: 2023-12-08T08:18:39.563 DEBUG:teuthology.orchestra.run.smithi170:> return f 2023-12-08T08:18:39.563 DEBUG:teuthology.orchestra.run.smithi170:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:18:39.563 DEBUG:teuthology.orchestra.run.smithi170:> 2023-12-08T08:18:39.563 DEBUG:teuthology.orchestra.run.smithi170:> print(_find_admin_socket("client.3")) 2023-12-08T08:18:39.563 DEBUG:teuthology.orchestra.run.smithi170:> ' 2023-12-08T08:18:39.680 INFO:teuthology.orchestra.run.smithi170.stdout:/var/run/ceph/ceph-client.3.95441.asok 2023-12-08T08:18:39.684 INFO:teuthology.orchestra.run.smithi170.stderr:2023-12-08T08:18:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:18:39.691 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.95441.asok 2023-12-08T08:18:39.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.692 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.95441.asok status 2023-12-08T08:18:39.828 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2023-12-08T08:18:39.828 INFO:teuthology.orchestra.run.smithi170.stdout: "metadata": { 2023-12-08T08:18:39.828 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:18:39.828 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:18:39.828 INFO:teuthology.orchestra.run.smithi170.stdout: "entity_id": "3", 2023-12-08T08:18:39.828 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": "smithi170", 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "pid": "95441", 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "root": "/" 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_count": 0, 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "dentry_pinned_count": 0, 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4846, 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "inst": { 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "name": { 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "client", 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "num": 4846 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-12-08T08:18:39.829 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.2:0", 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3748516276 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: } 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": { 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "192.168.0.2:0", 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3748516276 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "inst_str": "client.4846 192.168.0.2:0/3748516276", 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "addr_str": "192.168.0.2:0/3748516276", 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "inode_count": 1, 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_epoch": 9, 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch": 26, 2023-12-08T08:18:39.830 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:18:39.831 INFO:teuthology.orchestra.run.smithi170.stdout: "blocklisted": false, 2023-12-08T08:18:39.831 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs" 2023-12-08T08:18:39.831 INFO:teuthology.orchestra.run.smithi170.stdout:} 2023-12-08T08:18:39.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.836 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:18:39.836 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:39.855 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:18:39.857 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:39.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.858 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:39.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.931 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:18:39.931 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-08T08:18:39.990 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:18:39.990 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-08T08:18:39.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:39.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-08T08:18:40.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:40.067 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2023-12-08T08:18:40.067 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:40.082 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2023-12-08T08:18:40.082 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:40.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:40.083 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:40.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:40.150 DEBUG:teuthology.orchestra.run.smithi170:> stat --file-system '--printf=%T 2023-12-08T08:18:40.150 DEBUG:teuthology.orchestra.run.smithi170:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-08T08:18:40.205 INFO:teuthology.orchestra.run.smithi170.stdout:fuseblk 2023-12-08T08:18:40.206 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-08T08:18:40.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:40.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-08T08:18:40.273 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-08T08:18:40.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.409+0000 7ffb8709b640 1 Processor -- start 2023-12-08T08:18:40.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.409+0000 7ffb8709b640 1 -- start start 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb8709b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffb800ccd70 0x7ffb800ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb8709b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb800cf1e0 0x7ffb8006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb8709b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb8006c480 0x7ffb8015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb8709b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800d0a60 con 0x7ffb800cf1e0 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb8709b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800ce7b0 con 0x7ffb800ccd70 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb8709b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8006c910 con 0x7ffb8006c480 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb800cf1e0 0x7ffb8006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffb800cf1e0 0x7ffb8006bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41266/0 (socket says 172.21.15.50:41266) 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 -- 172.21.15.50:0/488004329 learned_addr learned my addr 172.21.15.50:0/488004329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:40.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb84e37640 1 --2- 172.21.15.50:0/488004329 >> v2:172.21.15.170:3300/0 conn(0x7ffb800ccd70 0x7ffb800ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb85638640 1 --2- 172.21.15.50:0/488004329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb8006c480 0x7ffb8015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 -- 172.21.15.50:0/488004329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb8006c480 msgr2=0x7ffb8015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 --2- 172.21.15.50:0/488004329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb8006c480 0x7ffb8015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 -- 172.21.15.50:0/488004329 >> v2:172.21.15.170:3300/0 conn(0x7ffb800ccd70 msgr2=0x7ffb800ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 --2- 172.21.15.50:0/488004329 >> v2:172.21.15.170:3300/0 conn(0x7ffb800ccd70 0x7ffb800ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.410+0000 7ffb7ffff640 1 -- 172.21.15.50:0/488004329 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800cf9c0 con 0x7ffb800cf1e0 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.411+0000 7ffb7ffff640 1 --2- 172.21.15.50:0/488004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800cf1e0 0x7ffb8006bf40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb80071080 tx=0x7ffb7402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a0bc256abe3e43 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.411+0000 7ffb7f7fe640 1 -- 172.21.15.50:0/488004329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74031640 con 0x7ffb800cf1e0 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.411+0000 7ffb7f7fe640 1 -- 172.21.15.50:0/488004329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740317a0 con 0x7ffb800cf1e0 2023-12-08T08:18:40.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.411+0000 7ffb7f7fe640 1 -- 172.21.15.50:0/488004329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74031b30 con 0x7ffb800cf1e0 2023-12-08T08:18:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 -- 172.21.15.50:0/488004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800cf1e0 msgr2=0x7ffb8006bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 --2- 172.21.15.50:0/488004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800cf1e0 0x7ffb8006bf40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb80071080 tx=0x7ffb7402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 -- 172.21.15.50:0/488004329 shutdown_connections 2023-12-08T08:18:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 --2- 172.21.15.50:0/488004329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb8006c480 0x7ffb8015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 --2- 172.21.15.50:0/488004329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb800cf1e0 0x7ffb8006bf40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 --2- 172.21.15.50:0/488004329 >> v2:172.21.15.170:3300/0 conn(0x7ffb800ccd70 0x7ffb800ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 -- 172.21.15.50:0/488004329 >> 172.21.15.50:0/488004329 conn(0x7ffb800d0de0 msgr2=0x7ffb800d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 -- 172.21.15.50:0/488004329 shutdown_connections 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.412+0000 7ffb8709b640 1 -- 172.21.15.50:0/488004329 wait complete. 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.413+0000 7ffb8709b640 1 Processor -- start 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.413+0000 7ffb8709b640 1 -- start start 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb8709b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb8006c480 0x7ffb800c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb8709b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb800ccd70 0x7ffb801e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb8709b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb800cf1e0 0x7ffb801560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb8709b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80156c90 con 0x7ffb8006c480 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb8709b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb801e9050 con 0x7ffb800ccd70 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb8709b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c6c40 con 0x7ffb800cf1e0 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb84e37640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb8006c480 0x7ffb800c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb84e37640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb8006c480 0x7ffb800c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41282/0 (socket says 172.21.15.50:41282) 2023-12-08T08:18:40.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb84e37640 1 -- 172.21.15.50:0/3594333804 learned_addr learned my addr 172.21.15.50:0/3594333804 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb7ffff640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb800ccd70 0x7ffb801e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.414+0000 7ffb85638640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb800cf1e0 0x7ffb801560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb84e37640 1 -- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb800cf1e0 msgr2=0x7ffb801560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb84e37640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb800cf1e0 0x7ffb801560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb84e37640 1 -- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb800ccd70 msgr2=0x7ffb801e8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb84e37640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb800ccd70 0x7ffb801e8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb84e37640 1 -- 172.21.15.50:0/3594333804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740094d0 con 0x7ffb8006c480 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb84e37640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb8006c480 0x7ffb800c6660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000d800 tx=0x7ffb7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb7d7fa640 1 -- 172.21.15.50:0/3594333804 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000b6c0 con 0x7ffb8006c480 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb7d7fa640 1 -- 172.21.15.50:0/3594333804 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000b820 con 0x7ffb8006c480 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb801e6eb0 con 0x7ffb8006c480 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb7d7fa640 1 -- 172.21.15.50:0/3594333804 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000bbb0 con 0x7ffb8006c480 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.415+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb801e7470 con 0x7ffb8006c480 2023-12-08T08:18:40.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.416+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80067430 con 0x7ffb8006c480 2023-12-08T08:18:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.417+0000 7ffb7d7fa640 1 -- 172.21.15.50:0/3594333804 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb7000bd10 con 0x7ffb8006c480 2023-12-08T08:18:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.417+0000 7ffb7d7fa640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb6c06ae40 0x7ffb6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.417+0000 7ffb7d7fa640 1 -- 172.21.15.50:0/3594333804 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ffb70089e90 con 0x7ffb8006c480 2023-12-08T08:18:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.417+0000 7ffb7ffff640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb6c06ae40 0x7ffb6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.418+0000 7ffb7ffff640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb6c06ae40 0x7ffb6c06d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb74036000 tx=0x7ffb7403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:40.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.421+0000 7ffb7d7fa640 1 -- 172.21.15.50:0/3594333804 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffb70054b80 con 0x7ffb8006c480 2023-12-08T08:18:40.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.599+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb800b0230 con 0x7ffb8006c480 2023-12-08T08:18:40.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.600+0000 7ffb7d7fa640 1 -- 172.21.15.50:0/3594333804 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7ffb700581a0 con 0x7ffb8006c480 2023-12-08T08:18:40.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:40.603 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb6c06ae40 msgr2=0x7ffb6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb6c06ae40 0x7ffb6c06d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb74036000 tx=0x7ffb7403c040 comp rx=0 tx=0).stop 2023-12-08T08:18:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb8006c480 msgr2=0x7ffb800c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb8006c480 0x7ffb800c6660 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000d800 tx=0x7ffb7000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 shutdown_connections 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb6c06ae40 0x7ffb6c06d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb800cf1e0 0x7ffb801560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb800ccd70 0x7ffb801e8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 --2- 172.21.15.50:0/3594333804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb8006c480 0x7ffb800c6660 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 >> 172.21.15.50:0/3594333804 conn(0x7ffb800d0de0 msgr2=0x7ffb800d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 shutdown_connections 2023-12-08T08:18:40.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.602+0000 7ffb8709b640 1 -- 172.21.15.50:0/3594333804 wait complete. 2023-12-08T08:18:40.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:40.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.723+0000 7f77daccf640 1 Processor -- start 2023-12-08T08:18:40.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.724+0000 7f77daccf640 1 -- start start 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.724+0000 7f77daccf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfa30 0x7f77d40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.724+0000 7f77daccf640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77d40b4150 0x7f77d40b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.724+0000 7f77daccf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40c6be0 con 0x7f77d40cfe10 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.724+0000 7f77daccf640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d40d3ff0 con 0x7f77d40b4150 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.724+0000 7f77daccf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40b4860 con 0x7f77d40cfa30 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77d40b4150 0x7f77d40b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d926c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f77d40cfe10 0x7f77d4161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36570/0 (socket says 172.21.15.50:36570) 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d926c640 1 -- 172.21.15.50:0/276254934 learned_addr learned my addr 172.21.15.50:0/276254934 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d8a6b640 1 --2- 172.21.15.50:0/276254934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfa30 0x7f77d40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d37fe640 1 -- 172.21.15.50:0/276254934 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612478996 0 0) 0x7f77d40c6be0 con 0x7f77d40cfe10 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d37fe640 1 -- 172.21.15.50:0/276254934 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c4003520 con 0x7f77d40cfe10 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d3fff640 1 -- 172.21.15.50:0/276254934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfa30 msgr2=0x7f77d40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d3fff640 1 --2- 172.21.15.50:0/276254934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfa30 0x7f77d40b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d3fff640 1 -- 172.21.15.50:0/276254934 >> v1:172.21.15.50:6789/0 conn(0x7f77d40cfe10 legacy=0x7f77d4161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d3fff640 1 -- 172.21.15.50:0/276254934 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40d3d50 con 0x7f77d40b4150 2023-12-08T08:18:40.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.725+0000 7f77d8a6b640 1 --2- 172.21.15.50:0/276254934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfa30 0x7f77d40b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:40.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77d3fff640 1 --2- 172.21.15.50:0/276254934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40b4150 0x7f77d40b3460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f77c00097a0 tx=0x7f77c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6e4ccd15318435 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77d37fe640 1 -- 172.21.15.50:0/276254934 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c002e070 con 0x7f77d40b4150 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77d37fe640 1 -- 172.21.15.50:0/276254934 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c00315a0 con 0x7f77d40b4150 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77d37fe640 1 -- 172.21.15.50:0/276254934 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0031910 con 0x7f77d40b4150 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 -- 172.21.15.50:0/276254934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40b4150 msgr2=0x7f77d40b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 --2- 172.21.15.50:0/276254934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40b4150 0x7f77d40b3460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f77c00097a0 tx=0x7f77c002b840 comp rx=0 tx=0).stop 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 -- 172.21.15.50:0/276254934 shutdown_connections 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 --2- 172.21.15.50:0/276254934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40b4150 0x7f77d40b3460 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 --2- 172.21.15.50:0/276254934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfa30 0x7f77d40b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 -- 172.21.15.50:0/276254934 >> 172.21.15.50:0/276254934 conn(0x7f77d40d3090 msgr2=0x7f77d40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 -- 172.21.15.50:0/276254934 shutdown_connections 2023-12-08T08:18:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.726+0000 7f77daccf640 1 -- 172.21.15.50:0/276254934 wait complete. 2023-12-08T08:18:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 Processor -- start 2023-12-08T08:18:40.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 -- start start 2023-12-08T08:18:40.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77d40b4150 0x7f77d41556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40cfa30 0x7f77d40cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfe10 0x7f77d415acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40cc450 con 0x7f77d40cfa30 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4156210 con 0x7f77d40b4150 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.728+0000 7f77daccf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d40cb8d0 con 0x7f77d40cfe10 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40cfa30 0x7f77d40cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40cfa30 0x7f77d40cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41298/0 (socket says 172.21.15.50:41298) 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 -- 172.21.15.50:0/3463010099 learned_addr learned my addr 172.21.15.50:0/3463010099 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d926c640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfe10 0x7f77d415acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d8a6b640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77d40b4150 0x7f77d41556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 -- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfe10 msgr2=0x7f77d415acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfe10 0x7f77d415acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 -- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77d40b4150 msgr2=0x7f77d41556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77d40b4150 0x7f77d41556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 -- 172.21.15.50:0/3463010099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009400 con 0x7f77d40cfa30 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d3fff640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40cfa30 0x7f77d40cb050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f77c0034040 tx=0x7f77c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:40.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d17fa640 1 -- 172.21.15.50:0/3463010099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0003810 con 0x7f77d40cfa30 2023-12-08T08:18:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d17fa640 1 -- 172.21.15.50:0/3463010099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0040070 con 0x7f77d40cfa30 2023-12-08T08:18:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40cbbb0 con 0x7f77d40cfa30 2023-12-08T08:18:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77d17fa640 1 -- 172.21.15.50:0/3463010099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0003b70 con 0x7f77d40cfa30 2023-12-08T08:18:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.729+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d40cc170 con 0x7f77d40cfa30 2023-12-08T08:18:40.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.730+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d4067430 con 0x7f77d40cfa30 2023-12-08T08:18:40.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.731+0000 7f77d17fa640 1 -- 172.21.15.50:0/3463010099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77c0003cd0 con 0x7f77d40cfa30 2023-12-08T08:18:40.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.731+0000 7f77d17fa640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77b806ae40 0x7f77b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:40.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.731+0000 7f77d17fa640 1 -- 172.21.15.50:0/3463010099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f77c0042070 con 0x7f77d40cfa30 2023-12-08T08:18:40.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.731+0000 7f77d8a6b640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77b806ae40 0x7f77b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:40.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.732+0000 7f77d8a6b640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77b806ae40 0x7f77b806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77c8006fd0 tx=0x7f77c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:40.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.735+0000 7f77d17fa640 1 -- 172.21.15.50:0/3463010099 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77c0076d50 con 0x7f77d40cfa30 2023-12-08T08:18:40.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.909+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77d40743e0 con 0x7f77d40cfa30 2023-12-08T08:18:40.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.910+0000 7f77d17fa640 1 -- 172.21.15.50:0/3463010099 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77c0006e10 con 0x7f77d40cfa30 2023-12-08T08:18:40.912 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:40.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77b806ae40 msgr2=0x7f77b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77b806ae40 0x7f77b806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f77c8006fd0 tx=0x7f77c8008040 comp rx=0 tx=0).stop 2023-12-08T08:18:40.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40cfa30 msgr2=0x7f77d40cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40cfa30 0x7f77d40cb050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f77c0034040 tx=0x7f77c00046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 shutdown_connections 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f77b806ae40 0x7f77b806d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77d40cfa30 0x7f77d40cb050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77d40cfe10 0x7f77d415acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 --2- 172.21.15.50:0/3463010099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77d40b4150 0x7f77d41556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 >> 172.21.15.50:0/3463010099 conn(0x7f77d40d3090 msgr2=0x7f77d415ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 shutdown_connections 2023-12-08T08:18:40.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:40.912+0000 7f77daccf640 1 -- 172.21.15.50:0/3463010099 wait complete. 2023-12-08T08:18:40.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.033+0000 7ffba869b640 1 Processor -- start 2023-12-08T08:18:41.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.033+0000 7ffba869b640 1 -- start start 2023-12-08T08:18:41.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba869b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba00b8950 0x7ffba00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba869b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00b5f00 con 0x7ffba00cebc0 2023-12-08T08:18:41.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba869b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00b6170 con 0x7ffba00cfc80 2023-12-08T08:18:41.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba869b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba00b6450 con 0x7ffba00b8950 2023-12-08T08:18:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba6437640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba00b8950 0x7ffba00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba6437640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba00b8950 0x7ffba00ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41312/0 (socket says 172.21.15.50:41312) 2023-12-08T08:18:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba5c36640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffba00cebc0 0x7ffba00cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36576/0 (socket says 172.21.15.50:36576) 2023-12-08T08:18:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba6437640 1 -- 172.21.15.50:0/3098547053 learned_addr learned my addr 172.21.15.50:0/3098547053 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba6437640 1 -- 172.21.15.50:0/3098547053 >> v1:172.21.15.170:6789/0 conn(0x7ffba00cfc80 legacy=0x7ffba00b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba6437640 1 -- 172.21.15.50:0/3098547053 >> v1:172.21.15.50:6789/0 conn(0x7ffba00cebc0 legacy=0x7ffba00cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.034+0000 7ffba6437640 1 -- 172.21.15.50:0/3098547053 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00b6730 con 0x7ffba00b8950 2023-12-08T08:18:41.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.035+0000 7ffba6437640 1 --2- 172.21.15.50:0/3098547053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00b8950 0x7ffba00ce680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009870 tx=0x7ffb9c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0331e6bb7913f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.035+0000 7ffba5435640 1 -- 172.21.15.50:0/3098547053 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c030860 con 0x7ffba00b8950 2023-12-08T08:18:41.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.035+0000 7ffba5435640 1 -- 172.21.15.50:0/3098547053 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c0309c0 con 0x7ffba00b8950 2023-12-08T08:18:41.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.035+0000 7ffba5435640 1 -- 172.21.15.50:0/3098547053 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c030d50 con 0x7ffba00b8950 2023-12-08T08:18:41.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.035+0000 7ffba869b640 1 -- 172.21.15.50:0/3098547053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00b8950 msgr2=0x7ffba00ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.035+0000 7ffba869b640 1 --2- 172.21.15.50:0/3098547053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00b8950 0x7ffba00ce680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009870 tx=0x7ffb9c02b9a0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.036+0000 7ffba869b640 1 -- 172.21.15.50:0/3098547053 shutdown_connections 2023-12-08T08:18:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.036+0000 7ffba869b640 1 --2- 172.21.15.50:0/3098547053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00b8950 0x7ffba00ce680 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.036+0000 7ffba869b640 1 -- 172.21.15.50:0/3098547053 >> 172.21.15.50:0/3098547053 conn(0x7ffba00d3010 msgr2=0x7ffba00d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.036+0000 7ffba869b640 1 -- 172.21.15.50:0/3098547053 shutdown_connections 2023-12-08T08:18:41.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.036+0000 7ffba869b640 1 -- 172.21.15.50:0/3098547053 wait complete. 2023-12-08T08:18:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.037+0000 7ffba869b640 1 Processor -- start 2023-12-08T08:18:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.037+0000 7ffba869b640 1 -- start start 2023-12-08T08:18:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.037+0000 7ffba869b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffba00b8950 0x7ffba00b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.037+0000 7ffba869b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffba00cebc0 0x7ffba01f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.037+0000 7ffba869b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00cfc80 0x7ffba01f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba869b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01f48f0 con 0x7ffba00cfc80 2023-12-08T08:18:41.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba869b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01f4bd0 con 0x7ffba00b8950 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba869b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01f4eb0 con 0x7ffba00cebc0 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00cfc80 0x7ffba01f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00cfc80 0x7ffba01f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41328/0 (socket says 172.21.15.50:41328) 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 -- 172.21.15.50:0/3881201000 learned_addr learned my addr 172.21.15.50:0/3881201000 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba5c36640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffba00cebc0 0x7ffba01f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6437640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffba00b8950 0x7ffba00b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 -- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffba00cebc0 msgr2=0x7ffba01f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffba00cebc0 0x7ffba01f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 -- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffba00b8950 msgr2=0x7ffba00b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffba00b8950 0x7ffba00b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 -- 172.21.15.50:0/3881201000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c0094d0 con 0x7ffba00cfc80 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba5c36640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffba00cebc0 0x7ffba01f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba6c38640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00cfc80 0x7ffba01f3f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c680 tx=0x7ffb9800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffb96ffd640 1 -- 172.21.15.50:0/3881201000 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98003b70 con 0x7ffba00cfc80 2023-12-08T08:18:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffb96ffd640 1 -- 172.21.15.50:0/3881201000 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb98003cd0 con 0x7ffba00cfc80 2023-12-08T08:18:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba01f5190 con 0x7ffba00cfc80 2023-12-08T08:18:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffb96ffd640 1 -- 172.21.15.50:0/3881201000 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb98005310 con 0x7ffba00cfc80 2023-12-08T08:18:41.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.038+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba00b3a70 con 0x7ffba00cfc80 2023-12-08T08:18:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.039+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba01f56b0 con 0x7ffba00cfc80 2023-12-08T08:18:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.040+0000 7ffb96ffd640 1 -- 172.21.15.50:0/3881201000 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb98005470 con 0x7ffba00cfc80 2023-12-08T08:18:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.040+0000 7ffb96ffd640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb8406ae70 0x7ffb8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.040+0000 7ffb96ffd640 1 -- 172.21.15.50:0/3881201000 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ffb980896f0 con 0x7ffba00cfc80 2023-12-08T08:18:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.041+0000 7ffba6437640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb8406ae70 0x7ffb8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.041+0000 7ffba6437640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb8406ae70 0x7ffb8406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c036000 tx=0x7ffb9c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.045+0000 7ffb96ffd640 1 -- 172.21.15.50:0/3881201000 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffba01f56b0 con 0x7ffba00cfc80 2023-12-08T08:18:41.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.221+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffba01f56b0 con 0x7ffba00cfc80 2023-12-08T08:18:41.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.221+0000 7ffb96ffd640 1 -- 172.21.15.50:0/3881201000 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffba01f56b0 con 0x7ffba00cfc80 2023-12-08T08:18:41.224 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb8406ae70 msgr2=0x7ffb8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb8406ae70 0x7ffb8406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c036000 tx=0x7ffb9c03b040 comp rx=0 tx=0).stop 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00cfc80 msgr2=0x7ffba01f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00cfc80 0x7ffba01f3f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800c680 tx=0x7ffb9800cb40 comp rx=0 tx=0).stop 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 shutdown_connections 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb8406ae70 0x7ffb8406d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00cfc80 0x7ffba01f3f10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffba00cebc0 0x7ffba01f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 --2- 172.21.15.50:0/3881201000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffba00b8950 0x7ffba00b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 >> 172.21.15.50:0/3881201000 conn(0x7ffba00d3010 msgr2=0x7ffba006b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 shutdown_connections 2023-12-08T08:18:41.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.223+0000 7ffba869b640 1 -- 172.21.15.50:0/3881201000 wait complete. 2023-12-08T08:18:41.236 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:41.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.344+0000 7f3015e6b640 1 Processor -- start 2023-12-08T08:18:41.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.344+0000 7f3015e6b640 1 -- start start 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f3015e6b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3010145d80 0x7f3010071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f3015e6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f301006a4d0 0x7f301006a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f3015e6b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301006ae60 con 0x7f30100b4920 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f3015e6b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30100b4e00 con 0x7f3010145d80 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f3015e6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30100b50e0 con 0x7f301006a4d0 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f301006a4d0 0x7f301006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300f7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3010145d80 0x7f3010071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f301006a4d0 0x7f301006a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:51622/0 (socket says 172.21.15.50:51622) 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300effd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f30100b4920 0x7f30100acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49748/0 (socket says 172.21.15.50:49748) 2023-12-08T08:18:41.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300effd640 1 -- 172.21.15.50:0/2135029392 learned_addr learned my addr 172.21.15.50:0/2135029392 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:41.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300f7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3010145d80 0x7f3010071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:33072/0 (socket says 172.21.15.50:33072) 2023-12-08T08:18:41.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300f7fe640 1 -- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f301006a4d0 msgr2=0x7f301006a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:41.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300f7fe640 1 --2- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f301006a4d0 0x7f301006a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.345+0000 7f300f7fe640 1 -- 172.21.15.50:0/2135029392 >> v1:172.21.15.170:6789/0 conn(0x7f30100b4920 legacy=0x7f30100acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.346+0000 7f300e7fc640 1 -- 172.21.15.50:0/2135029392 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968436010 0 0) 0x7f3004001110 con 0x7f30100b4920 2023-12-08T08:18:41.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.346+0000 7f300f7fe640 1 -- 172.21.15.50:0/2135029392 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301006cfb0 con 0x7f3010145d80 2023-12-08T08:18:41.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.346+0000 7f300ffff640 1 --2- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f301006a4d0 0x7f301006a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:41.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.346+0000 7f300f7fe640 1 --2- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3010145d80 0x7f3010071ae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30000097a0 tx=0x7f300002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa9c6f85fe4da1ef server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f300e7fc640 1 -- 172.21.15.50:0/2135029392 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000031830 con 0x7f3010145d80 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f300e7fc640 1 -- 172.21.15.50:0/2135029392 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3000031990 con 0x7f3010145d80 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f300e7fc640 1 -- 172.21.15.50:0/2135029392 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000031d20 con 0x7f3010145d80 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 -- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3010145d80 msgr2=0x7f3010071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 --2- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3010145d80 0x7f3010071ae0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30000097a0 tx=0x7f300002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 -- 172.21.15.50:0/2135029392 shutdown_connections 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 --2- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f301006a4d0 0x7f301006a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 --2- 172.21.15.50:0/2135029392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3010145d80 0x7f3010071ae0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 -- 172.21.15.50:0/2135029392 >> 172.21.15.50:0/2135029392 conn(0x7f301006b7c0 msgr2=0x7f301006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 -- 172.21.15.50:0/2135029392 shutdown_connections 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.347+0000 7f3015e6b640 1 -- 172.21.15.50:0/2135029392 wait complete. 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.348+0000 7f3015e6b640 1 Processor -- start 2023-12-08T08:18:41.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f3015e6b640 1 -- start start 2023-12-08T08:18:41.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f3015e6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f301006a4d0 0x7f30100cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f3015e6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30100b4920 0x7f301015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f3015e6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3010145d80 0x7f301015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f3015e6b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100cc760 con 0x7f30100b4920 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f3015e6b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30101f6290 con 0x7f301006a4d0 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f3015e6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301015fb70 con 0x7f3010145d80 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f300effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30100b4920 0x7f301015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f300effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30100b4920 0x7f301015ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41340/0 (socket says 172.21.15.50:41340) 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.349+0000 7f300effd640 1 -- 172.21.15.50:0/797167256 learned_addr learned my addr 172.21.15.50:0/797167256 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300ffff640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3010145d80 0x7f301015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300f7fe640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f301006a4d0 0x7f30100cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300effd640 1 -- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3010145d80 msgr2=0x7f301015f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300effd640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3010145d80 0x7f301015f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300effd640 1 -- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f301006a4d0 msgr2=0x7f30100cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300effd640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f301006a4d0 0x7f30100cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300effd640 1 -- 172.21.15.50:0/797167256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008009a70 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f300effd640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30100b4920 0x7f301015ef90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f300400c780 tx=0x7f300400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f2ff7fff640 1 -- 172.21.15.50:0/797167256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004005ab0 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f2ff7fff640 1 -- 172.21.15.50:0/797167256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3004005c10 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3000009400 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f2ff7fff640 1 -- 172.21.15.50:0/797167256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004001d10 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.350+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30100cc9b0 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.351+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3010071460 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.352+0000 7f2ff7fff640 1 -- 172.21.15.50:0/797167256 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3004007070 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.352+0000 7f2ff7fff640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ffc06ae40 0x7f2ffc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.352+0000 7f2ff7fff640 1 -- 172.21.15.50:0/797167256 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3004088d50 con 0x7f30100b4920 2023-12-08T08:18:41.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.352+0000 7f300f7fe640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ffc06ae40 0x7f2ffc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.353+0000 7f300f7fe640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ffc06ae40 0x7f2ffc06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3000036000 tx=0x7f3000008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.356+0000 7f2ff7fff640 1 -- 172.21.15.50:0/797167256 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f300408c030 con 0x7f30100b4920 2023-12-08T08:18:41.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.535+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f301006ae60 con 0x7f30100b4920 2023-12-08T08:18:41.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.535+0000 7f2ff7fff640 1 -- 172.21.15.50:0/797167256 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f301006ae60 con 0x7f30100b4920 2023-12-08T08:18:41.538 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ffc06ae40 msgr2=0x7f2ffc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ffc06ae40 0x7f2ffc06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3000036000 tx=0x7f3000008030 comp rx=0 tx=0).stop 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30100b4920 msgr2=0x7f301015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30100b4920 0x7f301015ef90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f300400c780 tx=0x7f300400cc40 comp rx=0 tx=0).stop 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 shutdown_connections 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ffc06ae40 0x7f2ffc06d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30100b4920 0x7f301015ef90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3010145d80 0x7f301015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 --2- 172.21.15.50:0/797167256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f301006a4d0 0x7f30100cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 >> 172.21.15.50:0/797167256 conn(0x7f301006b7c0 msgr2=0x7f301006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 shutdown_connections 2023-12-08T08:18:41.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.537+0000 7f3015e6b640 1 -- 172.21.15.50:0/797167256 wait complete. 2023-12-08T08:18:41.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:41.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f77756b4640 1 Processor -- start 2023-12-08T08:18:41.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f77756b4640 1 -- start start 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f77756b4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f77700b0af0 0x7f77700b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f77756b4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77700cef90 0x7f77700cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f77756b4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77700b2280 con 0x7f777015d4f0 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f77756b4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777006bb40 con 0x7f77700cef90 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f77756b4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77700b1430 con 0x7f77700b0af0 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f776f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77700cef90 0x7f77700cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.658+0000 7f776effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f777015d4f0 0x7f77700b03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36586/0 (socket says 172.21.15.50:36586) 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.659+0000 7f776effd640 1 -- 172.21.15.50:0/3838692953 learned_addr learned my addr 172.21.15.50:0/3838692953 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:41.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.659+0000 7f776e7fc640 1 --2- 172.21.15.50:0/3838692953 >> v2:172.21.15.170:3300/0 conn(0x7f77700b0af0 0x7f77700b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.659+0000 7f776f7fe640 1 -- 172.21.15.50:0/3838692953 >> v2:172.21.15.170:3300/0 conn(0x7f77700b0af0 msgr2=0x7f77700b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.659+0000 7f776f7fe640 1 --2- 172.21.15.50:0/3838692953 >> v2:172.21.15.170:3300/0 conn(0x7f77700b0af0 0x7f77700b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.659+0000 7f776f7fe640 1 -- 172.21.15.50:0/3838692953 >> v1:172.21.15.50:6789/0 conn(0x7f777015d4f0 legacy=0x7f77700b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.659+0000 7f776f7fe640 1 -- 172.21.15.50:0/3838692953 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700b2710 con 0x7f77700cef90 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.659+0000 7f776dffb640 1 -- 172.21.15.50:0/3838692953 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465275819 0 0) 0x7f77700b2280 con 0x7f777015d4f0 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f776f7fe640 1 --2- 172.21.15.50:0/3838692953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77700cef90 0x7f77700cf400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7770071250 tx=0x7f776802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1518d309cdd682 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f776dffb640 1 -- 172.21.15.50:0/3838692953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776802cc80 con 0x7f77700cef90 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f776dffb640 1 -- 172.21.15.50:0/3838692953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776802cde0 con 0x7f77700cef90 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f776dffb640 1 -- 172.21.15.50:0/3838692953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768034660 con 0x7f77700cef90 2023-12-08T08:18:41.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 -- 172.21.15.50:0/3838692953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77700cef90 msgr2=0x7f77700cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 --2- 172.21.15.50:0/3838692953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77700cef90 0x7f77700cf400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7770071250 tx=0x7f776802bed0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 -- 172.21.15.50:0/3838692953 shutdown_connections 2023-12-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 --2- 172.21.15.50:0/3838692953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77700cef90 0x7f77700cf400 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 --2- 172.21.15.50:0/3838692953 >> v2:172.21.15.170:3300/0 conn(0x7f77700b0af0 0x7f77700b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 -- 172.21.15.50:0/3838692953 >> 172.21.15.50:0/3838692953 conn(0x7f77700d0e00 msgr2=0x7f77700d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 -- 172.21.15.50:0/3838692953 shutdown_connections 2023-12-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.660+0000 7f77756b4640 1 -- 172.21.15.50:0/3838692953 wait complete. 2023-12-08T08:18:41.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 Processor -- start 2023-12-08T08:18:41.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 -- start start 2023-12-08T08:18:41.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77700b0af0 0x7f7770152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700cef90 0x7f777015ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777015d4f0 0x7f77700ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77700cb410 con 0x7f777015d4f0 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77701530d0 con 0x7f77700b0af0 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.662+0000 7f77756b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700cc420 con 0x7f77700cef90 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777015d4f0 0x7f77700ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777015d4f0 0x7f77700ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41368/0 (socket says 172.21.15.50:41368) 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 -- 172.21.15.50:0/1153085444 learned_addr learned my addr 172.21.15.50:0/1153085444 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776e7fc640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700cef90 0x7f777015ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776effd640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77700b0af0 0x7f7770152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 -- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700cef90 msgr2=0x7f777015ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700cef90 0x7f777015ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 -- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77700b0af0 msgr2=0x7f7770152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77700b0af0 0x7f7770152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 -- 172.21.15.50:0/1153085444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768009a70 con 0x7f777015d4f0 2023-12-08T08:18:41.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776e7fc640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700cef90 0x7f777015ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776effd640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77700b0af0 0x7f7770152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f776f7fe640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777015d4f0 0x7f77700ae840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e80 tx=0x7f7768004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f77577fe640 1 -- 172.21.15.50:0/1153085444 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768040650 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f77577fe640 1 -- 172.21.15.50:0/1153085444 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77680407b0 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f77577fe640 1 -- 172.21.15.50:0/1153085444 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768040b60 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77700cb660 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.663+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77700cbc20 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.664+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7770067430 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.665+0000 7f77577fe640 1 -- 172.21.15.50:0/1153085444 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7768040cc0 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.665+0000 7f77577fe640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775c06ae40 0x7f775c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.665+0000 7f77577fe640 1 -- 172.21.15.50:0/1153085444 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f77680ac800 con 0x7f777015d4f0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.666+0000 7f776effd640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775c06ae40 0x7f775c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.666+0000 7f776effd640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775c06ae40 0x7f775c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7760000f60 tx=0x7f7760007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.670+0000 7f77577fe640 1 -- 172.21.15.50:0/1153085444 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7768077440 con 0x7f777015d4f0 2023-12-08T08:18:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.844+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f777006bdd0 con 0x7f777015d4f0 2023-12-08T08:18:41.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.844+0000 7f77577fe640 1 -- 172.21.15.50:0/1153085444 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7768009450 con 0x7f777015d4f0 2023-12-08T08:18:41.847 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775c06ae40 msgr2=0x7f775c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775c06ae40 0x7f775c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7760000f60 tx=0x7f7760007ca0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777015d4f0 msgr2=0x7f77700ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777015d4f0 0x7f77700ae840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e80 tx=0x7f7768004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 shutdown_connections 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775c06ae40 0x7f775c06d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777015d4f0 0x7f77700ae840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77700cef90 0x7f777015ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 --2- 172.21.15.50:0/1153085444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77700b0af0 0x7f7770152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 >> 172.21.15.50:0/1153085444 conn(0x7f77700d0e00 msgr2=0x7f77700adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 shutdown_connections 2023-12-08T08:18:41.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.846+0000 7f77756b4640 1 -- 172.21.15.50:0/1153085444 wait complete. 2023-12-08T08:18:41.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.969+0000 7f1775c15640 1 Processor -- start 2023-12-08T08:18:41.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.969+0000 7f1775c15640 1 -- start start 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.969+0000 7f1775c15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f1770070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.969+0000 7f1775c15640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17700cbd10 0x7f177006c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.969+0000 7f1775c15640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17700720d0 con 0x7f177015b750 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.969+0000 7f1775c15640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700cc890 con 0x7f17700cbd10 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.969+0000 7f1775c15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17700714c0 con 0x7f1770158ee0 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176ffff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17700cbd10 0x7f177006c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176f7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f1770070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176ffff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17700cbd10 0x7f177006c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:33098/0 (socket says 172.21.15.50:33098) 2023-12-08T08:18:41.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176ffff640 1 -- 172.21.15.50:0/1226991994 learned_addr learned my addr 172.21.15.50:0/1226991994 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:41.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176effd640 1 --1- 172.21.15.50:0/1226991994 >> v1:172.21.15.170:6789/0 conn(0x7f177015b750 0x7f17700cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49762/0 (socket says 172.21.15.50:49762) 2023-12-08T08:18:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176ffff640 1 -- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 msgr2=0x7f1770070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176ffff640 1 --2- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f1770070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176ffff640 1 -- 172.21.15.50:0/1226991994 >> v1:172.21.15.170:6789/0 conn(0x7f177015b750 legacy=0x7f17700cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176ffff640 1 -- 172.21.15.50:0/1226991994 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700717a0 con 0x7f17700cbd10 2023-12-08T08:18:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176e7fc640 1 -- 172.21.15.50:0/1226991994 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333818964 0 0) 0x7f17700720d0 con 0x7f177015b750 2023-12-08T08:18:41.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.970+0000 7f176f7fe640 1 --2- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f1770070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.971+0000 7f176ffff640 1 --2- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17700cbd10 0x7f177006c480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1768009e50 tx=0x7f176802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c327fa0d5e86476d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.971+0000 7f176e7fc640 1 -- 172.21.15.50:0/1226991994 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176802ca70 con 0x7f17700cbd10 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.971+0000 7f176e7fc640 1 -- 172.21.15.50:0/1226991994 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176802cbd0 con 0x7f17700cbd10 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.971+0000 7f176e7fc640 1 -- 172.21.15.50:0/1226991994 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680343f0 con 0x7f17700cbd10 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 -- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17700cbd10 msgr2=0x7f177006c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 --2- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17700cbd10 0x7f177006c480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1768009e50 tx=0x7f176802bed0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 -- 172.21.15.50:0/1226991994 shutdown_connections 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 --2- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17700cbd10 0x7f177006c480 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 --2- 172.21.15.50:0/1226991994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f1770070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 -- 172.21.15.50:0/1226991994 >> 172.21.15.50:0/1226991994 conn(0x7f17700b09f0 msgr2=0x7f17700b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 -- 172.21.15.50:0/1226991994 shutdown_connections 2023-12-08T08:18:41.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.972+0000 7f1775c15640 1 -- 172.21.15.50:0/1226991994 wait complete. 2023-12-08T08:18:41.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.973+0000 7f1775c15640 1 Processor -- start 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.973+0000 7f1775c15640 1 -- start start 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f1775c15640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17700cbd10 0x7f17701528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f1775c15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f17701f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f1775c15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f177015b750 0x7f1770151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f1775c15640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177009b340 con 0x7f17700cbd10 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f1775c15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17701f7350 con 0x7f177015b750 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f1775c15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177009a7c0 con 0x7f1770158ee0 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17700cbd10 0x7f17701528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17700cbd10 0x7f17701528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41380/0 (socket says 172.21.15.50:41380) 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 -- 172.21.15.50:0/1482365680 learned_addr learned my addr 172.21.15.50:0/1482365680 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176effd640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f17701f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176ffff640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f177015b750 0x7f1770151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 -- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 msgr2=0x7f17701f6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f17701f6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 -- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f177015b750 msgr2=0x7f1770151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f177015b750 0x7f1770151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.974+0000 7f176f7fe640 1 -- 172.21.15.50:0/1482365680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009400 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.975+0000 7f176f7fe640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17700cbd10 0x7f17701528a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f176000ec10 tx=0x7f176000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.975+0000 7f1757fff640 1 -- 172.21.15.50:0/1482365680 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760009760 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.975+0000 7f1757fff640 1 -- 172.21.15.50:0/1482365680 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000cc30 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.975+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1768009b30 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.975+0000 7f1757fff640 1 -- 172.21.15.50:0/1482365680 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760013470 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.975+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177009ad80 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.976+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1770067430 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.976+0000 7f1757fff640 1 -- 172.21.15.50:0/1482365680 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17600135d0 con 0x7f17700cbd10 2023-12-08T08:18:41.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.977+0000 7f1757fff640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f175c06ae40 0x7f175c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.977+0000 7f1757fff640 1 -- 172.21.15.50:0/1482365680 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1760089ca0 con 0x7f17700cbd10 2023-12-08T08:18:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.977+0000 7f176effd640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f175c06ae40 0x7f175c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:41.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.977+0000 7f176effd640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f175c06ae40 0x7f175c06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f17700cb9d0 tx=0x7f1764007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:41.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:41.981+0000 7f1757fff640 1 -- 172.21.15.50:0/1482365680 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1760054980 con 0x7f17700cbd10 2023-12-08T08:18:42.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.158+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17700b1df0 con 0x7f17700cbd10 2023-12-08T08:18:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.160+0000 7f1757fff640 1 -- 172.21.15.50:0/1482365680 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f1760017090 con 0x7f17700cbd10 2023-12-08T08:18:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:42.167 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:42.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f175c06ae40 msgr2=0x7f175c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f175c06ae40 0x7f175c06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f17700cb9d0 tx=0x7f1764007de0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17700cbd10 msgr2=0x7f17701528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17700cbd10 0x7f17701528a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f176000ec10 tx=0x7f176000c520 comp rx=0 tx=0).stop 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 shutdown_connections 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f175c06ae40 0x7f175c06d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f177015b750 0x7f1770151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1770158ee0 0x7f17701f6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.161+0000 7f1775c15640 1 --2- 172.21.15.50:0/1482365680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17700cbd10 0x7f17701528a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.162+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 >> 172.21.15.50:0/1482365680 conn(0x7f17700b09f0 msgr2=0x7f177006dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.162+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 shutdown_connections 2023-12-08T08:18:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.162+0000 7f1775c15640 1 -- 172.21.15.50:0/1482365680 wait complete. 2023-12-08T08:18:42.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:42.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:42.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.284+0000 7f97b643d640 1 Processor -- start 2023-12-08T08:18:42.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.284+0000 7f97b643d640 1 -- start start 2023-12-08T08:18:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b643d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97b00b4fc0 0x7f97b015b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b643d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b00cfcc0 con 0x7f97b00ce780 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b643d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b015eed0 con 0x7f97b015ea20 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b643d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b00ceb60 con 0x7f97b00b4fc0 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b49da640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f97b00b4fc0 0x7f97b015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97affff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f97b00ce780 0x7f97b00cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36598/0 (socket says 172.21.15.50:36598) 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97affff640 1 -- 172.21.15.50:0/482910202 learned_addr learned my addr 172.21.15.50:0/482910202 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b49da640 1 -- 172.21.15.50:0/482910202 >> v1:172.21.15.170:6789/0 conn(0x7f97b015ea20 legacy=0x7f97b00b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b49da640 1 -- 172.21.15.50:0/482910202 >> v1:172.21.15.50:6789/0 conn(0x7f97b00ce780 legacy=0x7f97b00cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97b49da640 1 -- 172.21.15.50:0/482910202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00cff10 con 0x7f97b00b4fc0 2023-12-08T08:18:42.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.285+0000 7f97aeffd640 1 -- 172.21.15.50:0/482910202 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875773069 0 0) 0x7f97b00cfcc0 con 0x7f97b00ce780 2023-12-08T08:18:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.286+0000 7f97b49da640 1 --2- 172.21.15.50:0/482910202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00b4fc0 0x7f97b015b710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009d90 tx=0x7f97a802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddacec0b90c9d358 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.286+0000 7f97aeffd640 1 -- 172.21.15.50:0/482910202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a802cc60 con 0x7f97b00b4fc0 2023-12-08T08:18:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.286+0000 7f97aeffd640 1 -- 172.21.15.50:0/482910202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a802cdc0 con 0x7f97b00b4fc0 2023-12-08T08:18:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.286+0000 7f97aeffd640 1 -- 172.21.15.50:0/482910202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8034660 con 0x7f97b00b4fc0 2023-12-08T08:18:42.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.287+0000 7f97b643d640 1 -- 172.21.15.50:0/482910202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00b4fc0 msgr2=0x7f97b015b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.287+0000 7f97b643d640 1 --2- 172.21.15.50:0/482910202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00b4fc0 0x7f97b015b710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009d90 tx=0x7f97a802beb0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.287+0000 7f97b643d640 1 -- 172.21.15.50:0/482910202 shutdown_connections 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.287+0000 7f97b643d640 1 --2- 172.21.15.50:0/482910202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00b4fc0 0x7f97b015b710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.287+0000 7f97b643d640 1 -- 172.21.15.50:0/482910202 >> 172.21.15.50:0/482910202 conn(0x7f97b006b7c0 msgr2=0x7f97b006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.287+0000 7f97b643d640 1 -- 172.21.15.50:0/482910202 shutdown_connections 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.287+0000 7f97b643d640 1 -- 172.21.15.50:0/482910202 wait complete. 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.288+0000 7f97b643d640 1 Processor -- start 2023-12-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.288+0000 7f97b643d640 1 -- start start 2023-12-08T08:18:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97b643d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97b00b4fc0 0x7f97b014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97b643d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00ce780 0x7f97b009cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97b643d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97b015ea20 0x7f97b009d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97b643d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00b37f0 con 0x7f97b00ce780 2023-12-08T08:18:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97b643d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00b2be0 con 0x7f97b00b4fc0 2023-12-08T08:18:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97b643d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00b2ec0 con 0x7f97b015ea20 2023-12-08T08:18:42.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00ce780 0x7f97b009cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00ce780 0x7f97b009cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41392/0 (socket says 172.21.15.50:41392) 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 -- 172.21.15.50:0/4285200481 learned_addr learned my addr 172.21.15.50:0/4285200481 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97affff640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97b00b4fc0 0x7f97b014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97b49da640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97b015ea20 0x7f97b009d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 -- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97b015ea20 msgr2=0x7f97b009d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97b015ea20 0x7f97b009d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 -- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97b00b4fc0 msgr2=0x7f97b014c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97b00b4fc0 0x7f97b014c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 -- 172.21.15.50:0/4285200481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8009a70 con 0x7f97b00ce780 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97affff640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97b00b4fc0 0x7f97b014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.289+0000 7f97af7fe640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00ce780 0x7f97b009cfa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c430 tx=0x7f97a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.290+0000 7f97acff9640 1 -- 172.21.15.50:0/4285200481 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011790 con 0x7f97b00ce780 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.290+0000 7f97acff9640 1 -- 172.21.15.50:0/4285200481 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00118f0 con 0x7f97b00ce780 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.290+0000 7f97acff9640 1 -- 172.21.15.50:0/4285200481 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011ca0 con 0x7f97b00ce780 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.290+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b00b31a0 con 0x7f97b00ce780 2023-12-08T08:18:42.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.290+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b014ccc0 con 0x7f97b00ce780 2023-12-08T08:18:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.291+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b0067430 con 0x7f97b00ce780 2023-12-08T08:18:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.291+0000 7f97acff9640 1 -- 172.21.15.50:0/4285200481 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97a001c460 con 0x7f97b00ce780 2023-12-08T08:18:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.292+0000 7f97acff9640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f979c06ae40 0x7f979c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.292+0000 7f97acff9640 1 -- 172.21.15.50:0/4285200481 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f97a0089910 con 0x7f97b00ce780 2023-12-08T08:18:42.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.292+0000 7f97affff640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f979c06ae40 0x7f979c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.292+0000 7f97affff640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f979c06ae40 0x7f979c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97a4000f60 tx=0x7f97a4007c30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.296+0000 7f97acff9640 1 -- 172.21.15.50:0/4285200481 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f97a0054670 con 0x7f97b00ce780 2023-12-08T08:18:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.474+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97b009a6f0 con 0x7f97b00ce780 2023-12-08T08:18:42.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.474+0000 7f97acff9640 1 -- 172.21.15.50:0/4285200481 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97a0057c90 con 0x7f97b00ce780 2023-12-08T08:18:42.477 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f979c06ae40 msgr2=0x7f979c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f979c06ae40 0x7f979c06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f97a4000f60 tx=0x7f97a4007c30 comp rx=0 tx=0).stop 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00ce780 msgr2=0x7f97b009cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00ce780 0x7f97b009cfa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c430 tx=0x7f97a000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 shutdown_connections 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f979c06ae40 0x7f979c06d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f97b00ce780 0x7f97b009cfa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97b015ea20 0x7f97b009d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 --2- 172.21.15.50:0/4285200481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97b00b4fc0 0x7f97b014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.476+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 >> 172.21.15.50:0/4285200481 conn(0x7f97b006b7c0 msgr2=0x7f97b006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.477+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 shutdown_connections 2023-12-08T08:18:42.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.477+0000 7f97b643d640 1 -- 172.21.15.50:0/4285200481 wait complete. 2023-12-08T08:18:42.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.598+0000 7f8630610640 1 Processor -- start 2023-12-08T08:18:42.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.598+0000 7f8630610640 1 -- start start 2023-12-08T08:18:42.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f8630610640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86280d1ca0 0x7f86280b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f8630610640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d3b90 0x7f86280ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f8630610640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280d3fe0 con 0x7f86280d18c0 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f8630610640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280d04d0 con 0x7f86280d1ca0 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f8630610640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280d0ff0 con 0x7f86280d3b90 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862dbab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f86280d1ca0 0x7f86280b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862e3ac640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f86280d18c0 0x7f86280afc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36600/0 (socket says 172.21.15.50:36600) 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862e3ac640 1 -- 172.21.15.50:0/2976869951 learned_addr learned my addr 172.21.15.50:0/2976869951 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862dbab640 1 -- 172.21.15.50:0/2976869951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d3b90 msgr2=0x7f86280ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862ebad640 1 --2- 172.21.15.50:0/2976869951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d3b90 0x7f86280ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862dbab640 1 --2- 172.21.15.50:0/2976869951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d3b90 0x7f86280ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862dbab640 1 -- 172.21.15.50:0/2976869951 >> v1:172.21.15.50:6789/0 conn(0x7f86280d18c0 legacy=0x7f86280afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862dbab640 1 -- 172.21.15.50:0/2976869951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280d1290 con 0x7f86280d1ca0 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862d3aa640 1 -- 172.21.15.50:0/2976869951 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312856326 0 0) 0x7f86280d3fe0 con 0x7f86280d18c0 2023-12-08T08:18:42.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.599+0000 7f862ebad640 1 --2- 172.21.15.50:0/2976869951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d3b90 0x7f86280ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:42.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.600+0000 7f862dbab640 1 --2- 172.21.15.50:0/2976869951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d1ca0 0x7f86280b2030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86180097a0 tx=0x7f861802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b027519d0a23b043 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.600+0000 7f862d3aa640 1 -- 172.21.15.50:0/2976869951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618031780 con 0x7f86280d1ca0 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.600+0000 7f862d3aa640 1 -- 172.21.15.50:0/2976869951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86180318e0 con 0x7f86280d1ca0 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.600+0000 7f862d3aa640 1 -- 172.21.15.50:0/2976869951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618031c70 con 0x7f86280d1ca0 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.600+0000 7f8630610640 1 -- 172.21.15.50:0/2976869951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d1ca0 msgr2=0x7f86280b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.600+0000 7f8630610640 1 --2- 172.21.15.50:0/2976869951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d1ca0 0x7f86280b2030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f86180097a0 tx=0x7f861802b820 comp rx=0 tx=0).stop 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.601+0000 7f8630610640 1 -- 172.21.15.50:0/2976869951 shutdown_connections 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.601+0000 7f8630610640 1 --2- 172.21.15.50:0/2976869951 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d3b90 0x7f86280ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.601+0000 7f8630610640 1 --2- 172.21.15.50:0/2976869951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d1ca0 0x7f86280b2030 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.601+0000 7f8630610640 1 -- 172.21.15.50:0/2976869951 >> 172.21.15.50:0/2976869951 conn(0x7f86280d3070 msgr2=0x7f86280d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.601+0000 7f8630610640 1 -- 172.21.15.50:0/2976869951 shutdown_connections 2023-12-08T08:18:42.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.601+0000 7f8630610640 1 -- 172.21.15.50:0/2976869951 wait complete. 2023-12-08T08:18:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.602+0000 7f8630610640 1 Processor -- start 2023-12-08T08:18:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.602+0000 7f8630610640 1 -- start start 2023-12-08T08:18:42.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d18c0 0x7f862815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86280d1ca0 0x7f86280b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d3b90 0x7f86280b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280cc160 con 0x7f86280d3b90 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86281f3970 con 0x7f86280d1ca0 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280cb7c0 con 0x7f86280d18c0 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d3b90 0x7f86280b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d3b90 0x7f86280b48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41414/0 (socket says 172.21.15.50:41414) 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 -- 172.21.15.50:0/314411443 learned_addr learned my addr 172.21.15.50:0/314411443 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862dbab640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86280d1ca0 0x7f86280b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862e3ac640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d18c0 0x7f862815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 -- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d18c0 msgr2=0x7f862815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d18c0 0x7f862815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 -- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86280d1ca0 msgr2=0x7f86280b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86280d1ca0 0x7f86280b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 -- 172.21.15.50:0/314411443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618009400 con 0x7f86280d3b90 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862dbab640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86280d1ca0 0x7f86280b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f862ebad640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d3b90 0x7f86280b48e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f862000cef0 tx=0x7f862000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f861effd640 1 -- 172.21.15.50:0/314411443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862000d840 con 0x7f86280d3b90 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f861effd640 1 -- 172.21.15.50:0/314411443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862000d9c0 con 0x7f86280d3b90 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86280cbaa0 con 0x7f86280d3b90 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f861effd640 1 -- 172.21.15.50:0/314411443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862000dd70 con 0x7f86280d3b90 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.603+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86280cc580 con 0x7f86280d3b90 2023-12-08T08:18:42.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.604+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86280cc2a0 con 0x7f86280d3b90 2023-12-08T08:18:42.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.605+0000 7f861effd640 1 -- 172.21.15.50:0/314411443 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f862001e3b0 con 0x7f86280d3b90 2023-12-08T08:18:42.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.605+0000 7f861effd640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f860c06ae40 0x7f860c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.605+0000 7f861effd640 1 -- 172.21.15.50:0/314411443 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f862008a4d0 con 0x7f86280d3b90 2023-12-08T08:18:42.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.606+0000 7f862e3ac640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f860c06ae40 0x7f860c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.606+0000 7f862e3ac640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f860c06ae40 0x7f860c06d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8624000f60 tx=0x7f8624009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.609+0000 7f861effd640 1 -- 172.21.15.50:0/314411443 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86280cc2a0 con 0x7f86280d3b90 2023-12-08T08:18:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.785+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86280cc2a0 con 0x7f86280d3b90 2023-12-08T08:18:42.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.785+0000 7f861effd640 1 -- 172.21.15.50:0/314411443 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86280cc2a0 con 0x7f86280d3b90 2023-12-08T08:18:42.788 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f860c06ae40 msgr2=0x7f860c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f860c06ae40 0x7f860c06d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8624000f60 tx=0x7f8624009040 comp rx=0 tx=0).stop 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d3b90 msgr2=0x7f86280b48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d3b90 0x7f86280b48e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f862000cef0 tx=0x7f862000a710 comp rx=0 tx=0).stop 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 shutdown_connections 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f860c06ae40 0x7f860c06d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86280d3b90 0x7f86280b48e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86280d1ca0 0x7f86280b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 --2- 172.21.15.50:0/314411443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86280d18c0 0x7f862815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 >> 172.21.15.50:0/314411443 conn(0x7f86280d3070 msgr2=0x7f86280ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 shutdown_connections 2023-12-08T08:18:42.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.787+0000 7f8630610640 1 -- 172.21.15.50:0/314411443 wait complete. 2023-12-08T08:18:42.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.908+0000 7f5b82f16640 1 Processor -- start 2023-12-08T08:18:42.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.908+0000 7f5b82f16640 1 -- start start 2023-12-08T08:18:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.908+0000 7f5b82f16640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c157a20 0x7f5b7c15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.908+0000 7f5b82f16640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b7c06d7d0 0x7f5b7c0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.908+0000 7f5b82f16640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c157e00 con 0x7f5b7c0cb370 2023-12-08T08:18:42.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.908+0000 7f5b82f16640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c06dd20 con 0x7f5b7c06d7d0 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.908+0000 7f5b82f16640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c070cd0 con 0x7f5b7c157a20 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b814b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b7c06d7d0 0x7f5b7c0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b814b3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5b7c06d7d0 0x7f5b7c0b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41422/0 (socket says 172.21.15.50:41422) 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b7bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5b7c0cb370 0x7f5b7c15df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36604/0 (socket says 172.21.15.50:36604) 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b814b3640 1 -- 172.21.15.50:0/1776303677 learned_addr learned my addr 172.21.15.50:0/1776303677 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b80cb2640 1 --2- 172.21.15.50:0/1776303677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c157a20 0x7f5b7c15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b814b3640 1 -- 172.21.15.50:0/1776303677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c157a20 msgr2=0x7f5b7c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b814b3640 1 --2- 172.21.15.50:0/1776303677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c157a20 0x7f5b7c15d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b814b3640 1 -- 172.21.15.50:0/1776303677 >> v1:172.21.15.50:6789/0 conn(0x7f5b7c0cb370 legacy=0x7f5b7c15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b814b3640 1 -- 172.21.15.50:0/1776303677 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c070fb0 con 0x7f5b7c06d7d0 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b7b7fe640 1 -- 172.21.15.50:0/1776303677 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661576453 0 0) 0x7f5b7c157e00 con 0x7f5b7c0cb370 2023-12-08T08:18:42.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.909+0000 7f5b80cb2640 1 --2- 172.21.15.50:0/1776303677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c157a20 0x7f5b7c15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b814b3640 1 --2- 172.21.15.50:0/1776303677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c06d7d0 0x7f5b7c0b1b50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009e50 tx=0x7f5b7402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8710fe623d18046a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b7b7fe640 1 -- 172.21.15.50:0/1776303677 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402cb00 con 0x7f5b7c06d7d0 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b7b7fe640 1 -- 172.21.15.50:0/1776303677 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7402cc60 con 0x7f5b7c06d7d0 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b7b7fe640 1 -- 172.21.15.50:0/1776303677 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740343f0 con 0x7f5b7c06d7d0 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 -- 172.21.15.50:0/1776303677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c06d7d0 msgr2=0x7f5b7c0b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 --2- 172.21.15.50:0/1776303677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c06d7d0 0x7f5b7c0b1b50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009e50 tx=0x7f5b7402bf60 comp rx=0 tx=0).stop 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 -- 172.21.15.50:0/1776303677 shutdown_connections 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 --2- 172.21.15.50:0/1776303677 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c06d7d0 0x7f5b7c0b1b50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 --2- 172.21.15.50:0/1776303677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c157a20 0x7f5b7c15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 -- 172.21.15.50:0/1776303677 >> 172.21.15.50:0/1776303677 conn(0x7f5b7c0b0850 msgr2=0x7f5b7c0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 -- 172.21.15.50:0/1776303677 shutdown_connections 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.910+0000 7f5b82f16640 1 -- 172.21.15.50:0/1776303677 wait complete. 2023-12-08T08:18:42.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 Processor -- start 2023-12-08T08:18:42.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 -- start start 2023-12-08T08:18:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b7c06d7d0 0x7f5b7c146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c0cb370 0x7f5b7c135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c157a20 0x7f5b7c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c147490 con 0x7f5b7c157a20 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c158ab0 con 0x7f5b7c06d7d0 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.912+0000 7f5b82f16640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c157ea0 con 0x7f5b7c0cb370 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c157a20 0x7f5b7c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c157a20 0x7f5b7c14ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41424/0 (socket says 172.21.15.50:41424) 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 -- 172.21.15.50:0/3478395258 learned_addr learned my addr 172.21.15.50:0/3478395258 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b80cb2640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b7c06d7d0 0x7f5b7c146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b7bfff640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c0cb370 0x7f5b7c135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 -- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c0cb370 msgr2=0x7f5b7c135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c0cb370 0x7f5b7c135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 -- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b7c06d7d0 msgr2=0x7f5b7c146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b7c06d7d0 0x7f5b7c146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 -- 172.21.15.50:0/3478395258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009b30 con 0x7f5b7c157a20 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b7bfff640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c0cb370 0x7f5b7c135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:42.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b814b3640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c157a20 0x7f5b7c14ab10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009e50 tx=0x7f5b74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b797fa640 1 -- 172.21.15.50:0/3478395258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74009510 con 0x7f5b7c157a20 2023-12-08T08:18:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b797fa640 1 -- 172.21.15.50:0/3478395258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7403e450 con 0x7f5b7c157a20 2023-12-08T08:18:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c158180 con 0x7f5b7c157a20 2023-12-08T08:18:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b797fa640 1 -- 172.21.15.50:0/3478395258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7403e800 con 0x7f5b7c157a20 2023-12-08T08:18:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.913+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c158740 con 0x7f5b7c157a20 2023-12-08T08:18:42.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.914+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c158c60 con 0x7f5b7c157a20 2023-12-08T08:18:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.915+0000 7f5b797fa640 1 -- 172.21.15.50:0/3478395258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b7403e960 con 0x7f5b7c157a20 2023-12-08T08:18:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.915+0000 7f5b797fa640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5b6006ae70 0x7f5b6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.915+0000 7f5b797fa640 1 -- 172.21.15.50:0/3478395258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5b740ac720 con 0x7f5b7c157a20 2023-12-08T08:18:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.916+0000 7f5b80cb2640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5b6006ae70 0x7f5b6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:42.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.916+0000 7f5b80cb2640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5b6006ae70 0x7f5b6006d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c06d700 tx=0x7f5b70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:42.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:42.920+0000 7f5b797fa640 1 -- 172.21.15.50:0/3478395258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b7c158c60 con 0x7f5b7c157a20 2023-12-08T08:18:43.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.099+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b7c158c20 con 0x7f5b7c157a20 2023-12-08T08:18:43.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.099+0000 7f5b797fa640 1 -- 172.21.15.50:0/3478395258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b74077510 con 0x7f5b7c157a20 2023-12-08T08:18:43.102 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5b6006ae70 msgr2=0x7f5b6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5b6006ae70 0x7f5b6006d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c06d700 tx=0x7f5b70008040 comp rx=0 tx=0).stop 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c157a20 msgr2=0x7f5b7c14ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c157a20 0x7f5b7c14ab10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009e50 tx=0x7f5b74004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 shutdown_connections 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5b6006ae70 0x7f5b6006d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c157a20 0x7f5b7c14ab10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5b7c0cb370 0x7f5b7c135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 --2- 172.21.15.50:0/3478395258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b7c06d7d0 0x7f5b7c146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 >> 172.21.15.50:0/3478395258 conn(0x7f5b7c0b0850 msgr2=0x7f5b7c1529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 shutdown_connections 2023-12-08T08:18:43.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.101+0000 7f5b82f16640 1 -- 172.21.15.50:0/3478395258 wait complete. 2023-12-08T08:18:43.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:43.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.222+0000 7f6c9f0e0640 1 Processor -- start 2023-12-08T08:18:43.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.222+0000 7f6c9f0e0640 1 -- start start 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9f0e0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c9815d590 0x7f6c980ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9f0e0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6c980afeb0 0x7f6c980cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9f0e0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9806d650 con 0x7f6c980cf790 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9f0e0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980adbe0 con 0x7f6c9815d590 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9f0e0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9815d970 con 0x7f6c980afeb0 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9ce7c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c9815d590 0x7f6c980ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9ce7c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c9815d590 0x7f6c980ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41436/0 (socket says 172.21.15.50:41436) 2023-12-08T08:18:43.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.223+0000 7f6c9ce7c640 1 -- 172.21.15.50:0/3004221617 learned_addr learned my addr 172.21.15.50:0/3004221617 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.224+0000 7f6c97fff640 1 --2- 172.21.15.50:0/3004221617 >> v2:172.21.15.170:3300/0 conn(0x7f6c980afeb0 0x7f6c980cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.224+0000 7f6c9ce7c640 1 -- 172.21.15.50:0/3004221617 >> v2:172.21.15.170:3300/0 conn(0x7f6c980afeb0 msgr2=0x7f6c980cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.224+0000 7f6c9ce7c640 1 --2- 172.21.15.50:0/3004221617 >> v2:172.21.15.170:3300/0 conn(0x7f6c980afeb0 0x7f6c980cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.224+0000 7f6c9ce7c640 1 -- 172.21.15.50:0/3004221617 >> v1:172.21.15.170:6789/0 conn(0x7f6c980cf790 legacy=0x7f6c98161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.224+0000 7f6c9ce7c640 1 -- 172.21.15.50:0/3004221617 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9806c810 con 0x7f6c9815d590 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.224+0000 7f6c9ce7c640 1 --2- 172.21.15.50:0/3004221617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980ced10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6c98072760 tx=0x7f6c9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addd565c852f0bc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c977fe640 1 -- 172.21.15.50:0/3004221617 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90031870 con 0x7f6c9815d590 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c977fe640 1 -- 172.21.15.50:0/3004221617 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900319d0 con 0x7f6c9815d590 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c977fe640 1 -- 172.21.15.50:0/3004221617 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90031d60 con 0x7f6c9815d590 2023-12-08T08:18:43.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/3004221617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 msgr2=0x7f6c980ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/3004221617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980ced10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6c98072760 tx=0x7f6c9002b910 comp rx=0 tx=0).stop 2023-12-08T08:18:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/3004221617 shutdown_connections 2023-12-08T08:18:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/3004221617 >> v2:172.21.15.170:3300/0 conn(0x7f6c980afeb0 0x7f6c980cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/3004221617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980ced10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/3004221617 >> 172.21.15.50:0/3004221617 conn(0x7f6c980d0e10 msgr2=0x7f6c980d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:43.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/3004221617 shutdown_connections 2023-12-08T08:18:43.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.225+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/3004221617 wait complete. 2023-12-08T08:18:43.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.226+0000 7f6c9f0e0640 1 Processor -- start 2023-12-08T08:18:43.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.226+0000 7f6c9f0e0640 1 -- start start 2023-12-08T08:18:43.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9f0e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c980afeb0 0x7f6c980cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9f0e0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c980cf790 0x7f6c98157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9f0e0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9f0e0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c5480 con 0x7f6c9815d590 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9f0e0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c981583c0 con 0x7f6c980afeb0 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9f0e0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c4ae0 con 0x7f6c980cf790 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9d67d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9d67d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41448/0 (socket says 172.21.15.50:41448) 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9d67d640 1 -- 172.21.15.50:0/1174480650 learned_addr learned my addr 172.21.15.50:0/1174480650 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c97fff640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c980cf790 0x7f6c98157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.227+0000 7f6c9ce7c640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c980afeb0 0x7f6c980cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9d67d640 1 -- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c980cf790 msgr2=0x7f6c98157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9d67d640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c980cf790 0x7f6c98157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9d67d640 1 -- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c980afeb0 msgr2=0x7f6c980cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9d67d640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c980afeb0 0x7f6c980cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9d67d640 1 -- 172.21.15.50:0/1174480650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900094d0 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c97fff640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c980cf790 0x7f6c98157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9ce7c640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c980afeb0 0x7f6c980cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9d67d640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980c9fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c410 tx=0x7f6c8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c957fa640 1 -- 172.21.15.50:0/1174480650 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011790 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c957fa640 1 -- 172.21.15.50:0/1174480650 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c800118f0 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c980c4dc0 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c957fa640 1 -- 172.21.15.50:0/1174480650 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80011ce0 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.228+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c980ca510 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.229+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c980c55c0 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.230+0000 7f6c957fa640 1 -- 172.21.15.50:0/1174480650 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c8001c460 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.230+0000 7f6c957fa640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c7806ae40 0x7f6c7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.230+0000 7f6c957fa640 1 -- 172.21.15.50:0/1174480650 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6c800897f0 con 0x7f6c9815d590 2023-12-08T08:18:43.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.230+0000 7f6c9ce7c640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c7806ae40 0x7f6c7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.231+0000 7f6c9ce7c640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c7806ae40 0x7f6c7806d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c9003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.234+0000 7f6c957fa640 1 -- 172.21.15.50:0/1174480650 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c980c55c0 con 0x7f6c9815d590 2023-12-08T08:18:43.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.409+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6c980c55c0 con 0x7f6c9815d590 2023-12-08T08:18:43.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.410+0000 7f6c957fa640 1 -- 172.21.15.50:0/1174480650 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6c980c55c0 con 0x7f6c9815d590 2023-12-08T08:18:43.412 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.411+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c7806ae40 msgr2=0x7f6c7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.411+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c7806ae40 0x7f6c7806d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c9003c040 comp rx=0 tx=0).stop 2023-12-08T08:18:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.411+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 msgr2=0x7f6c980c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.411+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980c9fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c410 tx=0x7f6c8000c8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 shutdown_connections 2023-12-08T08:18:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c7806ae40 0x7f6c7806d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c9815d590 0x7f6c980c9fd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c980cf790 0x7f6c98157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 --2- 172.21.15.50:0/1174480650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c980afeb0 0x7f6c980cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 >> 172.21.15.50:0/1174480650 conn(0x7f6c980d0e10 msgr2=0x7f6c980b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 shutdown_connections 2023-12-08T08:18:43.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.412+0000 7f6c9f0e0640 1 -- 172.21.15.50:0/1174480650 wait complete. 2023-12-08T08:18:43.425 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.529+0000 7f44b11e3640 1 Processor -- start 2023-12-08T08:18:43.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.529+0000 7f44b11e3640 1 -- start start 2023-12-08T08:18:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44b11e3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 0x7f44ac0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44b11e3640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f44ac0b0cf0 0x7f44ac0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44b11e3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac0d20b0 con 0x7f44ac0b1d70 2023-12-08T08:18:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44b11e3640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac0d0620 con 0x7f44ac0b0cf0 2023-12-08T08:18:43.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44b11e3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0d1b80 con 0x7f44ac1608a0 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44aa59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f44ac0b1d70 0x7f44ac0d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36620/0 (socket says 172.21.15.50:36620) 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44aa59c640 1 -- 172.21.15.50:0/2476594849 learned_addr learned my addr 172.21.15.50:0/2476594849 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.530+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782074374 0 0) 0x7f44ac0d20b0 con 0x7f44ac0b1d70 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4494003520 con 0x7f44ac0b1d70 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44aad9d640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 0x7f44ac0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44ab59e640 1 --2- 172.21.15.50:0/2476594849 >> v2:172.21.15.170:3300/0 conn(0x7f44ac0b0cf0 0x7f44ac0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4166415835 0 0) 0x7f4494003520 con 0x7f44ac0b1d70 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 msgr2=0x7f44ac0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 0x7f44ac0d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 >> v2:172.21.15.170:3300/0 conn(0x7f44ac0b0cf0 msgr2=0x7f44ac0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 --2- 172.21.15.50:0/2476594849 >> v2:172.21.15.170:3300/0 conn(0x7f44ac0b0cf0 0x7f44ac0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac0d1dd0 con 0x7f44ac0b1d70 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f44a0001670 con 0x7f44ac0b1d70 2023-12-08T08:18:43.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 >> v1:172.21.15.50:6789/0 conn(0x7f44ac0b1d70 legacy=0x7f44ac0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 0x7f4494003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4494003ff0 0x7f44940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f4494005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0d0620 con 0x7f4494004d00 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0d1b80 con 0x7f4494003ff0 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449400bb90 con 0x7f44ac1608a0 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44ab59e640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f4494005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44aa59c640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4494003ff0 0x7f44940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44aad9d640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 0x7f4494003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44ab59e640 1 -- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 msgr2=0x7f4494003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44ab59e640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 0x7f4494003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44ab59e640 1 -- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4494003ff0 msgr2=0x7f44940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44ab59e640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4494003ff0 0x7f44940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44ab59e640 1 -- 172.21.15.50:0/2476594849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494003520 con 0x7f4494004d00 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.531+0000 7f44aad9d640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac1608a0 0x7f4494003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.532+0000 7f44ab59e640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f4494005180 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f449c007330 tx=0x7f44940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c8cca154c54b7a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.532+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c02ccd0 con 0x7f4494004d00 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.532+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c02ce30 con 0x7f4494004d00 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.532+0000 7f44a9d9b640 1 -- 172.21.15.50:0/2476594849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c034680 con 0x7f4494004d00 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.533+0000 7f44b11e3640 1 -- 172.21.15.50:0/2476594849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 msgr2=0x7f4494005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.533+0000 7f44b11e3640 1 --2- 172.21.15.50:0/2476594849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f4494005180 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f449c007330 tx=0x7f44940057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.533+0000 7f44ab59e640 1 -- 172.21.15.50:0/2476594849 reap_dead start 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.533+0000 7f44b11e3640 1 -- 172.21.15.50:0/2476594849 shutdown_connections 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.533+0000 7f44b11e3640 1 -- 172.21.15.50:0/2476594849 >> 172.21.15.50:0/2476594849 conn(0x7f44ac0d3030 msgr2=0x7f44ac0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:43.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.533+0000 7f44b11e3640 1 -- 172.21.15.50:0/2476594849 shutdown_connections 2023-12-08T08:18:43.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.533+0000 7f44b11e3640 1 -- 172.21.15.50:0/2476594849 wait complete. 2023-12-08T08:18:43.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.534+0000 7f44b11e3640 1 Processor -- start 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.534+0000 7f44b11e3640 1 -- start start 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44b11e3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f44ac14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44b11e3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44ac0b6fa0 0x7f44ac0b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44b11e3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac14f360 0x7f44ac14f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44b11e3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0b7ac0 con 0x7f4494004d00 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44b11e3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac14fd20 con 0x7f44ac0b6fa0 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44b11e3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0b7720 con 0x7f44ac14f360 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f44ac14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f44ac14ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41462/0 (socket says 172.21.15.50:41462) 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 -- 172.21.15.50:0/3202166194 learned_addr learned my addr 172.21.15.50:0/3202166194 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44ab59e640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac14f360 0x7f44ac14f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aa59c640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44ac0b6fa0 0x7f44ac0b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 -- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac14f360 msgr2=0x7f44ac14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac14f360 0x7f44ac14f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 -- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44ac0b6fa0 msgr2=0x7f44ac0b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44ac0b6fa0 0x7f44ac0b7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.535+0000 7f44aad9d640 1 -- 172.21.15.50:0/3202166194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac0ca230 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.536+0000 7f44aad9d640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f44ac14ff50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006a90 tx=0x7f44a4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.536+0000 7f44937fe640 1 -- 172.21.15.50:0/3202166194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4014870 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.536+0000 7f44937fe640 1 -- 172.21.15.50:0/3202166194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a40149d0 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.536+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac0ca510 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.536+0000 7f44937fe640 1 -- 172.21.15.50:0/3202166194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4014d60 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.536+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac0ca7f0 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.537+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac067430 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.537+0000 7f44937fe640 1 -- 172.21.15.50:0/3202166194 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44a4015410 con 0x7f4494004d00 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.538+0000 7f44937fe640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f449806ae40 0x7f449806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.538+0000 7f44937fe640 1 -- 172.21.15.50:0/3202166194 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f44a408a1c0 con 0x7f4494004d00 2023-12-08T08:18:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.538+0000 7f44aa59c640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f449806ae40 0x7f449806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.538+0000 7f44aa59c640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f449806ae40 0x7f449806d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44a0000fb0 tx=0x7f44a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.542+0000 7f44937fe640 1 -- 172.21.15.50:0/3202166194 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44a4054e80 con 0x7f4494004d00 2023-12-08T08:18:43.722 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.720+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44ac0cd560 con 0x7f4494004d00 2023-12-08T08:18:43.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.721+0000 7f44937fe640 1 -- 172.21.15.50:0/3202166194 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f44a40584a0 con 0x7f4494004d00 2023-12-08T08:18:43.724 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:43.724 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:43.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.723+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f449806ae40 msgr2=0x7f449806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.723+0000 7f44b11e3640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f449806ae40 0x7f449806d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44a0000fb0 tx=0x7f44a0009040 comp rx=0 tx=0).stop 2023-12-08T08:18:43.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 msgr2=0x7f44ac14ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f44ac14ff50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006a90 tx=0x7f44a4004610 comp rx=0 tx=0).stop 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 shutdown_connections 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f449806ae40 0x7f449806d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44ac14f360 0x7f44ac14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44ac0b6fa0 0x7f44ac0b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 --2- 172.21.15.50:0/3202166194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4494004d00 0x7f44ac14ff50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 >> 172.21.15.50:0/3202166194 conn(0x7f44ac0d3030 msgr2=0x7f44ac15f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 shutdown_connections 2023-12-08T08:18:43.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.724+0000 7f44b11e3640 1 -- 172.21.15.50:0/3202166194 wait complete. 2023-12-08T08:18:43.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:43.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.845+0000 7f8ccf489640 1 Processor -- start 2023-12-08T08:18:43.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.845+0000 7f8ccf489640 1 -- start start 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccf489640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8cc815d4f0 0x7f8cc80b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccf489640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8cc80b0920 0x7f8cc80b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccf489640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80adb50 0x7f8cc80adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccf489640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc806bb40 con 0x7f8cc80b0920 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccf489640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc80b2280 con 0x7f8cc815d4f0 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccf489640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80b2710 con 0x7f8cc80adb50 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8cc80b0920 0x7f8cc80b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8cc80b0920 0x7f8cc80b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41472/0 (socket says 172.21.15.50:41472) 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 -- 172.21.15.50:0/810288402 learned_addr learned my addr 172.21.15.50:0/810288402 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccd225640 1 --2- 172.21.15.50:0/810288402 >> v2:172.21.15.170:3300/0 conn(0x7f8cc815d4f0 0x7f8cc80b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccda26640 1 --2- 172.21.15.50:0/810288402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80adb50 0x7f8cc80adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 -- 172.21.15.50:0/810288402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80adb50 msgr2=0x7f8cc80adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 --2- 172.21.15.50:0/810288402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80adb50 0x7f8cc80adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 -- 172.21.15.50:0/810288402 >> v2:172.21.15.170:3300/0 conn(0x7f8cc815d4f0 msgr2=0x7f8cc80b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 --2- 172.21.15.50:0/810288402 >> v2:172.21.15.170:3300/0 conn(0x7f8cc815d4f0 0x7f8cc80b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.846+0000 7f8ccca24640 1 -- 172.21.15.50:0/810288402 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80b1690 con 0x7f8cc80b0920 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.847+0000 7f8ccca24640 1 --2- 172.21.15.50:0/810288402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80b0920 0x7f8cc80b0d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8071970 tx=0x7f8cb802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed88a4cd96021cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.847+0000 7f8cbffff640 1 -- 172.21.15.50:0/810288402 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031870 con 0x7f8cc80b0920 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.847+0000 7f8cbffff640 1 -- 172.21.15.50:0/810288402 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb80319d0 con 0x7f8cc80b0920 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.847+0000 7f8cbffff640 1 -- 172.21.15.50:0/810288402 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8031d60 con 0x7f8cc80b0920 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 -- 172.21.15.50:0/810288402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80b0920 msgr2=0x7f8cc80b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 --2- 172.21.15.50:0/810288402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80b0920 0x7f8cc80b0d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8071970 tx=0x7f8cb802b910 comp rx=0 tx=0).stop 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 -- 172.21.15.50:0/810288402 shutdown_connections 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 --2- 172.21.15.50:0/810288402 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80adb50 0x7f8cc80adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 --2- 172.21.15.50:0/810288402 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80b0920 0x7f8cc80b0d20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 --2- 172.21.15.50:0/810288402 >> v2:172.21.15.170:3300/0 conn(0x7f8cc815d4f0 0x7f8cc80b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 -- 172.21.15.50:0/810288402 >> 172.21.15.50:0/810288402 conn(0x7f8cc80d0e00 msgr2=0x7f8cc80d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 -- 172.21.15.50:0/810288402 shutdown_connections 2023-12-08T08:18:43.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.848+0000 7f8ccf489640 1 -- 172.21.15.50:0/810288402 wait complete. 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.849+0000 7f8ccf489640 1 Processor -- start 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.849+0000 7f8ccf489640 1 -- start start 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccf489640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80adb50 0x7f8cc81f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccf489640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80b0920 0x7f8cc80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccf489640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc815d4f0 0x7f8cc80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccf489640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80cc920 con 0x7f8cc80adb50 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccf489640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80ccdb0 con 0x7f8cc815d4f0 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccf489640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80cbd10 con 0x7f8cc80b0920 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80adb50 0x7f8cc81f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80adb50 0x7f8cc81f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41482/0 (socket says 172.21.15.50:41482) 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 -- 172.21.15.50:0/3238524290 learned_addr learned my addr 172.21.15.50:0/3238524290 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccda26640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc815d4f0 0x7f8cc80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccca24640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80b0920 0x7f8cc80cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 -- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80b0920 msgr2=0x7f8cc80cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80b0920 0x7f8cc80cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 -- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc815d4f0 msgr2=0x7f8cc80c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc815d4f0 0x7f8cc80c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccd225640 1 -- 172.21.15.50:0/3238524290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80094d0 con 0x7f8cc80adb50 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.850+0000 7f8ccda26640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc815d4f0 0x7f8cc80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.851+0000 7f8ccd225640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80adb50 0x7f8cc81f59d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400e870 tx=0x7f8cc400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.851+0000 7f8cbdffb640 1 -- 172.21.15.50:0/3238524290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40094f0 con 0x7f8cc80adb50 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.851+0000 7f8cbdffb640 1 -- 172.21.15.50:0/3238524290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc400c940 con 0x7f8cc80adb50 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.851+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc80cbff0 con 0x7f8cc80adb50 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.851+0000 7f8cbdffb640 1 -- 172.21.15.50:0/3238524290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400ccf0 con 0x7f8cc80adb50 2023-12-08T08:18:43.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.851+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc80cc5b0 con 0x7f8cc80adb50 2023-12-08T08:18:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.852+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc8067430 con 0x7f8cc80adb50 2023-12-08T08:18:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.852+0000 7f8cbdffb640 1 -- 172.21.15.50:0/3238524290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cc4013470 con 0x7f8cc80adb50 2023-12-08T08:18:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.853+0000 7f8cbdffb640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8cac06ae40 0x7f8cac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.853+0000 7f8cbdffb640 1 -- 172.21.15.50:0/3238524290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8cc4089ab0 con 0x7f8cc80adb50 2023-12-08T08:18:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.853+0000 7f8ccca24640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8cac06ae40 0x7f8cac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:43.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.854+0000 7f8ccca24640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8cac06ae40 0x7f8cac06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8036000 tx=0x7f8cb803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:43.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:43.857+0000 7f8cbdffb640 1 -- 172.21.15.50:0/3238524290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cc4054780 con 0x7f8cc80adb50 2023-12-08T08:18:44.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.034+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cc806bdd0 con 0x7f8cc80adb50 2023-12-08T08:18:44.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.034+0000 7f8cbdffb640 1 -- 172.21.15.50:0/3238524290 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cc40210a0 con 0x7f8cc80adb50 2023-12-08T08:18:44.037 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8cac06ae40 msgr2=0x7f8cac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8cac06ae40 0x7f8cac06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8036000 tx=0x7f8cb803c040 comp rx=0 tx=0).stop 2023-12-08T08:18:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80adb50 msgr2=0x7f8cc81f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80adb50 0x7f8cc81f59d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400e870 tx=0x7f8cc400ed30 comp rx=0 tx=0).stop 2023-12-08T08:18:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 shutdown_connections 2023-12-08T08:18:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8cac06ae40 0x7f8cac06d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8cc815d4f0 0x7f8cc80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8cc80b0920 0x7f8cc80cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 --2- 172.21.15.50:0/3238524290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cc80adb50 0x7f8cc81f59d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 >> 172.21.15.50:0/3238524290 conn(0x7f8cc80d0e00 msgr2=0x7f8cc815f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 shutdown_connections 2023-12-08T08:18:44.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.036+0000 7f8ccf489640 1 -- 172.21.15.50:0/3238524290 wait complete. 2023-12-08T08:18:44.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.158+0000 7f479850c640 1 Processor -- start 2023-12-08T08:18:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.158+0000 7f479850c640 1 -- start start 2023-12-08T08:18:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f479850c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 0x7f47900ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f479850c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f47900cebc0 0x7f47900cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f479850c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47900b5f00 con 0x7f47900cfab0 2023-12-08T08:18:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f479850c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900cff40 con 0x7f47900cebc0 2023-12-08T08:18:44.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f479850c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47900b6170 con 0x7f47900b8950 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f4796aa9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f47900cfab0 0x7f47900d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36624/0 (socket says 172.21.15.50:36624) 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f4796aa9640 1 -- 172.21.15.50:0/3863423439 learned_addr learned my addr 172.21.15.50:0/3863423439 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47962a8640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 0x7f47900ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f4795aa7640 1 --2- 172.21.15.50:0/3863423439 >> v2:172.21.15.170:3300/0 conn(0x7f47900cebc0 0x7f47900cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801352554 0 0) 0x7f47900b5f00 con 0x7f47900cfab0 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f477c003520 con 0x7f47900cfab0 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360620454 0 0) 0x7f477c003520 con 0x7f47900cfab0 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 msgr2=0x7f47900ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 0x7f47900ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 >> v2:172.21.15.170:3300/0 conn(0x7f47900cebc0 msgr2=0x7f47900cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 --2- 172.21.15.50:0/3863423439 >> v2:172.21.15.170:3300/0 conn(0x7f47900cebc0 0x7f47900cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900b6450 con 0x7f47900cfab0 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f47880019f0 con 0x7f47900cfab0 2023-12-08T08:18:44.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47962a8640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 0x7f47900ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f4795aa7640 1 --2- 172.21.15.50:0/3863423439 >> v2:172.21.15.170:3300/0 conn(0x7f47900cebc0 0x7f47900cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 >> v1:172.21.15.50:6789/0 conn(0x7f47900cfab0 legacy=0x7f47900d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c003970 0x7f477c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 0x7f477c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f477c004d00 0x7f477c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900cff40 con 0x7f477c004d00 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900b6170 con 0x7f477c003970 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.159+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c00b980 con 0x7f47900b8950 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f4796aa9640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f477c004d00 0x7f477c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f47962a8640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c003970 0x7f477c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f4795aa7640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 0x7f477c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f4796aa9640 1 -- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 msgr2=0x7f477c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f4796aa9640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47900b8950 0x7f477c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f4796aa9640 1 -- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c003970 msgr2=0x7f477c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f4796aa9640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c003970 0x7f477c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.160+0000 7f4796aa9640 1 -- 172.21.15.50:0/3863423439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009400 con 0x7f477c004d00 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f4796aa9640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f477c004d00 0x7f477c005180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f478800a830 tx=0x7f477c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a337ec324c0a9110 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788034630 con 0x7f477c004d00 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478802f070 con 0x7f477c004d00 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f47952a6640 1 -- 172.21.15.50:0/3863423439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880349f0 con 0x7f477c004d00 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f479850c640 1 -- 172.21.15.50:0/3863423439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f477c004d00 msgr2=0x7f477c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f479850c640 1 --2- 172.21.15.50:0/3863423439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f477c004d00 0x7f477c005180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f478800a830 tx=0x7f477c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f4796aa9640 1 -- 172.21.15.50:0/3863423439 reap_dead start 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f479850c640 1 -- 172.21.15.50:0/3863423439 shutdown_connections 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f479850c640 1 -- 172.21.15.50:0/3863423439 >> 172.21.15.50:0/3863423439 conn(0x7f47900d3010 msgr2=0x7f47900d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f479850c640 1 -- 172.21.15.50:0/3863423439 shutdown_connections 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.161+0000 7f479850c640 1 -- 172.21.15.50:0/3863423439 wait complete. 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 Processor -- start 2023-12-08T08:18:44.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 -- start start 2023-12-08T08:18:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c004d00 0x7f4790151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47900cc350 0x7f479009eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f479009eff0 0x7f479006c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479009f4b0 con 0x7f47900cc350 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479009f790 con 0x7f477c004d00 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f479850c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479009fa70 con 0x7f479009eff0 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f4795aa7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47900cc350 0x7f479009eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.163+0000 7f4795aa7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47900cc350 0x7f479009eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41496/0 (socket says 172.21.15.50:41496) 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4795aa7640 1 -- 172.21.15.50:0/3000613963 learned_addr learned my addr 172.21.15.50:0/3000613963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4796aa9640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f479009eff0 0x7f479006c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f47962a8640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c004d00 0x7f4790151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4795aa7640 1 -- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f479009eff0 msgr2=0x7f479006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4795aa7640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f479009eff0 0x7f479006c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4795aa7640 1 -- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c004d00 msgr2=0x7f4790151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4795aa7640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c004d00 0x7f4790151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4795aa7640 1 -- 172.21.15.50:0/3000613963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479009fd50 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4795aa7640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47900cc350 0x7f479009eab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4780011cd0 tx=0x7f478000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4786ffd640 1 -- 172.21.15.50:0/3000613963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000fd20 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4786ffd640 1 -- 172.21.15.50:0/3000613963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000fe80 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47900a0030 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f4786ffd640 1 -- 172.21.15.50:0/3000613963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780004250 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.164+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479006c580 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.165+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4790067430 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.166+0000 7f4786ffd640 1 -- 172.21.15.50:0/3000613963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47800043b0 con 0x7f47900cc350 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.166+0000 7f4786ffd640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f477406ae40 0x7f477406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.166+0000 7f4786ffd640 1 -- 172.21.15.50:0/3000613963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f478008a580 con 0x7f47900cc350 2023-12-08T08:18:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.166+0000 7f47962a8640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f477406ae40 0x7f477406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.167+0000 7f47962a8640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f477406ae40 0x7f477406d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47900cc270 tx=0x7f478c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.170+0000 7f4786ffd640 1 -- 172.21.15.50:0/3000613963 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4780055250 con 0x7f47900cc350 2023-12-08T08:18:44.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.347+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47900a01c0 con 0x7f47900cc350 2023-12-08T08:18:44.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.347+0000 7f4786ffd640 1 -- 172.21.15.50:0/3000613963 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4780058870 con 0x7f47900cc350 2023-12-08T08:18:44.350 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f477406ae40 msgr2=0x7f477406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f477406ae40 0x7f477406d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f47900cc270 tx=0x7f478c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47900cc350 msgr2=0x7f479009eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47900cc350 0x7f479009eab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4780011cd0 tx=0x7f478000f610 comp rx=0 tx=0).stop 2023-12-08T08:18:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 shutdown_connections 2023-12-08T08:18:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f477406ae40 0x7f477406d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47900cc350 0x7f479009eab0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f479009eff0 0x7f479006c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 --2- 172.21.15.50:0/3000613963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f477c004d00 0x7f4790151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 >> 172.21.15.50:0/3000613963 conn(0x7f47900d3010 msgr2=0x7f47900c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 shutdown_connections 2023-12-08T08:18:44.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.349+0000 7f479850c640 1 -- 172.21.15.50:0/3000613963 wait complete. 2023-12-08T08:18:44.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:44.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.472+0000 7f0a579a9640 1 Processor -- start 2023-12-08T08:18:44.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.472+0000 7f0a579a9640 1 -- start start 2023-12-08T08:18:44.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a579a9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a500cfa80 0x7f0a500d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a579a9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0a500b6bf0 0x7f0a500b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a579a9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500b5ec0 con 0x7f0a500ce690 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a579a9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500cede0 con 0x7f0a500cfa80 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a579a9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500b6110 con 0x7f0a500b6bf0 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55745640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a500cfa80 0x7f0a500d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a54f44640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a500ce690 0x7f0a500cfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36636/0 (socket says 172.21.15.50:36636) 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55745640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a500cfa80 0x7f0a500d3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41498/0 (socket says 172.21.15.50:41498) 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55745640 1 -- 172.21.15.50:0/2461812756 learned_addr learned my addr 172.21.15.50:0/2461812756 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55f46640 1 --2- 172.21.15.50:0/2461812756 >> v2:172.21.15.170:3300/0 conn(0x7f0a500b6bf0 0x7f0a500b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55745640 1 -- 172.21.15.50:0/2461812756 >> v2:172.21.15.170:3300/0 conn(0x7f0a500b6bf0 msgr2=0x7f0a500b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55745640 1 --2- 172.21.15.50:0/2461812756 >> v2:172.21.15.170:3300/0 conn(0x7f0a500b6bf0 0x7f0a500b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55745640 1 -- 172.21.15.50:0/2461812756 >> v1:172.21.15.50:6789/0 conn(0x7f0a500ce690 legacy=0x7f0a500cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.473+0000 7f0a55745640 1 -- 172.21.15.50:0/2461812756 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500b63f0 con 0x7f0a500cfa80 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.474+0000 7f0a55745640 1 --2- 172.21.15.50:0/2461812756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500cfa80 0x7f0a500d3b80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0a500cd650 tx=0x7f0a4c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bd01828c6aec5e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.474+0000 7f0a47fff640 1 -- 172.21.15.50:0/2461812756 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c031870 con 0x7f0a500cfa80 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.474+0000 7f0a47fff640 1 -- 172.21.15.50:0/2461812756 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c0319d0 con 0x7f0a500cfa80 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.474+0000 7f0a47fff640 1 -- 172.21.15.50:0/2461812756 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c031d60 con 0x7f0a500cfa80 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 -- 172.21.15.50:0/2461812756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500cfa80 msgr2=0x7f0a500d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 --2- 172.21.15.50:0/2461812756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500cfa80 0x7f0a500d3b80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0a500cd650 tx=0x7f0a4c02b910 comp rx=0 tx=0).stop 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 -- 172.21.15.50:0/2461812756 shutdown_connections 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 --2- 172.21.15.50:0/2461812756 >> v2:172.21.15.170:3300/0 conn(0x7f0a500b6bf0 0x7f0a500b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 --2- 172.21.15.50:0/2461812756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500cfa80 0x7f0a500d3b80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 -- 172.21.15.50:0/2461812756 >> 172.21.15.50:0/2461812756 conn(0x7f0a5009c340 msgr2=0x7f0a500d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 -- 172.21.15.50:0/2461812756 shutdown_connections 2023-12-08T08:18:44.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.475+0000 7f0a579a9640 1 -- 172.21.15.50:0/2461812756 wait complete. 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.476+0000 7f0a579a9640 1 Processor -- start 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.476+0000 7f0a579a9640 1 -- start start 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a579a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a500b6bf0 0x7f0a5015bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a579a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500ce690 0x7f0a500b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a579a9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a500cfa80 0x7f0a500c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a579a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500b3120 con 0x7f0a500ce690 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a579a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500b2550 con 0x7f0a500b6bf0 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a579a9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501f75a0 con 0x7f0a500cfa80 2023-12-08T08:18:44.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500ce690 0x7f0a500b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500ce690 0x7f0a500b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41504/0 (socket says 172.21.15.50:41504) 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 -- 172.21.15.50:0/268799461 learned_addr learned my addr 172.21.15.50:0/268799461 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a55f46640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a500cfa80 0x7f0a500c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a55745640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a500b6bf0 0x7f0a5015bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 -- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a500cfa80 msgr2=0x7f0a500c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a500cfa80 0x7f0a500c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 -- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a500b6bf0 msgr2=0x7f0a5015bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a500b6bf0 0x7f0a5015bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 -- 172.21.15.50:0/268799461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c0094d0 con 0x7f0a500ce690 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.477+0000 7f0a54f44640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500ce690 0x7f0a500b3540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c4d0 tx=0x7f0a4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.478+0000 7f0a45ffb640 1 -- 172.21.15.50:0/268799461 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40007480 con 0x7f0a500ce690 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.478+0000 7f0a45ffb640 1 -- 172.21.15.50:0/268799461 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a400075e0 con 0x7f0a500ce690 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.478+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5015c090 con 0x7f0a500ce690 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.478+0000 7f0a45ffb640 1 -- 172.21.15.50:0/268799461 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400049e0 con 0x7f0a500ce690 2023-12-08T08:18:44.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.478+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a500b2a60 con 0x7f0a500ce690 2023-12-08T08:18:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.479+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a50067430 con 0x7f0a500ce690 2023-12-08T08:18:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.479+0000 7f0a45ffb640 1 -- 172.21.15.50:0/268799461 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a40004b40 con 0x7f0a500ce690 2023-12-08T08:18:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.479+0000 7f0a45ffb640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a3406ae40 0x7f0a3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.480+0000 7f0a45ffb640 1 -- 172.21.15.50:0/268799461 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0a40088ad0 con 0x7f0a500ce690 2023-12-08T08:18:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.480+0000 7f0a55745640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a3406ae40 0x7f0a3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.480+0000 7f0a55745640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a3406ae40 0x7f0a3406d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c036000 tx=0x7f0a4c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.484+0000 7f0a45ffb640 1 -- 172.21.15.50:0/268799461 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a40053850 con 0x7f0a500ce690 2023-12-08T08:18:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.658+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a500d2e50 con 0x7f0a500ce690 2023-12-08T08:18:44.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.659+0000 7f0a45ffb640 1 -- 172.21.15.50:0/268799461 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a40018020 con 0x7f0a500ce690 2023-12-08T08:18:44.661 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a3406ae40 msgr2=0x7f0a3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a3406ae40 0x7f0a3406d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c036000 tx=0x7f0a4c03c040 comp rx=0 tx=0).stop 2023-12-08T08:18:44.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500ce690 msgr2=0x7f0a500b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500ce690 0x7f0a500b3540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c4d0 tx=0x7f0a4000c990 comp rx=0 tx=0).stop 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 shutdown_connections 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a3406ae40 0x7f0a3406d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a500ce690 0x7f0a500b3540 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a500cfa80 0x7f0a500c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 --2- 172.21.15.50:0/268799461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a500b6bf0 0x7f0a5015bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 >> 172.21.15.50:0/268799461 conn(0x7f0a5009c340 msgr2=0x7f0a500d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 shutdown_connections 2023-12-08T08:18:44.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.661+0000 7f0a579a9640 1 -- 172.21.15.50:0/268799461 wait complete. 2023-12-08T08:18:44.674 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:44.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.781+0000 7f4989290640 1 Processor -- start 2023-12-08T08:18:44.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.781+0000 7f4989290640 1 -- start start 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f4989290640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f498415b100 0x7f4984071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f4989290640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498415f860 con 0x7f49840ceed0 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f4989290640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498415ec50 con 0x7f498406b4e0 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f4989290640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498415ef30 con 0x7f498415b100 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49837fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49840ceed0 0x7f498415bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36646/0 (socket says 172.21.15.50:36646) 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49837fe640 1 -- 172.21.15.50:0/3299594993 learned_addr learned my addr 172.21.15.50:0/3299594993 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f4982ffd640 1 --2- 172.21.15.50:0/3299594993 >> v2:172.21.15.170:3300/0 conn(0x7f498415b100 0x7f4984071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038738272 0 0) 0x7f498415f860 con 0x7f49840ceed0 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4970003520 con 0x7f49840ceed0 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026359721 0 0) 0x7f4970003520 con 0x7f49840ceed0 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 >> v2:172.21.15.170:3300/0 conn(0x7f498415b100 msgr2=0x7f4984071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 --2- 172.21.15.50:0/3299594993 >> v2:172.21.15.170:3300/0 conn(0x7f498415b100 0x7f4984071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 >> v1:172.21.15.170:6789/0 conn(0x7f498406b4e0 legacy=0x7f498415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498415f210 con 0x7f49840ceed0 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f497c0019f0 con 0x7f49840ceed0 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 >> v1:172.21.15.50:6789/0 conn(0x7f49840ceed0 legacy=0x7f498415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4970003970 0x7f4970003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49700047c0 0x7f4970004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.782+0000 7f49827fc640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970005180 0x7f497000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498415ef30 con 0x7f4970003970 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497000c020 con 0x7f4970005180 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497000c1e0 con 0x7f49700047c0 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f4982ffd640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4970003970 0x7f4970003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f497a7fc640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49700047c0 0x7f4970004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f49837fe640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970005180 0x7f497000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f4982ffd640 1 -- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49700047c0 msgr2=0x7f4970004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f4982ffd640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49700047c0 0x7f4970004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f4982ffd640 1 -- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970005180 msgr2=0x7f497000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f4982ffd640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970005180 0x7f497000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f4982ffd640 1 -- 172.21.15.50:0/3299594993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970003520 con 0x7f4970003970 2023-12-08T08:18:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.783+0000 7f49837fe640 1 -- 172.21.15.50:0/3299594993 reap_dead start 2023-12-08T08:18:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4982ffd640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4970003970 0x7f4970003d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4974009ac0 tx=0x7f49700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71fea7d843b6dee server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497402c6b0 con 0x7f4970003970 2023-12-08T08:18:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497402c810 con 0x7f4970003970 2023-12-08T08:18:44.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f49827fc640 1 -- 172.21.15.50:0/3299594993 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497402cba0 con 0x7f4970003970 2023-12-08T08:18:44.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4989290640 1 -- 172.21.15.50:0/3299594993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4970003970 msgr2=0x7f4970003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4989290640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4970003970 0x7f4970003d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4974009ac0 tx=0x7f49700057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4989290640 1 -- 172.21.15.50:0/3299594993 shutdown_connections 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4989290640 1 --2- 172.21.15.50:0/3299594993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4970003970 0x7f4970003d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4989290640 1 -- 172.21.15.50:0/3299594993 >> 172.21.15.50:0/3299594993 conn(0x7f4984070960 msgr2=0x7f4984070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4989290640 1 -- 172.21.15.50:0/3299594993 shutdown_connections 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.784+0000 7f4989290640 1 -- 172.21.15.50:0/3299594993 wait complete. 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.785+0000 7f4989290640 1 Processor -- start 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f4989290640 1 -- start start 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f4989290640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970003970 0x7f4984141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f4989290640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f498415e100 0x7f498415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f4989290640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f498415cb50 0x7f49840b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f4989290640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498415d060 con 0x7f498415cb50 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f4989290640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498415d340 con 0x7f4970003970 2023-12-08T08:18:44.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f4989290640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498415d620 con 0x7f498415e100 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f49837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f498415cb50 0x7f49840b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f49837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f498415cb50 0x7f49840b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41518/0 (socket says 172.21.15.50:41518) 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.786+0000 7f49837fe640 1 -- 172.21.15.50:0/1046307426 learned_addr learned my addr 172.21.15.50:0/1046307426 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f497a7fc640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f498415e100 0x7f498415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f4982ffd640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970003970 0x7f4984141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f49837fe640 1 -- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f498415e100 msgr2=0x7f498415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f49837fe640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f498415e100 0x7f498415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f49837fe640 1 -- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970003970 msgr2=0x7f4984141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f49837fe640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970003970 0x7f4984141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f49837fe640 1 -- 172.21.15.50:0/1046307426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498415d900 con 0x7f498415cb50 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f4982ffd640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970003970 0x7f4984141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f49837fe640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f498415cb50 0x7f49840b2600 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f497c0013d0 tx=0x7f497c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f497bfff640 1 -- 172.21.15.50:0/1046307426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c00ea80 con 0x7f498415cb50 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f497bfff640 1 -- 172.21.15.50:0/1046307426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c00ebe0 con 0x7f498415cb50 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498415dbe0 con 0x7f498415cb50 2023-12-08T08:18:44.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f497bfff640 1 -- 172.21.15.50:0/1046307426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c013420 con 0x7f498415cb50 2023-12-08T08:18:44.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.787+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498414d4f0 con 0x7f498415cb50 2023-12-08T08:18:44.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.788+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498415ddd0 con 0x7f498415cb50 2023-12-08T08:18:44.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.789+0000 7f497bfff640 1 -- 172.21.15.50:0/1046307426 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f497c013580 con 0x7f498415cb50 2023-12-08T08:18:44.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.789+0000 7f497bfff640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f496406ae40 0x7f496406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:44.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.789+0000 7f497bfff640 1 -- 172.21.15.50:0/1046307426 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f497c089d40 con 0x7f498415cb50 2023-12-08T08:18:44.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.789+0000 7f4982ffd640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f496406ae40 0x7f496406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:44.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.790+0000 7f4982ffd640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f496406ae40 0x7f496406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4974036000 tx=0x7f4974030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:44.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.793+0000 7f497bfff640 1 -- 172.21.15.50:0/1046307426 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f497c054980 con 0x7f498415cb50 2023-12-08T08:18:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.969+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4984067430 con 0x7f498415cb50 2023-12-08T08:18:44.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.970+0000 7f497bfff640 1 -- 172.21.15.50:0/1046307426 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f497c057fa0 con 0x7f498415cb50 2023-12-08T08:18:44.972 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f496406ae40 msgr2=0x7f496406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f496406ae40 0x7f496406d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4974036000 tx=0x7f4974030000 comp rx=0 tx=0).stop 2023-12-08T08:18:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f498415cb50 msgr2=0x7f49840b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:44.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f498415cb50 0x7f49840b2600 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f497c0013d0 tx=0x7f497c007bc0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 shutdown_connections 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f496406ae40 0x7f496406d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f498415cb50 0x7f49840b2600 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f498415e100 0x7f498415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 --2- 172.21.15.50:0/1046307426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4970003970 0x7f4984141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 >> 172.21.15.50:0/1046307426 conn(0x7f4984070960 msgr2=0x7f49840aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 shutdown_connections 2023-12-08T08:18:44.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:44.972+0000 7f4989290640 1 -- 172.21.15.50:0/1046307426 wait complete. 2023-12-08T08:18:44.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.092+0000 7faeefdde640 1 Processor -- start 2023-12-08T08:18:45.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.092+0000 7faeefdde640 1 -- start start 2023-12-08T08:18:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeefdde640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faee80cfb30 0x7faee80cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeefdde640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 0x7faee80cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeefdde640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80d02b0 con 0x7faee80b6ac0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeefdde640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee8160cb0 con 0x7faee80cfb30 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeefdde640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80cb430 con 0x7faee80cc1f0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeedb7a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faee80b6ac0 0x7faee80cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36654/0 (socket says 172.21.15.50:36654) 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeedb7a640 1 -- 172.21.15.50:0/1654841793 learned_addr learned my addr 172.21.15.50:0/1654841793 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126887059 0 0) 0x7faee80d02b0 con 0x7faee80b6ac0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeed379640 1 --2- 172.21.15.50:0/1654841793 >> v2:172.21.15.170:3300/0 conn(0x7faee80cfb30 0x7faee80cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed4003520 con 0x7faee80b6ac0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeee37b640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 0x7faee80cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 142365312 0 0) 0x7faed4003520 con 0x7faee80b6ac0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 msgr2=0x7faee80cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 0x7faee80cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 >> v2:172.21.15.170:3300/0 conn(0x7faee80cfb30 msgr2=0x7faee80cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 --2- 172.21.15.50:0/1654841793 >> v2:172.21.15.170:3300/0 conn(0x7faee80cfb30 0x7faee80cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.093+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80cb710 con 0x7faee80b6ac0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7faee4001690 con 0x7faee80b6ac0 2023-12-08T08:18:45.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 >> v1:172.21.15.50:6789/0 conn(0x7faee80b6ac0 legacy=0x7faee80cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 0x7faed4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed4003ef0 0x7faed40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faed4004d00 0x7faed4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee8160cb0 con 0x7faed4004d00 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80cb430 con 0x7faed4003ef0 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed400ba60 con 0x7faee80cc1f0 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeee37b640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faed4004d00 0x7faed4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeedb7a640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 0x7faed4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeed379640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed4003ef0 0x7faed40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeee37b640 1 -- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 msgr2=0x7faed4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeee37b640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee80cc1f0 0x7faed4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeee37b640 1 -- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed4003ef0 msgr2=0x7faed40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeee37b640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faed4003ef0 0x7faed40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.094+0000 7faeee37b640 1 -- 172.21.15.50:0/1654841793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4003520 con 0x7faed4004d00 2023-12-08T08:18:45.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.095+0000 7faeee37b640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faed4004d00 0x7faed4005180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faee0009fc0 tx=0x7faed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b725f56b5ef5ef server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.095+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee002cc20 con 0x7faed4004d00 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.095+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee000f040 con 0x7faed4004d00 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.095+0000 7faeecb78640 1 -- 172.21.15.50:0/1654841793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0034440 con 0x7faed4004d00 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.095+0000 7faeefdde640 1 -- 172.21.15.50:0/1654841793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faed4004d00 msgr2=0x7faed4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.095+0000 7faeefdde640 1 --2- 172.21.15.50:0/1654841793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faed4004d00 0x7faed4005180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faee0009fc0 tx=0x7faed40057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.095+0000 7faeee37b640 1 -- 172.21.15.50:0/1654841793 reap_dead start 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.096+0000 7faeefdde640 1 -- 172.21.15.50:0/1654841793 shutdown_connections 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.096+0000 7faeefdde640 1 -- 172.21.15.50:0/1654841793 >> 172.21.15.50:0/1654841793 conn(0x7faee80d0de0 msgr2=0x7faee80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.096+0000 7faeefdde640 1 -- 172.21.15.50:0/1654841793 shutdown_connections 2023-12-08T08:18:45.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.096+0000 7faeefdde640 1 -- 172.21.15.50:0/1654841793 wait complete. 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.097+0000 7faeefdde640 1 Processor -- start 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.097+0000 7faeefdde640 1 -- start start 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.097+0000 7faeefdde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee815d2d0 0x7faee80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeefdde640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee815d6b0 0x7faee81e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeefdde640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee80b58e0 0x7faee81e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeefdde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b43e0 con 0x7faee815d2d0 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeefdde640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b4eb0 con 0x7faee80b58e0 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeefdde640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b4610 con 0x7faee815d6b0 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee815d2d0 0x7faee80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee815d2d0 0x7faee80b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41548/0 (socket says 172.21.15.50:41548) 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 -- 172.21.15.50:0/3790543579 learned_addr learned my addr 172.21.15.50:0/3790543579 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeed379640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee815d6b0 0x7faee81e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeee37b640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee80b58e0 0x7faee81e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 -- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee815d6b0 msgr2=0x7faee81e7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee815d6b0 0x7faee81e7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 -- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee80b58e0 msgr2=0x7faee81e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee80b58e0 0x7faee81e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 -- 172.21.15.50:0/3790543579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80b48f0 con 0x7faee815d2d0 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeedb7a640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee815d2d0 0x7faee80b3ea0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faee40072e0 tx=0x7faee40076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faede7fc640 1 -- 172.21.15.50:0/3790543579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400f940 con 0x7faee815d2d0 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faede7fc640 1 -- 172.21.15.50:0/3790543579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400faa0 con 0x7faee815d2d0 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faede7fc640 1 -- 172.21.15.50:0/3790543579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400fe50 con 0x7faee815d2d0 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee80b4bd0 con 0x7faee815d2d0 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.098+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee81f6450 con 0x7faee815d2d0 2023-12-08T08:18:45.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.099+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee80c8190 con 0x7faee815d2d0 2023-12-08T08:18:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.100+0000 7faede7fc640 1 -- 172.21.15.50:0/3790543579 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faee401d460 con 0x7faee815d2d0 2023-12-08T08:18:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.100+0000 7faede7fc640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faecc06ae40 0x7faecc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.100+0000 7faede7fc640 1 -- 172.21.15.50:0/3790543579 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faee4089bc0 con 0x7faee815d2d0 2023-12-08T08:18:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.100+0000 7faeed379640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faecc06ae40 0x7faecc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.101+0000 7faeed379640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faecc06ae40 0x7faecc06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faee815daf0 tx=0x7faed8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.104+0000 7faede7fc640 1 -- 172.21.15.50:0/3790543579 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faee80c8190 con 0x7faee815d2d0 2023-12-08T08:18:45.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.280+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faee80c8190 con 0x7faee815d2d0 2023-12-08T08:18:45.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.282+0000 7faede7fc640 1 -- 172.21.15.50:0/3790543579 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7faee80c8190 con 0x7faee815d2d0 2023-12-08T08:18:45.284 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:45.284 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faecc06ae40 msgr2=0x7faecc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faecc06ae40 0x7faecc06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faee815daf0 tx=0x7faed8009190 comp rx=0 tx=0).stop 2023-12-08T08:18:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee815d2d0 msgr2=0x7faee80b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee815d2d0 0x7faee80b3ea0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faee40072e0 tx=0x7faee40076e0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 shutdown_connections 2023-12-08T08:18:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faecc06ae40 0x7faecc06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee80b58e0 0x7faee81e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faee815d6b0 0x7faee81e7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 --2- 172.21.15.50:0/3790543579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faee815d2d0 0x7faee80b3ea0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.283+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 >> 172.21.15.50:0/3790543579 conn(0x7faee80d0de0 msgr2=0x7faee80cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.284+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 shutdown_connections 2023-12-08T08:18:45.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.284+0000 7faeefdde640 1 -- 172.21.15.50:0/3790543579 wait complete. 2023-12-08T08:18:45.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:45.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:45.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.405+0000 7fb6b9b41640 1 Processor -- start 2023-12-08T08:18:45.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.405+0000 7fb6b9b41640 1 -- start start 2023-12-08T08:18:45.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.405+0000 7fb6b9b41640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6b40cfa80 0x7fb6b40d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.405+0000 7fb6b9b41640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb6b40ce690 0x7fb6b40cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.405+0000 7fb6b9b41640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b40b5ec0 con 0x7fb6b40d10f0 2023-12-08T08:18:45.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.405+0000 7fb6b9b41640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b40d03a0 con 0x7fb6b40cfa80 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.405+0000 7fb6b9b41640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b40cede0 con 0x7fb6b40ce690 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6b40cfa80 0x7fb6b40d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb6b40cfa80 0x7fb6b40d3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41550/0 (socket says 172.21.15.50:41550) 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b37fe640 1 -- 172.21.15.50:0/1621891155 learned_addr learned my addr 172.21.15.50:0/1621891155 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b2ffd640 1 --2- 172.21.15.50:0/1621891155 >> v2:172.21.15.170:3300/0 conn(0x7fb6b40ce690 0x7fb6b40cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b37fe640 1 -- 172.21.15.50:0/1621891155 >> v2:172.21.15.170:3300/0 conn(0x7fb6b40ce690 msgr2=0x7fb6b40cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b37fe640 1 --2- 172.21.15.50:0/1621891155 >> v2:172.21.15.170:3300/0 conn(0x7fb6b40ce690 0x7fb6b40cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b37fe640 1 -- 172.21.15.50:0/1621891155 >> v1:172.21.15.170:6789/0 conn(0x7fb6b40d10f0 legacy=0x7fb6b40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.406+0000 7fb6b37fe640 1 -- 172.21.15.50:0/1621891155 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40b6110 con 0x7fb6b40cfa80 2023-12-08T08:18:45.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b37fe640 1 --2- 172.21.15.50:0/1621891155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b40d3b80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6b408bc30 tx=0x7fb6a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c44a27f4b1f691 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b27fc640 1 -- 172.21.15.50:0/1621891155 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4031870 con 0x7fb6b40cfa80 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b27fc640 1 -- 172.21.15.50:0/1621891155 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a40319d0 con 0x7fb6b40cfa80 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b27fc640 1 -- 172.21.15.50:0/1621891155 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4031d60 con 0x7fb6b40cfa80 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 -- 172.21.15.50:0/1621891155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 msgr2=0x7fb6b40d3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/1621891155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b40d3b80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6b408bc30 tx=0x7fb6a402b910 comp rx=0 tx=0).stop 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 -- 172.21.15.50:0/1621891155 shutdown_connections 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/1621891155 >> v2:172.21.15.170:3300/0 conn(0x7fb6b40ce690 0x7fb6b40cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/1621891155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b40d3b80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 -- 172.21.15.50:0/1621891155 >> 172.21.15.50:0/1621891155 conn(0x7fb6b409c340 msgr2=0x7fb6b40d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 -- 172.21.15.50:0/1621891155 shutdown_connections 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.407+0000 7fb6b9b41640 1 -- 172.21.15.50:0/1621891155 wait complete. 2023-12-08T08:18:45.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.408+0000 7fb6b9b41640 1 Processor -- start 2023-12-08T08:18:45.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b9b41640 1 -- start start 2023-12-08T08:18:45.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b9b41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b40ce690 0x7fb6b4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b9b41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b9b41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b40d10f0 0x7fb6b415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b9b41640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b41565a0 con 0x7fb6b40cfa80 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b9b41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b40c85b0 con 0x7fb6b40ce690 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b9b41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b40c8890 con 0x7fb6b40d10f0 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.409+0000 7fb6b2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b415b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41562/0 (socket says 172.21.15.50:41562) 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 -- 172.21.15.50:0/2540465332 learned_addr learned my addr 172.21.15.50:0/2540465332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b37fe640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b40ce690 0x7fb6b4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b3fff640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b40d10f0 0x7fb6b415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 -- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b40d10f0 msgr2=0x7fb6b415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b40d10f0 0x7fb6b415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 -- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b40ce690 msgr2=0x7fb6b4156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b40ce690 0x7fb6b4156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 -- 172.21.15.50:0/2540465332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40094d0 con 0x7fb6b40cfa80 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b3fff640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b40d10f0 0x7fb6b415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b2ffd640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b415b3e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800e870 tx=0x7fb6a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb69bfff640 1 -- 172.21.15.50:0/2540465332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80094f0 con 0x7fb6b40cfa80 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb69bfff640 1 -- 172.21.15.50:0/2540465332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a800c940 con 0x7fb6b40cfa80 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb69bfff640 1 -- 172.21.15.50:0/2540465332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a800ccf0 con 0x7fb6b40cfa80 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b40c8b70 con 0x7fb6b40cfa80 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.410+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b40c9130 con 0x7fb6b40cfa80 2023-12-08T08:18:45.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.411+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b4067430 con 0x7fb6b40cfa80 2023-12-08T08:18:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.412+0000 7fb69bfff640 1 -- 172.21.15.50:0/2540465332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6a8013470 con 0x7fb6b40cfa80 2023-12-08T08:18:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.412+0000 7fb69bfff640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6a006ae40 0x7fb6a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.412+0000 7fb69bfff640 1 -- 172.21.15.50:0/2540465332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb6a8089aa0 con 0x7fb6b40cfa80 2023-12-08T08:18:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.412+0000 7fb6b37fe640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6a006ae40 0x7fb6a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.413+0000 7fb6b37fe640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6a006ae40 0x7fb6a006d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4036000 tx=0x7fb6a403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.416+0000 7fb69bfff640 1 -- 172.21.15.50:0/2540465332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6a8054770 con 0x7fb6b40cfa80 2023-12-08T08:18:45.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.592+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6b40d2e50 con 0x7fb6b40cfa80 2023-12-08T08:18:45.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.592+0000 7fb69bfff640 1 -- 172.21.15.50:0/2540465332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6a8057d90 con 0x7fb6b40cfa80 2023-12-08T08:18:45.595 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6a006ae40 msgr2=0x7fb6a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6a006ae40 0x7fb6a006d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4036000 tx=0x7fb6a403c040 comp rx=0 tx=0).stop 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 msgr2=0x7fb6b415b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b415b3e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800e870 tx=0x7fb6a800ed30 comp rx=0 tx=0).stop 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 shutdown_connections 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6a006ae40 0x7fb6a006d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6b40cfa80 0x7fb6b415b3e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6b40d10f0 0x7fb6b415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 --2- 172.21.15.50:0/2540465332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6b40ce690 0x7fb6b4156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 >> 172.21.15.50:0/2540465332 conn(0x7fb6b409c340 msgr2=0x7fb6b406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 shutdown_connections 2023-12-08T08:18:45.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.594+0000 7fb6b9b41640 1 -- 172.21.15.50:0/2540465332 wait complete. 2023-12-08T08:18:45.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.714+0000 7fc526b25640 1 Processor -- start 2023-12-08T08:18:45.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.714+0000 7fc526b25640 1 -- start start 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc526b25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200b8950 0x7fc5200ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc526b25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc5200cebc0 0x7fc5200cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc526b25640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5200b5f00 con 0x7fc5200cfab0 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc526b25640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200cff40 con 0x7fc5200cebc0 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc526b25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200b6170 con 0x7fc5200b8950 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc5248c1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200b8950 0x7fc5200ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc51ffff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc5200cebc0 0x7fc5200cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc5250c2640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc5200cfab0 0x7fc5200d0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49812/0 (socket says 172.21.15.50:49812) 2023-12-08T08:18:45.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc5248c1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200b8950 0x7fc5200ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:51856/0 (socket says 172.21.15.50:51856) 2023-12-08T08:18:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.715+0000 7fc5250c2640 1 -- 172.21.15.50:0/4141529232 learned_addr learned my addr 172.21.15.50:0/4141529232 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.716+0000 7fc51ffff640 1 -- 172.21.15.50:0/4141529232 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200b8950 msgr2=0x7fc5200ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.716+0000 7fc51ffff640 1 --2- 172.21.15.50:0/4141529232 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200b8950 0x7fc5200ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.716+0000 7fc51ffff640 1 -- 172.21.15.50:0/4141529232 >> v1:172.21.15.170:6789/0 conn(0x7fc5200cfab0 legacy=0x7fc5200d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.716+0000 7fc51ffff640 1 -- 172.21.15.50:0/4141529232 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200b6450 con 0x7fc5200cebc0 2023-12-08T08:18:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc51ffff640 1 --2- 172.21.15.50:0/4141529232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 0x7fc5200cf570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce401bf06cd78912 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc51f7fe640 1 -- 172.21.15.50:0/4141529232 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51402e070 con 0x7fc5200cebc0 2023-12-08T08:18:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc51f7fe640 1 -- 172.21.15.50:0/4141529232 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140315a0 con 0x7fc5200cebc0 2023-12-08T08:18:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc51f7fe640 1 -- 172.21.15.50:0/4141529232 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514031930 con 0x7fc5200cebc0 2023-12-08T08:18:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 -- 172.21.15.50:0/4141529232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 msgr2=0x7fc5200cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 --2- 172.21.15.50:0/4141529232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 0x7fc5200cf570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc5140097a0 tx=0x7fc51402b840 comp rx=0 tx=0).stop 2023-12-08T08:18:45.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 -- 172.21.15.50:0/4141529232 shutdown_connections 2023-12-08T08:18:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 --2- 172.21.15.50:0/4141529232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 0x7fc5200cf570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 --2- 172.21.15.50:0/4141529232 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200b8950 0x7fc5200ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 -- 172.21.15.50:0/4141529232 >> 172.21.15.50:0/4141529232 conn(0x7fc5200d3010 msgr2=0x7fc5200d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 -- 172.21.15.50:0/4141529232 shutdown_connections 2023-12-08T08:18:45.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.717+0000 7fc526b25640 1 -- 172.21.15.50:0/4141529232 wait complete. 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.718+0000 7fc526b25640 1 Processor -- start 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.719+0000 7fc526b25640 1 -- start start 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.719+0000 7fc526b25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5200b8950 0x7fc52015f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.719+0000 7fc526b25640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 0x7fc5200c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.719+0000 7fc526b25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200cfab0 0x7fc5200c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.719+0000 7fc526b25640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52015f8d0 con 0x7fc5200b8950 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.719+0000 7fc526b25640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c8c10 con 0x7fc5200cebc0 2023-12-08T08:18:45.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.719+0000 7fc526b25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5200c8ef0 con 0x7fc5200cfab0 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5200b8950 0x7fc52015f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5200b8950 0x7fc52015f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41578/0 (socket says 172.21.15.50:41578) 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 -- 172.21.15.50:0/1999743563 learned_addr learned my addr 172.21.15.50:0/1999743563 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5250c2640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200cfab0 0x7fc5200c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc51ffff640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 0x7fc5200c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 -- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200cfab0 msgr2=0x7fc5200c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200cfab0 0x7fc5200c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 -- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 msgr2=0x7fc5200c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 0x7fc5200c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 -- 172.21.15.50:0/1999743563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514009400 con 0x7fc5200b8950 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc5248c1640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5200b8950 0x7fc52015f390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e9e0 tx=0x7fc51000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc51d7fa640 1 -- 172.21.15.50:0/1999743563 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510009670 con 0x7fc5200b8950 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc51d7fa640 1 -- 172.21.15.50:0/1999743563 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51000c9d0 con 0x7fc5200b8950 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5200c7010 con 0x7fc5200b8950 2023-12-08T08:18:45.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc51d7fa640 1 -- 172.21.15.50:0/1999743563 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51000cd80 con 0x7fc5200b8950 2023-12-08T08:18:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.720+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200c75d0 con 0x7fc5200b8950 2023-12-08T08:18:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.721+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52008b150 con 0x7fc5200b8950 2023-12-08T08:18:45.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.722+0000 7fc51d7fa640 1 -- 172.21.15.50:0/1999743563 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc510013470 con 0x7fc5200b8950 2023-12-08T08:18:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.722+0000 7fc51d7fa640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc50c06ae40 0x7fc50c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.722+0000 7fc51d7fa640 1 -- 172.21.15.50:0/1999743563 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc510089a90 con 0x7fc5200b8950 2023-12-08T08:18:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.722+0000 7fc51ffff640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc50c06ae40 0x7fc50c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:45.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.723+0000 7fc51ffff640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc50c06ae40 0x7fc50c06d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc514036000 tx=0x7fc51403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:45.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.726+0000 7fc51d7fa640 1 -- 172.21.15.50:0/1999743563 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5100548a0 con 0x7fc5200b8950 2023-12-08T08:18:45.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.906+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc520067430 con 0x7fc5200b8950 2023-12-08T08:18:45.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.906+0000 7fc51d7fa640 1 -- 172.21.15.50:0/1999743563 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc510057ec0 con 0x7fc5200b8950 2023-12-08T08:18:45.909 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc50c06ae40 msgr2=0x7fc50c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc50c06ae40 0x7fc50c06d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc514036000 tx=0x7fc51403d040 comp rx=0 tx=0).stop 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5200b8950 msgr2=0x7fc52015f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5200b8950 0x7fc52015f390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e9e0 tx=0x7fc51000eea0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 shutdown_connections 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc50c06ae40 0x7fc50c06d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5200cfab0 0x7fc5200c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5200cebc0 0x7fc5200c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 --2- 172.21.15.50:0/1999743563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc5200b8950 0x7fc52015f390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 >> 172.21.15.50:0/1999743563 conn(0x7fc5200d3010 msgr2=0x7fc5201605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 shutdown_connections 2023-12-08T08:18:45.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:45.908+0000 7fc526b25640 1 -- 172.21.15.50:0/1999743563 wait complete. 2023-12-08T08:18:45.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.030+0000 7f92a1f89640 1 Processor -- start 2023-12-08T08:18:46.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.030+0000 7f92a1f89640 1 -- start start 2023-12-08T08:18:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f92a1f89640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f929c15b430 0x7f929c0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f92a1f89640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f929c0cfae0 0x7f929c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f92a1f89640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0b1080 con 0x7f929c0cd490 2023-12-08T08:18:46.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f92a1f89640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0ce7d0 con 0x7f929c0cfae0 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f92a1f89640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0cb970 con 0x7f929c15b430 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f929bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f929c0cfae0 0x7f929c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f929bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f929c0cfae0 0x7f929c0cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41594/0 (socket says 172.21.15.50:41594) 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.031+0000 7f929bfff640 1 -- 172.21.15.50:0/1413386109 learned_addr learned my addr 172.21.15.50:0/1413386109 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.032+0000 7f929bfff640 1 -- 172.21.15.50:0/1413386109 >> v2:172.21.15.170:3300/0 conn(0x7f929c15b430 msgr2=0x7f929c0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.032+0000 7f929b7fe640 1 --2- 172.21.15.50:0/1413386109 >> v2:172.21.15.170:3300/0 conn(0x7f929c15b430 0x7f929c0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.032+0000 7f929bfff640 1 --2- 172.21.15.50:0/1413386109 >> v2:172.21.15.170:3300/0 conn(0x7f929c15b430 0x7f929c0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.032+0000 7f929bfff640 1 -- 172.21.15.50:0/1413386109 >> v1:172.21.15.170:6789/0 conn(0x7f929c0cd490 legacy=0x7f929c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.032+0000 7f929bfff640 1 -- 172.21.15.50:0/1413386109 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0cdf30 con 0x7f929c0cfae0 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.032+0000 7f929b7fe640 1 --2- 172.21.15.50:0/1413386109 >> v2:172.21.15.170:3300/0 conn(0x7f929c15b430 0x7f929c0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:46.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.032+0000 7f929bfff640 1 --2- 172.21.15.50:0/1413386109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0cfae0 0x7f929c0cd920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f929c074720 tx=0x7f929402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd485b28bdcd18c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f929a7fc640 1 -- 172.21.15.50:0/1413386109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929402cb20 con 0x7f929c0cfae0 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f929a7fc640 1 -- 172.21.15.50:0/1413386109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929402cc80 con 0x7f929c0cfae0 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f929a7fc640 1 -- 172.21.15.50:0/1413386109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92940343f0 con 0x7f929c0cfae0 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 -- 172.21.15.50:0/1413386109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0cfae0 msgr2=0x7f929c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 --2- 172.21.15.50:0/1413386109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0cfae0 0x7f929c0cd920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f929c074720 tx=0x7f929402bf80 comp rx=0 tx=0).stop 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 -- 172.21.15.50:0/1413386109 shutdown_connections 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 --2- 172.21.15.50:0/1413386109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c0cfae0 0x7f929c0cd920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 --2- 172.21.15.50:0/1413386109 >> v2:172.21.15.170:3300/0 conn(0x7f929c15b430 0x7f929c0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 -- 172.21.15.50:0/1413386109 >> 172.21.15.50:0/1413386109 conn(0x7f929c099a10 msgr2=0x7f929c099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 -- 172.21.15.50:0/1413386109 shutdown_connections 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.033+0000 7f92a1f89640 1 -- 172.21.15.50:0/1413386109 wait complete. 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.034+0000 7f92a1f89640 1 Processor -- start 2023-12-08T08:18:46.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f92a1f89640 1 -- start start 2023-12-08T08:18:46.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f92a1f89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f929c0cd490 0x7f929c159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f92a1f89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f929c0cfae0 0x7f929c0c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f92a1f89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c15b430 0x7f929c158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f92a1f89640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b5c20 con 0x7f929c15b430 2023-12-08T08:18:46.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f92a1f89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b5f00 con 0x7f929c0cd490 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f92a1f89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b61e0 con 0x7f929c0cfae0 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f929bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c15b430 0x7f929c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f929bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c15b430 0x7f929c158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41608/0 (socket says 172.21.15.50:41608) 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.035+0000 7f929bfff640 1 -- 172.21.15.50:0/3204178025 learned_addr learned my addr 172.21.15.50:0/3204178025 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f929bfff640 1 -- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f929c0cfae0 msgr2=0x7f929c0c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f929bfff640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f929c0cfae0 0x7f929c0c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f929bfff640 1 -- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f929c0cd490 msgr2=0x7f929c159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f929b7fe640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f929c0cd490 0x7f929c159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f929bfff640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f929c0cd490 0x7f929c159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f929bfff640 1 -- 172.21.15.50:0/3204178025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009b30 con 0x7f929c15b430 2023-12-08T08:18:46.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f929bfff640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c15b430 0x7f929c158020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9294036040 tx=0x7f9294004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f9283fff640 1 -- 172.21.15.50:0/3204178025 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294009510 con 0x7f929c15b430 2023-12-08T08:18:46.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f9283fff640 1 -- 172.21.15.50:0/3204178025 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294007e50 con 0x7f929c15b430 2023-12-08T08:18:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c0b64c0 con 0x7f929c15b430 2023-12-08T08:18:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f9283fff640 1 -- 172.21.15.50:0/3204178025 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929403e690 con 0x7f929c15b430 2023-12-08T08:18:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.036+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c159b50 con 0x7f929c15b430 2023-12-08T08:18:46.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.037+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c067ad0 con 0x7f929c15b430 2023-12-08T08:18:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.037+0000 7f9283fff640 1 -- 172.21.15.50:0/3204178025 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f929403e7f0 con 0x7f929c15b430 2023-12-08T08:18:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.038+0000 7f9283fff640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f928806ae70 0x7f928806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.038+0000 7f9283fff640 1 -- 172.21.15.50:0/3204178025 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f92940ac3f0 con 0x7f929c15b430 2023-12-08T08:18:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.038+0000 7f929b7fe640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f928806ae70 0x7f928806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.039+0000 7f929b7fe640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f928806ae70 0x7f928806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f928c008850 tx=0x7f928c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.042+0000 7f9283fff640 1 -- 172.21.15.50:0/3204178025 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92940770c0 con 0x7f929c15b430 2023-12-08T08:18:46.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.217+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f929c0cf1b0 con 0x7f929c15b430 2023-12-08T08:18:46.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.218+0000 7f9283fff640 1 -- 172.21.15.50:0/3204178025 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f929407a6e0 con 0x7f929c15b430 2023-12-08T08:18:46.220 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:46.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f928806ae70 msgr2=0x7f928806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f928806ae70 0x7f928806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f928c008850 tx=0x7f928c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:46.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c15b430 msgr2=0x7f929c158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c15b430 0x7f929c158020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9294036040 tx=0x7f9294004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 shutdown_connections 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f928806ae70 0x7f928806d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f929c15b430 0x7f929c158020 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f929c0cfae0 0x7f929c0c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 --2- 172.21.15.50:0/3204178025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f929c0cd490 0x7f929c159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 >> 172.21.15.50:0/3204178025 conn(0x7f929c099a10 msgr2=0x7f929c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 shutdown_connections 2023-12-08T08:18:46.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.220+0000 7f92a1f89640 1 -- 172.21.15.50:0/3204178025 wait complete. 2023-12-08T08:18:46.233 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:46.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.340+0000 7f1f5fc48640 1 Processor -- start 2023-12-08T08:18:46.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.340+0000 7f1f5fc48640 1 -- start start 2023-12-08T08:18:46.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5fc48640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 0x7f1f580cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5fc48640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1f580ae350 0x7f1f580ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5fc48640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5806d650 con 0x7f1f5815d590 2023-12-08T08:18:46.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5fc48640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f580adbe0 con 0x7f1f580ae350 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5fc48640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5815d970 con 0x7f1f580afeb0 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5d9e4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1f5815d590 0x7f1f580ced10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36658/0 (socket says 172.21.15.50:36658) 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5d9e4640 1 -- 172.21.15.50:0/2394152652 learned_addr learned my addr 172.21.15.50:0/2394152652 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.341+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598081167 0 0) 0x7f1f54001490 con 0x7f1f5815d590 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f44003520 con 0x7f1f5815d590 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5d1e3640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 0x7f1f580cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 --2- 172.21.15.50:0/2394152652 >> v2:172.21.15.170:3300/0 conn(0x7f1f580ae350 0x7f1f580ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3212948222 0 0) 0x7f1f44003520 con 0x7f1f5815d590 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 msgr2=0x7f1f580cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 0x7f1f580cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 >> v2:172.21.15.170:3300/0 conn(0x7f1f580ae350 msgr2=0x7f1f580ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 --2- 172.21.15.50:0/2394152652 >> v2:172.21.15.170:3300/0 conn(0x7f1f580ae350 0x7f1f580ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5806c810 con 0x7f1f5815d590 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f1f54001b80 con 0x7f1f5815d590 2023-12-08T08:18:46.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 --2- 172.21.15.50:0/2394152652 >> v2:172.21.15.170:3300/0 conn(0x7f1f580ae350 0x7f1f580ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 >> v1:172.21.15.50:6789/0 conn(0x7f1f5815d590 legacy=0x7f1f580ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f44003970 0x7f1f44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 0x7f1f440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580adbe0 con 0x7f1f44004d00 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5815d970 con 0x7f1f44003970 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4400ba30 con 0x7f1f580afeb0 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5d9e4640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f44003970 0x7f1f44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5d1e3640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 0x7f1f440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 -- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 msgr2=0x7f1f440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f580afeb0 0x7f1f440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 -- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f44003970 msgr2=0x7f1f44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f44003970 0x7f1f44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.342+0000 7f1f5e1e5640 1 -- 172.21.15.50:0/2394152652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44003520 con 0x7f1f44004d00 2023-12-08T08:18:46.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.343+0000 7f1f5e1e5640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f44005180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f500098a0 tx=0x7f1f440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d755bb831dd63b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.343+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004230 con 0x7f1f44004d00 2023-12-08T08:18:46.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.343+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50004390 con 0x7f1f44004d00 2023-12-08T08:18:46.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.343+0000 7f1f5c9e2640 1 -- 172.21.15.50:0/2394152652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50003830 con 0x7f1f44004d00 2023-12-08T08:18:46.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.344+0000 7f1f5fc48640 1 -- 172.21.15.50:0/2394152652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 msgr2=0x7f1f44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.344+0000 7f1f5fc48640 1 --2- 172.21.15.50:0/2394152652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f44005180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f500098a0 tx=0x7f1f440057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.344+0000 7f1f5e1e5640 1 -- 172.21.15.50:0/2394152652 reap_dead start 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.344+0000 7f1f5fc48640 1 -- 172.21.15.50:0/2394152652 shutdown_connections 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.344+0000 7f1f5fc48640 1 -- 172.21.15.50:0/2394152652 >> 172.21.15.50:0/2394152652 conn(0x7f1f580d0e10 msgr2=0x7f1f580d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.344+0000 7f1f5fc48640 1 -- 172.21.15.50:0/2394152652 shutdown_connections 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.344+0000 7f1f5fc48640 1 -- 172.21.15.50:0/2394152652 wait complete. 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.345+0000 7f1f5fc48640 1 Processor -- start 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.345+0000 7f1f5fc48640 1 -- start start 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5fc48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f580cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5fc48640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f58155370 0x7f1f58141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5fc48640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f581557f0 0x7f1f581415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5fc48640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580cccb0 con 0x7f1f44004d00 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5fc48640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580ccf90 con 0x7f1f581557f0 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5fc48640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580cd270 con 0x7f1f58155370 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f580cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f580cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41628/0 (socket says 172.21.15.50:41628) 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 -- 172.21.15.50:0/1571393890 learned_addr learned my addr 172.21.15.50:0/1571393890 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d1e3640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f58155370 0x7f1f58141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5e1e5640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f581557f0 0x7f1f581415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 -- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f58155370 msgr2=0x7f1f58141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f58155370 0x7f1f58141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 -- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f581557f0 msgr2=0x7f1f581415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f581557f0 0x7f1f581415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 -- 172.21.15.50:0/1571393890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f580cd550 con 0x7f1f44004d00 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.346+0000 7f1f5d9e4640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f580cc5b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f54001fb0 tx=0x7f1f54007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.347+0000 7f1f4e7fc640 1 -- 172.21.15.50:0/1571393890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540133f0 con 0x7f1f44004d00 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.347+0000 7f1f4e7fc640 1 -- 172.21.15.50:0/1571393890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f54013550 con 0x7f1f44004d00 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.347+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f580cd830 con 0x7f1f44004d00 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.347+0000 7f1f4e7fc640 1 -- 172.21.15.50:0/1571393890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54013900 con 0x7f1f44004d00 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.347+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f58141ae0 con 0x7f1f44004d00 2023-12-08T08:18:46.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.348+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f580cda50 con 0x7f1f44004d00 2023-12-08T08:18:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.348+0000 7f1f4e7fc640 1 -- 172.21.15.50:0/1571393890 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f54013a60 con 0x7f1f44004d00 2023-12-08T08:18:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.349+0000 7f1f4e7fc640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1f3c06ae70 0x7f1f3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.349+0000 7f1f4e7fc640 1 -- 172.21.15.50:0/1571393890 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1f5408a560 con 0x7f1f44004d00 2023-12-08T08:18:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.349+0000 7f1f5d1e3640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1f3c06ae70 0x7f1f3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.350+0000 7f1f5d1e3640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1f3c06ae70 0x7f1f3c06d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f580ce160 tx=0x7f1f48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.353+0000 7f1f4e7fc640 1 -- 172.21.15.50:0/1571393890 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f540552f0 con 0x7f1f44004d00 2023-12-08T08:18:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.532+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1f5806d650 con 0x7f1f44004d00 2023-12-08T08:18:46.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.533+0000 7f1f4e7fc640 1 -- 172.21.15.50:0/1571393890 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1f5806d650 con 0x7f1f44004d00 2023-12-08T08:18:46.535 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1f3c06ae70 msgr2=0x7f1f3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1f3c06ae70 0x7f1f3c06d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f580ce160 tx=0x7f1f48008040 comp rx=0 tx=0).stop 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 msgr2=0x7f1f580cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f580cc5b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f54001fb0 tx=0x7f1f54007430 comp rx=0 tx=0).stop 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 shutdown_connections 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1f3c06ae70 0x7f1f3c06d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f581557f0 0x7f1f581415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f58155370 0x7f1f58141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 --2- 172.21.15.50:0/1571393890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f44004d00 0x7f1f580cc5b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 >> 172.21.15.50:0/1571393890 conn(0x7f1f580d0e10 msgr2=0x7f1f580b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 shutdown_connections 2023-12-08T08:18:46.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.535+0000 7f1f5fc48640 1 -- 172.21.15.50:0/1571393890 wait complete. 2023-12-08T08:18:46.565 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2023-12-08T08:18:46.565 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-08T08:18:46.566 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:46.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.670+0000 7f268b705640 1 Processor -- start 2023-12-08T08:18:46.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.670+0000 7f268b705640 1 -- start start 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f268b705640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26840d1d60 0x7f26840d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f268b705640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f268415d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f268b705640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268415ee90 con 0x7f268415d580 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f268b705640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26840d0fe0 con 0x7f26840d1d60 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f268b705640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26840d1280 con 0x7f268415f890 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f2688ca0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26840d1d60 0x7f26840d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f2688ca0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f26840d1d60 0x7f26840d3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41636/0 (socket says 172.21.15.50:41636) 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.671+0000 7f2688ca0640 1 -- 172.21.15.50:0/100425732 learned_addr learned my addr 172.21.15.50:0/100425732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.672+0000 7f2688ca0640 1 -- 172.21.15.50:0/100425732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 msgr2=0x7f268415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.672+0000 7f2688ca0640 1 --2- 172.21.15.50:0/100425732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f268415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.672+0000 7f2688ca0640 1 -- 172.21.15.50:0/100425732 >> v1:172.21.15.170:6789/0 conn(0x7f268415d580 legacy=0x7f268415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.672+0000 7f2688ca0640 1 -- 172.21.15.50:0/100425732 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26840d1560 con 0x7f26840d1d60 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.672+0000 7f2688ca0640 1 --2- 172.21.15.50:0/100425732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26840d1d60 0x7f26840d3ad0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f26740098a0 tx=0x7f267402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435ffecd99245d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.672+0000 7f267bfff640 1 -- 172.21.15.50:0/100425732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740317c0 con 0x7f26840d1d60 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f267bfff640 1 -- 172.21.15.50:0/100425732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674031920 con 0x7f26840d1d60 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f267bfff640 1 -- 172.21.15.50:0/100425732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674031cb0 con 0x7f26840d1d60 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 -- 172.21.15.50:0/100425732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26840d1d60 msgr2=0x7f26840d3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 --2- 172.21.15.50:0/100425732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26840d1d60 0x7f26840d3ad0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f26740098a0 tx=0x7f267402b860 comp rx=0 tx=0).stop 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 -- 172.21.15.50:0/100425732 shutdown_connections 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 --2- 172.21.15.50:0/100425732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f268415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 --2- 172.21.15.50:0/100425732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26840d1d60 0x7f26840d3ad0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 -- 172.21.15.50:0/100425732 >> 172.21.15.50:0/100425732 conn(0x7f26840d2fb0 msgr2=0x7f26840d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 -- 172.21.15.50:0/100425732 shutdown_connections 2023-12-08T08:18:46.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.673+0000 7f268b705640 1 -- 172.21.15.50:0/100425732 wait complete. 2023-12-08T08:18:46.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.674+0000 7f268b705640 1 Processor -- start 2023-12-08T08:18:46.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.674+0000 7f268b705640 1 -- start start 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f268b705640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840d1d60 0x7f26840c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f268b705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268415d580 0x7f26840c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f268b705640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f26841f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f268b705640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26841f3f20 con 0x7f268415d580 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f268b705640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26840c79c0 con 0x7f26840d1d60 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f268b705640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26841f3960 con 0x7f268415f890 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f2688ca0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268415d580 0x7f26840c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f2688ca0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268415d580 0x7f26840c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41640/0 (socket says 172.21.15.50:41640) 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.675+0000 7f2688ca0640 1 -- 172.21.15.50:0/1683807924 learned_addr learned my addr 172.21.15.50:0/1683807924 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f26894a1640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840d1d60 0x7f26840c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2689ca2640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f26841f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2688ca0640 1 -- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 msgr2=0x7f26841f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2688ca0640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f26841f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2688ca0640 1 -- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840d1d60 msgr2=0x7f26840c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2688ca0640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840d1d60 0x7f26840c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2688ca0640 1 -- 172.21.15.50:0/1683807924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740094d0 con 0x7f268415d580 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f26894a1640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840d1d60 0x7f26840c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2689ca2640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f26841f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2688ca0640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268415d580 0x7f26840c7480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26740090b0 tx=0x7f26740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2679ffb640 1 -- 172.21.15.50:0/1683807924 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674032860 con 0x7f268415d580 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2679ffb640 1 -- 172.21.15.50:0/1683807924 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26740329c0 con 0x7f268415d580 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f2679ffb640 1 -- 172.21.15.50:0/1683807924 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674032d50 con 0x7f268415d580 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26841f3c40 con 0x7f268415d580 2023-12-08T08:18:46.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.676+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26840c6f60 con 0x7f268415d580 2023-12-08T08:18:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.677+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26840c6ae0 con 0x7f268415d580 2023-12-08T08:18:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.678+0000 7f2679ffb640 1 -- 172.21.15.50:0/1683807924 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f267404d3f0 con 0x7f268415d580 2023-12-08T08:18:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.678+0000 7f2679ffb640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f266806ae40 0x7f266806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.678+0000 7f2679ffb640 1 -- 172.21.15.50:0/1683807924 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f26740ab900 con 0x7f268415d580 2023-12-08T08:18:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.678+0000 7f26894a1640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f266806ae40 0x7f266806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.679+0000 7f26894a1640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f266806ae40 0x7f266806d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2680003eb0 tx=0x7f2680009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.682+0000 7f2679ffb640 1 -- 172.21.15.50:0/1683807924 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26840c6ae0 con 0x7f268415d580 2023-12-08T08:18:46.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.862+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26840c6ae0 con 0x7f268415d580 2023-12-08T08:18:46.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.863+0000 7f2679ffb640 1 -- 172.21.15.50:0/1683807924 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f26840c6ae0 con 0x7f268415d580 2023-12-08T08:18:46.866 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:46.866 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f266806ae40 msgr2=0x7f266806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f266806ae40 0x7f266806d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2680003eb0 tx=0x7f2680009040 comp rx=0 tx=0).stop 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268415d580 msgr2=0x7f26840c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268415d580 0x7f26840c7480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26740090b0 tx=0x7f26740046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 shutdown_connections 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f266806ae40 0x7f266806d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f268415d580 0x7f26840c7480 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f268415f890 0x7f26841f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 --2- 172.21.15.50:0/1683807924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26840d1d60 0x7f26840c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 >> 172.21.15.50:0/1683807924 conn(0x7f26840d2fb0 msgr2=0x7f26840cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 shutdown_connections 2023-12-08T08:18:46.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.865+0000 7f268b705640 1 -- 172.21.15.50:0/1683807924 wait complete. 2023-12-08T08:18:46.879 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:46.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.987+0000 7faac3305640 1 Processor -- start 2023-12-08T08:18:46.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.988+0000 7faac3305640 1 -- start start 2023-12-08T08:18:46.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.988+0000 7faac3305640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faabc0b3c80 0x7faabc0b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.988+0000 7faac3305640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0ceba0 con 0x7faabc0d1950 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.988+0000 7faac3305640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0cee80 con 0x7faabc15e6a0 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.988+0000 7faac3305640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0cbcb0 con 0x7faabc0b3c80 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.988+0000 7faac08a0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7faabc0d1950 0x7faabc0cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36664/0 (socket says 172.21.15.50:36664) 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.988+0000 7faac08a0640 1 -- 172.21.15.50:0/1520451044 learned_addr learned my addr 172.21.15.50:0/1520451044 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac18a2640 1 --2- 172.21.15.50:0/1520451044 >> v2:172.21.15.170:3300/0 conn(0x7faabc0b3c80 0x7faabc0b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965249122 0 0) 0x7faabc0ceba0 con 0x7faabc0d1950 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaa4003520 con 0x7faabc0d1950 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1133196 0 0) 0x7faaa4003520 con 0x7faabc0d1950 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 >> v2:172.21.15.170:3300/0 conn(0x7faabc0b3c80 msgr2=0x7faabc0b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 --2- 172.21.15.50:0/1520451044 >> v2:172.21.15.170:3300/0 conn(0x7faabc0b3c80 0x7faabc0b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 >> v1:172.21.15.170:6789/0 conn(0x7faabc15e6a0 legacy=0x7faabc0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0cbf90 con 0x7faabc0d1950 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7faab0001670 con 0x7faabc0d1950 2023-12-08T08:18:46.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac18a2640 1 --2- 172.21.15.50:0/1520451044 >> v2:172.21.15.170:3300/0 conn(0x7faabc0b3c80 0x7faabc0b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 >> v1:172.21.15.50:6789/0 conn(0x7faabc0d1950 legacy=0x7faabc0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaa4003970 0x7faaa4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40047c0 0x7faaa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa4005180 0x7faaa400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0cbcb0 con 0x7faaa40047c0 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa400c020 con 0x7faaa4003970 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa400c1e0 con 0x7faaa4005180 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac08a0640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40047c0 0x7faaa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac10a1640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaa4003970 0x7faaa4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac18a2640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa4005180 0x7faaa400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac08a0640 1 -- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa4005180 msgr2=0x7faaa400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac08a0640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa4005180 0x7faaa400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac08a0640 1 -- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaa4003970 msgr2=0x7faaa4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac08a0640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faaa4003970 0x7faaa4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac08a0640 1 -- 172.21.15.50:0/1520451044 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4003520 con 0x7faaa40047c0 2023-12-08T08:18:46.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.989+0000 7faac18a2640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa4005180 0x7faaa400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.990+0000 7faac18a2640 1 -- 172.21.15.50:0/1520451044 reap_dead start 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.990+0000 7faac08a0640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40047c0 0x7faaa4004c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faab000c240 tx=0x7faaa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a3b2cd8fd2584 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.990+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0005ad0 con 0x7faaa40047c0 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.990+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0005c30 con 0x7faaa40047c0 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.990+0000 7faabbfff640 1 -- 172.21.15.50:0/1520451044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab002ca90 con 0x7faaa40047c0 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.991+0000 7faac3305640 1 -- 172.21.15.50:0/1520451044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40047c0 msgr2=0x7faaa4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.991+0000 7faac3305640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40047c0 0x7faaa4004c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faab000c240 tx=0x7faaa40057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.991+0000 7faac3305640 1 -- 172.21.15.50:0/1520451044 shutdown_connections 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.991+0000 7faac3305640 1 --2- 172.21.15.50:0/1520451044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faaa40047c0 0x7faaa4004c40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.991+0000 7faac3305640 1 -- 172.21.15.50:0/1520451044 >> 172.21.15.50:0/1520451044 conn(0x7faabc0d0e30 msgr2=0x7faabc0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.991+0000 7faac3305640 1 -- 172.21.15.50:0/1520451044 shutdown_connections 2023-12-08T08:18:46.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.991+0000 7faac3305640 1 -- 172.21.15.50:0/1520451044 wait complete. 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.992+0000 7faac3305640 1 Processor -- start 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.992+0000 7faac3305640 1 -- start start 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac3305640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa40047c0 0x7faabc14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac3305640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fe80 0x7faabc0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac3305640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc15c580 0x7faabc15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac3305640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc15cf70 con 0x7faabc15c580 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac3305640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc14e7e0 con 0x7faabc06fe80 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac3305640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0c98c0 con 0x7faaa40047c0 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc15c580 0x7faabc15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc15c580 0x7faabc15ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41664/0 (socket says 172.21.15.50:41664) 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 -- 172.21.15.50:0/3239656145 learned_addr learned my addr 172.21.15.50:0/3239656145 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:46.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac08a0640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fe80 0x7faabc0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac10a1640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa40047c0 0x7faabc14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 -- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa40047c0 msgr2=0x7faabc14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa40047c0 0x7faabc14e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 -- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fe80 msgr2=0x7faabc0c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fe80 0x7faabc0c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac18a2640 1 -- 172.21.15.50:0/3239656145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0c9ba0 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.993+0000 7faac08a0640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fe80 0x7faabc0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.994+0000 7faac18a2640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc15c580 0x7faabc15ca30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faabc0c45d0 tx=0x7faab4011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.994+0000 7faab9ffb640 1 -- 172.21.15.50:0/3239656145 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4004440 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.994+0000 7faab9ffb640 1 -- 172.21.15.50:0/3239656145 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4003610 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.994+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc0c9e80 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.994+0000 7faab9ffb640 1 -- 172.21.15.50:0/3239656145 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4003980 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.994+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc0ca440 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.995+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc0ca630 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.995+0000 7faab9ffb640 1 -- 172.21.15.50:0/3239656145 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faab4003ae0 con 0x7faabc15c580 2023-12-08T08:18:47.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.996+0000 7faab9ffb640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faaa806ae40 0x7faaa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.996+0000 7faab9ffb640 1 -- 172.21.15.50:0/3239656145 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faab4089ee0 con 0x7faabc15c580 2023-12-08T08:18:47.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.996+0000 7faac10a1640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faaa806ae40 0x7faaa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:46.997+0000 7faac10a1640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faaa806ae40 0x7faaa806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faaac000f80 tx=0x7faaac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.000+0000 7faab9ffb640 1 -- 172.21.15.50:0/3239656145 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faab4054c40 con 0x7faabc15c580 2023-12-08T08:18:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.176+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faabc067ad0 con 0x7faabc15c580 2023-12-08T08:18:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.176+0000 7faab9ffb640 1 -- 172.21.15.50:0/3239656145 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7faab40190a0 con 0x7faabc15c580 2023-12-08T08:18:47.179 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faaa806ae40 msgr2=0x7faaa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faaa806ae40 0x7faaa806d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faaac000f80 tx=0x7faaac009040 comp rx=0 tx=0).stop 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc15c580 msgr2=0x7faabc15ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc15c580 0x7faabc15ca30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faabc0c45d0 tx=0x7faab4011990 comp rx=0 tx=0).stop 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 shutdown_connections 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faaa806ae40 0x7faaa806d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faabc15c580 0x7faabc15ca30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fe80 0x7faabc0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 --2- 172.21.15.50:0/3239656145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faaa40047c0 0x7faabc14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 >> 172.21.15.50:0/3239656145 conn(0x7faabc0d0e30 msgr2=0x7faabc0cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 shutdown_connections 2023-12-08T08:18:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.178+0000 7faac3305640 1 -- 172.21.15.50:0/3239656145 wait complete. 2023-12-08T08:18:47.192 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:47.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.301+0000 7f4fc89d7640 1 Processor -- start 2023-12-08T08:18:47.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.301+0000 7f4fc89d7640 1 -- start start 2023-12-08T08:18:47.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc89d7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4fc40cf570 0x7f4fc40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc89d7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b6c50 0x7f4fc40b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc89d7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cfef0 con 0x7f4fc40b8950 2023-12-08T08:18:47.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc89d7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40b5f00 con 0x7f4fc40cf570 2023-12-08T08:18:47.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc89d7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40b6170 con 0x7f4fc40b6c50 2023-12-08T08:18:47.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc2d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b6c50 0x7f4fc40b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fb9d9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4fc40cf570 0x7f4fc40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc2d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b6c50 0x7f4fc40b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:51952/0 (socket says 172.21.15.50:51952) 2023-12-08T08:18:47.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc2d9d640 1 -- 172.21.15.50:0/2613266638 learned_addr learned my addr 172.21.15.50:0/2613266638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:47.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc259c640 1 --1- 172.21.15.50:0/2613266638 >> v1:172.21.15.170:6789/0 conn(0x7f4fc40b8950 0x7f4fc40ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49840/0 (socket says 172.21.15.50:49840) 2023-12-08T08:18:47.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc1d9b640 1 -- 172.21.15.50:0/2613266638 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798045376 0 0) 0x7f4fc40cfef0 con 0x7f4fc40b8950 2023-12-08T08:18:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc1d9b640 1 -- 172.21.15.50:0/2613266638 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb0003520 con 0x7f4fc40b8950 2023-12-08T08:18:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc2d9d640 1 -- 172.21.15.50:0/2613266638 >> v2:172.21.15.170:3300/0 conn(0x7f4fc40cf570 msgr2=0x7f4fc40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc2d9d640 1 --2- 172.21.15.50:0/2613266638 >> v2:172.21.15.170:3300/0 conn(0x7f4fc40cf570 0x7f4fc40cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc2d9d640 1 -- 172.21.15.50:0/2613266638 >> v1:172.21.15.170:6789/0 conn(0x7f4fc40b8950 legacy=0x7f4fc40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.302+0000 7f4fc2d9d640 1 -- 172.21.15.50:0/2613266638 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40b6450 con 0x7f4fc40b6c50 2023-12-08T08:18:47.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.303+0000 7f4fb9d9b640 1 --2- 172.21.15.50:0/2613266638 >> v2:172.21.15.170:3300/0 conn(0x7f4fc40cf570 0x7f4fc40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.303+0000 7f4fc2d9d640 1 --2- 172.21.15.50:0/2613266638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b6c50 0x7f4fc40b70e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e50 tx=0x7f4fbc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a522b7be802cb8f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.303+0000 7f4fc1d9b640 1 -- 172.21.15.50:0/2613266638 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc02ca70 con 0x7f4fc40b6c50 2023-12-08T08:18:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc1d9b640 1 -- 172.21.15.50:0/2613266638 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc02cbd0 con 0x7f4fc40b6c50 2023-12-08T08:18:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc1d9b640 1 -- 172.21.15.50:0/2613266638 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0343f0 con 0x7f4fc40b6c50 2023-12-08T08:18:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2613266638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b6c50 msgr2=0x7f4fc40b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2613266638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b6c50 0x7f4fc40b70e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e50 tx=0x7f4fbc02bed0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2613266638 shutdown_connections 2023-12-08T08:18:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2613266638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b6c50 0x7f4fc40b70e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2613266638 >> v2:172.21.15.170:3300/0 conn(0x7f4fc40cf570 0x7f4fc40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2613266638 >> 172.21.15.50:0/2613266638 conn(0x7f4fc40d3010 msgr2=0x7f4fc40d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2613266638 shutdown_connections 2023-12-08T08:18:47.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.304+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2613266638 wait complete. 2023-12-08T08:18:47.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 Processor -- start 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 -- start start 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc40b6c50 0x7f4fc41567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b8950 0x7f4fc415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc40cf570 0x7f4fc4149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc415ed90 con 0x7f4fc40b6c50 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4149950 con 0x7f4fc40cf570 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.306+0000 7f4fc89d7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc415a9a0 con 0x7f4fc40b8950 2023-12-08T08:18:47.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc40b6c50 0x7f4fc41567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc40b6c50 0x7f4fc41567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41680/0 (socket says 172.21.15.50:41680) 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 -- 172.21.15.50:0/2072536424 learned_addr learned my addr 172.21.15.50:0/2072536424 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc2d9d640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc40cf570 0x7f4fc4149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fb9d9b640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b8950 0x7f4fc415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 -- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b8950 msgr2=0x7f4fc415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b8950 0x7f4fc415a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 -- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc40cf570 msgr2=0x7f4fc4149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc40cf570 0x7f4fc4149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 -- 172.21.15.50:0/2072536424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac009400 con 0x7f4fc40b6c50 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc2d9d640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc40cf570 0x7f4fc4149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc259c640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc40b6c50 0x7f4fc41567a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c430 tx=0x7f4fb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fbb7fe640 1 -- 172.21.15.50:0/2072536424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40074e0 con 0x7f4fc40b6c50 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fbb7fe640 1 -- 172.21.15.50:0/2072536424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4007660 con 0x7f4fc40b6c50 2023-12-08T08:18:47.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc009b30 con 0x7f4fc40b6c50 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fbb7fe640 1 -- 172.21.15.50:0/2072536424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4004a20 con 0x7f4fc40b6c50 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.307+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc415af60 con 0x7f4fc40b6c50 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.308+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc408b150 con 0x7f4fc40b6c50 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.309+0000 7f4fbb7fe640 1 -- 172.21.15.50:0/2072536424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4fb4004b80 con 0x7f4fc40b6c50 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.309+0000 7f4fbb7fe640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4fa406ae40 0x7f4fa406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.309+0000 7f4fbb7fe640 1 -- 172.21.15.50:0/2072536424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4fb40894d0 con 0x7f4fc40b6c50 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.309+0000 7f4fb9d9b640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4fa406ae40 0x7f4fa406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.310+0000 7f4fb9d9b640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4fa406ae40 0x7f4fa406d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4fc415e9d0 tx=0x7f4fac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.314+0000 7f4fbb7fe640 1 -- 172.21.15.50:0/2072536424 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4fb4057cf0 con 0x7f4fc40b6c50 2023-12-08T08:18:47.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.489+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fc4067430 con 0x7f4fc40b6c50 2023-12-08T08:18:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.490+0000 7f4fbb7fe640 1 -- 172.21.15.50:0/2072536424 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fb4057880 con 0x7f4fc40b6c50 2023-12-08T08:18:47.492 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4fa406ae40 msgr2=0x7f4fa406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4fa406ae40 0x7f4fa406d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4fc415e9d0 tx=0x7f4fac008040 comp rx=0 tx=0).stop 2023-12-08T08:18:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc40b6c50 msgr2=0x7f4fc41567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc40b6c50 0x7f4fc41567a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c430 tx=0x7f4fb400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 shutdown_connections 2023-12-08T08:18:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4fa406ae40 0x7f4fa406d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fc40cf570 0x7f4fc4149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fc40b8950 0x7f4fc415a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 --2- 172.21.15.50:0/2072536424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc40b6c50 0x7f4fc41567a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 >> 172.21.15.50:0/2072536424 conn(0x7f4fc40d3010 msgr2=0x7f4fc40b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 shutdown_connections 2023-12-08T08:18:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.491+0000 7f4fc89d7640 1 -- 172.21.15.50:0/2072536424 wait complete. 2023-12-08T08:18:47.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:47.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.612+0000 7f4598ce7640 1 Processor -- start 2023-12-08T08:18:47.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.612+0000 7f4598ce7640 1 -- start start 2023-12-08T08:18:47.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f4598ce7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f459415d590 0x7f45940ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f4598ce7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459406d650 con 0x7f45940ae350 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f4598ce7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45940adbe0 con 0x7f45940afeb0 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f4598ce7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459415d970 con 0x7f459415d590 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f459259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f459415d590 0x7f45940ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f459259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f459415d590 0x7f45940ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41694/0 (socket says 172.21.15.50:41694) 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f4592d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f45940ae350 0x7f45940ae7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36676/0 (socket says 172.21.15.50:36676) 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f459259c640 1 -- 172.21.15.50:0/2014099468 learned_addr learned my addr 172.21.15.50:0/2014099468 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f459259c640 1 -- 172.21.15.50:0/2014099468 >> v1:172.21.15.170:6789/0 conn(0x7f45940afeb0 legacy=0x7f45940cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f459259c640 1 -- 172.21.15.50:0/2014099468 >> v1:172.21.15.50:6789/0 conn(0x7f45940ae350 legacy=0x7f45940ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f4591d9b640 1 -- 172.21.15.50:0/2014099468 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943031690 0 0) 0x7f458c001490 con 0x7f45940ae350 2023-12-08T08:18:47.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.613+0000 7f459259c640 1 -- 172.21.15.50:0/2014099468 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459406c810 con 0x7f459415d590 2023-12-08T08:18:47.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.614+0000 7f459259c640 1 --2- 172.21.15.50:0/2014099468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f459415d590 0x7f45940ced10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4584009870 tx=0x7f458402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590b6bcb15776b9d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.614+0000 7f4591d9b640 1 -- 172.21.15.50:0/2014099468 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584030860 con 0x7f459415d590 2023-12-08T08:18:47.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.614+0000 7f4591d9b640 1 -- 172.21.15.50:0/2014099468 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45840309c0 con 0x7f459415d590 2023-12-08T08:18:47.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.614+0000 7f4591d9b640 1 -- 172.21.15.50:0/2014099468 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584030d50 con 0x7f459415d590 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.615+0000 7f4598ce7640 1 -- 172.21.15.50:0/2014099468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f459415d590 msgr2=0x7f45940ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.615+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2014099468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f459415d590 0x7f45940ced10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4584009870 tx=0x7f458402b9a0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.615+0000 7f4598ce7640 1 -- 172.21.15.50:0/2014099468 shutdown_connections 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.615+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2014099468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f459415d590 0x7f45940ced10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.615+0000 7f4598ce7640 1 -- 172.21.15.50:0/2014099468 >> 172.21.15.50:0/2014099468 conn(0x7f45940d0e10 msgr2=0x7f45940d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.615+0000 7f4598ce7640 1 -- 172.21.15.50:0/2014099468 shutdown_connections 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.615+0000 7f4598ce7640 1 -- 172.21.15.50:0/2014099468 wait complete. 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.616+0000 7f4598ce7640 1 Processor -- start 2023-12-08T08:18:47.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.616+0000 7f4598ce7640 1 -- start start 2023-12-08T08:18:47.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4598ce7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45940ae350 0x7f45941ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4598ce7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45940afeb0 0x7f4594144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4598ce7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f459415d590 0x7f459415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4598ce7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941f40c0 con 0x7f45940afeb0 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4598ce7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940cc610 con 0x7f459415d590 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4598ce7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940cc8f0 con 0x7f45940ae350 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45940afeb0 0x7f4594144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45940afeb0 0x7f4594144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41710/0 (socket says 172.21.15.50:41710) 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 -- 172.21.15.50:0/2018150107 learned_addr learned my addr 172.21.15.50:0/2018150107 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f459259c640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45940ae350 0x7f45941ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4592d9d640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f459415d590 0x7f459415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 -- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45940ae350 msgr2=0x7f45941ed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45940ae350 0x7f45941ed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 -- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f459415d590 msgr2=0x7f459415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f459415d590 0x7f459415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f458bfff640 1 -- 172.21.15.50:0/2018150107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840094d0 con 0x7f45940afeb0 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.617+0000 7f4592d9d640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f459415d590 0x7f459415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:47.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.618+0000 7f458bfff640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45940afeb0 0x7f4594144d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c450 tx=0x7f457c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.618+0000 7f458affd640 1 -- 172.21.15.50:0/2018150107 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0052d0 con 0x7f45940afeb0 2023-12-08T08:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.618+0000 7f458affd640 1 -- 172.21.15.50:0/2018150107 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c005430 con 0x7f45940afeb0 2023-12-08T08:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.618+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45940ccbd0 con 0x7f45940afeb0 2023-12-08T08:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.618+0000 7f458affd640 1 -- 172.21.15.50:0/2018150107 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c012870 con 0x7f45940afeb0 2023-12-08T08:18:47.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.618+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4594145270 con 0x7f45940afeb0 2023-12-08T08:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.619+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4594145430 con 0x7f45940afeb0 2023-12-08T08:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.619+0000 7f458affd640 1 -- 172.21.15.50:0/2018150107 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f457c0129d0 con 0x7f45940afeb0 2023-12-08T08:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.620+0000 7f458affd640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f457406ae40 0x7f457406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.620+0000 7f458affd640 1 -- 172.21.15.50:0/2018150107 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f457c0894b0 con 0x7f45940afeb0 2023-12-08T08:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.620+0000 7f459259c640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f457406ae40 0x7f457406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.620+0000 7f459259c640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f457406ae40 0x7f457406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4584036000 tx=0x7f4584008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.624+0000 7f458affd640 1 -- 172.21.15.50:0/2018150107 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f457c054210 con 0x7f45940afeb0 2023-12-08T08:18:47.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.804+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45940cd0f0 con 0x7f45940afeb0 2023-12-08T08:18:47.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.804+0000 7f458affd640 1 -- 172.21.15.50:0/2018150107 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45940cd0f0 con 0x7f45940afeb0 2023-12-08T08:18:47.807 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f457406ae40 msgr2=0x7f457406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f457406ae40 0x7f457406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4584036000 tx=0x7f4584008030 comp rx=0 tx=0).stop 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45940afeb0 msgr2=0x7f4594144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45940afeb0 0x7f4594144d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c450 tx=0x7f457c00c910 comp rx=0 tx=0).stop 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 shutdown_connections 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f457406ae40 0x7f457406d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45940afeb0 0x7f4594144d30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f459415d590 0x7f459415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 --2- 172.21.15.50:0/2018150107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45940ae350 0x7f45941ed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 >> 172.21.15.50:0/2018150107 conn(0x7f45940d0e10 msgr2=0x7f459406fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 shutdown_connections 2023-12-08T08:18:47.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.806+0000 7f4598ce7640 1 -- 172.21.15.50:0/2018150107 wait complete. 2023-12-08T08:18:47.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:47.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.926+0000 7f56ad390640 1 Processor -- start 2023-12-08T08:18:47.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.926+0000 7f56ad390640 1 -- start start 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.927+0000 7f56ad390640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a806e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.927+0000 7f56ad390640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56a815f820 0x7f56a815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.927+0000 7f56ad390640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a815c500 con 0x7f56a806a4d0 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.927+0000 7f56ad390640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a815eb60 con 0x7f56a815f820 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.927+0000 7f56ad390640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a81524e0 con 0x7f56a8152100 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.927+0000 7f56a67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56a815f820 0x7f56a815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.927+0000 7f56a67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f56a815f820 0x7f56a815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41718/0 (socket says 172.21.15.50:41718) 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.928+0000 7f56a67fc640 1 -- 172.21.15.50:0/3292585863 learned_addr learned my addr 172.21.15.50:0/3292585863 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.928+0000 7f56a6ffd640 1 --2- 172.21.15.50:0/3292585863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.928+0000 7f56a67fc640 1 -- 172.21.15.50:0/3292585863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 msgr2=0x7f56a806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.928+0000 7f56a67fc640 1 --2- 172.21.15.50:0/3292585863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.928+0000 7f56a67fc640 1 -- 172.21.15.50:0/3292585863 >> v1:172.21.15.170:6789/0 conn(0x7f56a806a4d0 legacy=0x7f56a80cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.928+0000 7f56a67fc640 1 -- 172.21.15.50:0/3292585863 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a806eea0 con 0x7f56a815f820 2023-12-08T08:18:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56a67fc640 1 --2- 172.21.15.50:0/3292585863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a815f820 0x7f56a815bfc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5690009870 tx=0x7f569002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be10194f2da74ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56a5ffb640 1 -- 172.21.15.50:0/3292585863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690031640 con 0x7f56a815f820 2023-12-08T08:18:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56a5ffb640 1 -- 172.21.15.50:0/3292585863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56900317a0 con 0x7f56a815f820 2023-12-08T08:18:47.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56a5ffb640 1 -- 172.21.15.50:0/3292585863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690031b30 con 0x7f56a815f820 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 -- 172.21.15.50:0/3292585863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a815f820 msgr2=0x7f56a815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 --2- 172.21.15.50:0/3292585863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a815f820 0x7f56a815bfc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5690009870 tx=0x7f569002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 -- 172.21.15.50:0/3292585863 shutdown_connections 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 --2- 172.21.15.50:0/3292585863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a815f820 0x7f56a815bfc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 --2- 172.21.15.50:0/3292585863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 -- 172.21.15.50:0/3292585863 >> 172.21.15.50:0/3292585863 conn(0x7f56a80b1860 msgr2=0x7f56a80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 -- 172.21.15.50:0/3292585863 shutdown_connections 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.929+0000 7f56ad390640 1 -- 172.21.15.50:0/3292585863 wait complete. 2023-12-08T08:18:47.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 Processor -- start 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 -- start start 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a806a4d0 0x7f56a80c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a80cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56a815f820 0x7f56a81e5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a814d950 con 0x7f56a806a4d0 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8154410 con 0x7f56a815f820 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56ad390640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80c72e0 con 0x7f56a8152100 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.931+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a806a4d0 0x7f56a80c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a806a4d0 0x7f56a80c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41720/0 (socket says 172.21.15.50:41720) 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 -- 172.21.15.50:0/2536961001 learned_addr learned my addr 172.21.15.50:0/2536961001 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a67fc640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a80cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a77fe640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56a815f820 0x7f56a81e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 -- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 msgr2=0x7f56a80cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a80cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 -- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56a815f820 msgr2=0x7f56a81e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56a815f820 0x7f56a81e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 -- 172.21.15.50:0/2536961001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900094d0 con 0x7f56a806a4d0 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a67fc640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a77fe640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56a815f820 0x7f56a81e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56a6ffd640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a806a4d0 0x7f56a80c6da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56a000d830 tx=0x7f56a000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f569f7fe640 1 -- 172.21.15.50:0/2536961001 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000b6c0 con 0x7f56a806a4d0 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f569f7fe640 1 -- 172.21.15.50:0/2536961001 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000b820 con 0x7f56a806a4d0 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a81e6460 con 0x7f56a806a4d0 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f569f7fe640 1 -- 172.21.15.50:0/2536961001 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000bbb0 con 0x7f56a806a4d0 2023-12-08T08:18:47.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.932+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a81540a0 con 0x7f56a806a4d0 2023-12-08T08:18:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.933+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a80c2f70 con 0x7f56a806a4d0 2023-12-08T08:18:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.934+0000 7f569f7fe640 1 -- 172.21.15.50:0/2536961001 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56a001e460 con 0x7f56a806a4d0 2023-12-08T08:18:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.934+0000 7f569f7fe640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f568806ae40 0x7f568806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.934+0000 7f569f7fe640 1 -- 172.21.15.50:0/2536961001 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f56a008a170 con 0x7f56a806a4d0 2023-12-08T08:18:47.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.934+0000 7f56a67fc640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f568806ae40 0x7f568806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:47.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.935+0000 7f56a67fc640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f568806ae40 0x7f568806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5690036000 tx=0x7f569003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:47.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:47.938+0000 7f569f7fe640 1 -- 172.21.15.50:0/2536961001 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f56a0054e40 con 0x7f56a806a4d0 2023-12-08T08:18:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.115+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f56a8067ad0 con 0x7f56a806a4d0 2023-12-08T08:18:48.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.115+0000 7f569f7fe640 1 -- 172.21.15.50:0/2536961001 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f56a0058460 con 0x7f56a806a4d0 2023-12-08T08:18:48.118 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:48.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f568806ae40 msgr2=0x7f568806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f568806ae40 0x7f568806d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5690036000 tx=0x7f569003c040 comp rx=0 tx=0).stop 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a806a4d0 msgr2=0x7f56a80c6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a806a4d0 0x7f56a80c6da0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56a000d830 tx=0x7f56a000dcf0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 shutdown_connections 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f568806ae40 0x7f568806d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56a815f820 0x7f56a81e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56a8152100 0x7f56a80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 --2- 172.21.15.50:0/2536961001 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56a806a4d0 0x7f56a80c6da0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 >> 172.21.15.50:0/2536961001 conn(0x7f56a80b1860 msgr2=0x7f56a80717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 shutdown_connections 2023-12-08T08:18:48.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.117+0000 7f56ad390640 1 -- 172.21.15.50:0/2536961001 wait complete. 2023-12-08T08:18:48.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-12-08T08:18:48.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.235+0000 7fc32d456640 1 Processor -- start 2023-12-08T08:18:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.235+0000 7fc32d456640 1 -- start start 2023-12-08T08:18:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc32d456640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc3280d1d60 0x7fc3280d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc32d456640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32815ee90 con 0x7fc32815f890 2023-12-08T08:18:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc32d456640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280d0fe0 con 0x7fc32815d580 2023-12-08T08:18:48.238 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc32d456640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280d1280 con 0x7fc3280d1d60 2023-12-08T08:18:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc3277fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc32815f890 0x7fc32815d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36692/0 (socket says 172.21.15.50:36692) 2023-12-08T08:18:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc3277fe640 1 -- 172.21.15.50:0/3265128481 learned_addr learned my addr 172.21.15.50:0/3265128481 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:48.239 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc3267fc640 1 --2- 172.21.15.50:0/3265128481 >> v2:172.21.15.170:3300/0 conn(0x7fc3280d1d60 0x7fc3280d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286220432 0 0) 0x7fc32815ee90 con 0x7fc32815f890 2023-12-08T08:18:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.236+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc310003520 con 0x7fc32815f890 2023-12-08T08:18:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.237+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388666991 0 0) 0x7fc3280d0fe0 con 0x7fc32815d580 2023-12-08T08:18:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.237+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32815ee90 con 0x7fc32815d580 2023-12-08T08:18:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.237+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512704665 0 0) 0x7fc310003520 con 0x7fc32815f890 2023-12-08T08:18:48.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.237+0000 7fc3267fc640 1 -- 172.21.15.50:0/3265128481 >> v1:172.21.15.170:6789/0 conn(0x7fc32815d580 legacy=0x7fc32815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.237+0000 7fc3267fc640 1 -- 172.21.15.50:0/3265128481 >> v1:172.21.15.50:6789/0 conn(0x7fc32815f890 legacy=0x7fc32815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.237+0000 7fc3267fc640 1 -- 172.21.15.50:0/3265128481 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280d1560 con 0x7fc3280d1d60 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.237+0000 7fc3267fc640 1 --2- 172.21.15.50:0/3265128481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280d3ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097d0 tx=0x7fc31c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ccc49065c6ddbc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200019f0 con 0x7fc3280d1d60 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c02e050 con 0x7fc3280d1d60 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc325ffb640 1 -- 172.21.15.50:0/3265128481 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c030730 con 0x7fc3280d1d60 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc32d456640 1 -- 172.21.15.50:0/3265128481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 msgr2=0x7fc3280d3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc32d456640 1 --2- 172.21.15.50:0/3265128481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280d3ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0097d0 tx=0x7fc31c02b790 comp rx=0 tx=0).stop 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc32d456640 1 -- 172.21.15.50:0/3265128481 shutdown_connections 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc32d456640 1 --2- 172.21.15.50:0/3265128481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280d3ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc32d456640 1 -- 172.21.15.50:0/3265128481 >> 172.21.15.50:0/3265128481 conn(0x7fc3280d2fb0 msgr2=0x7fc3280d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc32d456640 1 -- 172.21.15.50:0/3265128481 shutdown_connections 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.238+0000 7fc32d456640 1 -- 172.21.15.50:0/3265128481 wait complete. 2023-12-08T08:18:48.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 Processor -- start 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 -- start start 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815d580 0x7fc3280c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32815f890 0x7fc3280cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280c9b80 con 0x7fc32815d580 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280ca990 con 0x7fc3280d1d60 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc32d456640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3281f6690 con 0x7fc32815f890 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc3267fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815d580 0x7fc3280c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc3267fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815d580 0x7fc3280c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41724/0 (socket says 172.21.15.50:41724) 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.240+0000 7fc3267fc640 1 -- 172.21.15.50:0/3446597821 learned_addr learned my addr 172.21.15.50:0/3446597821 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc326ffd640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3267fc640 1 -- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32815f890 msgr2=0x7fc3280cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3277fe640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32815f890 0x7fc3280cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3267fc640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32815f890 0x7fc3280cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3267fc640 1 -- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 msgr2=0x7fc3280c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3267fc640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3267fc640 1 -- 172.21.15.50:0/3446597821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009400 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc326ffd640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3277fe640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32815f890 0x7fc3280cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc3267fc640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815d580 0x7fc3280c7370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc31c000c00 tx=0x7fc31c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc30f7fe640 1 -- 172.21.15.50:0/3446597821 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c004230 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc30f7fe640 1 -- 172.21.15.50:0/3446597821 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c0043b0 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3281f6970 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc30f7fe640 1 -- 172.21.15.50:0/3446597821 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c004520 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.241+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3281f6f30 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.242+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3280d09d0 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.243+0000 7fc30f7fe640 1 -- 172.21.15.50:0/3446597821 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc31c039040 con 0x7fc32815d580 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.243+0000 7fc30f7fe640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc31406ae40 0x7fc31406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:48.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.243+0000 7fc30f7fe640 1 -- 172.21.15.50:0/3446597821 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc31c0aafa0 con 0x7fc32815d580 2023-12-08T08:18:48.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.244+0000 7fc326ffd640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc31406ae40 0x7fc31406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:48.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.244+0000 7fc326ffd640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc31406ae40 0x7fc31406d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc3180011e0 tx=0x7fc318009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:48.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.247+0000 7fc30f7fe640 1 -- 172.21.15.50:0/3446597821 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc31c0dde90 con 0x7fc32815d580 2023-12-08T08:18:48.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:48.493+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7fc3280cab60 con 0x7fc32815d580 2023-12-08T08:18:49.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.013+0000 7fc30f7fe640 1 -- 172.21.15.50:0/3446597821 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v71) v1 ==== 150+0+0 (secure 0 0 0) 0x7fc31c0370d0 con 0x7fc32815d580 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc31406ae40 msgr2=0x7fc31406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc31406ae40 0x7fc31406d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc3180011e0 tx=0x7fc318009040 comp rx=0 tx=0).stop 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815d580 msgr2=0x7fc3280c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815d580 0x7fc3280c7370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc31c000c00 tx=0x7fc31c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 shutdown_connections 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc31406ae40 0x7fc31406d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc32815d580 0x7fc3280c7370 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc32815f890 0x7fc3280cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 --2- 172.21.15.50:0/3446597821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3280d1d60 0x7fc3280c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 >> 172.21.15.50:0/3446597821 conn(0x7fc3280d2fb0 msgr2=0x7fc32806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 shutdown_connections 2023-12-08T08:18:49.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.015+0000 7fc32d456640 1 -- 172.21.15.50:0/3446597821 wait complete. 2023-12-08T08:18:49.031 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:18:49.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.144+0000 7f3989db0640 1 Processor -- start 2023-12-08T08:18:49.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.144+0000 7f3989db0640 1 -- start start 2023-12-08T08:18:49.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.144+0000 7f3989db0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 0x7f39840b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.144+0000 7f3989db0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39840b0920 0x7f39840b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f3989db0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840b2280 con 0x7f39840adb50 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f3989db0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398406bb40 con 0x7f39840b0920 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f3989db0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840b2710 con 0x7f398415d4f0 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f3983fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f39840adb50 0x7f39840adfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36698/0 (socket says 172.21.15.50:36698) 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f3983fff640 1 -- 172.21.15.50:0/1029344527 learned_addr learned my addr 172.21.15.50:0/1029344527 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f3982ffd640 1 --2- 172.21.15.50:0/1029344527 >> v2:172.21.15.170:3300/0 conn(0x7f39840b0920 0x7f39840b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39837fe640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 0x7f39840b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785642294 0 0) 0x7f39840b2280 con 0x7f39840adb50 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f396c003520 con 0x7f39840adb50 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424256884 0 0) 0x7f396c003520 con 0x7f39840adb50 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 msgr2=0x7f39840b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 0x7f39840b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 >> v2:172.21.15.170:3300/0 conn(0x7f39840b0920 msgr2=0x7f39840b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 --2- 172.21.15.50:0/1029344527 >> v2:172.21.15.170:3300/0 conn(0x7f39840b0920 0x7f39840b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840b1690 con 0x7f39840adb50 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f397c0019f0 con 0x7f39840adb50 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f3982ffd640 1 --2- 172.21.15.50:0/1029344527 >> v2:172.21.15.170:3300/0 conn(0x7f39840b0920 0x7f39840b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 >> v1:172.21.15.50:6789/0 conn(0x7f39840adb50 legacy=0x7f39840adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c003970 0x7f396c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 0x7f396c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c004d00 0x7f396c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398406bb40 con 0x7f396c003970 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840b2710 con 0x7f396c004d00 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c00b980 con 0x7f398415d4f0 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.145+0000 7f39837fe640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c003970 0x7f396c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.146+0000 7f3982ffd640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 0x7f396c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.146+0000 7f3983fff640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c004d00 0x7f396c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.146+0000 7f39837fe640 1 -- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 msgr2=0x7f396c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.146+0000 7f39837fe640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f398415d4f0 0x7f396c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.146+0000 7f39837fe640 1 -- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c004d00 msgr2=0x7f396c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.146+0000 7f39837fe640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c004d00 0x7f396c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.146+0000 7f39837fe640 1 -- 172.21.15.50:0/1029344527 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c003520 con 0x7f396c003970 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f39837fe640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c003970 0x7f396c003d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3974009ac0 tx=0x7f396c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f5f6f6767b47ff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397402c6b0 con 0x7f396c003970 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397402c810 con 0x7f396c003970 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f39827fc640 1 -- 172.21.15.50:0/1029344527 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397402cba0 con 0x7f396c003970 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f3989db0640 1 -- 172.21.15.50:0/1029344527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c003970 msgr2=0x7f396c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f3989db0640 1 --2- 172.21.15.50:0/1029344527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f396c003970 0x7f396c003d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3974009ac0 tx=0x7f396c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f3983fff640 1 -- 172.21.15.50:0/1029344527 reap_dead start 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f3989db0640 1 -- 172.21.15.50:0/1029344527 shutdown_connections 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f3989db0640 1 -- 172.21.15.50:0/1029344527 >> 172.21.15.50:0/1029344527 conn(0x7f39840d0e00 msgr2=0x7f39840d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f3989db0640 1 -- 172.21.15.50:0/1029344527 shutdown_connections 2023-12-08T08:18:49.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.147+0000 7f3989db0640 1 -- 172.21.15.50:0/1029344527 wait complete. 2023-12-08T08:18:49.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.148+0000 7f3989db0640 1 Processor -- start 2023-12-08T08:18:49.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.149+0000 7f3989db0640 1 -- start start 2023-12-08T08:18:49.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.149+0000 7f3989db0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c003970 0x7f39840cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.149+0000 7f3989db0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39840cc740 0x7f398414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.149+0000 7f3989db0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f398414f0e0 0x7f398414f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.149+0000 7f3989db0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840c97c0 con 0x7f398414f0e0 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.149+0000 7f3989db0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398415bd60 con 0x7f396c003970 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.149+0000 7f3989db0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840ccbe0 con 0x7f39840cc740 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f398414f0e0 0x7f398414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f398414f0e0 0x7f398414f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41744/0 (socket says 172.21.15.50:41744) 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 -- 172.21.15.50:0/896522589 learned_addr learned my addr 172.21.15.50:0/896522589 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f39837fe640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c003970 0x7f39840cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3982ffd640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39840cc740 0x7f398414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 -- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39840cc740 msgr2=0x7f398414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39840cc740 0x7f398414eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 -- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c003970 msgr2=0x7f39840cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c003970 0x7f39840cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 -- 172.21.15.50:0/896522589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840ccec0 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3983fff640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f398414f0e0 0x7f398414f570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f397c000f80 tx=0x7f397c007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f396bfff640 1 -- 172.21.15.50:0/896522589 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00ac80 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f396bfff640 1 -- 172.21.15.50:0/896522589 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00ae20 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f396bfff640 1 -- 172.21.15.50:0/896522589 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c013630 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39840cd1a0 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.150+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39840c8020 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.151+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39840c81b0 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.152+0000 7f396bfff640 1 -- 172.21.15.50:0/896522589 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f397c013790 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.152+0000 7f396bfff640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f397006ae40 0x7f397006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.152+0000 7f396bfff640 1 -- 172.21.15.50:0/896522589 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f397c089f50 con 0x7f398414f0e0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.152+0000 7f39837fe640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f397006ae40 0x7f397006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.153+0000 7f39837fe640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f397006ae40 0x7f397006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3974036000 tx=0x7f3974030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.156+0000 7f396bfff640 1 -- 172.21.15.50:0/896522589 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f397c054cd0 con 0x7f398414f0e0 2023-12-08T08:18:49.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.334+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3984067430 con 0x7f398414f0e0 2023-12-08T08:18:49.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.337+0000 7f396bfff640 1 -- 172.21.15.50:0/896522589 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f397c0582f0 con 0x7f398414f0e0 2023-12-08T08:18:49.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.339+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f397006ae40 msgr2=0x7f397006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.339+0000 7f3989db0640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f397006ae40 0x7f397006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3974036000 tx=0x7f3974030000 comp rx=0 tx=0).stop 2023-12-08T08:18:49.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.339+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f398414f0e0 msgr2=0x7f398414f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.339+0000 7f3989db0640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f398414f0e0 0x7f398414f570 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f397c000f80 tx=0x7f397c007b20 comp rx=0 tx=0).stop 2023-12-08T08:18:49.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 shutdown_connections 2023-12-08T08:18:49.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f397006ae40 0x7f397006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f398414f0e0 0x7f398414f570 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39840cc740 0x7f398414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 --2- 172.21.15.50:0/896522589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c003970 0x7f39840cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 >> 172.21.15.50:0/896522589 conn(0x7f39840d0e00 msgr2=0x7f398415c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 shutdown_connections 2023-12-08T08:18:49.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.340+0000 7f3989db0640 1 -- 172.21.15.50:0/896522589 wait complete. 2023-12-08T08:18:49.353 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:18:49.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:18:49.403 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:18:49.459 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:18:49.459 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:49.459 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:49.475 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:49.475 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:49.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:49.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.675+0000 7f2ed963d640 1 Processor -- start 2023-12-08T08:18:49.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.675+0000 7f2ed963d640 1 -- start start 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed963d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ed4140a10 0x7f2ed40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed963d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed4070db0 con 0x7f2ed40b2640 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed963d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed4071090 con 0x7f2ed4071e50 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed963d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed4070ba0 con 0x7f2ed4140a10 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2ed4140a10 0x7f2ed40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2ed40b2640 0x7f2ed406c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:36702/0 (socket says 172.21.15.50:36702) 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed37fe640 1 -- 172.21.15.50:0/362226469 learned_addr learned my addr 172.21.15.50:0/362226469 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed2ffd640 1 -- 172.21.15.50:0/362226469 >> v1:172.21.15.170:6789/0 conn(0x7f2ed4071e50 legacy=0x7f2ed40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed2ffd640 1 -- 172.21.15.50:0/362226469 >> v1:172.21.15.50:6789/0 conn(0x7f2ed40b2640 legacy=0x7f2ed406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed1ffb640 1 -- 172.21.15.50:0/362226469 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372820122 0 0) 0x7f2ed4070db0 con 0x7f2ed40b2640 2023-12-08T08:18:49.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.676+0000 7f2ed2ffd640 1 -- 172.21.15.50:0/362226469 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed4071370 con 0x7f2ed4140a10 2023-12-08T08:18:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.677+0000 7f2ed2ffd640 1 --2- 172.21.15.50:0/362226469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4140a10 0x7f2ed40cdcd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40097a0 tx=0x7f2ec402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e62e7a205535ac server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.677+0000 7f2ed1ffb640 1 -- 172.21.15.50:0/362226469 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec402f810 con 0x7f2ed4140a10 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.677+0000 7f2ed1ffb640 1 -- 172.21.15.50:0/362226469 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec402f970 con 0x7f2ed4140a10 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.677+0000 7f2ed1ffb640 1 -- 172.21.15.50:0/362226469 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec402fd00 con 0x7f2ed4140a10 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.678+0000 7f2ed963d640 1 -- 172.21.15.50:0/362226469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4140a10 msgr2=0x7f2ed40cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.678+0000 7f2ed963d640 1 --2- 172.21.15.50:0/362226469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4140a10 0x7f2ed40cdcd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40097a0 tx=0x7f2ec402b9f0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.678+0000 7f2ed963d640 1 -- 172.21.15.50:0/362226469 shutdown_connections 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.678+0000 7f2ed963d640 1 --2- 172.21.15.50:0/362226469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4140a10 0x7f2ed40cdcd0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.678+0000 7f2ed963d640 1 -- 172.21.15.50:0/362226469 >> 172.21.15.50:0/362226469 conn(0x7f2ed40b09f0 msgr2=0x7f2ed40b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.678+0000 7f2ed963d640 1 -- 172.21.15.50:0/362226469 shutdown_connections 2023-12-08T08:18:49.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.678+0000 7f2ed963d640 1 -- 172.21.15.50:0/362226469 wait complete. 2023-12-08T08:18:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.679+0000 7f2ed963d640 1 Processor -- start 2023-12-08T08:18:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.679+0000 7f2ed963d640 1 -- start start 2023-12-08T08:18:49.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed963d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4071e50 0x7f2ed40afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed963d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ed40b2640 0x7f2ed40b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed963d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed4140a10 0x7f2ed415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed963d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed4132330 con 0x7f2ed4071e50 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed963d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed415bbf0 con 0x7f2ed40b2640 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed963d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed415be90 con 0x7f2ed4140a10 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4071e50 0x7f2ed40afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4071e50 0x7f2ed40afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41756/0 (socket says 172.21.15.50:41756) 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 -- 172.21.15.50:0/4280890599 learned_addr learned my addr 172.21.15.50:0/4280890599 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed27fc640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ed40b2640 0x7f2ed40b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed37fe640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed4140a10 0x7f2ed415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 -- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed4140a10 msgr2=0x7f2ed415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed4140a10 0x7f2ed415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 -- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ed40b2640 msgr2=0x7f2ed40b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ed40b2640 0x7f2ed40b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.680+0000 7f2ed2ffd640 1 -- 172.21.15.50:0/4280890599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec4009400 con 0x7f2ed4071e50 2023-12-08T08:18:49.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.681+0000 7f2ed2ffd640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4071e50 0x7f2ed40afae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40098c0 tx=0x7f2ec4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.681+0000 7f2ebb7fe640 1 -- 172.21.15.50:0/4280890599 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec403c040 con 0x7f2ed4071e50 2023-12-08T08:18:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.681+0000 7f2ebb7fe640 1 -- 172.21.15.50:0/4280890599 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec40379f0 con 0x7f2ed4071e50 2023-12-08T08:18:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.681+0000 7f2ebb7fe640 1 -- 172.21.15.50:0/4280890599 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4037da0 con 0x7f2ed4071e50 2023-12-08T08:18:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.681+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed415c170 con 0x7f2ed4071e50 2023-12-08T08:18:49.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.681+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed415c730 con 0x7f2ed4071e50 2023-12-08T08:18:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.682+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed415c920 con 0x7f2ed4071e50 2023-12-08T08:18:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.682+0000 7f2ebb7fe640 1 -- 172.21.15.50:0/4280890599 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ec402d3a0 con 0x7f2ed4071e50 2023-12-08T08:18:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.683+0000 7f2ebb7fe640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ec006ae40 0x7f2ec006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.683+0000 7f2ebb7fe640 1 -- 172.21.15.50:0/4280890599 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2ec40ab7e0 con 0x7f2ed4071e50 2023-12-08T08:18:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.683+0000 7f2ed27fc640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ec006ae40 0x7f2ec006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.684+0000 7f2ed27fc640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ec006ae40 0x7f2ec006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ed409bf30 tx=0x7f2ec8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.687+0000 7f2ebb7fe640 1 -- 172.21.15.50:0/4280890599 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ec40764b0 con 0x7f2ed4071e50 2023-12-08T08:18:49.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.865+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ed4067430 con 0x7f2ed4071e50 2023-12-08T08:18:49.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.866+0000 7f2ebb7fe640 1 -- 172.21.15.50:0/4280890599 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f2ec4079ad0 con 0x7f2ed4071e50 2023-12-08T08:18:49.869 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:49.869 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:49.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ec006ae40 msgr2=0x7f2ec006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ec006ae40 0x7f2ec006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2ed409bf30 tx=0x7f2ec8009040 comp rx=0 tx=0).stop 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4071e50 msgr2=0x7f2ed40afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4071e50 0x7f2ed40afae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40098c0 tx=0x7f2ec4004730 comp rx=0 tx=0).stop 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 shutdown_connections 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ec006ae40 0x7f2ec006d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed4140a10 0x7f2ed415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ed40b2640 0x7f2ed40b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 --2- 172.21.15.50:0/4280890599 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ed4071e50 0x7f2ed40afae0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 >> 172.21.15.50:0/4280890599 conn(0x7f2ed40b09f0 msgr2=0x7f2ed406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 shutdown_connections 2023-12-08T08:18:49.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.868+0000 7f2ed963d640 1 -- 172.21.15.50:0/4280890599 wait complete. 2023-12-08T08:18:49.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:49.883 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.992+0000 7f9f2a9be640 1 Processor -- start 2023-12-08T08:18:49.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.992+0000 7f9f2a9be640 1 -- start start 2023-12-08T08:18:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f2a9be640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f240b0c20 0x7f9f24166150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f2a9be640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240ce360 con 0x7f9f2415e730 2023-12-08T08:18:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f2a9be640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240ce640 con 0x7f9f240cd1c0 2023-12-08T08:18:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f2a9be640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240cbda0 con 0x7f9f240b0c20 2023-12-08T08:18:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f28f5b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9f240b0c20 0x7f9f24166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:49.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f23fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9f2415e730 0x7f9f240cc5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40978/0 (socket says 172.21.15.50:40978) 2023-12-08T08:18:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f23fff640 1 -- 172.21.15.50:0/2114906390 learned_addr learned my addr 172.21.15.50:0/2114906390 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f28f5b640 1 -- 172.21.15.50:0/2114906390 >> v1:172.21.15.170:6789/0 conn(0x7f9f240cd1c0 legacy=0x7f9f240b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f28f5b640 1 -- 172.21.15.50:0/2114906390 >> v1:172.21.15.50:6789/0 conn(0x7f9f2415e730 legacy=0x7f9f240cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.993+0000 7f9f28f5b640 1 -- 172.21.15.50:0/2114906390 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240cc080 con 0x7f9f240b0c20 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f28f5b640 1 --2- 172.21.15.50:0/2114906390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240b0c20 0x7f9f24166150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009d90 tx=0x7f9f1c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac303fae768e43f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f22ffd640 1 -- 172.21.15.50:0/2114906390 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c02cd00 con 0x7f9f240b0c20 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f22ffd640 1 -- 172.21.15.50:0/2114906390 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c02ce60 con 0x7f9f240b0c20 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f22ffd640 1 -- 172.21.15.50:0/2114906390 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c034660 con 0x7f9f240b0c20 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2114906390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240b0c20 msgr2=0x7f9f24166150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2114906390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240b0c20 0x7f9f24166150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009d90 tx=0x7f9f1c02bf50 comp rx=0 tx=0).stop 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2114906390 shutdown_connections 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2114906390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240b0c20 0x7f9f24166150 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2114906390 >> 172.21.15.50:0/2114906390 conn(0x7f9f240d0e10 msgr2=0x7f9f240d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:49.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.994+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2114906390 shutdown_connections 2023-12-08T08:18:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.995+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2114906390 wait complete. 2023-12-08T08:18:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.996+0000 7f9f2a9be640 1 Processor -- start 2023-12-08T08:18:49.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.996+0000 7f9f2a9be640 1 -- start start 2023-12-08T08:18:50.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f240b0c20 0x7f9f240c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240cd1c0 0x7f9f240c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2415e730 0x7f9f240c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24152c00 con 0x7f9f240cd1c0 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2406cf00 con 0x7f9f2415e730 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240adf00 con 0x7f9f240b0c20 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240cd1c0 0x7f9f240c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240cd1c0 0x7f9f240c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50610/0 (socket says 172.21.15.50:50610) 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 -- 172.21.15.50:0/2804571718 learned_addr learned my addr 172.21.15.50:0/2804571718 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f28f5b640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2415e730 0x7f9f240c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f23fff640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f240b0c20 0x7f9f240c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 -- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f240b0c20 msgr2=0x7f9f240c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f240b0c20 0x7f9f240c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 -- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2415e730 msgr2=0x7f9f240c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2415e730 0x7f9f240c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 -- 172.21.15.50:0/2804571718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c009a70 con 0x7f9f240cd1c0 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f28f5b640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2415e730 0x7f9f240c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:50.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f23fff640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f240b0c20 0x7f9f240c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f237fe640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240cd1c0 0x7f9f240c9210 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800c450 tx=0x7f9f1800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f20ff9640 1 -- 172.21.15.50:0/2804571718 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f180052d0 con 0x7f9f240cd1c0 2023-12-08T08:18:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f20ff9640 1 -- 172.21.15.50:0/2804571718 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f18005430 con 0x7f9f240cd1c0 2023-12-08T08:18:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240ae1e0 con 0x7f9f240cd1c0 2023-12-08T08:18:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f20ff9640 1 -- 172.21.15.50:0/2804571718 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f18012870 con 0x7f9f240cd1c0 2023-12-08T08:18:50.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.997+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f240ae7a0 con 0x7f9f240cd1c0 2023-12-08T08:18:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.999+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f240ae9c0 con 0x7f9f240cd1c0 2023-12-08T08:18:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.999+0000 7f9f20ff9640 1 -- 172.21.15.50:0/2804571718 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f180129d0 con 0x7f9f240cd1c0 2023-12-08T08:18:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.999+0000 7f9f20ff9640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9f1006ae40 0x7f9f1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:49.999+0000 7f9f20ff9640 1 -- 172.21.15.50:0/2804571718 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9f18089540 con 0x7f9f240cd1c0 2023-12-08T08:18:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.000+0000 7f9f23fff640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9f1006ae40 0x7f9f1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.000+0000 7f9f23fff640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9f1006ae40 0x7f9f1006d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9f14005880 tx=0x7f9f14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.003+0000 7f9f20ff9640 1 -- 172.21.15.50:0/2804571718 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f18054210 con 0x7f9f240cd1c0 2023-12-08T08:18:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.178+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f240cb9e0 con 0x7f9f240cd1c0 2023-12-08T08:18:50.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.178+0000 7f9f20ff9640 1 -- 172.21.15.50:0/2804571718 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f18057830 con 0x7f9f240cd1c0 2023-12-08T08:18:50.181 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:50.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9f1006ae40 msgr2=0x7f9f1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9f1006ae40 0x7f9f1006d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9f14005880 tx=0x7f9f14009040 comp rx=0 tx=0).stop 2023-12-08T08:18:50.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240cd1c0 msgr2=0x7f9f240c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240cd1c0 0x7f9f240c9210 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9f1800c450 tx=0x7f9f1800c910 comp rx=0 tx=0).stop 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 shutdown_connections 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9f1006ae40 0x7f9f1006d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f240cd1c0 0x7f9f240c9210 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2415e730 0x7f9f240c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 --2- 172.21.15.50:0/2804571718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f240b0c20 0x7f9f240c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.180+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 >> 172.21.15.50:0/2804571718 conn(0x7f9f240d0e10 msgr2=0x7f9f2406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.181+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 shutdown_connections 2023-12-08T08:18:50.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.181+0000 7f9f2a9be640 1 -- 172.21.15.50:0/2804571718 wait complete. 2023-12-08T08:18:50.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.300+0000 7f5f4efa0640 1 Processor -- start 2023-12-08T08:18:50.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.301+0000 7f5f4efa0640 1 -- start start 2023-12-08T08:18:50.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.301+0000 7f5f4efa0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f4815d3f0 0x7f5f480d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.301+0000 7f5f4efa0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5f480cea60 0x7f5f480d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.301+0000 7f5f4efa0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f480cee70 con 0x7f5f480d0c90 2023-12-08T08:18:50.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.301+0000 7f5f4efa0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f480d02a0 con 0x7f5f4815d3f0 2023-12-08T08:18:50.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.301+0000 7f5f4efa0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f480b2310 con 0x7f5f480cea60 2023-12-08T08:18:50.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4df9e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5f4815d3f0 0x7f5f480d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4d79d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5f480d0c90 0x7f5f480b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40994/0 (socket says 172.21.15.50:40994) 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4d79d640 1 -- 172.21.15.50:0/2224215658 learned_addr learned my addr 172.21.15.50:0/2224215658 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4df9e640 1 -- 172.21.15.50:0/2224215658 >> v2:172.21.15.170:3300/0 conn(0x7f5f480cea60 msgr2=0x7f5f480d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4e79f640 1 --2- 172.21.15.50:0/2224215658 >> v2:172.21.15.170:3300/0 conn(0x7f5f480cea60 0x7f5f480d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4df9e640 1 --2- 172.21.15.50:0/2224215658 >> v2:172.21.15.170:3300/0 conn(0x7f5f480cea60 0x7f5f480d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4cf9c640 1 -- 172.21.15.50:0/2224215658 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118416835 0 0) 0x7f5f480cee70 con 0x7f5f480d0c90 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4df9e640 1 -- 172.21.15.50:0/2224215658 >> v1:172.21.15.50:6789/0 conn(0x7f5f480d0c90 legacy=0x7f5f480b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4df9e640 1 -- 172.21.15.50:0/2224215658 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480d39d0 con 0x7f5f4815d3f0 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.302+0000 7f5f4e79f640 1 --2- 172.21.15.50:0/2224215658 >> v2:172.21.15.170:3300/0 conn(0x7f5f480cea60 0x7f5f480d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4df9e640 1 --2- 172.21.15.50:0/2224215658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4815d3f0 0x7f5f480d1490 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5f4806acd0 tx=0x7f5f4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c5ad9f34fe3a85 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4cf9c640 1 -- 172.21.15.50:0/2224215658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4402e070 con 0x7f5f4815d3f0 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4cf9c640 1 -- 172.21.15.50:0/2224215658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440315a0 con 0x7f5f4815d3f0 2023-12-08T08:18:50.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4cf9c640 1 -- 172.21.15.50:0/2224215658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44031930 con 0x7f5f4815d3f0 2023-12-08T08:18:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2224215658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4815d3f0 msgr2=0x7f5f480d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2224215658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4815d3f0 0x7f5f480d1490 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5f4806acd0 tx=0x7f5f4402b840 comp rx=0 tx=0).stop 2023-12-08T08:18:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2224215658 shutdown_connections 2023-12-08T08:18:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2224215658 >> v2:172.21.15.170:3300/0 conn(0x7f5f480cea60 0x7f5f480d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2224215658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f4815d3f0 0x7f5f480d1490 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.303+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2224215658 >> 172.21.15.50:0/2224215658 conn(0x7f5f480d2eb0 msgr2=0x7f5f480d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.304+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2224215658 shutdown_connections 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.304+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2224215658 wait complete. 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 Processor -- start 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 -- start start 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f480cea60 0x7f5f480cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f480d0c90 0x7f5f481600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f4815d3f0 0x7f5f4815b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4815ed20 con 0x7f5f480cea60 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4815f000 con 0x7f5f480d0c90 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.305+0000 7f5f4efa0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4815f2e0 con 0x7f5f4815d3f0 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f480cea60 0x7f5f480cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f480cea60 0x7f5f480cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50620/0 (socket says 172.21.15.50:50620) 2023-12-08T08:18:50.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 -- 172.21.15.50:0/2873922848 learned_addr learned my addr 172.21.15.50:0/2873922848 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4d79d640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f480d0c90 0x7f5f481600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4e79f640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f4815d3f0 0x7f5f4815b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 -- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f4815d3f0 msgr2=0x7f5f4815b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f4815d3f0 0x7f5f4815b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 -- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f480d0c90 msgr2=0x7f5f481600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f480d0c90 0x7f5f481600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 -- 172.21.15.50:0/2873922848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009400 con 0x7f5f480cea60 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4df9e640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f480cea60 0x7f5f480cc0d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009890 tx=0x7f5f440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f3e7fc640 1 -- 172.21.15.50:0/2873922848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44032900 con 0x7f5f480cea60 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f3e7fc640 1 -- 172.21.15.50:0/2873922848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44032a60 con 0x7f5f480cea60 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4815f5c0 con 0x7f5f480cea60 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f3e7fc640 1 -- 172.21.15.50:0/2873922848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44032e10 con 0x7f5f480cea60 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.306+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f481f28a0 con 0x7f5f480cea60 2023-12-08T08:18:50.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.307+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f480673c0 con 0x7f5f480cea60 2023-12-08T08:18:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.308+0000 7f5f3e7fc640 1 -- 172.21.15.50:0/2873922848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f4403b3f0 con 0x7f5f480cea60 2023-12-08T08:18:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.308+0000 7f5f3e7fc640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5f2c06ae40 0x7f5f2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.308+0000 7f5f3e7fc640 1 -- 172.21.15.50:0/2873922848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5f440abb80 con 0x7f5f480cea60 2023-12-08T08:18:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.308+0000 7f5f4d79d640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5f2c06ae40 0x7f5f2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.309+0000 7f5f4d79d640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5f2c06ae40 0x7f5f2c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5f480b0e40 tx=0x7f5f38007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.312+0000 7f5f3e7fc640 1 -- 172.21.15.50:0/2873922848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f44076850 con 0x7f5f480cea60 2023-12-08T08:18:50.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.488+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f480d1270 con 0x7f5f480cea60 2023-12-08T08:18:50.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.488+0000 7f5f3e7fc640 1 -- 172.21.15.50:0/2873922848 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f44079e70 con 0x7f5f480cea60 2023-12-08T08:18:50.495 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5f2c06ae40 msgr2=0x7f5f2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5f2c06ae40 0x7f5f2c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5f480b0e40 tx=0x7f5f38007c00 comp rx=0 tx=0).stop 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f480cea60 msgr2=0x7f5f480cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f480cea60 0x7f5f480cc0d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009890 tx=0x7f5f440046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 shutdown_connections 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5f2c06ae40 0x7f5f2c06d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f4815d3f0 0x7f5f4815b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f480d0c90 0x7f5f481600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 --2- 172.21.15.50:0/2873922848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f480cea60 0x7f5f480cc0d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 >> 172.21.15.50:0/2873922848 conn(0x7f5f480d2eb0 msgr2=0x7f5f480b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.490+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 shutdown_connections 2023-12-08T08:18:50.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.491+0000 7f5f4efa0640 1 -- 172.21.15.50:0/2873922848 wait complete. 2023-12-08T08:18:50.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:50.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.612+0000 7fb1a8d0f640 1 Processor -- start 2023-12-08T08:18:50.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.612+0000 7fb1a8d0f640 1 -- start start 2023-12-08T08:18:50.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a8d0f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a8d0f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb1a40cc380 0x7fb1a40b1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a8d0f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40cce00 con 0x7fb1a415e790 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a8d0f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a40b0f00 con 0x7fb1a40cc380 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a8d0f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40ccb20 con 0x7fb1a40cde00 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a1d9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a2d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb1a40cc380 0x7fb1a40b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a259c640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb1a415e790 0x7fb1a40cd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:37780/0 (socket says 172.21.15.50:37780) 2023-12-08T08:18:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.613+0000 7fb1a259c640 1 -- 172.21.15.50:0/435370710 learned_addr learned my addr 172.21.15.50:0/435370710 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:50.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.614+0000 7fb1a2d9d640 1 -- 172.21.15.50:0/435370710 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 msgr2=0x7fb1a40ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.614+0000 7fb1a2d9d640 1 --2- 172.21.15.50:0/435370710 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.614+0000 7fb1a2d9d640 1 -- 172.21.15.50:0/435370710 >> v1:172.21.15.170:6789/0 conn(0x7fb1a415e790 legacy=0x7fb1a40cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.614+0000 7fb1a2d9d640 1 -- 172.21.15.50:0/435370710 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40b08b0 con 0x7fb1a40cc380 2023-12-08T08:18:50.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.615+0000 7fb1a2d9d640 1 --2- 172.21.15.50:0/435370710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a40cc380 0x7fb1a40b1390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb194009d90 tx=0x7fb19402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a8ac25f2db89a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.615+0000 7fb1a159a640 1 -- 172.21.15.50:0/435370710 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19402cbc0 con 0x7fb1a40cc380 2023-12-08T08:18:50.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.615+0000 7fb1a159a640 1 -- 172.21.15.50:0/435370710 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19402cd20 con 0x7fb1a40cc380 2023-12-08T08:18:50.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.615+0000 7fb1a159a640 1 -- 172.21.15.50:0/435370710 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194034660 con 0x7fb1a40cc380 2023-12-08T08:18:50.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/435370710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a40cc380 msgr2=0x7fb1a40b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/435370710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a40cc380 0x7fb1a40b1390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb194009d90 tx=0x7fb19402be10 comp rx=0 tx=0).stop 2023-12-08T08:18:50.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/435370710 shutdown_connections 2023-12-08T08:18:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/435370710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a40cc380 0x7fb1a40b1390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/435370710 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/435370710 >> 172.21.15.50:0/435370710 conn(0x7fb1a40d0e00 msgr2=0x7fb1a40d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/435370710 shutdown_connections 2023-12-08T08:18:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.616+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/435370710 wait complete. 2023-12-08T08:18:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.617+0000 7fb1a8d0f640 1 Processor -- start 2023-12-08T08:18:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.617+0000 7fb1a8d0f640 1 -- start start 2023-12-08T08:18:50.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a8d0f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a40cc380 0x7fb1a40c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a8d0f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a8d0f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a415e790 0x7fb1a40c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a8d0f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4152b10 con 0x7fb1a40cc380 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a8d0f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4158550 con 0x7fb1a415e790 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a8d0f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a41524c0 con 0x7fb1a40cde00 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a40cc380 0x7fb1a40c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a40cc380 0x7fb1a40c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50636/0 (socket says 172.21.15.50:50636) 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 -- 172.21.15.50:0/1677101382 learned_addr learned my addr 172.21.15.50:0/1677101382 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a2d9d640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a415e790 0x7fb1a40c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a1d9b640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 -- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 msgr2=0x7fb1a40c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 -- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a415e790 msgr2=0x7fb1a40c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a415e790 0x7fb1a40c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a259c640 1 -- 172.21.15.50:0/1677101382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194009a70 con 0x7fb1a40cc380 2023-12-08T08:18:50.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.618+0000 7fb1a2d9d640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a415e790 0x7fb1a40c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:50.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.619+0000 7fb1a259c640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a40cc380 0x7fb1a40c8f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c480 tx=0x7fb19c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.619+0000 7fb19affd640 1 -- 172.21.15.50:0/1677101382 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c005ce0 con 0x7fb1a40cc380 2023-12-08T08:18:50.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.619+0000 7fb19affd640 1 -- 172.21.15.50:0/1677101382 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c005e40 con 0x7fb1a40cc380 2023-12-08T08:18:50.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.619+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a41527a0 con 0x7fb1a40cc380 2023-12-08T08:18:50.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.619+0000 7fb19affd640 1 -- 172.21.15.50:0/1677101382 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0072f0 con 0x7fb1a40cc380 2023-12-08T08:18:50.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.619+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a41557b0 con 0x7fb1a40cc380 2023-12-08T08:18:50.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.620+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a4067430 con 0x7fb1a40cc380 2023-12-08T08:18:50.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.621+0000 7fb19affd640 1 -- 172.21.15.50:0/1677101382 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb19c007510 con 0x7fb1a40cc380 2023-12-08T08:18:50.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.621+0000 7fb19affd640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb18406ae40 0x7fb18406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.621+0000 7fb19affd640 1 -- 172.21.15.50:0/1677101382 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb19c088de0 con 0x7fb1a40cc380 2023-12-08T08:18:50.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.621+0000 7fb1a1d9b640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb18406ae40 0x7fb18406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.622+0000 7fb1a1d9b640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb18406ae40 0x7fb18406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb1a415df60 tx=0x7fb18c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.625+0000 7fb19affd640 1 -- 172.21.15.50:0/1677101382 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb19c053bf0 con 0x7fb1a40cc380 2023-12-08T08:18:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.802+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1a4067d70 con 0x7fb1a40cc380 2023-12-08T08:18:50.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.803+0000 7fb19affd640 1 -- 172.21.15.50:0/1677101382 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb19c017020 con 0x7fb1a40cc380 2023-12-08T08:18:50.805 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb18406ae40 msgr2=0x7fb18406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb18406ae40 0x7fb18406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb1a415df60 tx=0x7fb18c008040 comp rx=0 tx=0).stop 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a40cc380 msgr2=0x7fb1a40c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a40cc380 0x7fb1a40c8f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c480 tx=0x7fb19c00c940 comp rx=0 tx=0).stop 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 shutdown_connections 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb18406ae40 0x7fb18406d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1a415e790 0x7fb1a40c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1a40cde00 0x7fb1a40c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 --2- 172.21.15.50:0/1677101382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1a40cc380 0x7fb1a40c8f20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 >> 172.21.15.50:0/1677101382 conn(0x7fb1a40d0e00 msgr2=0x7fb1a40afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 shutdown_connections 2023-12-08T08:18:50.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.805+0000 7fb1a8d0f640 1 -- 172.21.15.50:0/1677101382 wait complete. 2023-12-08T08:18:50.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:50.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.929+0000 7fa130809640 1 Processor -- start 2023-12-08T08:18:50.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.929+0000 7fa130809640 1 -- start start 2023-12-08T08:18:50.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa130809640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa12c0cde00 0x7fa12c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa130809640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c0cce00 con 0x7fa12c15e790 2023-12-08T08:18:50.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa130809640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c0b0f00 con 0x7fa12c0cc380 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa130809640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c0ccb20 con 0x7fa12c0cde00 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa123fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa12c0cde00 0x7fa12c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa12a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa12c15e790 0x7fa12c0cd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41002/0 (socket says 172.21.15.50:41002) 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa12a59c640 1 -- 172.21.15.50:0/1358394142 learned_addr learned my addr 172.21.15.50:0/1358394142 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa123fff640 1 -- 172.21.15.50:0/1358394142 >> v1:172.21.15.170:6789/0 conn(0x7fa12c0cc380 legacy=0x7fa12c0b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa123fff640 1 -- 172.21.15.50:0/1358394142 >> v1:172.21.15.50:6789/0 conn(0x7fa12c15e790 legacy=0x7fa12c0cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa129d9b640 1 -- 172.21.15.50:0/1358394142 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596677236 0 0) 0x7fa12c0cce00 con 0x7fa12c15e790 2023-12-08T08:18:50.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.930+0000 7fa123fff640 1 -- 172.21.15.50:0/1358394142 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0b08b0 con 0x7fa12c0cde00 2023-12-08T08:18:50.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.931+0000 7fa123fff640 1 --2- 172.21.15.50:0/1358394142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c0cde00 0x7fa12c0ce300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097a0 tx=0x7fa11402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92af356a0efd10a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.931+0000 7fa129d9b640 1 -- 172.21.15.50:0/1358394142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11402e070 con 0x7fa12c0cde00 2023-12-08T08:18:50.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.931+0000 7fa129d9b640 1 -- 172.21.15.50:0/1358394142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1140315a0 con 0x7fa12c0cde00 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.931+0000 7fa129d9b640 1 -- 172.21.15.50:0/1358394142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114031930 con 0x7fa12c0cde00 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.931+0000 7fa130809640 1 -- 172.21.15.50:0/1358394142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c0cde00 msgr2=0x7fa12c0ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.931+0000 7fa130809640 1 --2- 172.21.15.50:0/1358394142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c0cde00 0x7fa12c0ce300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097a0 tx=0x7fa11402b840 comp rx=0 tx=0).stop 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.932+0000 7fa130809640 1 -- 172.21.15.50:0/1358394142 shutdown_connections 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.932+0000 7fa130809640 1 --2- 172.21.15.50:0/1358394142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c0cde00 0x7fa12c0ce300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.932+0000 7fa130809640 1 -- 172.21.15.50:0/1358394142 >> 172.21.15.50:0/1358394142 conn(0x7fa12c0d0e00 msgr2=0x7fa12c0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.932+0000 7fa130809640 1 -- 172.21.15.50:0/1358394142 shutdown_connections 2023-12-08T08:18:50.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.932+0000 7fa130809640 1 -- 172.21.15.50:0/1358394142 wait complete. 2023-12-08T08:18:50.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.933+0000 7fa130809640 1 Processor -- start 2023-12-08T08:18:50.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.933+0000 7fa130809640 1 -- start start 2023-12-08T08:18:50.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa130809640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa12c0cc380 0x7fa12c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa130809640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa12c0cde00 0x7fa12c0b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa130809640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c15e790 0x7fa12c0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa130809640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0b5ef0 con 0x7fa12c15e790 2023-12-08T08:18:50.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa130809640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c152aa0 con 0x7fa12c0cde00 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa130809640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0b53b0 con 0x7fa12c0cc380 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c15e790 0x7fa12c0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c15e790 0x7fa12c0b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50652/0 (socket says 172.21.15.50:50652) 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 -- 172.21.15.50:0/3340902831 learned_addr learned my addr 172.21.15.50:0/3340902831 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa123fff640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa12c0cde00 0x7fa12c0b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 -- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa12c0cc380 msgr2=0x7fa12c152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12a59c640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa12c0cc380 0x7fa12c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa12c0cc380 0x7fa12c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 -- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa12c0cde00 msgr2=0x7fa12c0b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa12c0cde00 0x7fa12c0b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 -- 172.21.15.50:0/3340902831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114009400 con 0x7fa12c15e790 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa123fff640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa12c0cde00 0x7fa12c0b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa12ad9d640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c15e790 0x7fa12c0b2f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c7b0 tx=0x7fa12400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.934+0000 7fa122ffd640 1 -- 172.21.15.50:0/3340902831 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124004b60 con 0x7fa12c15e790 2023-12-08T08:18:50.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.935+0000 7fa122ffd640 1 -- 172.21.15.50:0/3340902831 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa124004cc0 con 0x7fa12c15e790 2023-12-08T08:18:50.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.935+0000 7fa122ffd640 1 -- 172.21.15.50:0/3340902831 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12400aa90 con 0x7fa12c15e790 2023-12-08T08:18:50.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.935+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c0b5650 con 0x7fa12c15e790 2023-12-08T08:18:50.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.935+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c0b5c10 con 0x7fa12c15e790 2023-12-08T08:18:50.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.936+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c067430 con 0x7fa12c15e790 2023-12-08T08:18:50.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.936+0000 7fa122ffd640 1 -- 172.21.15.50:0/3340902831 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa12400abf0 con 0x7fa12c15e790 2023-12-08T08:18:50.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.936+0000 7fa122ffd640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa10c06ae70 0x7fa10c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:50.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.936+0000 7fa122ffd640 1 -- 172.21.15.50:0/3340902831 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa124089b80 con 0x7fa12c15e790 2023-12-08T08:18:50.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.937+0000 7fa12a59c640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa10c06ae70 0x7fa10c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:50.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.937+0000 7fa12a59c640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa10c06ae70 0x7fa10c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000f60 tx=0x7fa11c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:50.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:50.941+0000 7fa122ffd640 1 -- 172.21.15.50:0/3340902831 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa124054850 con 0x7fa12c15e790 2023-12-08T08:18:51.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.117+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa12c0cdbc0 con 0x7fa12c15e790 2023-12-08T08:18:51.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.117+0000 7fa122ffd640 1 -- 172.21.15.50:0/3340902831 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa124057e70 con 0x7fa12c15e790 2023-12-08T08:18:51.120 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:51.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa10c06ae70 msgr2=0x7fa10c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa10c06ae70 0x7fa10c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000f60 tx=0x7fa11c009040 comp rx=0 tx=0).stop 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c15e790 msgr2=0x7fa12c0b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c15e790 0x7fa12c0b2f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c7b0 tx=0x7fa12400cc70 comp rx=0 tx=0).stop 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 shutdown_connections 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa10c06ae70 0x7fa10c06d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa12c15e790 0x7fa12c0b2f10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa12c0cde00 0x7fa12c0b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 --2- 172.21.15.50:0/3340902831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa12c0cc380 0x7fa12c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 >> 172.21.15.50:0/3340902831 conn(0x7fa12c0d0e00 msgr2=0x7fa12c0d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 shutdown_connections 2023-12-08T08:18:51.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.119+0000 7fa130809640 1 -- 172.21.15.50:0/3340902831 wait complete. 2023-12-08T08:18:51.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:51.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.238+0000 7f9ec7083640 1 Processor -- start 2023-12-08T08:18:51.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.238+0000 7f9ec7083640 1 -- start start 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec7083640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ec00d1d00 0x7f9ec00d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec7083640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9ec00b3bf0 0x7f9ec00b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec7083640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00cdc20 con 0x7f9ec00b3340 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec7083640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00d11d0 con 0x7f9ec00d1d00 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec7083640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00d3a60 con 0x7f9ec00b3bf0 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ebffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9ec00d1d00 0x7f9ec00d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec4e1f640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ec00b3340 0x7f9ec00d15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41012/0 (socket says 172.21.15.50:41012) 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec4e1f640 1 -- 172.21.15.50:0/3517959027 learned_addr learned my addr 172.21.15.50:0/3517959027 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.239+0000 7f9ec5620640 1 --2- 172.21.15.50:0/3517959027 >> v2:172.21.15.170:3300/0 conn(0x7f9ec00b3bf0 0x7f9ec00b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebffff640 1 -- 172.21.15.50:0/3517959027 >> v2:172.21.15.170:3300/0 conn(0x7f9ec00b3bf0 msgr2=0x7f9ec00b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebffff640 1 --2- 172.21.15.50:0/3517959027 >> v2:172.21.15.170:3300/0 conn(0x7f9ec00b3bf0 0x7f9ec00b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebffff640 1 -- 172.21.15.50:0/3517959027 >> v1:172.21.15.50:6789/0 conn(0x7f9ec00b3340 legacy=0x7f9ec00d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebffff640 1 -- 172.21.15.50:0/3517959027 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00d3d40 con 0x7f9ec00d1d00 2023-12-08T08:18:51.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ec5620640 1 --2- 172.21.15.50:0/3517959027 >> v2:172.21.15.170:3300/0 conn(0x7f9ec00b3bf0 0x7f9ec00b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebffff640 1 --2- 172.21.15.50:0/3517959027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec00d00c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00b4970 tx=0x7f9eb002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fc07c010d4dc26 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebf7fe640 1 -- 172.21.15.50:0/3517959027 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb002e070 con 0x7f9ec00d1d00 2023-12-08T08:18:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebf7fe640 1 -- 172.21.15.50:0/3517959027 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb00315a0 con 0x7f9ec00d1d00 2023-12-08T08:18:51.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.240+0000 7f9ebf7fe640 1 -- 172.21.15.50:0/3517959027 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0031930 con 0x7f9ec00d1d00 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 -- 172.21.15.50:0/3517959027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 msgr2=0x7f9ec00d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 --2- 172.21.15.50:0/3517959027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec00d00c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00b4970 tx=0x7f9eb002b840 comp rx=0 tx=0).stop 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 -- 172.21.15.50:0/3517959027 shutdown_connections 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 --2- 172.21.15.50:0/3517959027 >> v2:172.21.15.170:3300/0 conn(0x7f9ec00b3bf0 0x7f9ec00b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 --2- 172.21.15.50:0/3517959027 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec00d00c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 -- 172.21.15.50:0/3517959027 >> 172.21.15.50:0/3517959027 conn(0x7f9ec009c2f0 msgr2=0x7f9ec00d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 -- 172.21.15.50:0/3517959027 shutdown_connections 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.241+0000 7f9ec7083640 1 -- 172.21.15.50:0/3517959027 wait complete. 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.242+0000 7f9ec7083640 1 Processor -- start 2023-12-08T08:18:51.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.242+0000 7f9ec7083640 1 -- start start 2023-12-08T08:18:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec7083640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec00b3340 0x7f9ec0149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec7083640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ec00b3bf0 0x7f9ec00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec7083640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec01f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec7083640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec014a170 con 0x7f9ec00d1d00 2023-12-08T08:18:51.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec7083640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c8d50 con 0x7f9ec00b3340 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec7083640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c9030 con 0x7f9ec00b3bf0 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec5620640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec01f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec5620640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec01f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50662/0 (socket says 172.21.15.50:50662) 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec5620640 1 -- 172.21.15.50:0/1666497436 learned_addr learned my addr 172.21.15.50:0/1666497436 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec4e1f640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec00b3340 0x7f9ec0149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ec5620640 1 -- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ec00b3bf0 msgr2=0x7f9ec00cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.243+0000 7f9ebffff640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ec00b3bf0 0x7f9ec00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec5620640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ec00b3bf0 0x7f9ec00cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec5620640 1 -- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec00b3340 msgr2=0x7f9ec0149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec5620640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec00b3340 0x7f9ec0149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec5620640 1 -- 172.21.15.50:0/1666497436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0009400 con 0x7f9ec00d1d00 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec4e1f640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec00b3340 0x7f9ec0149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:51.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec5620640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec01f2fc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800c7f0 tx=0x7f9ea800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ebd7fa640 1 -- 172.21.15.50:0/1666497436 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007820 con 0x7f9ec00d1d00 2023-12-08T08:18:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ebd7fa640 1 -- 172.21.15.50:0/1666497436 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8007980 con 0x7f9ec00d1d00 2023-12-08T08:18:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00c9310 con 0x7f9ec00d1d00 2023-12-08T08:18:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ebd7fa640 1 -- 172.21.15.50:0/1666497436 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007d70 con 0x7f9ec00d1d00 2023-12-08T08:18:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.244+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec00c98d0 con 0x7f9ec00d1d00 2023-12-08T08:18:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.245+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec00c9a60 con 0x7f9ec00d1d00 2023-12-08T08:18:51.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.245+0000 7f9ebd7fa640 1 -- 172.21.15.50:0/1666497436 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ea80113f0 con 0x7f9ec00d1d00 2023-12-08T08:18:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.246+0000 7f9ebd7fa640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ea006ae40 0x7f9ea006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.246+0000 7f9ebd7fa640 1 -- 172.21.15.50:0/1666497436 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9ea8089d20 con 0x7f9ec00d1d00 2023-12-08T08:18:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.246+0000 7f9ec4e1f640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ea006ae40 0x7f9ea006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.247+0000 7f9ec4e1f640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ea006ae40 0x7f9ea006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8005c00 tx=0x7f9eb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.250+0000 7f9ebd7fa640 1 -- 172.21.15.50:0/1666497436 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ea80549f0 con 0x7f9ec00d1d00 2023-12-08T08:18:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.440+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ec0067430 con 0x7f9ec00d1d00 2023-12-08T08:18:51.442 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.440+0000 7f9ebd7fa640 1 -- 172.21.15.50:0/1666497436 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ea801f080 con 0x7f9ec00d1d00 2023-12-08T08:18:51.443 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ea006ae40 msgr2=0x7f9ea006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ea006ae40 0x7f9ea006d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8005c00 tx=0x7f9eb8009040 comp rx=0 tx=0).stop 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 msgr2=0x7f9ec01f2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec01f2fc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800c7f0 tx=0x7f9ea800ccb0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 shutdown_connections 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ea006ae40 0x7f9ea006d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ec00d1d00 0x7f9ec01f2fc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ec00b3bf0 0x7f9ec00cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 --2- 172.21.15.50:0/1666497436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ec00b3340 0x7f9ec0149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 >> 172.21.15.50:0/1666497436 conn(0x7f9ec009c2f0 msgr2=0x7f9ec00b7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 shutdown_connections 2023-12-08T08:18:51.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.442+0000 7f9ec7083640 1 -- 172.21.15.50:0/1666497436 wait complete. 2023-12-08T08:18:51.455 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:51.455 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:51.471 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.616+0000 7f445384f640 1 Processor -- start 2023-12-08T08:18:51.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.616+0000 7f445384f640 1 -- start start 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f445384f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c1608a0 0x7f444c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f445384f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f444c0b1d70 0x7f444c0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f445384f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c0d20b0 con 0x7f444c0afce0 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f445384f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c0d0620 con 0x7f444c0b1d70 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f445384f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0d1dd0 con 0x7f444c1608a0 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4451dec640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f444c0afce0 0x7f444c0b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41020/0 (socket says 172.21.15.50:41020) 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4451dec640 1 -- 172.21.15.50:0/1691648943 learned_addr learned my addr 172.21.15.50:0/1691648943 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4450dea640 1 --2- 172.21.15.50:0/1691648943 >> v2:172.21.15.170:3300/0 conn(0x7f444c0b1d70 0x7f444c0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f44515eb640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c1608a0 0x7f444c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861654584 0 0) 0x7f444c0d20b0 con 0x7f444c0afce0 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4438003520 con 0x7f444c0afce0 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1634488269 0 0) 0x7f4438003520 con 0x7f444c0afce0 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c1608a0 msgr2=0x7f444c0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c1608a0 0x7f444c0d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 >> v2:172.21.15.170:3300/0 conn(0x7f444c0b1d70 msgr2=0x7f444c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 --2- 172.21.15.50:0/1691648943 >> v2:172.21.15.170:3300/0 conn(0x7f444c0b1d70 0x7f444c0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0cff60 con 0x7f444c0afce0 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f4444001670 con 0x7f444c0afce0 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4450dea640 1 --2- 172.21.15.50:0/1691648943 >> v2:172.21.15.170:3300/0 conn(0x7f444c0b1d70 0x7f444c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.617+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 >> v1:172.21.15.50:6789/0 conn(0x7f444c0afce0 legacy=0x7f444c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4443fff640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4438003970 0x7f4438003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4443fff640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4438004360 0x7f4438004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4443fff640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004f50 0x7f443800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0d0620 con 0x7f4438004360 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0d1dd0 con 0x7f4438004f50 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443800bef0 con 0x7f4438003970 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f44515eb640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c1608a0 0x7f444c0d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4450dea640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4438004360 0x7f4438004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4451dec640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004f50 0x7f443800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f44515eb640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4438003970 0x7f4438003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4450dea640 1 -- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4438003970 msgr2=0x7f4438003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4450dea640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4438003970 0x7f4438003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4450dea640 1 -- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004f50 msgr2=0x7f443800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4450dea640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004f50 0x7f443800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4450dea640 1 -- 172.21.15.50:0/1691648943 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438003520 con 0x7f4438004360 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.618+0000 7f4451dec640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004f50 0x7f443800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:51.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f4450dea640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4438004360 0x7f4438004840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f443c009c90 tx=0x7f44380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f81e0d51198a030 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c02c980 con 0x7f4438004360 2023-12-08T08:18:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c02cae0 con 0x7f4438004360 2023-12-08T08:18:51.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f4443fff640 1 -- 172.21.15.50:0/1691648943 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c034440 con 0x7f4438004360 2023-12-08T08:18:51.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f445384f640 1 -- 172.21.15.50:0/1691648943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4438004360 msgr2=0x7f4438004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f445384f640 1 --2- 172.21.15.50:0/1691648943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4438004360 0x7f4438004840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f443c009c90 tx=0x7f44380057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f4451dec640 1 -- 172.21.15.50:0/1691648943 reap_dead start 2023-12-08T08:18:51.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f445384f640 1 -- 172.21.15.50:0/1691648943 shutdown_connections 2023-12-08T08:18:51.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f445384f640 1 -- 172.21.15.50:0/1691648943 >> 172.21.15.50:0/1691648943 conn(0x7f444c0d3030 msgr2=0x7f444c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.619+0000 7f445384f640 1 -- 172.21.15.50:0/1691648943 shutdown_connections 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.620+0000 7f445384f640 1 -- 172.21.15.50:0/1691648943 wait complete. 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 Processor -- start 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 -- start start 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004360 0x7f444c1535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444c0c99e0 0x7f444c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c15c500 0x7f444c0b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0c6dd0 con 0x7f444c0c99e0 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0c9550 con 0x7f4438004360 2023-12-08T08:18:51.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.621+0000 7f445384f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0c86f0 con 0x7f444c15c500 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444c0c99e0 0x7f444c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444c0c99e0 0x7f444c0c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50676/0 (socket says 172.21.15.50:50676) 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 -- 172.21.15.50:0/3081691459 learned_addr learned my addr 172.21.15.50:0/3081691459 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f44515eb640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004360 0x7f444c1535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4451dec640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c15c500 0x7f444c0b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 -- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c15c500 msgr2=0x7f444c0b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c15c500 0x7f444c0b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 -- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004360 msgr2=0x7f444c1535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004360 0x7f444c1535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 -- 172.21.15.50:0/3081691459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0c8940 con 0x7f444c0c99e0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4450dea640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444c0c99e0 0x7f444c0c81b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f443c009db0 tx=0x7f443c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4441ffb640 1 -- 172.21.15.50:0/3081691459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c034c80 con 0x7f444c0c99e0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4441ffb640 1 -- 172.21.15.50:0/3081691459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c034e20 con 0x7f444c0c99e0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f4441ffb640 1 -- 172.21.15.50:0/3081691459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c040690 con 0x7f444c0c99e0 2023-12-08T08:18:51.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c0c8c20 con 0x7f444c0c99e0 2023-12-08T08:18:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.622+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c0c91e0 con 0x7f444c0c99e0 2023-12-08T08:18:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.624+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c0c9370 con 0x7f444c0c99e0 2023-12-08T08:18:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.624+0000 7f4441ffb640 1 -- 172.21.15.50:0/3081691459 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f443c0407f0 con 0x7f444c0c99e0 2023-12-08T08:18:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.624+0000 7f4441ffb640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f443006ae40 0x7f443006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.625+0000 7f4441ffb640 1 -- 172.21.15.50:0/3081691459 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f443c0abe30 con 0x7f444c0c99e0 2023-12-08T08:18:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.625+0000 7f44515eb640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f443006ae40 0x7f443006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.625+0000 7f44515eb640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f443006ae40 0x7f443006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f444c08b770 tx=0x7f444800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.629+0000 7f4441ffb640 1 -- 172.21.15.50:0/3081691459 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f443c076c40 con 0x7f444c0c99e0 2023-12-08T08:18:51.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.809+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f444c067430 con 0x7f444c0c99e0 2023-12-08T08:18:51.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.810+0000 7f4441ffb640 1 -- 172.21.15.50:0/3081691459 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f443c039020 con 0x7f444c0c99e0 2023-12-08T08:18:51.813 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:51.813 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:51.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f443006ae40 msgr2=0x7f443006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f443006ae40 0x7f443006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f444c08b770 tx=0x7f444800b040 comp rx=0 tx=0).stop 2023-12-08T08:18:51.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444c0c99e0 msgr2=0x7f444c0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444c0c99e0 0x7f444c0c81b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f443c009db0 tx=0x7f443c004730 comp rx=0 tx=0).stop 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 shutdown_connections 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f443006ae40 0x7f443006d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f444c0c99e0 0x7f444c0c81b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f444c15c500 0x7f444c0b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 --2- 172.21.15.50:0/3081691459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4438004360 0x7f444c1535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 >> 172.21.15.50:0/3081691459 conn(0x7f444c0d3030 msgr2=0x7f444c15f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 shutdown_connections 2023-12-08T08:18:51.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.813+0000 7f445384f640 1 -- 172.21.15.50:0/3081691459 wait complete. 2023-12-08T08:18:51.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:51.827 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:51.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.934+0000 7f3c3cb25640 1 Processor -- start 2023-12-08T08:18:51.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.934+0000 7f3c3cb25640 1 -- start start 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c3cb25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3c381595f0 0x7f3c380ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c3cb25640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c3806cdd0 0x7f3c380b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c3cb25640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c380cb800 con 0x7f3c380b3670 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c3cb25640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c380b1b50 con 0x7f3c3806cdd0 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c3cb25640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c380ce9a0 con 0x7f3c381595f0 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c36d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3c3806cdd0 0x7f3c380b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c35d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3c380b3670 0x7f3c3806c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41026/0 (socket says 172.21.15.50:41026) 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c35d9b640 1 -- 172.21.15.50:0/3942491662 learned_addr learned my addr 172.21.15.50:0/3942491662 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c3659c640 1 --2- 172.21.15.50:0/3942491662 >> v2:172.21.15.170:3300/0 conn(0x7f3c381595f0 0x7f3c380ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c36d9d640 1 -- 172.21.15.50:0/3942491662 >> v2:172.21.15.170:3300/0 conn(0x7f3c381595f0 msgr2=0x7f3c380ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c36d9d640 1 --2- 172.21.15.50:0/3942491662 >> v2:172.21.15.170:3300/0 conn(0x7f3c381595f0 0x7f3c380ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.935+0000 7f3c36d9d640 1 -- 172.21.15.50:0/3942491662 >> v1:172.21.15.50:6789/0 conn(0x7f3c380b3670 legacy=0x7f3c3806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.936+0000 7f3c36d9d640 1 -- 172.21.15.50:0/3942491662 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38070b60 con 0x7f3c3806cdd0 2023-12-08T08:18:51.939 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.936+0000 7f3c3559a640 1 -- 172.21.15.50:0/3942491662 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158608605 0 0) 0x7f3c380cb800 con 0x7f3c380b3670 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.936+0000 7f3c36d9d640 1 --2- 172.21.15.50:0/3942491662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c3806cdd0 0x7f3c380b1fe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3c38066ba0 tx=0x7f3c2802d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02c50fdfa44d9db server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.936+0000 7f3c3559a640 1 -- 172.21.15.50:0/3942491662 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2802dc00 con 0x7f3c3806cdd0 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.936+0000 7f3c3559a640 1 -- 172.21.15.50:0/3942491662 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2802dd60 con 0x7f3c3806cdd0 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.936+0000 7f3c3559a640 1 -- 172.21.15.50:0/3942491662 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28008660 con 0x7f3c3806cdd0 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 -- 172.21.15.50:0/3942491662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c3806cdd0 msgr2=0x7f3c380b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/3942491662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c3806cdd0 0x7f3c380b1fe0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3c38066ba0 tx=0x7f3c2802d060 comp rx=0 tx=0).stop 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 -- 172.21.15.50:0/3942491662 shutdown_connections 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/3942491662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c3806cdd0 0x7f3c380b1fe0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.940 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/3942491662 >> v2:172.21.15.170:3300/0 conn(0x7f3c381595f0 0x7f3c380ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 -- 172.21.15.50:0/3942491662 >> 172.21.15.50:0/3942491662 conn(0x7f3c380b0850 msgr2=0x7f3c380b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:51.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 -- 172.21.15.50:0/3942491662 shutdown_connections 2023-12-08T08:18:51.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.937+0000 7f3c3cb25640 1 -- 172.21.15.50:0/3942491662 wait complete. 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.938+0000 7f3c3cb25640 1 Processor -- start 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.938+0000 7f3c3cb25640 1 -- start start 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c3cb25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c3806cdd0 0x7f3c3815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c3cb25640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c380b3670 0x7f3c3815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c3cb25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c381595f0 0x7f3c38145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c3cb25640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381f72f0 con 0x7f3c381595f0 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c3cb25640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381f63d0 con 0x7f3c380b3670 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c3cb25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38156d70 con 0x7f3c3806cdd0 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c36d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c381595f0 0x7f3c38145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c36d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c381595f0 0x7f3c38145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50694/0 (socket says 172.21.15.50:50694) 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c36d9d640 1 -- 172.21.15.50:0/392264100 learned_addr learned my addr 172.21.15.50:0/392264100 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c35d9b640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c380b3670 0x7f3c3815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.939+0000 7f3c3659c640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c3806cdd0 0x7f3c3815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c36d9d640 1 -- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c3806cdd0 msgr2=0x7f3c3815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c36d9d640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c3806cdd0 0x7f3c3815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c36d9d640 1 -- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c380b3670 msgr2=0x7f3c3815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c36d9d640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c380b3670 0x7f3c3815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c36d9d640 1 -- 172.21.15.50:0/392264100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2800ab80 con 0x7f3c381595f0 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c3659c640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c3806cdd0 0x7f3c3815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c36d9d640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c381595f0 0x7f3c38145890 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c28037040 tx=0x7f3c28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c26ffd640 1 -- 172.21.15.50:0/392264100 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28040670 con 0x7f3c381595f0 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c26ffd640 1 -- 172.21.15.50:0/392264100 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c280407f0 con 0x7f3c381595f0 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c381f6670 con 0x7f3c381595f0 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c26ffd640 1 -- 172.21.15.50:0/392264100 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28040ba0 con 0x7f3c381595f0 2023-12-08T08:18:51.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.940+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c381f6c30 con 0x7f3c381595f0 2023-12-08T08:18:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.941+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c38067430 con 0x7f3c381595f0 2023-12-08T08:18:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.942+0000 7f3c26ffd640 1 -- 172.21.15.50:0/392264100 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c28040d00 con 0x7f3c381595f0 2023-12-08T08:18:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.942+0000 7f3c26ffd640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c1806ae70 0x7f3c1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.942+0000 7f3c26ffd640 1 -- 172.21.15.50:0/392264100 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3c280ac900 con 0x7f3c381595f0 2023-12-08T08:18:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.942+0000 7f3c3659c640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c1806ae70 0x7f3c1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:51.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.943+0000 7f3c3659c640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c1806ae70 0x7f3c1806d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3c38156d00 tx=0x7f3c30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:51.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:51.946+0000 7f3c26ffd640 1 -- 172.21.15.50:0/392264100 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c28077660 con 0x7f3c381595f0 2023-12-08T08:18:52.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.123+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c3806d3a0 con 0x7f3c381595f0 2023-12-08T08:18:52.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.124+0000 7f3c26ffd640 1 -- 172.21.15.50:0/392264100 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c2807ac80 con 0x7f3c381595f0 2023-12-08T08:18:52.126 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.125+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c1806ae70 msgr2=0x7f3c1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c1806ae70 0x7f3c1806d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3c38156d00 tx=0x7f3c30008040 comp rx=0 tx=0).stop 2023-12-08T08:18:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c381595f0 msgr2=0x7f3c38145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c381595f0 0x7f3c38145890 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c28037040 tx=0x7f3c28004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:52.128 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 shutdown_connections 2023-12-08T08:18:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3c1806ae70 0x7f3c1806d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3c381595f0 0x7f3c38145890 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c380b3670 0x7f3c3815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 --2- 172.21.15.50:0/392264100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3c3806cdd0 0x7f3c3815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 >> 172.21.15.50:0/392264100 conn(0x7f3c380b0850 msgr2=0x7f3c380cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 shutdown_connections 2023-12-08T08:18:52.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.126+0000 7f3c3cb25640 1 -- 172.21.15.50:0/392264100 wait complete. 2023-12-08T08:18:52.139 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:52.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.280+0000 7fc738409640 1 Processor -- start 2023-12-08T08:18:52.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.280+0000 7fc738409640 1 -- start start 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.281+0000 7fc738409640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc7300ce300 0x7fc7300cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.281+0000 7fc738409640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300cce00 con 0x7fc73015e790 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.281+0000 7fc738409640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300b0f00 con 0x7fc7300cde00 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.281+0000 7fc738409640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300cc8c0 con 0x7fc7300ce300 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.281+0000 7fc7361a5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc73015e790 0x7fc7300cd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41030/0 (socket says 172.21.15.50:41030) 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.281+0000 7fc7361a5640 1 -- 172.21.15.50:0/2676597395 learned_addr learned my addr 172.21.15.50:0/2676597395 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.281+0000 7fc7369a6640 1 --2- 172.21.15.50:0/2676597395 >> v2:172.21.15.50:3300/0 conn(0x7fc7300ce300 0x7fc7300cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.282+0000 7fc7351a3640 1 -- 172.21.15.50:0/2676597395 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599471201 0 0) 0x7fc7300cce00 con 0x7fc73015e790 2023-12-08T08:18:52.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.282+0000 7fc7351a3640 1 -- 172.21.15.50:0/2676597395 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc71c003520 con 0x7fc73015e790 2023-12-08T08:18:52.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.282+0000 7fc7369a6640 1 -- 172.21.15.50:0/2676597395 >> v1:172.21.15.170:6789/0 conn(0x7fc7300cde00 legacy=0x7fc7300b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.282+0000 7fc7369a6640 1 -- 172.21.15.50:0/2676597395 >> v1:172.21.15.50:6789/0 conn(0x7fc73015e790 legacy=0x7fc7300cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.282+0000 7fc7369a6640 1 -- 172.21.15.50:0/2676597395 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300ce730 con 0x7fc7300ce300 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.282+0000 7fc7369a6640 1 --2- 172.21.15.50:0/2676597395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300ce300 0x7fc7300cc380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009d90 tx=0x7fc72c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d315690af8f9883 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc7351a3640 1 -- 172.21.15.50:0/2676597395 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c02cc60 con 0x7fc7300ce300 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc7351a3640 1 -- 172.21.15.50:0/2676597395 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c02cdc0 con 0x7fc7300ce300 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc7351a3640 1 -- 172.21.15.50:0/2676597395 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c034660 con 0x7fc7300ce300 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc738409640 1 -- 172.21.15.50:0/2676597395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300ce300 msgr2=0x7fc7300cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc738409640 1 --2- 172.21.15.50:0/2676597395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300ce300 0x7fc7300cc380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009d90 tx=0x7fc72c02beb0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc738409640 1 -- 172.21.15.50:0/2676597395 shutdown_connections 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc738409640 1 --2- 172.21.15.50:0/2676597395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300ce300 0x7fc7300cc380 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc738409640 1 -- 172.21.15.50:0/2676597395 >> 172.21.15.50:0/2676597395 conn(0x7fc7300d0e00 msgr2=0x7fc7300d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc738409640 1 -- 172.21.15.50:0/2676597395 shutdown_connections 2023-12-08T08:18:52.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.283+0000 7fc738409640 1 -- 172.21.15.50:0/2676597395 wait complete. 2023-12-08T08:18:52.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.284+0000 7fc738409640 1 Processor -- start 2023-12-08T08:18:52.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.284+0000 7fc738409640 1 -- start start 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc738409640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300cde00 0x7fc7301f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc738409640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7300ce300 0x7fc7300c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc738409640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73015e790 0x7fc7300ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc738409640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc730149f70 con 0x7fc7300cde00 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc738409640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc730148d80 con 0x7fc73015e790 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc738409640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc730149010 con 0x7fc7300ce300 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc7361a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300cde00 0x7fc7301f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc7361a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300cde00 0x7fc7301f03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50714/0 (socket says 172.21.15.50:50714) 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.285+0000 7fc7361a5640 1 -- 172.21.15.50:0/3128641253 learned_addr learned my addr 172.21.15.50:0/3128641253 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc7369a6640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73015e790 0x7fc7300ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc7361a5640 1 -- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7300ce300 msgr2=0x7fc7300c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc7361a5640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7300ce300 0x7fc7300c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc7361a5640 1 -- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73015e790 msgr2=0x7fc7300ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc7361a5640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73015e790 0x7fc7300ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc7361a5640 1 -- 172.21.15.50:0/3128641253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c009a70 con 0x7fc7300cde00 2023-12-08T08:18:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc7361a5640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300cde00 0x7fc7301f03c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c410 tx=0x7fc72800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc726ffd640 1 -- 172.21.15.50:0/3128641253 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728005ce0 con 0x7fc7300cde00 2023-12-08T08:18:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc726ffd640 1 -- 172.21.15.50:0/3128641253 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc728005e40 con 0x7fc7300cde00 2023-12-08T08:18:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7301492f0 con 0x7fc7300cde00 2023-12-08T08:18:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc726ffd640 1 -- 172.21.15.50:0/3128641253 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280072f0 con 0x7fc7300cde00 2023-12-08T08:18:52.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.286+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7301498b0 con 0x7fc7300cde00 2023-12-08T08:18:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.287+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73014a0b0 con 0x7fc7300cde00 2023-12-08T08:18:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.287+0000 7fc726ffd640 1 -- 172.21.15.50:0/3128641253 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc728007450 con 0x7fc7300cde00 2023-12-08T08:18:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.288+0000 7fc726ffd640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc71406ae40 0x7fc71406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.288+0000 7fc726ffd640 1 -- 172.21.15.50:0/3128641253 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc728088fa0 con 0x7fc7300cde00 2023-12-08T08:18:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.288+0000 7fc7359a4640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc71406ae40 0x7fc71406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.289+0000 7fc7359a4640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc71406ae40 0x7fc71406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc720000f60 tx=0x7fc7200079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.292+0000 7fc726ffd640 1 -- 172.21.15.50:0/3128641253 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7280bbe90 con 0x7fc7300cde00 2023-12-08T08:18:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.470+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc730067430 con 0x7fc7300cde00 2023-12-08T08:18:52.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.470+0000 7fc726ffd640 1 -- 172.21.15.50:0/3128641253 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc728057850 con 0x7fc7300cde00 2023-12-08T08:18:52.472 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:52.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc71406ae40 msgr2=0x7fc71406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc71406ae40 0x7fc71406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc720000f60 tx=0x7fc7200079b0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300cde00 msgr2=0x7fc7301f03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300cde00 0x7fc7301f03c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c410 tx=0x7fc72800c8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 shutdown_connections 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc71406ae40 0x7fc71406d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73015e790 0x7fc7300ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7300ce300 0x7fc7300c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 --2- 172.21.15.50:0/3128641253 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7300cde00 0x7fc7301f03c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 >> 172.21.15.50:0/3128641253 conn(0x7fc7300d0e00 msgr2=0x7fc73006fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 shutdown_connections 2023-12-08T08:18:52.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.472+0000 7fc738409640 1 -- 172.21.15.50:0/3128641253 wait complete. 2023-12-08T08:18:52.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:52.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.593+0000 7ff86e1b0640 1 Processor -- start 2023-12-08T08:18:52.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.593+0000 7ff86e1b0640 1 -- start start 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff86e1b0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8680cb370 0x7ff86815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff86e1b0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff868157e00 con 0x7ff86806d7d0 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff86e1b0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86806dd20 con 0x7ff868157a20 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff86e1b0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff868070cd0 con 0x7ff8680cb370 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff866ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8680cb370 0x7ff86815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff867fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff86806d7d0 0x7ff8680b1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41036/0 (socket says 172.21.15.50:41036) 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff866ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff8680cb370 0x7ff86815e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50726/0 (socket says 172.21.15.50:50726) 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff867fff640 1 -- 172.21.15.50:0/3084090250 learned_addr learned my addr 172.21.15.50:0/3084090250 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:52.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff866ffd640 1 -- 172.21.15.50:0/3084090250 >> v1:172.21.15.170:6789/0 conn(0x7ff868157a20 legacy=0x7ff86815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:52.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff866ffd640 1 -- 172.21.15.50:0/3084090250 >> v1:172.21.15.50:6789/0 conn(0x7ff86806d7d0 legacy=0x7ff8680b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.594+0000 7ff866ffd640 1 -- 172.21.15.50:0/3084090250 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff868070fb0 con 0x7ff8680cb370 2023-12-08T08:18:52.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.595+0000 7ff866ffd640 1 --2- 172.21.15.50:0/3084090250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8680cb370 0x7ff86815e0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0097a0 tx=0x7ff85c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e916d69e11a8bc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.595+0000 7ff8667fc640 1 -- 172.21.15.50:0/3084090250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c031830 con 0x7ff8680cb370 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.595+0000 7ff8667fc640 1 -- 172.21.15.50:0/3084090250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c031990 con 0x7ff8680cb370 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.595+0000 7ff8667fc640 1 -- 172.21.15.50:0/3084090250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c031d20 con 0x7ff8680cb370 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.596+0000 7ff86e1b0640 1 -- 172.21.15.50:0/3084090250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8680cb370 msgr2=0x7ff86815e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.596+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/3084090250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8680cb370 0x7ff86815e0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff85c0097a0 tx=0x7ff85c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.596+0000 7ff86e1b0640 1 -- 172.21.15.50:0/3084090250 shutdown_connections 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.596+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/3084090250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8680cb370 0x7ff86815e0e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.596+0000 7ff86e1b0640 1 -- 172.21.15.50:0/3084090250 >> 172.21.15.50:0/3084090250 conn(0x7ff8680b0850 msgr2=0x7ff8680b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.596+0000 7ff86e1b0640 1 -- 172.21.15.50:0/3084090250 shutdown_connections 2023-12-08T08:18:52.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.596+0000 7ff86e1b0640 1 -- 172.21.15.50:0/3084090250 wait complete. 2023-12-08T08:18:52.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.597+0000 7ff86e1b0640 1 Processor -- start 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.597+0000 7ff86e1b0640 1 -- start start 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff86e1b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86806d7d0 0x7ff86813c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff86e1b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8680cb370 0x7ff868155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff86e1b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff868157a20 0x7ff86815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff86e1b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86814f070 con 0x7ff86806d7d0 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff86e1b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86813cb90 con 0x7ff8680cb370 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff86e1b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff868156300 con 0x7ff868157a20 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86806d7d0 0x7ff86813c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86806d7d0 0x7ff86813c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50734/0 (socket says 172.21.15.50:50734) 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 -- 172.21.15.50:0/2913645370 learned_addr learned my addr 172.21.15.50:0/2913645370 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:52.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff867fff640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff868157a20 0x7ff86815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff866ffd640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8680cb370 0x7ff868155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 -- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff868157a20 msgr2=0x7ff86815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff868157a20 0x7ff86815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 -- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8680cb370 msgr2=0x7ff868155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8680cb370 0x7ff868155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 -- 172.21.15.50:0/2913645370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c009400 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff867fff640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff868157a20 0x7ff86815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff8677fe640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86806d7d0 0x7ff86813c650 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff85800b3f0 tx=0x7ff85800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.598+0000 7ff84ffff640 1 -- 172.21.15.50:0/2913645370 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858011830 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.599+0000 7ff84ffff640 1 -- 172.21.15.50:0/2913645370 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858011990 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.599+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff868155a60 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.599+0000 7ff84ffff640 1 -- 172.21.15.50:0/2913645370 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858011d40 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.599+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff868156020 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.599+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86814f1b0 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.600+0000 7ff84ffff640 1 -- 172.21.15.50:0/2913645370 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff85801a400 con 0x7ff86806d7d0 2023-12-08T08:18:52.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.600+0000 7ff84ffff640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff85406ae40 0x7ff85406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.600+0000 7ff84ffff640 1 -- 172.21.15.50:0/2913645370 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff858089880 con 0x7ff86806d7d0 2023-12-08T08:18:52.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.601+0000 7ff866ffd640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff85406ae40 0x7ff85406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.601+0000 7ff866ffd640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff85406ae40 0x7ff85406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff85c036000 tx=0x7ff85c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.605+0000 7ff84ffff640 1 -- 172.21.15.50:0/2913645370 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff86814f1b0 con 0x7ff86806d7d0 2023-12-08T08:18:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.781+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff86814f1b0 con 0x7ff86806d7d0 2023-12-08T08:18:52.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.782+0000 7ff84ffff640 1 -- 172.21.15.50:0/2913645370 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff86814f1b0 con 0x7ff86806d7d0 2023-12-08T08:18:52.784 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:52.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff85406ae40 msgr2=0x7ff85406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff85406ae40 0x7ff85406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff85c036000 tx=0x7ff85c03c040 comp rx=0 tx=0).stop 2023-12-08T08:18:52.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86806d7d0 msgr2=0x7ff86813c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86806d7d0 0x7ff86813c650 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff85800b3f0 tx=0x7ff85800b8b0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 shutdown_connections 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff85406ae40 0x7ff85406d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff868157a20 0x7ff86815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8680cb370 0x7ff868155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 --2- 172.21.15.50:0/2913645370 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff86806d7d0 0x7ff86813c650 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 >> 172.21.15.50:0/2913645370 conn(0x7ff8680b0850 msgr2=0x7ff8680b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 shutdown_connections 2023-12-08T08:18:52.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.784+0000 7ff86e1b0640 1 -- 172.21.15.50:0/2913645370 wait complete. 2023-12-08T08:18:52.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:52.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.906+0000 7feb33656640 1 Processor -- start 2023-12-08T08:18:52.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.906+0000 7feb33656640 1 -- start start 2023-12-08T08:18:52.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb33656640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feb2c0d3b80 0x7feb2c0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb33656640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c0b5ec0 con 0x7feb2c0cfa80 2023-12-08T08:18:52.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb33656640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c0d3fe0 con 0x7feb2c0b6bf0 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb33656640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0cebd0 con 0x7feb2c0d3b80 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb313f2640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7feb2c0cfa80 0x7feb2c0cfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41048/0 (socket says 172.21.15.50:41048) 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb313f2640 1 -- 172.21.15.50:0/2368937890 learned_addr learned my addr 172.21.15.50:0/2368937890 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb30bf1640 1 --2- 172.21.15.50:0/2368937890 >> v2:172.21.15.170:3300/0 conn(0x7feb2c0d3b80 0x7feb2c0ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806352599 0 0) 0x7feb2c0b5ec0 con 0x7feb2c0cfa80 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb18003520 con 0x7feb2c0cfa80 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1502759057 0 0) 0x7feb18003520 con 0x7feb2c0cfa80 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 >> v2:172.21.15.170:3300/0 conn(0x7feb2c0d3b80 msgr2=0x7feb2c0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 --2- 172.21.15.50:0/2368937890 >> v2:172.21.15.170:3300/0 conn(0x7feb2c0d3b80 0x7feb2c0ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 >> v1:172.21.15.170:6789/0 conn(0x7feb2c0b6bf0 legacy=0x7feb2c0b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0cede0 con 0x7feb2c0cfa80 2023-12-08T08:18:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7feb28001670 con 0x7feb2c0cfa80 2023-12-08T08:18:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb30bf1640 1 --2- 172.21.15.50:0/2368937890 >> v2:172.21.15.170:3300/0 conn(0x7feb2c0d3b80 0x7feb2c0ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 >> v1:172.21.15.50:6789/0 conn(0x7feb2c0cfa80 legacy=0x7feb2c0cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb18003970 0x7feb18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb180047c0 0x7feb18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.907+0000 7feb1ffff640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cebd0 con 0x7feb18005180 2023-12-08T08:18:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1800c120 con 0x7feb180047c0 2023-12-08T08:18:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1800c2e0 con 0x7feb18003970 2023-12-08T08:18:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb31bf3640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb30bf1640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb180047c0 0x7feb18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb313f2640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb18003970 0x7feb18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb31bf3640 1 -- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb18003970 msgr2=0x7feb18003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb31bf3640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb18003970 0x7feb18003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb31bf3640 1 -- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb180047c0 msgr2=0x7feb18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb31bf3640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb180047c0 0x7feb18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.908+0000 7feb31bf3640 1 -- 172.21.15.50:0/2368937890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18003520 con 0x7feb18005180 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb31bf3640 1 -- 172.21.15.50:0/2368937890 reap_dead start 2023-12-08T08:18:52.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb31bf3640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb1800b980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feb24001e50 tx=0x7feb180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa7c87c2219229e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24003b70 con 0x7feb18005180 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24003d10 con 0x7feb18005180 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb1ffff640 1 -- 172.21.15.50:0/2368937890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24005310 con 0x7feb18005180 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb33656640 1 -- 172.21.15.50:0/2368937890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 msgr2=0x7feb1800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb33656640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb1800b980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feb24001e50 tx=0x7feb180057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb33656640 1 -- 172.21.15.50:0/2368937890 shutdown_connections 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb33656640 1 --2- 172.21.15.50:0/2368937890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb1800b980 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb33656640 1 -- 172.21.15.50:0/2368937890 >> 172.21.15.50:0/2368937890 conn(0x7feb2c09c340 msgr2=0x7feb2c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb33656640 1 -- 172.21.15.50:0/2368937890 shutdown_connections 2023-12-08T08:18:52.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.909+0000 7feb33656640 1 -- 172.21.15.50:0/2368937890 wait complete. 2023-12-08T08:18:52.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 Processor -- start 2023-12-08T08:18:52.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 -- start start 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb2c1f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb2c15fab0 0x7feb2c15ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb2c0ca8a0 0x7feb2c0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c160470 con 0x7feb18005180 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c15f180 con 0x7feb2c0ca8a0 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.911+0000 7feb33656640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c15e570 con 0x7feb2c15fab0 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb2c1f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb2c1f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50750/0 (socket says 172.21.15.50:50750) 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 -- 172.21.15.50:0/214405314 learned_addr learned my addr 172.21.15.50:0/214405314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb30bf1640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb2c15fab0 0x7feb2c15ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb31bf3640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb2c0ca8a0 0x7feb2c0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 -- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb2c15fab0 msgr2=0x7feb2c15ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb2c15fab0 0x7feb2c15ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 -- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb2c0ca8a0 msgr2=0x7feb2c0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb2c0ca8a0 0x7feb2c0cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 -- 172.21.15.50:0/214405314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c15e850 con 0x7feb18005180 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb31bf3640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb2c0ca8a0 0x7feb2c0cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb313f2640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb2c1f2cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb280072c0 tx=0x7feb28007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb1dffb640 1 -- 172.21.15.50:0/214405314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2800f960 con 0x7feb18005180 2023-12-08T08:18:52.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb1dffb640 1 -- 172.21.15.50:0/214405314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2800fac0 con 0x7feb18005180 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb1dffb640 1 -- 172.21.15.50:0/214405314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2800fe70 con 0x7feb18005180 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.912+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c15eb30 con 0x7feb18005180 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.913+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c1f31f0 con 0x7feb18005180 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.913+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c08d0d0 con 0x7feb18005180 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.914+0000 7feb1dffb640 1 -- 172.21.15.50:0/214405314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb2801d460 con 0x7feb18005180 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.914+0000 7feb1dffb640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feb1006ae40 0x7feb1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.914+0000 7feb1dffb640 1 -- 172.21.15.50:0/214405314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7feb28089a60 con 0x7feb18005180 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.914+0000 7feb30bf1640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feb1006ae40 0x7feb1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.915+0000 7feb30bf1640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feb1006ae40 0x7feb1006d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0cc350 tx=0x7feb20009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:52.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:52.918+0000 7feb1dffb640 1 -- 172.21.15.50:0/214405314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb280547c0 con 0x7feb18005180 2023-12-08T08:18:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.093+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feb2c067430 con 0x7feb18005180 2023-12-08T08:18:53.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.094+0000 7feb1dffb640 1 -- 172.21.15.50:0/214405314 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7feb28057de0 con 0x7feb18005180 2023-12-08T08:18:53.096 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:53.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feb1006ae40 msgr2=0x7feb1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feb1006ae40 0x7feb1006d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0cc350 tx=0x7feb20009190 comp rx=0 tx=0).stop 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 msgr2=0x7feb2c1f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb2c1f2cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb280072c0 tx=0x7feb28007780 comp rx=0 tx=0).stop 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 shutdown_connections 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7feb1006ae40 0x7feb1006d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb2c0ca8a0 0x7feb2c0cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feb2c15fab0 0x7feb2c15ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 --2- 172.21.15.50:0/214405314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feb18005180 0x7feb2c1f2cb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 >> 172.21.15.50:0/214405314 conn(0x7feb2c09c340 msgr2=0x7feb2c06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:53.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 shutdown_connections 2023-12-08T08:18:53.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.096+0000 7feb33656640 1 -- 172.21.15.50:0/214405314 wait complete. 2023-12-08T08:18:53.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.214+0000 7f99e2341640 1 Processor -- start 2023-12-08T08:18:53.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.214+0000 7f99e2341640 1 -- start start 2023-12-08T08:18:53.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99e2341640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 0x7f99dc0d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99e2341640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f99dc15f890 0x7f99dc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99e2341640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99dc15ee90 con 0x7f99dc15d580 2023-12-08T08:18:53.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99e2341640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99dc0d0fe0 con 0x7f99dc15f890 2023-12-08T08:18:53.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99e2341640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0d1280 con 0x7f99dc0d1d60 2023-12-08T08:18:53.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99dbfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99dc15d580 0x7f99dc15f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41056/0 (socket says 172.21.15.50:41056) 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99dbfff640 1 -- 172.21.15.50:0/547763925 learned_addr learned my addr 172.21.15.50:0/547763925 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702849131 0 0) 0x7f99dc15ee90 con 0x7f99dc15d580 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99e08de640 1 --2- 172.21.15.50:0/547763925 >> v2:172.21.15.170:3300/0 conn(0x7f99dc15f890 0x7f99dc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99db7fe640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 0x7f99dc0d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.215+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99c8003520 con 0x7f99dc15d580 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 166304629 0 0) 0x7f99c8003520 con 0x7f99dc15d580 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 msgr2=0x7f99dc0d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 0x7f99dc0d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 >> v2:172.21.15.170:3300/0 conn(0x7f99dc15f890 msgr2=0x7f99dc15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 --2- 172.21.15.50:0/547763925 >> v2:172.21.15.170:3300/0 conn(0x7f99dc15f890 0x7f99dc15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0d1560 con 0x7f99dc15d580 2023-12-08T08:18:53.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f99cc001670 con 0x7f99dc15d580 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 >> v1:172.21.15.50:6789/0 conn(0x7f99dc15d580 legacy=0x7f99dc15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 0x7f99c8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c8003ef0 0x7f99c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c8004d00 0x7f99c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0d0fe0 con 0x7f99c8004d00 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0d1280 con 0x7f99c8003ef0 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c800b9d0 con 0x7f99dc0d1d60 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99e08de640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c8004d00 0x7f99c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99db7fe640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c8003ef0 0x7f99c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99dbfff640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 0x7f99c8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99e08de640 1 -- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 msgr2=0x7f99c8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99e08de640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc0d1d60 0x7f99c8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99e08de640 1 -- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c8003ef0 msgr2=0x7f99c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99e08de640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99c8003ef0 0x7f99c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.216+0000 7f99e08de640 1 -- 172.21.15.50:0/547763925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c8003520 con 0x7f99c8004d00 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.217+0000 7f99e08de640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c8004d00 0x7f99c8005180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f99d400e170 tx=0x7f99c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5889f4542fe93f58 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.217+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d402cc20 con 0x7f99c8004d00 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.217+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d400f040 con 0x7f99c8004d00 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.217+0000 7f99daffd640 1 -- 172.21.15.50:0/547763925 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4034440 con 0x7f99c8004d00 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.218+0000 7f99e2341640 1 -- 172.21.15.50:0/547763925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c8004d00 msgr2=0x7f99c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.218+0000 7f99e2341640 1 --2- 172.21.15.50:0/547763925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99c8004d00 0x7f99c8005180 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f99d400e170 tx=0x7f99c80057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.218+0000 7f99e08de640 1 -- 172.21.15.50:0/547763925 reap_dead start 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.218+0000 7f99e2341640 1 -- 172.21.15.50:0/547763925 shutdown_connections 2023-12-08T08:18:53.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.218+0000 7f99e2341640 1 -- 172.21.15.50:0/547763925 >> 172.21.15.50:0/547763925 conn(0x7f99dc0d2fb0 msgr2=0x7f99dc0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:53.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.218+0000 7f99e2341640 1 -- 172.21.15.50:0/547763925 shutdown_connections 2023-12-08T08:18:53.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.218+0000 7f99e2341640 1 -- 172.21.15.50:0/547763925 wait complete. 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.219+0000 7f99e2341640 1 Processor -- start 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.219+0000 7f99e2341640 1 -- start start 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99e2341640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99dc1514c0 0x7f99dc0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99e2341640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc0b8aa0 0x7f99dc15d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99e2341640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc15dea0 0x7f99dc0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99e2341640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0b2a30 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99e2341640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc15e350 con 0x7f99dc1514c0 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99e2341640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc0b1db0 con 0x7f99dc15dea0 2023-12-08T08:18:53.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc0b8aa0 0x7f99dc15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc0b8aa0 0x7f99dc15d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50772/0 (socket says 172.21.15.50:50772) 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 -- 172.21.15.50:0/2750573714 learned_addr learned my addr 172.21.15.50:0/2750573714 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99dbfff640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99dc1514c0 0x7f99dc0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99e08de640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc15dea0 0x7f99dc0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 -- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc15dea0 msgr2=0x7f99dc0afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc15dea0 0x7f99dc0afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 -- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99dc1514c0 msgr2=0x7f99dc0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99dc1514c0 0x7f99dc0b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 -- 172.21.15.50:0/2750573714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc0b2090 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99dbfff640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99dc1514c0 0x7f99dc0b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99db7fe640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc0b8aa0 0x7f99dc15d960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f99c40118e0 tx=0x7f99c4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.220+0000 7f99d8ff9640 1 -- 172.21.15.50:0/2750573714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400faf0 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.221+0000 7f99d8ff9640 1 -- 172.21.15.50:0/2750573714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c400fc50 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.221+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc0b2370 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.221+0000 7f99d8ff9640 1 -- 172.21.15.50:0/2750573714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4014440 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.221+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc1518a0 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.221+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc0d09d0 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.222+0000 7f99d8ff9640 1 -- 172.21.15.50:0/2750573714 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99c40145a0 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.222+0000 7f99d8ff9640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f99bc06ae40 0x7f99bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.222+0000 7f99d8ff9640 1 -- 172.21.15.50:0/2750573714 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f99c408a2e0 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.223+0000 7f99dbfff640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f99bc06ae40 0x7f99bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.223+0000 7f99dbfff640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f99bc06ae40 0x7f99bc06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99cc004840 tx=0x7f99cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.226+0000 7f99d8ff9640 1 -- 172.21.15.50:0/2750573714 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99c4055040 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.416+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f99dc067430 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.416+0000 7f99d8ff9640 1 -- 172.21.15.50:0/2750573714 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f99c4058660 con 0x7f99dc0b8aa0 2023-12-08T08:18:53.419 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f99bc06ae40 msgr2=0x7f99bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f99bc06ae40 0x7f99bc06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99cc004840 tx=0x7f99cc009040 comp rx=0 tx=0).stop 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc0b8aa0 msgr2=0x7f99dc15d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc0b8aa0 0x7f99dc15d960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f99c40118e0 tx=0x7f99c4011da0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 shutdown_connections 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f99bc06ae40 0x7f99bc06d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99dc0b8aa0 0x7f99dc15d960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99dc15dea0 0x7f99dc0afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 --2- 172.21.15.50:0/2750573714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99dc1514c0 0x7f99dc0b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 >> 172.21.15.50:0/2750573714 conn(0x7f99dc0d2fb0 msgr2=0x7f99dc15b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:53.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 shutdown_connections 2023-12-08T08:18:53.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.418+0000 7f99e2341640 1 -- 172.21.15.50:0/2750573714 wait complete. 2023-12-08T08:18:53.431 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:18:53.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:53.432 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T08:18:53.463 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:18:53.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:18:53.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:53.463 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:18:53.519 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:18:53.519 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:53.538 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:18:53.538 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:53.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:53.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.701+0000 7efef8ff1640 1 Processor -- start 2023-12-08T08:18:53.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.701+0000 7efef8ff1640 1 -- start start 2023-12-08T08:18:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef8ff1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efef40cc2e0 0x7efef40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef8ff1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efef4144930 0x7efef40cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef8ff1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef40cfb50 con 0x7efef4144440 2023-12-08T08:18:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef8ff1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef40ca720 con 0x7efef40cc2e0 2023-12-08T08:18:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef8ff1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef40711e0 con 0x7efef4144930 2023-12-08T08:18:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efef40cc2e0 0x7efef40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7efef40cc2e0 0x7efef40cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50782/0 (socket says 172.21.15.50:50782) 2023-12-08T08:18:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.702+0000 7efef1d9b640 1 -- 172.21.15.50:0/3140386430 learned_addr learned my addr 172.21.15.50:0/3140386430 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.703+0000 7efef2d9d640 1 --2- 172.21.15.50:0/3140386430 >> v2:172.21.15.170:3300/0 conn(0x7efef4144930 0x7efef40cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.703+0000 7efef1d9b640 1 -- 172.21.15.50:0/3140386430 >> v2:172.21.15.170:3300/0 conn(0x7efef4144930 msgr2=0x7efef40cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.703+0000 7efef1d9b640 1 --2- 172.21.15.50:0/3140386430 >> v2:172.21.15.170:3300/0 conn(0x7efef4144930 0x7efef40cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.703+0000 7efef1d9b640 1 -- 172.21.15.50:0/3140386430 >> v1:172.21.15.170:6789/0 conn(0x7efef4144440 legacy=0x7efef40cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.703+0000 7efef1d9b640 1 -- 172.21.15.50:0/3140386430 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40714a0 con 0x7efef40cc2e0 2023-12-08T08:18:53.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.703+0000 7efef2d9d640 1 --2- 172.21.15.50:0/3140386430 >> v2:172.21.15.170:3300/0 conn(0x7efef4144930 0x7efef40cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.703+0000 7efef1d9b640 1 --2- 172.21.15.50:0/3140386430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef40cc2e0 0x7efef40cf610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efef4144f10 tx=0x7efedc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8615c1e3e483cb57 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef159a640 1 -- 172.21.15.50:0/3140386430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc031870 con 0x7efef40cc2e0 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef159a640 1 -- 172.21.15.50:0/3140386430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc0319d0 con 0x7efef40cc2e0 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef159a640 1 -- 172.21.15.50:0/3140386430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc031d60 con 0x7efef40cc2e0 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 -- 172.21.15.50:0/3140386430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef40cc2e0 msgr2=0x7efef40cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 --2- 172.21.15.50:0/3140386430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef40cc2e0 0x7efef40cf610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efef4144f10 tx=0x7efedc02b910 comp rx=0 tx=0).stop 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 -- 172.21.15.50:0/3140386430 shutdown_connections 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 --2- 172.21.15.50:0/3140386430 >> v2:172.21.15.170:3300/0 conn(0x7efef4144930 0x7efef40cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.708 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 --2- 172.21.15.50:0/3140386430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef40cc2e0 0x7efef40cf610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 -- 172.21.15.50:0/3140386430 >> 172.21.15.50:0/3140386430 conn(0x7efef40cfda0 msgr2=0x7efef40d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 -- 172.21.15.50:0/3140386430 shutdown_connections 2023-12-08T08:18:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.704+0000 7efef8ff1640 1 -- 172.21.15.50:0/3140386430 wait complete. 2023-12-08T08:18:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 Processor -- start 2023-12-08T08:18:53.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 -- start start 2023-12-08T08:18:53.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef40cc2e0 0x7efef40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef4144440 0x7efef4137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef4144930 0x7efef409d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef4141db0 con 0x7efef4144930 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40b4370 con 0x7efef4144440 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.706+0000 7efef8ff1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef40b39a0 con 0x7efef40cc2e0 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef4144930 0x7efef409d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef4144930 0x7efef409d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50798/0 (socket says 172.21.15.50:50798) 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 -- 172.21.15.50:0/2078383868 learned_addr learned my addr 172.21.15.50:0/2078383868 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef1d9b640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef4144440 0x7efef4137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 -- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef40cc2e0 msgr2=0x7efef40b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef259c640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef40cc2e0 0x7efef40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef40cc2e0 0x7efef40b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 -- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef4144440 msgr2=0x7efef4137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef4144440 0x7efef4137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 -- 172.21.15.50:0/2078383868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc0094d0 con 0x7efef4144930 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef1d9b640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef4144440 0x7efef4137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef2d9d640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef4144930 0x7efef409d730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c7f0 tx=0x7efeec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efeeaffd640 1 -- 172.21.15.50:0/2078383868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec004230 con 0x7efef4144930 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efeeaffd640 1 -- 172.21.15.50:0/2078383868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec004390 con 0x7efef4144930 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef4137bb0 con 0x7efef4144930 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efeeaffd640 1 -- 172.21.15.50:0/2078383868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec007860 con 0x7efef4144930 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.707+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef40b3070 con 0x7efef4144930 2023-12-08T08:18:53.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.708+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef4067430 con 0x7efef4144930 2023-12-08T08:18:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.709+0000 7efeeaffd640 1 -- 172.21.15.50:0/2078383868 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efeec007bd0 con 0x7efef4144930 2023-12-08T08:18:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.709+0000 7efeeaffd640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efed406ae40 0x7efed406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.709+0000 7efeeaffd640 1 -- 172.21.15.50:0/2078383868 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efeec089f00 con 0x7efef4144930 2023-12-08T08:18:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.709+0000 7efef259c640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efed406ae40 0x7efed406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.710+0000 7efef259c640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efed406ae40 0x7efed406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efee4007fd0 tx=0x7efee4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:53.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.713+0000 7efeeaffd640 1 -- 172.21.15.50:0/2078383868 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efeec054c10 con 0x7efef4144930 2023-12-08T08:18:53.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.893+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efef40b3ae0 con 0x7efef4144930 2023-12-08T08:18:53.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.894+0000 7efeeaffd640 1 -- 172.21.15.50:0/2078383868 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7efeec058230 con 0x7efef4144930 2023-12-08T08:18:53.896 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:53.897 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efed406ae40 msgr2=0x7efed406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efed406ae40 0x7efed406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efee4007fd0 tx=0x7efee4009040 comp rx=0 tx=0).stop 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef4144930 msgr2=0x7efef409d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef4144930 0x7efef409d730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c7f0 tx=0x7efeec00ccb0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 shutdown_connections 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efed406ae40 0x7efed406d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efef4144930 0x7efef409d730 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efef4144440 0x7efef4137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 --2- 172.21.15.50:0/2078383868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efef40cc2e0 0x7efef40b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 >> 172.21.15.50:0/2078383868 conn(0x7efef40cfda0 msgr2=0x7efef40acde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 shutdown_connections 2023-12-08T08:18:53.899 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:53.896+0000 7efef8ff1640 1 -- 172.21.15.50:0/2078383868 wait complete. 2023-12-08T08:18:53.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:53.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:54.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.018+0000 7f3a4b18e640 1 Processor -- start 2023-12-08T08:18:54.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.018+0000 7f3a4b18e640 1 -- start start 2023-12-08T08:18:54.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4b18e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 0x7f3a440d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4b18e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a440b6bf0 0x7f3a440b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4b18e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440b5ec0 con 0x7f3a440ce690 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4b18e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a440cede0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4b18e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440b6110 con 0x7f3a440cfa80 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4972b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a440b6bf0 0x7f3a440b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4972b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a440b6bf0 0x7f3a440b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50802/0 (socket says 172.21.15.50:50802) 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4972b640 1 -- 172.21.15.50:0/1186835411 learned_addr learned my addr 172.21.15.50:0/1186835411 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4972b640 1 -- 172.21.15.50:0/1186835411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 msgr2=0x7f3a440d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4972b640 1 --2- 172.21.15.50:0/1186835411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 0x7f3a440d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4972b640 1 -- 172.21.15.50:0/1186835411 >> v1:172.21.15.170:6789/0 conn(0x7f3a440ce690 legacy=0x7f3a440cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.019+0000 7f3a4972b640 1 -- 172.21.15.50:0/1186835411 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440b63f0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.020+0000 7f3a4972b640 1 --2- 172.21.15.50:0/1186835411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a440b7080 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009e50 tx=0x7f3a3c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa79caadb9ef735c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.020+0000 7f3a437fe640 1 -- 172.21.15.50:0/1186835411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c02c9e0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.020+0000 7f3a437fe640 1 -- 172.21.15.50:0/1186835411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c02cb40 con 0x7f3a440b6bf0 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.020+0000 7f3a437fe640 1 -- 172.21.15.50:0/1186835411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0343f0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1186835411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 msgr2=0x7f3a440b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1186835411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a440b7080 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009e50 tx=0x7f3a3c02be40 comp rx=0 tx=0).stop 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1186835411 shutdown_connections 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1186835411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a440b7080 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1186835411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 0x7f3a440d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1186835411 >> 172.21.15.50:0/1186835411 conn(0x7f3a4409c340 msgr2=0x7f3a440d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1186835411 shutdown_connections 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.021+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1186835411 wait complete. 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.022+0000 7f3a4b18e640 1 Processor -- start 2023-12-08T08:18:54.026 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.022+0000 7f3a4b18e640 1 -- start start 2023-12-08T08:18:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.023+0000 7f3a4b18e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a44153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.023+0000 7f3a4b18e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a440ce690 0x7f3a4415e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.023+0000 7f3a4b18e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 0x7f3a4415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.023+0000 7f3a4b18e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a441543a0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.023+0000 7f3a4b18e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44158380 con 0x7f3a440ce690 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.023+0000 7f3a4b18e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44158660 con 0x7f3a440cfa80 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.023+0000 7f3a48f2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a44153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a44153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50804/0 (socket says 172.21.15.50:50804) 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 -- 172.21.15.50:0/1213492473 learned_addr learned my addr 172.21.15.50:0/1213492473 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a43fff640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a440ce690 0x7f3a4415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a4972b640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 0x7f3a4415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 -- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 msgr2=0x7f3a4415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 0x7f3a4415ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 -- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a440ce690 msgr2=0x7f3a4415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a440ce690 0x7f3a4415e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 -- 172.21.15.50:0/1213492473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009b30 con 0x7f3a440b6bf0 2023-12-08T08:18:54.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.024+0000 7f3a48f2a640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a44153e60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b410 tx=0x7f3a3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.026+0000 7f3a417fa640 1 -- 172.21.15.50:0/1213492473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34011830 con 0x7f3a440b6bf0 2023-12-08T08:18:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.026+0000 7f3a417fa640 1 -- 172.21.15.50:0/1213492473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a340119b0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.026+0000 7f3a417fa640 1 -- 172.21.15.50:0/1213492473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34011d60 con 0x7f3a440b6bf0 2023-12-08T08:18:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.026+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a44158940 con 0x7f3a440b6bf0 2023-12-08T08:18:54.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.026+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a44158f00 con 0x7f3a440b6bf0 2023-12-08T08:18:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.027+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a440cead0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.027+0000 7f3a417fa640 1 -- 172.21.15.50:0/1213492473 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a3401a400 con 0x7f3a440b6bf0 2023-12-08T08:18:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.027+0000 7f3a417fa640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a3006ae40 0x7f3a3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.028+0000 7f3a417fa640 1 -- 172.21.15.50:0/1213492473 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3a34089a10 con 0x7f3a440b6bf0 2023-12-08T08:18:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.028+0000 7f3a43fff640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a3006ae40 0x7f3a3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.028+0000 7f3a43fff640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a3006ae40 0x7f3a3006d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a440a0f10 tx=0x7f3a38007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.032+0000 7f3a417fa640 1 -- 172.21.15.50:0/1213492473 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a440cead0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.207+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a440cead0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.210 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.207+0000 7f3a417fa640 1 -- 172.21.15.50:0/1213492473 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a440cead0 con 0x7f3a440b6bf0 2023-12-08T08:18:54.210 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a3006ae40 msgr2=0x7f3a3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a3006ae40 0x7f3a3006d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a440a0f10 tx=0x7f3a38007e30 comp rx=0 tx=0).stop 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 msgr2=0x7f3a44153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a44153e60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b410 tx=0x7f3a3400b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 shutdown_connections 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a3006ae40 0x7f3a3006d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a440cfa80 0x7f3a4415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a440ce690 0x7f3a4415e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 --2- 172.21.15.50:0/1213492473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a440b6bf0 0x7f3a44153e60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 >> 172.21.15.50:0/1213492473 conn(0x7f3a4409c340 msgr2=0x7f3a4406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.209+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 shutdown_connections 2023-12-08T08:18:54.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.210+0000 7f3a4b18e640 1 -- 172.21.15.50:0/1213492473 wait complete. 2023-12-08T08:18:54.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:54.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.331+0000 7f85d2417640 1 Processor -- start 2023-12-08T08:18:54.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.331+0000 7f85d2417640 1 -- start start 2023-12-08T08:18:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85d2417640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f85cc0cfa30 0x7f85cc0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85d2417640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc0c6be0 con 0x7f85cc0cfe10 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85d2417640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85cc0d3ff0 con 0x7f85cc0b4150 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85d2417640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc0b4860 con 0x7f85cc0cfa30 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85d09b4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85cc0cfe10 0x7f85cc0cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41064/0 (socket says 172.21.15.50:41064) 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85d09b4640 1 -- 172.21.15.50:0/1024432426 learned_addr learned my addr 172.21.15.50:0/1024432426 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565585428 0 0) 0x7f85cc0c6be0 con 0x7f85cc0cfe10 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b4003520 con 0x7f85cc0cfe10 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.332+0000 7f85cbfff640 1 --2- 172.21.15.50:0/1024432426 >> v2:172.21.15.170:3300/0 conn(0x7f85cc0cfa30 0x7f85cc0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 743114117 0 0) 0x7f85b4003520 con 0x7f85cc0cfe10 2023-12-08T08:18:54.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 >> v2:172.21.15.170:3300/0 conn(0x7f85cc0cfa30 msgr2=0x7f85cc0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 --2- 172.21.15.50:0/1024432426 >> v2:172.21.15.170:3300/0 conn(0x7f85cc0cfa30 0x7f85cc0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 >> v1:172.21.15.170:6789/0 conn(0x7f85cc0b4150 legacy=0x7f85cc0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0d3d50 con 0x7f85cc0cfe10 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f85c40019f0 con 0x7f85cc0cfe10 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 >> v1:172.21.15.50:6789/0 conn(0x7f85cc0cfe10 legacy=0x7f85cc0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85b4003970 0x7f85b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b40047c0 0x7f85b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b4005180 0x7f85b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0b4860 con 0x7f85b4003970 2023-12-08T08:18:54.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b400c120 con 0x7f85b4005180 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b400c2e0 con 0x7f85b40047c0 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85cbfff640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85b4003970 0x7f85b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85d09b4640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b4005180 0x7f85b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85cb7fe640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b40047c0 0x7f85b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85cbfff640 1 -- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b40047c0 msgr2=0x7f85b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85cbfff640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b40047c0 0x7f85b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85cbfff640 1 -- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b4005180 msgr2=0x7f85b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85cbfff640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b4005180 0x7f85b400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85d09b4640 1 -- 172.21.15.50:0/1024432426 reap_dead start 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.333+0000 7f85cbfff640 1 -- 172.21.15.50:0/1024432426 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4003520 con 0x7f85b4003970 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.334+0000 7f85cbfff640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85b4003970 0x7f85b4003d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009ac0 tx=0x7f85b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2be5810d2199093 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.334+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c002c630 con 0x7f85b4003970 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.334+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c002c790 con 0x7f85b4003970 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.334+0000 7f85caffd640 1 -- 172.21.15.50:0/1024432426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c002cb20 con 0x7f85b4003970 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.335+0000 7f85d2417640 1 -- 172.21.15.50:0/1024432426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85b4003970 msgr2=0x7f85b4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.335+0000 7f85d2417640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85b4003970 0x7f85b4003d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009ac0 tx=0x7f85b40057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.335+0000 7f85d2417640 1 -- 172.21.15.50:0/1024432426 shutdown_connections 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.335+0000 7f85d2417640 1 --2- 172.21.15.50:0/1024432426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85b4003970 0x7f85b4003d90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.335+0000 7f85d2417640 1 -- 172.21.15.50:0/1024432426 >> 172.21.15.50:0/1024432426 conn(0x7f85cc0d3090 msgr2=0x7f85cc0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.335+0000 7f85d2417640 1 -- 172.21.15.50:0/1024432426 shutdown_connections 2023-12-08T08:18:54.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.335+0000 7f85d2417640 1 -- 172.21.15.50:0/1024432426 wait complete. 2023-12-08T08:18:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.337+0000 7f85d2417640 1 Processor -- start 2023-12-08T08:18:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.337+0000 7f85d2417640 1 -- start start 2023-12-08T08:18:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d2417640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b4003970 0x7f85cc1f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d2417640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85cc0b2cf0 0x7f85cc0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d2417640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85cc153d70 0x7f85cc1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d2417640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc0b36b0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.343 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d2417640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc155c40 con 0x7f85cc153d70 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d2417640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc155e70 con 0x7f85b4003970 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85cc0b2cf0 0x7f85cc0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85cc0b2cf0 0x7f85cc0b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50816/0 (socket says 172.21.15.50:50816) 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 -- 172.21.15.50:0/3251980949 learned_addr learned my addr 172.21.15.50:0/3251980949 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d09b4640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85cc153d70 0x7f85cc1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cbfff640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b4003970 0x7f85cc1f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 -- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b4003970 msgr2=0x7f85cc1f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b4003970 0x7f85cc1f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 -- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85cc153d70 msgr2=0x7f85cc1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85cc153d70 0x7f85cc1541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 -- 172.21.15.50:0/3251980949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc156150 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85cb7fe640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85cc0b2cf0 0x7f85cc0b3170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00f5f0 tx=0x7f85bc00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85c8ff9640 1 -- 172.21.15.50:0/3251980949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0053a0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85c8ff9640 1 -- 172.21.15.50:0/3251980949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc0035f0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc156430 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.339+0000 7f85c8ff9640 1 -- 172.21.15.50:0/3251980949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0039a0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.340+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85cc1569f0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.340+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc156bb0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.341+0000 7f85c8ff9640 1 -- 172.21.15.50:0/3251980949 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85bc003b00 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.345 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.342+0000 7f85c8ff9640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f85b806ae40 0x7f85b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.342+0000 7f85c8ff9640 1 -- 172.21.15.50:0/3251980949 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f85bc089840 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.342+0000 7f85cbfff640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f85b806ae40 0x7f85b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.346 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.343+0000 7f85cbfff640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f85b806ae40 0x7f85b806d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85c0036000 tx=0x7f85c0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.350+0000 7f85c8ff9640 1 -- 172.21.15.50:0/3251980949 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85bc0545d0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.527+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85cc067430 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.528+0000 7f85c8ff9640 1 -- 172.21.15.50:0/3251980949 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85bc003db0 con 0x7f85cc0b2cf0 2023-12-08T08:18:54.530 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:54.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f85b806ae40 msgr2=0x7f85b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f85b806ae40 0x7f85b806d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f85c0036000 tx=0x7f85c0030000 comp rx=0 tx=0).stop 2023-12-08T08:18:54.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85cc0b2cf0 msgr2=0x7f85cc0b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85cc0b2cf0 0x7f85cc0b3170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00f5f0 tx=0x7f85bc00fab0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 shutdown_connections 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f85b806ae40 0x7f85b806d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85cc0b2cf0 0x7f85cc0b3170 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85cc153d70 0x7f85cc1541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 --2- 172.21.15.50:0/3251980949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b4003970 0x7f85cc1f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 >> 172.21.15.50:0/3251980949 conn(0x7f85cc0d3090 msgr2=0x7f85cc0d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 shutdown_connections 2023-12-08T08:18:54.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.530+0000 7f85d2417640 1 -- 172.21.15.50:0/3251980949 wait complete. 2023-12-08T08:18:54.544 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:54.551 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:54.591 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:18:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.656+0000 7fa654a56640 1 Processor -- start 2023-12-08T08:18:54.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.656+0000 7fa654a56640 1 -- start start 2023-12-08T08:18:54.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa654a56640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 0x7fa6500cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa654a56640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa6500cfb20 0x7fa6500c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa654a56640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6500cc430 con 0x7fa6500cef40 2023-12-08T08:18:54.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa654a56640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6500c4980 con 0x7fa6500cfb20 2023-12-08T08:18:54.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa654a56640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500c4c60 con 0x7fa65015b240 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa6500cef40 0x7fa6500cf410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41080/0 (socket says 172.21.15.50:41080) 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64dd9b640 1 -- 172.21.15.50:0/1144922393 learned_addr learned my addr 172.21.15.50:0/1144922393 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64ed9d640 1 --2- 172.21.15.50:0/1144922393 >> v2:172.21.15.170:3300/0 conn(0x7fa6500cfb20 0x7fa6500c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64e59c640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 0x7fa6500cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816780882 0 0) 0x7fa6500cc430 con 0x7fa6500cef40 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa638003520 con 0x7fa6500cef40 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3207099281 0 0) 0x7fa638003520 con 0x7fa6500cef40 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 msgr2=0x7fa6500cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 0x7fa6500cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 >> v2:172.21.15.170:3300/0 conn(0x7fa6500cfb20 msgr2=0x7fa6500c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 --2- 172.21.15.50:0/1144922393 >> v2:172.21.15.170:3300/0 conn(0x7fa6500cfb20 0x7fa6500c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65015b620 con 0x7fa6500cef40 2023-12-08T08:18:54.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.657+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fa644001670 con 0x7fa6500cef40 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 >> v1:172.21.15.50:6789/0 conn(0x7fa6500cef40 legacy=0x7fa6500cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64d59a640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa638003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64d59a640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6380047c0 0x7fa638004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64d59a640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 0x7fa638005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500c4980 con 0x7fa638003970 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500c4c60 con 0x7fa6380047c0 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800b980 con 0x7fa65015b240 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64e59c640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa638003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64ed9d640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 0x7fa638005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64dd9b640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6380047c0 0x7fa638004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64e59c640 1 -- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 msgr2=0x7fa638005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64e59c640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65015b240 0x7fa638005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64e59c640 1 -- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6380047c0 msgr2=0x7fa638004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:54.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64e59c640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6380047c0 0x7fa638004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.658+0000 7fa64e59c640 1 -- 172.21.15.50:0/1144922393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638003520 con 0x7fa638003970 2023-12-08T08:18:54.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.659+0000 7fa64e59c640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa638003d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa640009ac0 tx=0x7fa6380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9a1cb8a14164a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.659+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64002c6b0 con 0x7fa638003970 2023-12-08T08:18:54.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.659+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64002c810 con 0x7fa638003970 2023-12-08T08:18:54.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.659+0000 7fa64d59a640 1 -- 172.21.15.50:0/1144922393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64002cba0 con 0x7fa638003970 2023-12-08T08:18:54.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.660+0000 7fa654a56640 1 -- 172.21.15.50:0/1144922393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 msgr2=0x7fa638003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.660+0000 7fa654a56640 1 --2- 172.21.15.50:0/1144922393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa638003d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa640009ac0 tx=0x7fa6380057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.660+0000 7fa64ed9d640 1 -- 172.21.15.50:0/1144922393 reap_dead start 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.660+0000 7fa654a56640 1 -- 172.21.15.50:0/1144922393 shutdown_connections 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.660+0000 7fa654a56640 1 -- 172.21.15.50:0/1144922393 >> 172.21.15.50:0/1144922393 conn(0x7fa6500d0e30 msgr2=0x7fa6500d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.660+0000 7fa654a56640 1 -- 172.21.15.50:0/1144922393 shutdown_connections 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.660+0000 7fa654a56640 1 -- 172.21.15.50:0/1144922393 wait complete. 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 Processor -- start 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 -- start start 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa65014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa650153a80 0x7fa650153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6501e4930 0x7fa6501e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6501e52f0 con 0x7fa638003970 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65014f6a0 con 0x7fa650153a80 2023-12-08T08:18:54.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.662+0000 7fa654a56640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65006b870 con 0x7fa6501e4930 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa65014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa65014f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50830/0 (socket says 172.21.15.50:50830) 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 -- 172.21.15.50:0/2238252494 learned_addr learned my addr 172.21.15.50:0/2238252494 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64dd9b640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa650153a80 0x7fa650153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64ed9d640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6501e4930 0x7fa6501e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 -- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6501e4930 msgr2=0x7fa6501e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6501e4930 0x7fa6501e4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 -- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa650153a80 msgr2=0x7fa650153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa650153a80 0x7fa650153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 -- 172.21.15.50:0/2238252494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65006bb50 con 0x7fa638003970 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64ed9d640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6501e4930 0x7fa6501e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa64e59c640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa65014f160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa64002c250 tx=0x7fa640004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa63effd640 1 -- 172.21.15.50:0/2238252494 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640003810 con 0x7fa638003970 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa63effd640 1 -- 172.21.15.50:0/2238252494 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640003970 con 0x7fa638003970 2023-12-08T08:18:54.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65006be30 con 0x7fa638003970 2023-12-08T08:18:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa63effd640 1 -- 172.21.15.50:0/2238252494 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640003ce0 con 0x7fa638003970 2023-12-08T08:18:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.663+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa650153320 con 0x7fa638003970 2023-12-08T08:18:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.664+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6500c72b0 con 0x7fa638003970 2023-12-08T08:18:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.665+0000 7fa63effd640 1 -- 172.21.15.50:0/2238252494 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa640034440 con 0x7fa638003970 2023-12-08T08:18:54.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.665+0000 7fa63effd640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa63006ae70 0x7fa63006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.665+0000 7fa63effd640 1 -- 172.21.15.50:0/2238252494 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa6400abc60 con 0x7fa638003970 2023-12-08T08:18:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.665+0000 7fa64dd9b640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa63006ae70 0x7fa63006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:54.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.666+0000 7fa64dd9b640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa63006ae70 0x7fa63006d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa644001050 tx=0x7fa6440078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:54.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.669+0000 7fa63effd640 1 -- 172.21.15.50:0/2238252494 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa640076940 con 0x7fa638003970 2023-12-08T08:18:54.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.846+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa650067ad0 con 0x7fa638003970 2023-12-08T08:18:54.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.847+0000 7fa63effd640 1 -- 172.21.15.50:0/2238252494 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa64004c0a0 con 0x7fa638003970 2023-12-08T08:18:54.849 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:54.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa63006ae70 msgr2=0x7fa63006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa63006ae70 0x7fa63006d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa644001050 tx=0x7fa6440078f0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 msgr2=0x7fa65014f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa65014f160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa64002c250 tx=0x7fa640004730 comp rx=0 tx=0).stop 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 shutdown_connections 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa63006ae70 0x7fa63006d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6501e4930 0x7fa6501e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa650153a80 0x7fa650153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 --2- 172.21.15.50:0/2238252494 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa638003970 0x7fa65014f160 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 >> 172.21.15.50:0/2238252494 conn(0x7fa6500d0e30 msgr2=0x7fa65015a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 shutdown_connections 2023-12-08T08:18:54.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:54.849+0000 7fa654a56640 1 -- 172.21.15.50:0/2238252494 wait complete. 2023-12-08T08:18:54.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.011+0000 7f04fa590640 1 Processor -- start 2023-12-08T08:18:55.014 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.011+0000 7f04fa590640 1 -- start start 2023-12-08T08:18:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04fa590640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 0x7f04f406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04fa590640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f415dd90 con 0x7f04f40caec0 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04fa590640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f415e600 con 0x7f04f40caae0 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04fa590640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4161c20 con 0x7f04f40af030 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04f37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f04f40caec0 0x7f04f415d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41090/0 (socket says 172.21.15.50:41090) 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04f37fe640 1 -- 172.21.15.50:0/588278333 learned_addr learned my addr 172.21.15.50:0/588278333 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04f8b2d640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 0x7f04f406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.012+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344013001 0 0) 0x7f04f415dd90 con 0x7f04f40caec0 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04dc003520 con 0x7f04f40caec0 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3621945105 0 0) 0x7f04dc003520 con 0x7f04f40caec0 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 msgr2=0x7f04f406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 0x7f04f406a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 >> v1:172.21.15.170:6789/0 conn(0x7f04f40caae0 legacy=0x7f04f4161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f415e040 con 0x7f04f40caec0 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f04e4001670 con 0x7f04f40caec0 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 >> v1:172.21.15.50:6789/0 conn(0x7f04f40caec0 legacy=0x7f04f415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 0x7f04dc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04dc003ee0 0x7f04dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4161c20 con 0x7f04dc003ee0 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc00b9e0 con 0x7f04dc004d00 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc00bba0 con 0x7f04f40af030 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f37fe640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04dc003ee0 0x7f04dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f3fff640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 0x7f04dc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f8b2d640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f37fe640 1 -- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 msgr2=0x7f04dc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f37fe640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 0x7f04dc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.018 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f37fe640 1 -- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc004d00 msgr2=0x7f04dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f37fe640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f37fe640 1 -- 172.21.15.50:0/588278333 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc003520 con 0x7f04dc003ee0 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f3fff640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40af030 0x7f04dc0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.013+0000 7f04f8b2d640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.014+0000 7f04f37fe640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04dc003ee0 0x7f04dc0047c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c210 tx=0x7f04dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ddc9efb273abcc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.014+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4005ad0 con 0x7f04dc003ee0 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.014+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e4005c50 con 0x7f04dc003ee0 2023-12-08T08:18:55.019 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.014+0000 7f04f2ffd640 1 -- 172.21.15.50:0/588278333 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e402c810 con 0x7f04dc003ee0 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.015+0000 7f04fa590640 1 -- 172.21.15.50:0/588278333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04dc003ee0 msgr2=0x7f04dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.015+0000 7f04fa590640 1 --2- 172.21.15.50:0/588278333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04dc003ee0 0x7f04dc0047c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c210 tx=0x7f04dc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.015+0000 7f04f8b2d640 1 -- 172.21.15.50:0/588278333 reap_dead start 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.015+0000 7f04fa590640 1 -- 172.21.15.50:0/588278333 shutdown_connections 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.015+0000 7f04fa590640 1 -- 172.21.15.50:0/588278333 >> 172.21.15.50:0/588278333 conn(0x7f04f40cfcd0 msgr2=0x7f04f40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.015+0000 7f04fa590640 1 -- 172.21.15.50:0/588278333 shutdown_connections 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.015+0000 7f04fa590640 1 -- 172.21.15.50:0/588278333 wait complete. 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.016+0000 7f04fa590640 1 Processor -- start 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.016+0000 7f04fa590640 1 -- start start 2023-12-08T08:18:55.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04fa590640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc003ee0 0x7f04f4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04fa590640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40ade60 0x7f04f40ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04fa590640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f41f6000 0x7f04f41f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04fa590640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40ae800 con 0x7f04f41f6000 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04fa590640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40c56b0 con 0x7f04dc003ee0 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04fa590640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f41f6d50 con 0x7f04f40ade60 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f41f6000 0x7f04f41f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f41f6000 0x7f04f41f6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50850/0 (socket says 172.21.15.50:50850) 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 -- 172.21.15.50:0/3368962561 learned_addr learned my addr 172.21.15.50:0/3368962561 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f37fe640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40ade60 0x7f04f40ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f3fff640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc003ee0 0x7f04f4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 -- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40ade60 msgr2=0x7f04f40ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40ade60 0x7f04f40ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 -- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc003ee0 msgr2=0x7f04f4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc003ee0 0x7f04f4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.017+0000 7f04f8b2d640 1 -- 172.21.15.50:0/3368962561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40c5970 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.018+0000 7f04f8b2d640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f41f6000 0x7f04f41f6480 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04f40cc090 tx=0x7f04ec010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.018+0000 7f04f0ff9640 1 -- 172.21.15.50:0/3368962561 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec01b070 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.018+0000 7f04f0ff9640 1 -- 172.21.15.50:0/3368962561 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00f040 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.018+0000 7f04f0ff9640 1 -- 172.21.15.50:0/3368962561 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00e050 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.018+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f40c5c50 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.018+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f41573d0 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.019+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f40c6170 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.019+0000 7f04f0ff9640 1 -- 172.21.15.50:0/3368962561 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04ec015440 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.020+0000 7f04f0ff9640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f04e006ae40 0x7f04e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.020+0000 7f04f0ff9640 1 -- 172.21.15.50:0/3368962561 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f04ec089cd0 con 0x7f04f41f6000 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.020+0000 7f04f3fff640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f04e006ae40 0x7f04e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.020+0000 7f04f3fff640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f04e006ae40 0x7f04e006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f04e8007fd0 tx=0x7f04e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.028+0000 7f04f0ff9640 1 -- 172.21.15.50:0/3368962561 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04f40c6170 con 0x7f04f41f6000 2023-12-08T08:18:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.204+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f04f40c6170 con 0x7f04f41f6000 2023-12-08T08:18:55.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.204+0000 7f04f0ff9640 1 -- 172.21.15.50:0/3368962561 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f04f40c6170 con 0x7f04f41f6000 2023-12-08T08:18:55.207 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f04e006ae40 msgr2=0x7f04e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f04e006ae40 0x7f04e006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f04e8007fd0 tx=0x7f04e8009040 comp rx=0 tx=0).stop 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f41f6000 msgr2=0x7f04f41f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f41f6000 0x7f04f41f6480 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04f40cc090 tx=0x7f04ec010590 comp rx=0 tx=0).stop 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 shutdown_connections 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f04e006ae40 0x7f04e006d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04f41f6000 0x7f04f41f6480 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04f40ade60 0x7f04f40ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 --2- 172.21.15.50:0/3368962561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04dc003ee0 0x7f04f4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 >> 172.21.15.50:0/3368962561 conn(0x7f04f40cfcd0 msgr2=0x7f04f40b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 shutdown_connections 2023-12-08T08:18:55.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.206+0000 7f04fa590640 1 -- 172.21.15.50:0/3368962561 wait complete. 2023-12-08T08:18:55.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:55.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.325+0000 7f62f1ab4640 1 Processor -- start 2023-12-08T08:18:55.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.325+0000 7f62f1ab4640 1 -- start start 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62f1ab4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cd240 0x7f62ec0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62f1ab4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f62ec15f4e0 0x7f62ec15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62f1ab4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ec0cfb90 con 0x7f62ec0cf730 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62f1ab4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec0cd620 con 0x7f62ec15f4e0 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62f1ab4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec15c150 con 0x7f62ec0cd240 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62eb7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cd240 0x7f62ec0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62ebfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f62ec15f4e0 0x7f62ec15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62eaffd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f62ec0cf730 0x7f62ec15edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:37864/0 (socket says 172.21.15.50:37864) 2023-12-08T08:18:55.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.326+0000 7f62eaffd640 1 -- 172.21.15.50:0/2350794815 learned_addr learned my addr 172.21.15.50:0/2350794815 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.327+0000 7f62ea7fc640 1 -- 172.21.15.50:0/2350794815 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831775454 0 0) 0x7f62ec0cfb90 con 0x7f62ec0cf730 2023-12-08T08:18:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.327+0000 7f62ea7fc640 1 -- 172.21.15.50:0/2350794815 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d4003520 con 0x7f62ec0cf730 2023-12-08T08:18:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.327+0000 7f62eb7fe640 1 -- 172.21.15.50:0/2350794815 >> v2:172.21.15.170:3300/0 conn(0x7f62ec15f4e0 msgr2=0x7f62ec15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.327+0000 7f62eb7fe640 1 --2- 172.21.15.50:0/2350794815 >> v2:172.21.15.170:3300/0 conn(0x7f62ec15f4e0 0x7f62ec15a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.327+0000 7f62eb7fe640 1 -- 172.21.15.50:0/2350794815 >> v1:172.21.15.170:6789/0 conn(0x7f62ec0cf730 legacy=0x7f62ec15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.327+0000 7f62eb7fe640 1 -- 172.21.15.50:0/2350794815 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec15fb00 con 0x7f62ec0cd240 2023-12-08T08:18:55.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.327+0000 7f62ebfff640 1 --2- 172.21.15.50:0/2350794815 >> v2:172.21.15.170:3300/0 conn(0x7f62ec15f4e0 0x7f62ec15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62eb7fe640 1 --2- 172.21.15.50:0/2350794815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cd240 0x7f62ec0cf1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62e00097a0 tx=0x7f62e002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f17ce1b8b5afe2d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62ea7fc640 1 -- 172.21.15.50:0/2350794815 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0031830 con 0x7f62ec0cd240 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62ea7fc640 1 -- 172.21.15.50:0/2350794815 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0031990 con 0x7f62ec0cd240 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62ea7fc640 1 -- 172.21.15.50:0/2350794815 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0031d20 con 0x7f62ec0cd240 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 -- 172.21.15.50:0/2350794815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cd240 msgr2=0x7f62ec0cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/2350794815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cd240 0x7f62ec0cf1f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62e00097a0 tx=0x7f62e002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 -- 172.21.15.50:0/2350794815 shutdown_connections 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/2350794815 >> v2:172.21.15.170:3300/0 conn(0x7f62ec15f4e0 0x7f62ec15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/2350794815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cd240 0x7f62ec0cf1f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 -- 172.21.15.50:0/2350794815 >> 172.21.15.50:0/2350794815 conn(0x7f62ec099a10 msgr2=0x7f62ec099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 -- 172.21.15.50:0/2350794815 shutdown_connections 2023-12-08T08:18:55.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.328+0000 7f62f1ab4640 1 -- 172.21.15.50:0/2350794815 wait complete. 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.329+0000 7f62f1ab4640 1 Processor -- start 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.330+0000 7f62f1ab4640 1 -- start start 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.330+0000 7f62f1ab4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0cd240 0x7f62ec14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.330+0000 7f62f1ab4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cf730 0x7f62ec0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.330+0000 7f62f1ab4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec15f4e0 0x7f62ec1f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.330+0000 7f62f1ab4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b6140 con 0x7f62ec15f4e0 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.330+0000 7f62f1ab4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec14e7e0 con 0x7f62ec0cd240 2023-12-08T08:18:55.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.330+0000 7f62f1ab4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b6690 con 0x7f62ec0cf730 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec15f4e0 0x7f62ec1f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec15f4e0 0x7f62ec1f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50862/0 (socket says 172.21.15.50:50862) 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 -- 172.21.15.50:0/147868416 learned_addr learned my addr 172.21.15.50:0/147868416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62eb7fe640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0cd240 0x7f62ec14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62eaffd640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cf730 0x7f62ec0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 -- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cf730 msgr2=0x7f62ec0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cf730 0x7f62ec0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 -- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0cd240 msgr2=0x7f62ec14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0cd240 0x7f62ec14e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 -- 172.21.15.50:0/147868416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009a70 con 0x7f62ec15f4e0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62ebfff640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec15f4e0 0x7f62ec1f4680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62e400efc0 tx=0x7f62e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62d3fff640 1 -- 172.21.15.50:0/147868416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4009d70 con 0x7f62ec15f4e0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62d3fff640 1 -- 172.21.15.50:0/147868416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e400f040 con 0x7f62ec15f4e0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e0009400 con 0x7f62ec15f4e0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62d3fff640 1 -- 172.21.15.50:0/147868416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4003990 con 0x7f62ec15f4e0 2023-12-08T08:18:55.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.331+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec0c7310 con 0x7f62ec15f4e0 2023-12-08T08:18:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.332+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec15c5c0 con 0x7f62ec15f4e0 2023-12-08T08:18:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.333+0000 7f62d3fff640 1 -- 172.21.15.50:0/147868416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62e40144a0 con 0x7f62ec15f4e0 2023-12-08T08:18:55.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.333+0000 7f62d3fff640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f62d806ae40 0x7f62d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.334+0000 7f62d3fff640 1 -- 172.21.15.50:0/147868416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f62e408a660 con 0x7f62ec15f4e0 2023-12-08T08:18:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.334+0000 7f62eb7fe640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f62d806ae40 0x7f62d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.334+0000 7f62eb7fe640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f62d806ae40 0x7f62d806d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f62e0036000 tx=0x7f62e003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.340 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.338+0000 7f62d3fff640 1 -- 172.21.15.50:0/147868416 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62ec15c5c0 con 0x7f62ec15f4e0 2023-12-08T08:18:55.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.528+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f62ec15c5c0 con 0x7f62ec15f4e0 2023-12-08T08:18:55.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.528+0000 7f62d3fff640 1 -- 172.21.15.50:0/147868416 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62ec15c5c0 con 0x7f62ec15f4e0 2023-12-08T08:18:55.531 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:18:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f62d806ae40 msgr2=0x7f62d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f62d806ae40 0x7f62d806d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f62e0036000 tx=0x7f62e003c040 comp rx=0 tx=0).stop 2023-12-08T08:18:55.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec15f4e0 msgr2=0x7f62ec1f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec15f4e0 0x7f62ec1f4680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f62e400efc0 tx=0x7f62e4009f90 comp rx=0 tx=0).stop 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 shutdown_connections 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f62d806ae40 0x7f62d806d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec15f4e0 0x7f62ec1f4680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62ec0cf730 0x7f62ec0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 --2- 172.21.15.50:0/147868416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0cd240 0x7f62ec14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 >> 172.21.15.50:0/147868416 conn(0x7f62ec099a10 msgr2=0x7f62ec06ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 shutdown_connections 2023-12-08T08:18:55.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.531+0000 7f62f1ab4640 1 -- 172.21.15.50:0/147868416 wait complete. 2023-12-08T08:18:55.544 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:18:55.544 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:55.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.667+0000 7f70d246b640 1 Processor -- start 2023-12-08T08:18:55.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.667+0000 7f70d246b640 1 -- start start 2023-12-08T08:18:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70d246b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70cc1608a0 0x7f70cc0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70d246b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f70cc0b0cf0 0x7f70cc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70d246b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0d20b0 con 0x7f70cc0b1d70 2023-12-08T08:18:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70d246b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0d0620 con 0x7f70cc1608a0 2023-12-08T08:18:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70d246b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0d1b80 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70cbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f70cc1608a0 0x7f70cc0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70cb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f70cc0b1d70 0x7f70cc0d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41094/0 (socket says 172.21.15.50:41094) 2023-12-08T08:18:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.668+0000 7f70cb7fe640 1 -- 172.21.15.50:0/634344537 learned_addr learned my addr 172.21.15.50:0/634344537 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.669+0000 7f70d0a08640 1 --2- 172.21.15.50:0/634344537 >> v2:172.21.15.170:3300/0 conn(0x7f70cc0b0cf0 0x7f70cc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.669+0000 7f70cbfff640 1 -- 172.21.15.50:0/634344537 >> v2:172.21.15.170:3300/0 conn(0x7f70cc0b0cf0 msgr2=0x7f70cc0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.669+0000 7f70cbfff640 1 --2- 172.21.15.50:0/634344537 >> v2:172.21.15.170:3300/0 conn(0x7f70cc0b0cf0 0x7f70cc0cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.669+0000 7f70cbfff640 1 -- 172.21.15.50:0/634344537 >> v1:172.21.15.50:6789/0 conn(0x7f70cc0b1d70 legacy=0x7f70cc0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.669+0000 7f70cbfff640 1 -- 172.21.15.50:0/634344537 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0d1dd0 con 0x7f70cc1608a0 2023-12-08T08:18:55.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.669+0000 7f70caffd640 1 -- 172.21.15.50:0/634344537 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691101759 0 0) 0x7f70cc0d20b0 con 0x7f70cc0b1d70 2023-12-08T08:18:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.669+0000 7f70cbfff640 1 --2- 172.21.15.50:0/634344537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc1608a0 0x7f70cc0d0f30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f70cc073100 tx=0x7f70bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8728f2bf07a423 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70caffd640 1 -- 172.21.15.50:0/634344537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc02e070 con 0x7f70cc1608a0 2023-12-08T08:18:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70caffd640 1 -- 172.21.15.50:0/634344537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc0315a0 con 0x7f70cc1608a0 2023-12-08T08:18:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70caffd640 1 -- 172.21.15.50:0/634344537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc031930 con 0x7f70cc1608a0 2023-12-08T08:18:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 -- 172.21.15.50:0/634344537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc1608a0 msgr2=0x7f70cc0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 --2- 172.21.15.50:0/634344537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc1608a0 0x7f70cc0d0f30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f70cc073100 tx=0x7f70bc02b840 comp rx=0 tx=0).stop 2023-12-08T08:18:55.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 -- 172.21.15.50:0/634344537 shutdown_connections 2023-12-08T08:18:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 --2- 172.21.15.50:0/634344537 >> v2:172.21.15.170:3300/0 conn(0x7f70cc0b0cf0 0x7f70cc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 --2- 172.21.15.50:0/634344537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc1608a0 0x7f70cc0d0f30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 -- 172.21.15.50:0/634344537 >> 172.21.15.50:0/634344537 conn(0x7f70cc0d3030 msgr2=0x7f70cc0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 -- 172.21.15.50:0/634344537 shutdown_connections 2023-12-08T08:18:55.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.670+0000 7f70d246b640 1 -- 172.21.15.50:0/634344537 wait complete. 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.671+0000 7f70d246b640 1 Processor -- start 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70d246b640 1 -- start start 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70d246b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc0b0cf0 0x7f70cc152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70d246b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70cc0b1d70 0x7f70cc14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70d246b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70cc1608a0 0x7f70cc14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70d246b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c9a60 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70d246b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0b8650 con 0x7f70cc1608a0 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70d246b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c9780 con 0x7f70cc0b1d70 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc0b0cf0 0x7f70cc152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc0b0cf0 0x7f70cc152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50888/0 (socket says 172.21.15.50:50888) 2023-12-08T08:18:55.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.672+0000 7f70cbfff640 1 -- 172.21.15.50:0/1565327125 learned_addr learned my addr 172.21.15.50:0/1565327125 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70d0a08640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70cc1608a0 0x7f70cc14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70cb7fe640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70cc0b1d70 0x7f70cc14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70cbfff640 1 -- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70cc0b1d70 msgr2=0x7f70cc14f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70cbfff640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70cc0b1d70 0x7f70cc14f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70cbfff640 1 -- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70cc1608a0 msgr2=0x7f70cc14f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70cbfff640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70cc1608a0 0x7f70cc14f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70cbfff640 1 -- 172.21.15.50:0/1565327125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc009400 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70d0a08640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70cc1608a0 0x7f70cc14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70cbfff640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc0b0cf0 0x7f70cc152b30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f70bc000c00 tx=0x7f70bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70c8ff9640 1 -- 172.21.15.50:0/1565327125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc004230 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70c8ff9640 1 -- 172.21.15.50:0/1565327125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc004390 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc0b8000 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70c8ff9640 1 -- 172.21.15.50:0/1565327125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc032940 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.673+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc0b8ae0 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.674+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc0b7e60 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.674+0000 7f70c8ff9640 1 -- 172.21.15.50:0/1565327125 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70bc032aa0 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.675+0000 7f70c8ff9640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f70b806ae70 0x7f70b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.675+0000 7f70c8ff9640 1 -- 172.21.15.50:0/1565327125 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f70bc0abb10 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.675+0000 7f70cb7fe640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f70b806ae70 0x7f70b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.676+0000 7f70cb7fe640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f70b806ae70 0x7f70b806d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0b25a0 tx=0x7f70c0007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.679+0000 7f70c8ff9640 1 -- 172.21.15.50:0/1565327125 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70cc0b7e60 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.855+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70cc0b7e60 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.856+0000 7f70c8ff9640 1 -- 172.21.15.50:0/1565327125 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f70cc0b7e60 con 0x7f70cc0b0cf0 2023-12-08T08:18:55.859 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:55.859 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f70b806ae70 msgr2=0x7f70b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f70b806ae70 0x7f70b806d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0b25a0 tx=0x7f70c0007b50 comp rx=0 tx=0).stop 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc0b0cf0 msgr2=0x7f70cc152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc0b0cf0 0x7f70cc152b30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f70bc000c00 tx=0x7f70bc0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 shutdown_connections 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f70b806ae70 0x7f70b806d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70cc1608a0 0x7f70cc14f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f70cc0b1d70 0x7f70cc14f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 --2- 172.21.15.50:0/1565327125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f70cc0b0cf0 0x7f70cc152b30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 >> 172.21.15.50:0/1565327125 conn(0x7f70cc0d3030 msgr2=0x7f70cc0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 shutdown_connections 2023-12-08T08:18:55.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.858+0000 7f70d246b640 1 -- 172.21.15.50:0/1565327125 wait complete. 2023-12-08T08:18:55.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:55.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.979+0000 7fa6c7d89640 1 Processor -- start 2023-12-08T08:18:55.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.980+0000 7fa6c7d89640 1 -- start start 2023-12-08T08:18:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.980+0000 7fa6c7d89640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6c00b0ef0 0x7fa6c00cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c7d89640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c00b2280 con 0x7fa6c015d4f0 2023-12-08T08:18:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c7d89640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c00b2710 con 0x7fa6c00b0af0 2023-12-08T08:18:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c7d89640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c006bb40 con 0x7fa6c00b0ef0 2023-12-08T08:18:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c6326640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa6c00b0ef0 0x7fa6c00cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c5b25640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa6c015d4f0 0x7fa6c00b03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41100/0 (socket says 172.21.15.50:41100) 2023-12-08T08:18:55.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c5b25640 1 -- 172.21.15.50:0/883479547 learned_addr learned my addr 172.21.15.50:0/883479547 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c6326640 1 -- 172.21.15.50:0/883479547 >> v1:172.21.15.170:6789/0 conn(0x7fa6c00b0af0 legacy=0x7fa6c00cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c6326640 1 -- 172.21.15.50:0/883479547 >> v1:172.21.15.50:6789/0 conn(0x7fa6c015d4f0 legacy=0x7fa6c00b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.981+0000 7fa6c6326640 1 -- 172.21.15.50:0/883479547 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00b1690 con 0x7fa6c00b0ef0 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c6326640 1 --2- 172.21.15.50:0/883479547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c00b0ef0 0x7fa6c00cf6a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009d90 tx=0x7fa6b802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecae4b1d9ad593f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c4b23640 1 -- 172.21.15.50:0/883479547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b802cc60 con 0x7fa6c00b0ef0 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c4b23640 1 -- 172.21.15.50:0/883479547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b802cdc0 con 0x7fa6c00b0ef0 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c4b23640 1 -- 172.21.15.50:0/883479547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8034660 con 0x7fa6c00b0ef0 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c7d89640 1 -- 172.21.15.50:0/883479547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c00b0ef0 msgr2=0x7fa6c00cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/883479547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c00b0ef0 0x7fa6c00cf6a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009d90 tx=0x7fa6b802beb0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c7d89640 1 -- 172.21.15.50:0/883479547 shutdown_connections 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/883479547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c00b0ef0 0x7fa6c00cf6a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.982+0000 7fa6c7d89640 1 -- 172.21.15.50:0/883479547 >> 172.21.15.50:0/883479547 conn(0x7fa6c00d0e00 msgr2=0x7fa6c00d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.983+0000 7fa6c7d89640 1 -- 172.21.15.50:0/883479547 shutdown_connections 2023-12-08T08:18:55.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.983+0000 7fa6c7d89640 1 -- 172.21.15.50:0/883479547 wait complete. 2023-12-08T08:18:55.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 Processor -- start 2023-12-08T08:18:55.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 -- start start 2023-12-08T08:18:55.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6c00b0af0 0x7fa6c01e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6c00b0ef0 0x7fa6c00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c015d4f0 0x7fa6c0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00ccda0 con 0x7fa6c015d4f0 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c01e6790 con 0x7fa6c00b0af0 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.984+0000 7fa6c7d89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00cc6e0 con 0x7fa6c00b0ef0 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c015d4f0 0x7fa6c0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c015d4f0 0x7fa6c0158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50914/0 (socket says 172.21.15.50:50914) 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 -- 172.21.15.50:0/1073334331 learned_addr learned my addr 172.21.15.50:0/1073334331 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 -- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6c00b0ef0 msgr2=0x7fa6c00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c5b25640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6c00b0af0 0x7fa6c01e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c5324640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6c00b0ef0 0x7fa6c00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6c00b0ef0 0x7fa6c00cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 -- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6c00b0af0 msgr2=0x7fa6c01e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:55.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6c00b0af0 0x7fa6c01e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 -- 172.21.15.50:0/1073334331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8009a70 con 0x7fa6c015d4f0 2023-12-08T08:18:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c6326640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c015d4f0 0x7fa6c0158c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009d90 tx=0x7fa6b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6b67fc640 1 -- 172.21.15.50:0/1073334331 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8040450 con 0x7fa6c015d4f0 2023-12-08T08:18:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6b67fc640 1 -- 172.21.15.50:0/1073334331 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b80405d0 con 0x7fa6c015d4f0 2023-12-08T08:18:55.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c00cc9c0 con 0x7fa6c015d4f0 2023-12-08T08:18:55.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6b67fc640 1 -- 172.21.15.50:0/1073334331 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8040980 con 0x7fa6c015d4f0 2023-12-08T08:18:55.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.985+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c00c7ed0 con 0x7fa6c015d4f0 2023-12-08T08:18:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.986+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c00ccee0 con 0x7fa6c015d4f0 2023-12-08T08:18:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.987+0000 7fa6b67fc640 1 -- 172.21.15.50:0/1073334331 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6b8040ae0 con 0x7fa6c015d4f0 2023-12-08T08:18:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.987+0000 7fa6b67fc640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa6a406ae40 0x7fa6a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.987+0000 7fa6b67fc640 1 -- 172.21.15.50:0/1073334331 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa6b80ac550 con 0x7fa6c015d4f0 2023-12-08T08:18:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.987+0000 7fa6c5b25640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa6a406ae40 0x7fa6a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.988+0000 7fa6c5b25640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa6a406ae40 0x7fa6a406d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005880 tx=0x7fa6bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:55.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:55.991+0000 7fa6b67fc640 1 -- 172.21.15.50:0/1073334331 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6c00ccee0 con 0x7fa6c015d4f0 2023-12-08T08:18:56.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.169+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6c00ccee0 con 0x7fa6c015d4f0 2023-12-08T08:18:56.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.169+0000 7fa6b67fc640 1 -- 172.21.15.50:0/1073334331 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6c00ccee0 con 0x7fa6c015d4f0 2023-12-08T08:18:56.172 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:56.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa6a406ae40 msgr2=0x7fa6a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa6a406ae40 0x7fa6a406d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005880 tx=0x7fa6bc009040 comp rx=0 tx=0).stop 2023-12-08T08:18:56.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c015d4f0 msgr2=0x7fa6c0158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c015d4f0 0x7fa6c0158c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009d90 tx=0x7fa6b8004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:56.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 shutdown_connections 2023-12-08T08:18:56.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa6a406ae40 0x7fa6a406d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6c015d4f0 0x7fa6c0158c80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6c00b0ef0 0x7fa6c00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 --2- 172.21.15.50:0/1073334331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6c00b0af0 0x7fa6c01e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 >> 172.21.15.50:0/1073334331 conn(0x7fa6c00d0e00 msgr2=0x7fa6c01e89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.171+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 shutdown_connections 2023-12-08T08:18:56.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.172+0000 7fa6c7d89640 1 -- 172.21.15.50:0/1073334331 wait complete. 2023-12-08T08:18:56.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.291+0000 7f3d00be5640 1 Processor -- start 2023-12-08T08:18:56.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.291+0000 7f3d00be5640 1 -- start start 2023-12-08T08:18:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.291+0000 7f3d00be5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3cfc0b4920 0x7f3cfc0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.291+0000 7f3d00be5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0ad290 0x7f3cfc06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.291+0000 7f3d00be5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc0721f0 con 0x7f3cfc145d80 2023-12-08T08:18:56.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.291+0000 7f3d00be5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc0b4e00 con 0x7f3cfc0b4920 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3d00be5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0b50e0 con 0x7f3cfc0ad290 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cf1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3cfc0b4920 0x7f3cfc0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cf1d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3cfc0b4920 0x7f3cfc0acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50920/0 (socket says 172.21.15.50:50920) 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cf1d9b640 1 -- 172.21.15.50:0/2510974984 learned_addr learned my addr 172.21.15.50:0/2510974984 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cfad9d640 1 --2- 172.21.15.50:0/2510974984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0ad290 0x7f3cfc06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cf1d9b640 1 -- 172.21.15.50:0/2510974984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0ad290 msgr2=0x7f3cfc06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cf1d9b640 1 --2- 172.21.15.50:0/2510974984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0ad290 0x7f3cfc06a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cf1d9b640 1 -- 172.21.15.50:0/2510974984 >> v1:172.21.15.170:6789/0 conn(0x7f3cfc145d80 legacy=0x7f3cfc071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.292+0000 7f3cf1d9b640 1 -- 172.21.15.50:0/2510974984 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc06cfb0 con 0x7f3cfc0b4920 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3cf1d9b640 1 --2- 172.21.15.50:0/2510974984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0b4920 0x7f3cfc0acd50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5fa432a2ad0895 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3cf9d9b640 1 -- 172.21.15.50:0/2510974984 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4030840 con 0x7f3cfc0b4920 2023-12-08T08:18:56.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3cf9d9b640 1 -- 172.21.15.50:0/2510974984 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40309a0 con 0x7f3cfc0b4920 2023-12-08T08:18:56.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3cf9d9b640 1 -- 172.21.15.50:0/2510974984 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4030d30 con 0x7f3cfc0b4920 2023-12-08T08:18:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3d00be5640 1 -- 172.21.15.50:0/2510974984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0b4920 msgr2=0x7f3cfc0acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3d00be5640 1 --2- 172.21.15.50:0/2510974984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0b4920 0x7f3cfc0acd50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce402b980 comp rx=0 tx=0).stop 2023-12-08T08:18:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3d00be5640 1 -- 172.21.15.50:0/2510974984 shutdown_connections 2023-12-08T08:18:56.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3d00be5640 1 --2- 172.21.15.50:0/2510974984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0ad290 0x7f3cfc06a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3d00be5640 1 --2- 172.21.15.50:0/2510974984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0b4920 0x7f3cfc0acd50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3d00be5640 1 -- 172.21.15.50:0/2510974984 >> 172.21.15.50:0/2510974984 conn(0x7f3cfc06b7c0 msgr2=0x7f3cfc06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.293+0000 7f3d00be5640 1 -- 172.21.15.50:0/2510974984 shutdown_connections 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.294+0000 7f3d00be5640 1 -- 172.21.15.50:0/2510974984 wait complete. 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.295+0000 7f3d00be5640 1 Processor -- start 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.295+0000 7f3d00be5640 1 -- start start 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3d00be5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0ad290 0x7f3cfc14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3d00be5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0b4920 0x7f3cfc13d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3d00be5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cfc145d80 0x7f3cfc13f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3d00be5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc140a30 con 0x7f3cfc0ad290 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3d00be5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc13ddf0 con 0x7f3cfc145d80 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3d00be5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc13fdb0 con 0x7f3cfc0b4920 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0ad290 0x7f3cfc14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0ad290 0x7f3cfc14ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50934/0 (socket says 172.21.15.50:50934) 2023-12-08T08:18:56.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 -- 172.21.15.50:0/4106998086 learned_addr learned my addr 172.21.15.50:0/4106998086 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 -- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0b4920 msgr2=0x7f3cfc13d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfad9d640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cfc145d80 0x7f3cfc13f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cf1d9b640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0b4920 0x7f3cfc13d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0b4920 0x7f3cfc13d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 -- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cfc145d80 msgr2=0x7f3cfc13f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cfc145d80 0x7f3cfc13f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 -- 172.21.15.50:0/4106998086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40094d0 con 0x7f3cfc0ad290 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.296+0000 7f3cfa59c640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0ad290 0x7f3cfc14ffb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c400 tx=0x7f3cec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.297+0000 7f3cf37fe640 1 -- 172.21.15.50:0/4106998086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0052d0 con 0x7f3cfc0ad290 2023-12-08T08:18:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.297+0000 7f3cf37fe640 1 -- 172.21.15.50:0/4106998086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec005430 con 0x7f3cfc0ad290 2023-12-08T08:18:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.297+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc140090 con 0x7f3cfc0ad290 2023-12-08T08:18:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.297+0000 7f3cf37fe640 1 -- 172.21.15.50:0/4106998086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec003830 con 0x7f3cfc0ad290 2023-12-08T08:18:56.302 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.297+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc140650 con 0x7f3cfc0ad290 2023-12-08T08:18:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.298+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc071460 con 0x7f3cfc0ad290 2023-12-08T08:18:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.298+0000 7f3cf37fe640 1 -- 172.21.15.50:0/4106998086 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cec003990 con 0x7f3cfc0ad290 2023-12-08T08:18:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.299+0000 7f3cf37fe640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3cdc06ae40 0x7f3cdc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.299+0000 7f3cf37fe640 1 -- 172.21.15.50:0/4106998086 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3cec088ff0 con 0x7f3cfc0ad290 2023-12-08T08:18:56.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.299+0000 7f3cf1d9b640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3cdc06ae40 0x7f3cdc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.299+0000 7f3cf1d9b640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3cdc06ae40 0x7f3cdc06d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4036000 tx=0x7f3ce403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.305 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.303+0000 7f3cf37fe640 1 -- 172.21.15.50:0/4106998086 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3cec053c40 con 0x7f3cfc0ad290 2023-12-08T08:18:56.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.478+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cfc067430 con 0x7f3cfc0ad290 2023-12-08T08:18:56.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.479+0000 7f3cf37fe640 1 -- 172.21.15.50:0/4106998086 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3cec074e60 con 0x7f3cfc0ad290 2023-12-08T08:18:56.481 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.480+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3cdc06ae40 msgr2=0x7f3cdc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.480+0000 7f3d00be5640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3cdc06ae40 0x7f3cdc06d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4036000 tx=0x7f3ce403b040 comp rx=0 tx=0).stop 2023-12-08T08:18:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.480+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0ad290 msgr2=0x7f3cfc14ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.480+0000 7f3d00be5640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0ad290 0x7f3cfc14ffb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00c400 tx=0x7f3cec00c8c0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.480+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 shutdown_connections 2023-12-08T08:18:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.481+0000 7f3d00be5640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3cdc06ae40 0x7f3cdc06d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.481+0000 7f3d00be5640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cfc145d80 0x7f3cfc13f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.481+0000 7f3d00be5640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cfc0b4920 0x7f3cfc13d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.481+0000 7f3d00be5640 1 --2- 172.21.15.50:0/4106998086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3cfc0ad290 0x7f3cfc14ffb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.481+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 >> 172.21.15.50:0/4106998086 conn(0x7f3cfc06b7c0 msgr2=0x7f3cfc06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.481+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 shutdown_connections 2023-12-08T08:18:56.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.481+0000 7f3d00be5640 1 -- 172.21.15.50:0/4106998086 wait complete. 2023-12-08T08:18:56.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.602+0000 7f9040b78640 1 Processor -- start 2023-12-08T08:18:56.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.602+0000 7f9040b78640 1 -- start start 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9040b78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9040b78640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f903c0cd1c0 0x7f903c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9040b78640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0ce360 con 0x7f903c0ccae0 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9040b78640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0ce640 con 0x7f903c0cd1c0 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9040b78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0cbda0 con 0x7f903c15e730 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f903a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9031d9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f903c0cd1c0 0x7f903c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f903ad9d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f903c0ccae0 0x7f903c0ced10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:37884/0 (socket says 172.21.15.50:37884) 2023-12-08T08:18:56.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f903ad9d640 1 -- 172.21.15.50:0/1956572066 learned_addr learned my addr 172.21.15.50:0/1956572066 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9039d9b640 1 -- 172.21.15.50:0/1956572066 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255558137 0 0) 0x7f903c0ce360 con 0x7f903c0ccae0 2023-12-08T08:18:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9039d9b640 1 -- 172.21.15.50:0/1956572066 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9028003520 con 0x7f903c0ccae0 2023-12-08T08:18:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9031d9b640 1 -- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 msgr2=0x7f903c0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9031d9b640 1 --2- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c0cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.603+0000 7f9031d9b640 1 -- 172.21.15.50:0/1956572066 >> v1:172.21.15.170:6789/0 conn(0x7f903c0ccae0 legacy=0x7f903c0ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.604+0000 7f9031d9b640 1 -- 172.21.15.50:0/1956572066 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0cc080 con 0x7f903c0cd1c0 2023-12-08T08:18:56.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.604+0000 7f903a59c640 1 --2- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c0cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.604+0000 7f9031d9b640 1 --2- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 0x7f903c0b0510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90240097a0 tx=0x7f902402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b07b2d7f8be62792 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9039d9b640 1 -- 172.21.15.50:0/1956572066 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902402d040 con 0x7f903c0cd1c0 2023-12-08T08:18:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9039d9b640 1 -- 172.21.15.50:0/1956572066 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9024031810 con 0x7f903c0cd1c0 2023-12-08T08:18:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9039d9b640 1 -- 172.21.15.50:0/1956572066 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024031ba0 con 0x7f903c0cd1c0 2023-12-08T08:18:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 -- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 msgr2=0x7f903c0b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 --2- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 0x7f903c0b0510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90240097a0 tx=0x7f902402b8b0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 -- 172.21.15.50:0/1956572066 shutdown_connections 2023-12-08T08:18:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 --2- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 0x7f903c0b0510 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 --2- 172.21.15.50:0/1956572066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c0cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 -- 172.21.15.50:0/1956572066 >> 172.21.15.50:0/1956572066 conn(0x7f903c0d0e10 msgr2=0x7f903c0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 -- 172.21.15.50:0/1956572066 shutdown_connections 2023-12-08T08:18:56.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.605+0000 7f9040b78640 1 -- 172.21.15.50:0/1956572066 wait complete. 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 Processor -- start 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 -- start start 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c0ccae0 0x7f903c09acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 0x7f903c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b1460 con 0x7f903c0ccae0 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c7890 con 0x7f903c0cd1c0 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f9040b78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c6ec0 con 0x7f903c15e730 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f903a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c0ccae0 0x7f903c09acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.607+0000 7f903a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c0ccae0 0x7f903c09acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50942/0 (socket says 172.21.15.50:50942) 2023-12-08T08:18:56.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903a59c640 1 -- 172.21.15.50:0/3756501473 learned_addr learned my addr 172.21.15.50:0/3756501473 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f9031d9b640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 0x7f903c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903ad9d640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903a59c640 1 -- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 msgr2=0x7f903c149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903a59c640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903a59c640 1 -- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 msgr2=0x7f903c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903a59c640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 0x7f903c0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903a59c640 1 -- 172.21.15.50:0/3756501473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c009400 con 0x7f903c0ccae0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f903a59c640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c0ccae0 0x7f903c09acf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f902c00e960 tx=0x7f902c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f90337fe640 1 -- 172.21.15.50:0/3756501473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00ca00 con 0x7f903c0ccae0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f90337fe640 1 -- 172.21.15.50:0/3756501473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c00cb60 con 0x7f903c0ccae0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9024009400 con 0x7f903c0ccae0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f90337fe640 1 -- 172.21.15.50:0/3756501473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c013470 con 0x7f903c0ccae0 2023-12-08T08:18:56.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.608+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c0c47b0 con 0x7f903c0ccae0 2023-12-08T08:18:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.609+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c067430 con 0x7f903c0ccae0 2023-12-08T08:18:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.610+0000 7f90337fe640 1 -- 172.21.15.50:0/3756501473 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f902c0135d0 con 0x7f903c0ccae0 2023-12-08T08:18:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.610+0000 7f90337fe640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f901c06ae40 0x7f901c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.610+0000 7f90337fe640 1 -- 172.21.15.50:0/3756501473 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f902c089be0 con 0x7f903c0ccae0 2023-12-08T08:18:56.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.610+0000 7f9031d9b640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f901c06ae40 0x7f901c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.611+0000 7f9031d9b640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f901c06ae40 0x7f901c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9024036000 tx=0x7f902403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.614+0000 7f90337fe640 1 -- 172.21.15.50:0/3756501473 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f902c0548c0 con 0x7f903c0ccae0 2023-12-08T08:18:56.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.790+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f903c15b730 con 0x7f903c0ccae0 2023-12-08T08:18:56.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.790+0000 7f90337fe640 1 -- 172.21.15.50:0/3756501473 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f902c0170a0 con 0x7f903c0ccae0 2023-12-08T08:18:56.793 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f901c06ae40 msgr2=0x7f901c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f901c06ae40 0x7f901c06d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9024036000 tx=0x7f902403c040 comp rx=0 tx=0).stop 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c0ccae0 msgr2=0x7f903c09acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c0ccae0 0x7f903c09acf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f902c00e960 tx=0x7f902c00ee20 comp rx=0 tx=0).stop 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 shutdown_connections 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f901c06ae40 0x7f901c06d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f903c15e730 0x7f903c149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f903c0cd1c0 0x7f903c0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 --2- 172.21.15.50:0/3756501473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f903c0ccae0 0x7f903c09acf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 >> 172.21.15.50:0/3756501473 conn(0x7f903c0d0e10 msgr2=0x7f903c15bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 shutdown_connections 2023-12-08T08:18:56.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.792+0000 7f9040b78640 1 -- 172.21.15.50:0/3756501473 wait complete. 2023-12-08T08:18:56.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.913+0000 7fc15b7c5640 1 Processor -- start 2023-12-08T08:18:56.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.913+0000 7fc15b7c5640 1 -- start start 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc15b7c5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc15415d4f0 0x7fc1540b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc15b7c5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc1540b0920 0x7fc1540b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc15b7c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc1540adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc15b7c5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc15406bb40 con 0x7fc15415d4f0 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc15b7c5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1540b2280 con 0x7fc1540b0920 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc15b7c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1540b2710 con 0x7fc1540adb50 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc15415d4f0 0x7fc1540b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc15415d4f0 0x7fc1540b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50956/0 (socket says 172.21.15.50:50956) 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 -- 172.21.15.50:0/1238442063 learned_addr learned my addr 172.21.15.50:0/1238442063 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:56.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc158d60640 1 --2- 172.21.15.50:0/1238442063 >> v2:172.21.15.170:3300/0 conn(0x7fc1540b0920 0x7fc1540b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159d62640 1 --2- 172.21.15.50:0/1238442063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc1540adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 -- 172.21.15.50:0/1238442063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 msgr2=0x7fc1540adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 --2- 172.21.15.50:0/1238442063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc1540adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 -- 172.21.15.50:0/1238442063 >> v2:172.21.15.170:3300/0 conn(0x7fc1540b0920 msgr2=0x7fc1540b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 --2- 172.21.15.50:0/1238442063 >> v2:172.21.15.170:3300/0 conn(0x7fc1540b0920 0x7fc1540b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc159561640 1 -- 172.21.15.50:0/1238442063 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540b1690 con 0x7fc15415d4f0 2023-12-08T08:18:56.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.914+0000 7fc158d60640 1 --2- 172.21.15.50:0/1238442063 >> v2:172.21.15.170:3300/0 conn(0x7fc1540b0920 0x7fc1540b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.915+0000 7fc159561640 1 --2- 172.21.15.50:0/1238442063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15415d4f0 0x7fc1540b03e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc154071250 tx=0x7fc15002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c75dd50ca543453 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.915+0000 7fc14bfff640 1 -- 172.21.15.50:0/1238442063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150031870 con 0x7fc15415d4f0 2023-12-08T08:18:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.915+0000 7fc14bfff640 1 -- 172.21.15.50:0/1238442063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1500319d0 con 0x7fc15415d4f0 2023-12-08T08:18:56.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.915+0000 7fc14bfff640 1 -- 172.21.15.50:0/1238442063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150031d60 con 0x7fc15415d4f0 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 -- 172.21.15.50:0/1238442063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15415d4f0 msgr2=0x7fc1540b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/1238442063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15415d4f0 0x7fc1540b03e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc154071250 tx=0x7fc15002b910 comp rx=0 tx=0).stop 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 -- 172.21.15.50:0/1238442063 shutdown_connections 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/1238442063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc1540adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/1238442063 >> v2:172.21.15.170:3300/0 conn(0x7fc1540b0920 0x7fc1540b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/1238442063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15415d4f0 0x7fc1540b03e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 -- 172.21.15.50:0/1238442063 >> 172.21.15.50:0/1238442063 conn(0x7fc1540d0e00 msgr2=0x7fc1540d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 -- 172.21.15.50:0/1238442063 shutdown_connections 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.916+0000 7fc15b7c5640 1 -- 172.21.15.50:0/1238442063 wait complete. 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.917+0000 7fc15b7c5640 1 Processor -- start 2023-12-08T08:18:56.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.917+0000 7fc15b7c5640 1 -- start start 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc15b7c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc154157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc15b7c5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1540b0920 0x7fc154154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc15b7c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc15415d4f0 0x7fc15415e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc15b7c5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc154154880 con 0x7fc1540b0920 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc15b7c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1540cc260 con 0x7fc15415d4f0 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc15b7c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1540cb4d0 con 0x7fc1540adb50 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1540b0920 0x7fc154154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1540b0920 0x7fc154154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50960/0 (socket says 172.21.15.50:50960) 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 -- 172.21.15.50:0/2695027618 learned_addr learned my addr 172.21.15.50:0/2695027618 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc159d62640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc15415d4f0 0x7fc15415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc159561640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc154157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 -- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 msgr2=0x7fc154157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc154157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 -- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc15415d4f0 msgr2=0x7fc15415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc15415d4f0 0x7fc15415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 -- 172.21.15.50:0/2695027618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500094d0 con 0x7fc1540b0920 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc158d60640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1540b0920 0x7fc154154340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc14400e730 tx=0x7fc14400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc149ffb640 1 -- 172.21.15.50:0/2695027618 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144004230 con 0x7fc1540b0920 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc149ffb640 1 -- 172.21.15.50:0/2695027618 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc144004390 con 0x7fc1540b0920 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1540cb7b0 con 0x7fc1540b0920 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.918+0000 7fc149ffb640 1 -- 172.21.15.50:0/2695027618 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14400c8f0 con 0x7fc1540b0920 2023-12-08T08:18:56.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.919+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc154154d20 con 0x7fc1540b0920 2023-12-08T08:18:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.920+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc154154ee0 con 0x7fc1540b0920 2023-12-08T08:18:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.920+0000 7fc149ffb640 1 -- 172.21.15.50:0/2695027618 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc14400ca50 con 0x7fc1540b0920 2023-12-08T08:18:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.920+0000 7fc149ffb640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc13806ae40 0x7fc13806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.921+0000 7fc149ffb640 1 -- 172.21.15.50:0/2695027618 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc1440895a0 con 0x7fc1540b0920 2023-12-08T08:18:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.921+0000 7fc159561640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc13806ae40 0x7fc13806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:56.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.921+0000 7fc159561640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc13806ae40 0x7fc13806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc150036000 tx=0x7fc15003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:56.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:56.925+0000 7fc149ffb640 1 -- 172.21.15.50:0/2695027618 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc144054270 con 0x7fc1540b0920 2023-12-08T08:18:57.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.100+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc154067430 con 0x7fc1540b0920 2023-12-08T08:18:57.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.100+0000 7fc149ffb640 1 -- 172.21.15.50:0/2695027618 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc144057890 con 0x7fc1540b0920 2023-12-08T08:18:57.103 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc13806ae40 msgr2=0x7fc13806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc13806ae40 0x7fc13806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc150036000 tx=0x7fc15003c040 comp rx=0 tx=0).stop 2023-12-08T08:18:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1540b0920 msgr2=0x7fc154154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1540b0920 0x7fc154154340 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc14400e730 tx=0x7fc14400ebf0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 shutdown_connections 2023-12-08T08:18:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc13806ae40 0x7fc13806d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1540b0920 0x7fc154154340 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc15415d4f0 0x7fc15415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 --2- 172.21.15.50:0/2695027618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1540adb50 0x7fc154157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 >> 172.21.15.50:0/2695027618 conn(0x7fc1540d0e00 msgr2=0x7fc1540cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 shutdown_connections 2023-12-08T08:18:57.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.103+0000 7fc15b7c5640 1 -- 172.21.15.50:0/2695027618 wait complete. 2023-12-08T08:18:57.116 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:57.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.220+0000 7fe3d3f48640 1 Processor -- start 2023-12-08T08:18:57.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.221+0000 7fe3d3f48640 1 -- start start 2023-12-08T08:18:57.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.221+0000 7fe3d3f48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3cc0b0cf0 0x7fe3cc0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.221+0000 7fe3d3f48640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe3cc0b1d70 0x7fe3cc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.221+0000 7fe3d3f48640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc0d20b0 con 0x7fe3cc1608a0 2023-12-08T08:18:57.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.221+0000 7fe3d3f48640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0d0620 con 0x7fe3cc0b0cf0 2023-12-08T08:18:57.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.221+0000 7fe3d3f48640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0d1b80 con 0x7fe3cc0b1d70 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.221+0000 7fe3d14e3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3cc0b0cf0 0x7fe3cc0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d14e3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe3cc0b0cf0 0x7fe3cc0d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50966/0 (socket says 172.21.15.50:50966) 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d14e3640 1 -- 172.21.15.50:0/2368196210 learned_addr learned my addr 172.21.15.50:0/2368196210 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d24e5640 1 --2- 172.21.15.50:0/2368196210 >> v2:172.21.15.170:3300/0 conn(0x7fe3cc0b1d70 0x7fe3cc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d14e3640 1 -- 172.21.15.50:0/2368196210 >> v2:172.21.15.170:3300/0 conn(0x7fe3cc0b1d70 msgr2=0x7fe3cc0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d14e3640 1 --2- 172.21.15.50:0/2368196210 >> v2:172.21.15.170:3300/0 conn(0x7fe3cc0b1d70 0x7fe3cc0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d14e3640 1 -- 172.21.15.50:0/2368196210 >> v1:172.21.15.170:6789/0 conn(0x7fe3cc1608a0 legacy=0x7fe3cc0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d14e3640 1 -- 172.21.15.50:0/2368196210 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc0d1dd0 con 0x7fe3cc0b0cf0 2023-12-08T08:18:57.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.222+0000 7fe3d24e5640 1 --2- 172.21.15.50:0/2368196210 >> v2:172.21.15.170:3300/0 conn(0x7fe3cc0b1d70 0x7fe3cc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:57.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d14e3640 1 --2- 172.21.15.50:0/2368196210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc0d1640 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc073100 tx=0x7fe3c002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80b4464f74544c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d0ce2640 1 -- 172.21.15.50:0/2368196210 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00317e0 con 0x7fe3cc0b0cf0 2023-12-08T08:18:57.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d0ce2640 1 -- 172.21.15.50:0/2368196210 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0031940 con 0x7fe3cc0b0cf0 2023-12-08T08:18:57.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d0ce2640 1 -- 172.21.15.50:0/2368196210 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0031cd0 con 0x7fe3cc0b0cf0 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2368196210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc0b0cf0 msgr2=0x7fe3cc0d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2368196210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc0d1640 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc073100 tx=0x7fe3c002b880 comp rx=0 tx=0).stop 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2368196210 shutdown_connections 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2368196210 >> v2:172.21.15.170:3300/0 conn(0x7fe3cc0b1d70 0x7fe3cc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2368196210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc0d1640 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2368196210 >> 172.21.15.50:0/2368196210 conn(0x7fe3cc0d3030 msgr2=0x7fe3cc0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2368196210 shutdown_connections 2023-12-08T08:18:57.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.223+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2368196210 wait complete. 2023-12-08T08:18:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 Processor -- start 2023-12-08T08:18:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 -- start start 2023-12-08T08:18:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3cc0b1d70 0x7fe3cc0b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc1608a0 0x7fe3cc0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0cc0f0 con 0x7fe3cc1608a0 2023-12-08T08:18:57.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0cc390 con 0x7fe3cc0b0cf0 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d3f48640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0cc670 con 0x7fe3cc0b1d70 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d24e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc1608a0 0x7fe3cc0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.225+0000 7fe3d24e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc1608a0 0x7fe3cc0ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50976/0 (socket says 172.21.15.50:50976) 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d24e5640 1 -- 172.21.15.50:0/2413765144 learned_addr learned my addr 172.21.15.50:0/2413765144 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d1ce4640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d14e3640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3cc0b1d70 0x7fe3cc0b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d24e5640 1 -- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3cc0b1d70 msgr2=0x7fe3cc0b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d24e5640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3cc0b1d70 0x7fe3cc0b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d24e5640 1 -- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3cc0b0cf0 msgr2=0x7fe3cc14d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d24e5640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc14d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d24e5640 1 -- 172.21.15.50:0/2413765144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c00094d0 con 0x7fe3cc1608a0 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d1ce4640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc14d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d24e5640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc1608a0 0x7fe3cc0ca100 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00cef0 tx=0x7fe3bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3ca7fc640 1 -- 172.21.15.50:0/2413765144 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00d840 con 0x7fe3cc1608a0 2023-12-08T08:18:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3ca7fc640 1 -- 172.21.15.50:0/2413765144 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00d9c0 con 0x7fe3cc1608a0 2023-12-08T08:18:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc0cc950 con 0x7fe3cc1608a0 2023-12-08T08:18:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3ca7fc640 1 -- 172.21.15.50:0/2413765144 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00dd70 con 0x7fe3cc1608a0 2023-12-08T08:18:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.226+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc0ccf10 con 0x7fe3cc1608a0 2023-12-08T08:18:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.227+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc0b6b40 con 0x7fe3cc1608a0 2023-12-08T08:18:57.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.228+0000 7fe3ca7fc640 1 -- 172.21.15.50:0/2413765144 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3bc01e3b0 con 0x7fe3cc1608a0 2023-12-08T08:18:57.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.228+0000 7fe3ca7fc640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe3b806ae70 0x7fe3b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.228+0000 7fe3ca7fc640 1 -- 172.21.15.50:0/2413765144 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe3bc08a490 con 0x7fe3cc1608a0 2023-12-08T08:18:57.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.228+0000 7fe3d1ce4640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe3b806ae70 0x7fe3b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.229+0000 7fe3d1ce4640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe3b806ae70 0x7fe3b806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4006fd0 tx=0x7fe3c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.232+0000 7fe3ca7fc640 1 -- 172.21.15.50:0/2413765144 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3cc0b6b40 con 0x7fe3cc1608a0 2023-12-08T08:18:57.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.420+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe3cc0b6b40 con 0x7fe3cc1608a0 2023-12-08T08:18:57.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.421+0000 7fe3ca7fc640 1 -- 172.21.15.50:0/2413765144 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe3cc0b6b40 con 0x7fe3cc1608a0 2023-12-08T08:18:57.423 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:18:57.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe3b806ae70 msgr2=0x7fe3b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe3b806ae70 0x7fe3b806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4006fd0 tx=0x7fe3c4008040 comp rx=0 tx=0).stop 2023-12-08T08:18:57.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc1608a0 msgr2=0x7fe3cc0ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc1608a0 0x7fe3cc0ca100 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00cef0 tx=0x7fe3bc00a710 comp rx=0 tx=0).stop 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 shutdown_connections 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe3b806ae70 0x7fe3b806d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe3cc1608a0 0x7fe3cc0ca100 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3cc0b1d70 0x7fe3cc0b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 --2- 172.21.15.50:0/2413765144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3cc0b0cf0 0x7fe3cc14d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 >> 172.21.15.50:0/2413765144 conn(0x7fe3cc0d3030 msgr2=0x7fe3cc15eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 shutdown_connections 2023-12-08T08:18:57.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.423+0000 7fe3d3f48640 1 -- 172.21.15.50:0/2413765144 wait complete. 2023-12-08T08:18:57.436 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2023-12-08T08:18:57.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:57.436 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-08T08:18:57.468 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:18:57.469 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:18:57.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:18:57.469 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:18:57.534 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:57.535 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:57.550 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:57.551 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:57.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:57.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.751+0000 7f35a450c640 1 Processor -- start 2023-12-08T08:18:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.751+0000 7f35a450c640 1 -- start start 2023-12-08T08:18:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a450c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f359c0cf380 0x7f359c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a450c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f359c0cf760 0x7f359c161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a450c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c06b070 con 0x7f359c071b80 2023-12-08T08:18:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a450c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0d0d00 con 0x7f359c0cf380 2023-12-08T08:18:57.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a450c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c161bd0 con 0x7f359c0cf760 2023-12-08T08:18:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a22a8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f359c0cf380 0x7f359c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a2aa9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f359c071b80 0x7f359c0acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41104/0 (socket says 172.21.15.50:41104) 2023-12-08T08:18:57.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a2aa9640 1 -- 172.21.15.50:0/1514018579 learned_addr learned my addr 172.21.15.50:0/1514018579 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a22a8640 1 -- 172.21.15.50:0/1514018579 >> v2:172.21.15.170:3300/0 conn(0x7f359c0cf760 msgr2=0x7f359c161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a22a8640 1 --2- 172.21.15.50:0/1514018579 >> v2:172.21.15.170:3300/0 conn(0x7f359c0cf760 0x7f359c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.752+0000 7f35a22a8640 1 -- 172.21.15.50:0/1514018579 >> v1:172.21.15.50:6789/0 conn(0x7f359c071b80 legacy=0x7f359c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.753+0000 7f35a12a6640 1 -- 172.21.15.50:0/1514018579 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763388150 0 0) 0x7f359c06b070 con 0x7f359c071b80 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.753+0000 7f35a22a8640 1 -- 172.21.15.50:0/1514018579 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c06aab0 con 0x7f359c0cf380 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.753+0000 7f35a22a8640 1 --2- 172.21.15.50:0/1514018579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c06a4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f359c0cd830 tx=0x7f359402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d19390b917c6371 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.753+0000 7f35a12a6640 1 -- 172.21.15.50:0/1514018579 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359402e070 con 0x7f359c0cf380 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.753+0000 7f35a12a6640 1 -- 172.21.15.50:0/1514018579 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35940315a0 con 0x7f359c0cf380 2023-12-08T08:18:57.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.753+0000 7f35a12a6640 1 -- 172.21.15.50:0/1514018579 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594031930 con 0x7f359c0cf380 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 -- 172.21.15.50:0/1514018579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 msgr2=0x7f359c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 --2- 172.21.15.50:0/1514018579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c06a4d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f359c0cd830 tx=0x7f359402b840 comp rx=0 tx=0).stop 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 -- 172.21.15.50:0/1514018579 shutdown_connections 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 --2- 172.21.15.50:0/1514018579 >> v2:172.21.15.170:3300/0 conn(0x7f359c0cf760 0x7f359c161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 --2- 172.21.15.50:0/1514018579 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c06a4d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 -- 172.21.15.50:0/1514018579 >> 172.21.15.50:0/1514018579 conn(0x7f359c0cfda0 msgr2=0x7f359c0d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 -- 172.21.15.50:0/1514018579 shutdown_connections 2023-12-08T08:18:57.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.754+0000 7f35a450c640 1 -- 172.21.15.50:0/1514018579 wait complete. 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.755+0000 7f35a450c640 1 Processor -- start 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.755+0000 7f35a450c640 1 -- start start 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a450c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359c071b80 0x7f359c14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a450c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a450c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f359c0cf760 0x7f359c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a450c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b4100 con 0x7f359c0cf380 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a450c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b43e0 con 0x7f359c071b80 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a450c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b46c0 con 0x7f359c0cf760 2023-12-08T08:18:57.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a1aa7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a1aa7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c14dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50990/0 (socket says 172.21.15.50:50990) 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a1aa7640 1 -- 172.21.15.50:0/1847870035 learned_addr learned my addr 172.21.15.50:0/1847870035 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a22a8640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359c071b80 0x7f359c14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.756+0000 7f35a2aa9640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f359c0cf760 0x7f359c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a1aa7640 1 -- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f359c0cf760 msgr2=0x7f359c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a1aa7640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f359c0cf760 0x7f359c0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a1aa7640 1 -- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359c071b80 msgr2=0x7f359c14a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a1aa7640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359c071b80 0x7f359c14a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a1aa7640 1 -- 172.21.15.50:0/1847870035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009400 con 0x7f359c0cf380 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a22a8640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359c071b80 0x7f359c14a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a1aa7640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c14dc10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b410 tx=0x7f358c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f3592ffd640 1 -- 172.21.15.50:0/1847870035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011830 con 0x7f359c0cf380 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f3592ffd640 1 -- 172.21.15.50:0/1847870035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c0119b0 con 0x7f359c0cf380 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c0b49a0 con 0x7f359c0cf380 2023-12-08T08:18:57.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f3592ffd640 1 -- 172.21.15.50:0/1847870035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011d60 con 0x7f359c0cf380 2023-12-08T08:18:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.757+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c14ad10 con 0x7f359c0cf380 2023-12-08T08:18:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.758+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c067430 con 0x7f359c0cf380 2023-12-08T08:18:57.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.758+0000 7f3592ffd640 1 -- 172.21.15.50:0/1847870035 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f358c01a400 con 0x7f359c0cf380 2023-12-08T08:18:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.759+0000 7f3592ffd640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f358006ae40 0x7f358006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.759+0000 7f3592ffd640 1 -- 172.21.15.50:0/1847870035 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f358c089b90 con 0x7f359c0cf380 2023-12-08T08:18:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.759+0000 7f35a22a8640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f358006ae40 0x7f358006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:57.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.760+0000 7f35a22a8640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f358006ae40 0x7f358006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3594036000 tx=0x7f3594008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:57.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.763+0000 7f3592ffd640 1 -- 172.21.15.50:0/1847870035 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f358c054860 con 0x7f359c0cf380 2023-12-08T08:18:57.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.942+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f359c15e450 con 0x7f359c0cf380 2023-12-08T08:18:57.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.944+0000 7f3592ffd640 1 -- 172.21.15.50:0/1847870035 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f358c015020 con 0x7f359c0cf380 2023-12-08T08:18:57.946 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:57.947 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f358006ae40 msgr2=0x7f358006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f358006ae40 0x7f358006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3594036000 tx=0x7f3594008030 comp rx=0 tx=0).stop 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 msgr2=0x7f359c14dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c14dc10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f358c00b410 tx=0x7f358c00b8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 shutdown_connections 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f358006ae40 0x7f358006d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f359c0cf380 0x7f359c14dc10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f359c0cf760 0x7f359c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 --2- 172.21.15.50:0/1847870035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f359c071b80 0x7f359c14a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 >> 172.21.15.50:0/1847870035 conn(0x7f359c0cfda0 msgr2=0x7f359c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 shutdown_connections 2023-12-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:57.946+0000 7f35a450c640 1 -- 172.21.15.50:0/1847870035 wait complete. 2023-12-08T08:18:57.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:57.960 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:58.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.067+0000 7f4a63b4c640 1 Processor -- start 2023-12-08T08:18:58.070 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.067+0000 7f4a63b4c640 1 -- start start 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a63b4c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a5c0cd3d0 0x7f4a5c0712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a63b4c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c0ce370 con 0x7f4a5c06d6a0 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a63b4c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c06c8e0 con 0x7f4a5c0cdec0 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a63b4c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c06d280 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a618e8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4a5c0cd3d0 0x7f4a5c0712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a610e7640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a5c06d6a0 0x7f4a5c0cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41112/0 (socket says 172.21.15.50:41112) 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a610e7640 1 -- 172.21.15.50:0/2579803482 learned_addr learned my addr 172.21.15.50:0/2579803482 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.068+0000 7f4a618e8640 1 -- 172.21.15.50:0/2579803482 >> v1:172.21.15.170:6789/0 conn(0x7f4a5c0cdec0 legacy=0x7f4a5c15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.069+0000 7f4a618e8640 1 -- 172.21.15.50:0/2579803482 >> v1:172.21.15.50:6789/0 conn(0x7f4a5c06d6a0 legacy=0x7f4a5c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.069+0000 7f4a618e8640 1 -- 172.21.15.50:0/2579803482 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c06cbc0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.069+0000 7f4a608e6640 1 -- 172.21.15.50:0/2579803482 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835280998 0 0) 0x7f4a5c0ce370 con 0x7f4a5c06d6a0 2023-12-08T08:18:58.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.069+0000 7f4a618e8640 1 --2- 172.21.15.50:0/2579803482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0712c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009d90 tx=0x7f4a4c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c6ba7b06df940a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.069+0000 7f4a608e6640 1 -- 172.21.15.50:0/2579803482 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c02cc60 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.069+0000 7f4a608e6640 1 -- 172.21.15.50:0/2579803482 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c02cdc0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.069+0000 7f4a608e6640 1 -- 172.21.15.50:0/2579803482 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c034660 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.070+0000 7f4a63b4c640 1 -- 172.21.15.50:0/2579803482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 msgr2=0x7f4a5c0712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.070+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/2579803482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0712c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009d90 tx=0x7f4a4c02beb0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.070+0000 7f4a63b4c640 1 -- 172.21.15.50:0/2579803482 shutdown_connections 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.070+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/2579803482 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0712c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.070+0000 7f4a63b4c640 1 -- 172.21.15.50:0/2579803482 >> 172.21.15.50:0/2579803482 conn(0x7f4a5c0b0850 msgr2=0x7f4a5c0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.070+0000 7f4a63b4c640 1 -- 172.21.15.50:0/2579803482 shutdown_connections 2023-12-08T08:18:58.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.070+0000 7f4a63b4c640 1 -- 172.21.15.50:0/2579803482 wait complete. 2023-12-08T08:18:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.071+0000 7f4a63b4c640 1 Processor -- start 2023-12-08T08:18:58.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.071+0000 7f4a63b4c640 1 -- start start 2023-12-08T08:18:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a63b4c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c06d6a0 0x7f4a5c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a63b4c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a63b4c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0cdec0 0x7f4a5c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a63b4c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b2db0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a63b4c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b2130 con 0x7f4a5c0cdec0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a63b4c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b2410 con 0x7f4a5c06d6a0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51018/0 (socket says 172.21.15.50:51018) 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 -- 172.21.15.50:0/368585568 learned_addr learned my addr 172.21.15.50:0/368585568 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 -- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c06d6a0 msgr2=0x7f4a5c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c06d6a0 0x7f4a5c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a620e9640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0cdec0 0x7f4a5c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 -- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0cdec0 msgr2=0x7f4a5c070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0cdec0 0x7f4a5c070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.072+0000 7f4a610e7640 1 -- 172.21.15.50:0/368585568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c009a70 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.073+0000 7f4a610e7640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0addf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c4d0 tx=0x7f4a5000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.073+0000 7f4a5a7fc640 1 -- 172.21.15.50:0/368585568 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500074e0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.073+0000 7f4a5a7fc640 1 -- 172.21.15.50:0/368585568 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50007660 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.073+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c0b26f0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.073+0000 7f4a5a7fc640 1 -- 172.21.15.50:0/368585568 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50004a20 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.073+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c0ae330 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.074+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c0b2ef0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.074+0000 7f4a5a7fc640 1 -- 172.21.15.50:0/368585568 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a50004b80 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.075+0000 7f4a5a7fc640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a4806ae40 0x7f4a4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.075+0000 7f4a5a7fc640 1 -- 172.21.15.50:0/368585568 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4a50088e90 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.075+0000 7f4a618e8640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a4806ae40 0x7f4a4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.076+0000 7f4a618e8640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a4806ae40 0x7f4a4806d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c036000 tx=0x7f4a4c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.079+0000 7f4a5a7fc640 1 -- 172.21.15.50:0/368585568 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a5c0b2ef0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.255+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a5c0b2ef0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.255+0000 7f4a5a7fc640 1 -- 172.21.15.50:0/368585568 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a5c0b2ef0 con 0x7f4a5c0cd3d0 2023-12-08T08:18:58.258 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:18:58.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a4806ae40 msgr2=0x7f4a4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a4806ae40 0x7f4a4806d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c036000 tx=0x7f4a4c02e000 comp rx=0 tx=0).stop 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 msgr2=0x7f4a5c0addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0addf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000c4d0 tx=0x7f4a5000c990 comp rx=0 tx=0).stop 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 shutdown_connections 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a4806ae40 0x7f4a4806d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a5c0cd3d0 0x7f4a5c0addf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a5c0cdec0 0x7f4a5c070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 --2- 172.21.15.50:0/368585568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a5c06d6a0 0x7f4a5c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 >> 172.21.15.50:0/368585568 conn(0x7f4a5c0b0850 msgr2=0x7f4a5c0ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 shutdown_connections 2023-12-08T08:18:58.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.257+0000 7f4a63b4c640 1 -- 172.21.15.50:0/368585568 wait complete. 2023-12-08T08:18:58.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:18:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.377+0000 7fcb1f901640 1 Processor -- start 2023-12-08T08:18:58.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.377+0000 7fcb1f901640 1 -- start start 2023-12-08T08:18:58.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1f901640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcb1815d590 0x7fcb180ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1f901640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1f901640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1806d650 con 0x7fcb180cf790 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1f901640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb180adbe0 con 0x7fcb1815d590 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1f901640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1815d970 con 0x7fcb180afeb0 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1d69d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcb1815d590 0x7fcb180ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1ce9c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1d69d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcb1815d590 0x7fcb180ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:40842/0 (socket says 172.21.15.50:40842) 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1de9e640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fcb180cf790 0x7fcb18161070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:37918/0 (socket says 172.21.15.50:37918) 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1d69d640 1 -- 172.21.15.50:0/206762274 learned_addr learned my addr 172.21.15.50:0/206762274 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1d69d640 1 -- 172.21.15.50:0/206762274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 msgr2=0x7fcb180cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1d69d640 1 --2- 172.21.15.50:0/206762274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1d69d640 1 -- 172.21.15.50:0/206762274 >> v1:172.21.15.170:6789/0 conn(0x7fcb180cf790 legacy=0x7fcb18161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb1d69d640 1 -- 172.21.15.50:0/206762274 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1806c810 con 0x7fcb1815d590 2023-12-08T08:18:58.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.378+0000 7fcb0ffff640 1 -- 172.21.15.50:0/206762274 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951192287 0 0) 0x7fcb10001490 con 0x7fcb180cf790 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.379+0000 7fcb1d69d640 1 --2- 172.21.15.50:0/206762274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 0x7fcb180ced10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009870 tx=0x7fcb1402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3257aba16a2eca5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.379+0000 7fcb0ffff640 1 -- 172.21.15.50:0/206762274 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14030840 con 0x7fcb1815d590 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.379+0000 7fcb0ffff640 1 -- 172.21.15.50:0/206762274 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb140309a0 con 0x7fcb1815d590 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.379+0000 7fcb0ffff640 1 -- 172.21.15.50:0/206762274 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14030d30 con 0x7fcb1815d590 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 -- 172.21.15.50:0/206762274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 msgr2=0x7fcb180ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 --2- 172.21.15.50:0/206762274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 0x7fcb180ced10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009870 tx=0x7fcb1402b980 comp rx=0 tx=0).stop 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 -- 172.21.15.50:0/206762274 shutdown_connections 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 --2- 172.21.15.50:0/206762274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 --2- 172.21.15.50:0/206762274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 0x7fcb180ced10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 -- 172.21.15.50:0/206762274 >> 172.21.15.50:0/206762274 conn(0x7fcb180d0e10 msgr2=0x7fcb180d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 -- 172.21.15.50:0/206762274 shutdown_connections 2023-12-08T08:18:58.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.380+0000 7fcb1f901640 1 -- 172.21.15.50:0/206762274 wait complete. 2023-12-08T08:18:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.381+0000 7fcb1f901640 1 Processor -- start 2023-12-08T08:18:58.385 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.381+0000 7fcb1f901640 1 -- start start 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1f901640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1f901640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb180cf790 0x7fcb181f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1f901640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 0x7fcb1815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1f901640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180c6ce0 con 0x7fcb180cf790 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1f901640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180c5700 con 0x7fcb1815d590 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1f901640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180c59e0 con 0x7fcb180afeb0 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1ce9c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb180cf790 0x7fcb181f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1ce9c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb180cf790 0x7fcb181f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51022/0 (socket says 172.21.15.50:51022) 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1ce9c640 1 -- 172.21.15.50:0/327141428 learned_addr learned my addr 172.21.15.50:0/327141428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1de9e640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 0x7fcb1815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1d69d640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1ce9c640 1 -- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 msgr2=0x7fcb180c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1ce9c640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.382+0000 7fcb1ce9c640 1 -- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 msgr2=0x7fcb1815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb1ce9c640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 0x7fcb1815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb1ce9c640 1 -- 172.21.15.50:0/327141428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb140094d0 con 0x7fcb180cf790 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb1ce9c640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb180cf790 0x7fcb181f2980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800e9b0 tx=0x7fcb0800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb0dffb640 1 -- 172.21.15.50:0/327141428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08009670 con 0x7fcb180cf790 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180c5cc0 con 0x7fcb180cf790 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb0dffb640 1 -- 172.21.15.50:0/327141428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0800c9a0 con 0x7fcb180cf790 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb0dffb640 1 -- 172.21.15.50:0/327141428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800cd50 con 0x7fcb180cf790 2023-12-08T08:18:58.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.383+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb180c6280 con 0x7fcb180cf790 2023-12-08T08:18:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.384+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb18067430 con 0x7fcb180cf790 2023-12-08T08:18:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.385+0000 7fcb0dffb640 1 -- 172.21.15.50:0/327141428 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb08013470 con 0x7fcb180cf790 2023-12-08T08:18:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.385+0000 7fcb0dffb640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcafc06ae40 0x7fcafc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.385+0000 7fcb0dffb640 1 -- 172.21.15.50:0/327141428 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcb08089b80 con 0x7fcb180cf790 2023-12-08T08:18:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.385+0000 7fcb1d69d640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcafc06ae40 0x7fcafc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.386+0000 7fcb1d69d640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcafc06ae40 0x7fcafc06d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb14036000 tx=0x7fcb14008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.389+0000 7fcb0dffb640 1 -- 172.21.15.50:0/327141428 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb08054910 con 0x7fcb180cf790 2023-12-08T08:18:58.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.564+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb1815cc10 con 0x7fcb180cf790 2023-12-08T08:18:58.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.564+0000 7fcb0dffb640 1 -- 172.21.15.50:0/327141428 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb08057f30 con 0x7fcb180cf790 2023-12-08T08:18:58.567 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcafc06ae40 msgr2=0x7fcafc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcafc06ae40 0x7fcafc06d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb14036000 tx=0x7fcb14008030 comp rx=0 tx=0).stop 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb180cf790 msgr2=0x7fcb181f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb180cf790 0x7fcb181f2980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800e9b0 tx=0x7fcb0800ee70 comp rx=0 tx=0).stop 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 shutdown_connections 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcafc06ae40 0x7fcafc06d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb180cf790 0x7fcb181f2980 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb1815d590 0x7fcb1815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 --2- 172.21.15.50:0/327141428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb180afeb0 0x7fcb180c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 >> 172.21.15.50:0/327141428 conn(0x7fcb180d0e10 msgr2=0x7fcb180b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.566+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 shutdown_connections 2023-12-08T08:18:58.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.567+0000 7fcb1f901640 1 -- 172.21.15.50:0/327141428 wait complete. 2023-12-08T08:18:58.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:18:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.687+0000 7fe431636640 1 Processor -- start 2023-12-08T08:18:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.687+0000 7fe431636640 1 -- start start 2023-12-08T08:18:58.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.688+0000 7fe431636640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe42c160c00 0x7fe42c0ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.688+0000 7fe431636640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0b1f00 con 0x7fe42c0b1160 2023-12-08T08:18:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.688+0000 7fe431636640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0d03f0 con 0x7fe42c0cf900 2023-12-08T08:18:58.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.688+0000 7fe431636640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0b2150 con 0x7fe42c160c00 2023-12-08T08:18:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.688+0000 7fe42b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe42c160c00 0x7fe42c0ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.688+0000 7fe42a7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe42c0b1160 0x7fe42c1604f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41114/0 (socket says 172.21.15.50:41114) 2023-12-08T08:18:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.688+0000 7fe42a7fc640 1 -- 172.21.15.50:0/264530620 learned_addr learned my addr 172.21.15.50:0/264530620 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.689+0000 7fe42b7fe640 1 -- 172.21.15.50:0/264530620 >> v1:172.21.15.170:6789/0 conn(0x7fe42c0cf900 legacy=0x7fe42c0cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:58.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.689+0000 7fe42b7fe640 1 -- 172.21.15.50:0/264530620 >> v1:172.21.15.50:6789/0 conn(0x7fe42c0b1160 legacy=0x7fe42c1604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.689+0000 7fe429ffb640 1 -- 172.21.15.50:0/264530620 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403613176 0 0) 0x7fe42c0b1f00 con 0x7fe42c0b1160 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.689+0000 7fe42b7fe640 1 -- 172.21.15.50:0/264530620 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0d3b80 con 0x7fe42c160c00 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.689+0000 7fe42b7fe640 1 --2- 172.21.15.50:0/264530620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c160c00 0x7fe42c0ceb80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009d90 tx=0x7fe41c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f844b73aeda3b74 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe429ffb640 1 -- 172.21.15.50:0/264530620 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c02cc60 con 0x7fe42c160c00 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe429ffb640 1 -- 172.21.15.50:0/264530620 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c02cdc0 con 0x7fe42c160c00 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe429ffb640 1 -- 172.21.15.50:0/264530620 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c034660 con 0x7fe42c160c00 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe431636640 1 -- 172.21.15.50:0/264530620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c160c00 msgr2=0x7fe42c0ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe431636640 1 --2- 172.21.15.50:0/264530620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c160c00 0x7fe42c0ceb80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009d90 tx=0x7fe41c02beb0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe431636640 1 -- 172.21.15.50:0/264530620 shutdown_connections 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe431636640 1 --2- 172.21.15.50:0/264530620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c160c00 0x7fe42c0ceb80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe431636640 1 -- 172.21.15.50:0/264530620 >> 172.21.15.50:0/264530620 conn(0x7fe42c0d3060 msgr2=0x7fe42c0d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe431636640 1 -- 172.21.15.50:0/264530620 shutdown_connections 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.690+0000 7fe431636640 1 -- 172.21.15.50:0/264530620 wait complete. 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.691+0000 7fe431636640 1 Processor -- start 2023-12-08T08:18:58.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.691+0000 7fe431636640 1 -- start start 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe431636640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42c0b1160 0x7fe42c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe431636640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c0cf900 0x7fe42c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe431636640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42c160c00 0x7fe42c1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe431636640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c15ba10 con 0x7fe42c0cf900 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe431636640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c15b730 con 0x7fe42c0b1160 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe431636640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0b4cb0 con 0x7fe42c160c00 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe42a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c0cf900 0x7fe42c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe42a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c0cf900 0x7fe42c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51030/0 (socket says 172.21.15.50:51030) 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.692+0000 7fe42a7fc640 1 -- 172.21.15.50:0/1143927416 learned_addr learned my addr 172.21.15.50:0/1143927416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe42affd640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42c0b1160 0x7fe42c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe42a7fc640 1 -- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42c160c00 msgr2=0x7fe42c1f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe42a7fc640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42c160c00 0x7fe42c1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe42a7fc640 1 -- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42c0b1160 msgr2=0x7fe42c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe42a7fc640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42c0b1160 0x7fe42c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe42a7fc640 1 -- 172.21.15.50:0/1143927416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009a70 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe42a7fc640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c0cf900 0x7fe42c15b070 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c410 tx=0x7fe41400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe4237fe640 1 -- 172.21.15.50:0/1143927416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4140074e0 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe4237fe640 1 -- 172.21.15.50:0/1143927416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe414007660 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c0b4f90 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe4237fe640 1 -- 172.21.15.50:0/1143927416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414004a20 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.693+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c1f29b0 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.694+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c0b4b10 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.695+0000 7fe4237fe640 1 -- 172.21.15.50:0/1143927416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe414004b80 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.695+0000 7fe4237fe640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe40c06ae40 0x7fe40c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.695+0000 7fe4237fe640 1 -- 172.21.15.50:0/1143927416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe4140898b0 con 0x7fe42c0cf900 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.695+0000 7fe42affd640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe40c06ae40 0x7fe40c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:58.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.696+0000 7fe42affd640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe40c06ae40 0x7fe40c06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe424000f60 tx=0x7fe424009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:58.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.699+0000 7fe4237fe640 1 -- 172.21.15.50:0/1143927416 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe42c0b4b10 con 0x7fe42c0cf900 2023-12-08T08:18:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.875+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe42c0b4b10 con 0x7fe42c0cf900 2023-12-08T08:18:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.875+0000 7fe4237fe640 1 -- 172.21.15.50:0/1143927416 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe42c0b4b10 con 0x7fe42c0cf900 2023-12-08T08:18:58.878 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:18:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe40c06ae40 msgr2=0x7fe40c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe40c06ae40 0x7fe40c06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe424000f60 tx=0x7fe424009040 comp rx=0 tx=0).stop 2023-12-08T08:18:58.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c0cf900 msgr2=0x7fe42c15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c0cf900 0x7fe42c15b070 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c410 tx=0x7fe41400c8d0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 shutdown_connections 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe40c06ae40 0x7fe40c06d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe42c0cf900 0x7fe42c15b070 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe42c160c00 0x7fe42c1f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 --2- 172.21.15.50:0/1143927416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe42c0b1160 0x7fe42c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 >> 172.21.15.50:0/1143927416 conn(0x7fe42c0d3060 msgr2=0x7fe42c0cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 shutdown_connections 2023-12-08T08:18:58.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.877+0000 7fe431636640 1 -- 172.21.15.50:0/1143927416 wait complete. 2023-12-08T08:18:58.890 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:18:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.998+0000 7fb36fce5640 1 Processor -- start 2023-12-08T08:18:59.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.998+0000 7fb36fce5640 1 -- start start 2023-12-08T08:18:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36fce5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3680b0ef0 0x7fb3680cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36fce5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680b2280 con 0x7fb36815d4f0 2023-12-08T08:18:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36fce5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680b2710 con 0x7fb3680b0af0 2023-12-08T08:18:59.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36fce5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36806bb40 con 0x7fb3680b0ef0 2023-12-08T08:18:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36e282640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3680b0ef0 0x7fb3680cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36da81640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb36815d4f0 0x7fb3680b03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41122/0 (socket says 172.21.15.50:41122) 2023-12-08T08:18:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36da81640 1 -- 172.21.15.50:0/2750192106 learned_addr learned my addr 172.21.15.50:0/2750192106 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36e282640 1 -- 172.21.15.50:0/2750192106 >> v1:172.21.15.170:6789/0 conn(0x7fb3680b0af0 legacy=0x7fb3680cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36e282640 1 -- 172.21.15.50:0/2750192106 >> v1:172.21.15.50:6789/0 conn(0x7fb36815d4f0 legacy=0x7fb3680b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36e282640 1 -- 172.21.15.50:0/2750192106 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680b1690 con 0x7fb3680b0ef0 2023-12-08T08:18:59.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:58.999+0000 7fb36ca7f640 1 -- 172.21.15.50:0/2750192106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939641947 0 0) 0x7fb3680b2280 con 0x7fb36815d4f0 2023-12-08T08:18:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.000+0000 7fb36e282640 1 --2- 172.21.15.50:0/2750192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3680b0ef0 0x7fb3680cf6a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb364009d90 tx=0x7fb36402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e990c6529bde81 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.000+0000 7fb36ca7f640 1 -- 172.21.15.50:0/2750192106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36402cc60 con 0x7fb3680b0ef0 2023-12-08T08:18:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.000+0000 7fb36ca7f640 1 -- 172.21.15.50:0/2750192106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36402cdc0 con 0x7fb3680b0ef0 2023-12-08T08:18:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.000+0000 7fb36ca7f640 1 -- 172.21.15.50:0/2750192106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364034660 con 0x7fb3680b0ef0 2023-12-08T08:18:59.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.001+0000 7fb36fce5640 1 -- 172.21.15.50:0/2750192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3680b0ef0 msgr2=0x7fb3680cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.001+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2750192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3680b0ef0 0x7fb3680cf6a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb364009d90 tx=0x7fb36402beb0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.001+0000 7fb36fce5640 1 -- 172.21.15.50:0/2750192106 shutdown_connections 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.001+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2750192106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3680b0ef0 0x7fb3680cf6a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.001+0000 7fb36fce5640 1 -- 172.21.15.50:0/2750192106 >> 172.21.15.50:0/2750192106 conn(0x7fb3680d0e00 msgr2=0x7fb3680d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.001+0000 7fb36fce5640 1 -- 172.21.15.50:0/2750192106 shutdown_connections 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.001+0000 7fb36fce5640 1 -- 172.21.15.50:0/2750192106 wait complete. 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.002+0000 7fb36fce5640 1 Processor -- start 2023-12-08T08:18:59.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.002+0000 7fb36fce5640 1 -- start start 2023-12-08T08:18:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36fce5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3680b0af0 0x7fb368147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36fce5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3680b0ef0 0x7fb36815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36fce5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb36815d4f0 0x7fb36815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36fce5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c8680 con 0x7fb36815d4f0 2023-12-08T08:18:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36fce5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c4880 con 0x7fb3680b0af0 2023-12-08T08:18:59.006 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36fce5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c4b60 con 0x7fb3680b0ef0 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb36815d4f0 0x7fb36815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb36815d4f0 0x7fb36815e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51038/0 (socket says 172.21.15.50:51038) 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 -- 172.21.15.50:0/2293671341 learned_addr learned my addr 172.21.15.50:0/2293671341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36da81640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3680b0af0 0x7fb368147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36d280640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3680b0ef0 0x7fb36815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 -- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3680b0ef0 msgr2=0x7fb36815db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3680b0ef0 0x7fb36815db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 -- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3680b0af0 msgr2=0x7fb368147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3680b0af0 0x7fb368147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 -- 172.21.15.50:0/2293671341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb364009a70 con 0x7fb36815d4f0 2023-12-08T08:18:59.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36d280640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3680b0ef0 0x7fb36815db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:18:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.003+0000 7fb36e282640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb36815d4f0 0x7fb36815e800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb364009d90 tx=0x7fb364004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.004+0000 7fb35e7fc640 1 -- 172.21.15.50:0/2293671341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36403e610 con 0x7fb36815d4f0 2023-12-08T08:18:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.004+0000 7fb35e7fc640 1 -- 172.21.15.50:0/2293671341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36403e790 con 0x7fb36815d4f0 2023-12-08T08:18:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.004+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680c4e40 con 0x7fb36815d4f0 2023-12-08T08:18:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.004+0000 7fb35e7fc640 1 -- 172.21.15.50:0/2293671341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36403eb40 con 0x7fb36815d4f0 2023-12-08T08:18:59.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.004+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3681484d0 con 0x7fb36815d4f0 2023-12-08T08:18:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.005+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb368067430 con 0x7fb36815d4f0 2023-12-08T08:18:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.005+0000 7fb35e7fc640 1 -- 172.21.15.50:0/2293671341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb36403b050 con 0x7fb36815d4f0 2023-12-08T08:18:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.005+0000 7fb35e7fc640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb34c06ae40 0x7fb34c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.006+0000 7fb35e7fc640 1 -- 172.21.15.50:0/2293671341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb3640ac470 con 0x7fb36815d4f0 2023-12-08T08:18:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.006+0000 7fb36da81640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb34c06ae40 0x7fb34c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.009 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.006+0000 7fb36da81640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb34c06ae40 0x7fb34c06d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb360000f60 tx=0x7fb360007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.012 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.010+0000 7fb35e7fc640 1 -- 172.21.15.50:0/2293671341 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb364077140 con 0x7fb36815d4f0 2023-12-08T08:18:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.185+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb36806bdd0 con 0x7fb36815d4f0 2023-12-08T08:18:59.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.186+0000 7fb35e7fc640 1 -- 172.21.15.50:0/2293671341 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb36407a760 con 0x7fb36815d4f0 2023-12-08T08:18:59.188 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:18:59.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb34c06ae40 msgr2=0x7fb34c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb34c06ae40 0x7fb34c06d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb360000f60 tx=0x7fb360007c00 comp rx=0 tx=0).stop 2023-12-08T08:18:59.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb36815d4f0 msgr2=0x7fb36815e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb36815d4f0 0x7fb36815e800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb364009d90 tx=0x7fb364004a40 comp rx=0 tx=0).stop 2023-12-08T08:18:59.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 shutdown_connections 2023-12-08T08:18:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb34c06ae40 0x7fb34c06d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb36815d4f0 0x7fb36815e800 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3680b0ef0 0x7fb36815db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 --2- 172.21.15.50:0/2293671341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3680b0af0 0x7fb368147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 >> 172.21.15.50:0/2293671341 conn(0x7fb3680d0e00 msgr2=0x7fb3680d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 shutdown_connections 2023-12-08T08:18:59.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.188+0000 7fb36fce5640 1 -- 172.21.15.50:0/2293671341 wait complete. 2023-12-08T08:18:59.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:18:59.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.306+0000 7f6c5ed9e640 1 Processor -- start 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.306+0000 7f6c5ed9e640 1 -- start start 2023-12-08T08:18:59.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5ed9e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c580d1420 0x7f6c580d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5ed9e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580d0a30 con 0x7f6c5806b810 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5ed9e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5806b380 con 0x7f6c5815d170 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5ed9e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c580d1de0 con 0x7f6c580d1420 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5d59b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c580d1420 0x7f6c580d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5e59d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c5806b810 0x7f6c5806bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:41130/0 (socket says 172.21.15.50:41130) 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5e59d640 1 -- 172.21.15.50:0/2873081566 learned_addr learned my addr 172.21.15.50:0/2873081566 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5d59b640 1 -- 172.21.15.50:0/2873081566 >> v1:172.21.15.170:6789/0 conn(0x7f6c5815d170 legacy=0x7f6c580d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5d59b640 1 -- 172.21.15.50:0/2873081566 >> v1:172.21.15.50:6789/0 conn(0x7f6c5806b810 legacy=0x7f6c5806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5cd9a640 1 -- 172.21.15.50:0/2873081566 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817244239 0 0) 0x7f6c580d0a30 con 0x7f6c5806b810 2023-12-08T08:18:59.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.307+0000 7f6c5d59b640 1 -- 172.21.15.50:0/2873081566 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580ced80 con 0x7f6c580d1420 2023-12-08T08:18:59.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.308+0000 7f6c5d59b640 1 --2- 172.21.15.50:0/2873081566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c580d18a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097a0 tx=0x7f6c4c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3856c98fb23bb0b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.311 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.308+0000 7f6c5cd9a640 1 -- 172.21.15.50:0/2873081566 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c02f050 con 0x7f6c580d1420 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.308+0000 7f6c5cd9a640 1 -- 172.21.15.50:0/2873081566 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c031700 con 0x7f6c580d1420 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.308+0000 7f6c5cd9a640 1 -- 172.21.15.50:0/2873081566 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c031a90 con 0x7f6c580d1420 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.309+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2873081566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 msgr2=0x7f6c580d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.309+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2873081566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c580d18a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097a0 tx=0x7f6c4c02b7a0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.309+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2873081566 shutdown_connections 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.309+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2873081566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c580d18a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.309+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2873081566 >> 172.21.15.50:0/2873081566 conn(0x7f6c5809c1d0 msgr2=0x7f6c580d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.309+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2873081566 shutdown_connections 2023-12-08T08:18:59.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.309+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2873081566 wait complete. 2023-12-08T08:18:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.310+0000 7f6c5ed9e640 1 Processor -- start 2023-12-08T08:18:59.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.310+0000 7f6c5ed9e640 1 -- start start 2023-12-08T08:18:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5ed9e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5806b810 0x7f6c580cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5ed9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c581f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5ed9e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5815d170 0x7f6c58158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5ed9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b7910 con 0x7f6c580d1420 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5ed9e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b6c90 con 0x7f6c5806b810 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5ed9e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b6f70 con 0x7f6c5815d170 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5d59b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c581f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5d59b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c581f3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51048/0 (socket says 172.21.15.50:51048) 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5d59b640 1 -- 172.21.15.50:0/2224708863 learned_addr learned my addr 172.21.15.50:0/2224708863 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5e59d640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5815d170 0x7f6c58158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5dd9c640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5806b810 0x7f6c580cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.311+0000 7f6c5d59b640 1 -- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5815d170 msgr2=0x7f6c58158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c5d59b640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5815d170 0x7f6c58158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c5d59b640 1 -- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5806b810 msgr2=0x7f6c580cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c5d59b640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5806b810 0x7f6c580cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c5d59b640 1 -- 172.21.15.50:0/2224708863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009400 con 0x7f6c580d1420 2023-12-08T08:18:59.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c5d59b640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c581f3190 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097a0 tx=0x7f6c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c567fc640 1 -- 172.21.15.50:0/2224708863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c033c30 con 0x7f6c580d1420 2023-12-08T08:18:59.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c567fc640 1 -- 172.21.15.50:0/2224708863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c033d90 con 0x7f6c580d1420 2023-12-08T08:18:59.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c580b7250 con 0x7f6c580d1420 2023-12-08T08:18:59.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c567fc640 1 -- 172.21.15.50:0/2224708863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c004270 con 0x7f6c580d1420 2023-12-08T08:18:59.316 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.312+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c58159530 con 0x7f6c580d1420 2023-12-08T08:18:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.313+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c580b7a50 con 0x7f6c580d1420 2023-12-08T08:18:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.314+0000 7f6c567fc640 1 -- 172.21.15.50:0/2224708863 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c4c03a070 con 0x7f6c580d1420 2023-12-08T08:18:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.314+0000 7f6c567fc640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.314+0000 7f6c567fc640 1 -- 172.21.15.50:0/2224708863 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6c4c0ab9a0 con 0x7f6c580d1420 2023-12-08T08:18:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.314+0000 7f6c5dd9c640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.315+0000 7f6c5dd9c640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c48007bf0 tx=0x7f6c48007240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.318+0000 7f6c567fc640 1 -- 172.21.15.50:0/2224708863 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c580b7a50 con 0x7f6c580d1420 2023-12-08T08:18:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.507+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c580b7a50 con 0x7f6c580d1420 2023-12-08T08:18:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.507+0000 7f6c567fc640 1 -- 172.21.15.50:0/2224708863 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c580b7a50 con 0x7f6c580d1420 2023-12-08T08:18:59.510 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 msgr2=0x7f6c4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c48007bf0 tx=0x7f6c48007240 comp rx=0 tx=0).stop 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 msgr2=0x7f6c581f3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c581f3190 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097a0 tx=0x7f6c4c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 shutdown_connections 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6c4406ae40 0x7f6c4406d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c580d1420 0x7f6c581f3190 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5815d170 0x7f6c58158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 --2- 172.21.15.50:0/2224708863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5806b810 0x7f6c580cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 >> 172.21.15.50:0/2224708863 conn(0x7f6c5809c1d0 msgr2=0x7f6c5815c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 shutdown_connections 2023-12-08T08:18:59.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.509+0000 7f6c5ed9e640 1 -- 172.21.15.50:0/2224708863 wait complete. 2023-12-08T08:18:59.522 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:18:59.523 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:18:59.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:18:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.681+0000 7f635b84f640 1 Processor -- start 2023-12-08T08:18:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.681+0000 7f635b84f640 1 -- start start 2023-12-08T08:18:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.682+0000 7f635b84f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540b6ac0 0x7f63540cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.682+0000 7f635b84f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f63540cd660 0x7f63540cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.682+0000 7f635b84f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63540d0070 con 0x7f63540cdfc0 2023-12-08T08:18:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.682+0000 7f635b84f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6354160cb0 con 0x7f63540cd660 2023-12-08T08:18:59.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.682+0000 7f635b84f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63540cd200 con 0x7f63540b6ac0 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f63595eb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540b6ac0 0x7f63540cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f6358dea640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f63540cd660 0x7f63540cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f6359dec640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f63540cdfc0 0x7f635406b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:42874/0 (socket says 172.21.15.50:42874) 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f6359dec640 1 -- 172.21.15.50:0/745531912 learned_addr learned my addr 172.21.15.50:0/745531912 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f6358dea640 1 -- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540b6ac0 msgr2=0x7f63540cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f6358dea640 1 --2- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540b6ac0 0x7f63540cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f6358dea640 1 -- 172.21.15.50:0/745531912 >> v1:172.21.15.170:6789/0 conn(0x7f63540cdfc0 legacy=0x7f635406b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f6358dea640 1 -- 172.21.15.50:0/745531912 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63540d02b0 con 0x7f63540cd660 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f634bfff640 1 -- 172.21.15.50:0/745531912 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146945156 0 0) 0x7f6350001490 con 0x7f63540cdfc0 2023-12-08T08:18:59.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.683+0000 7f63595eb640 1 --2- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540b6ac0 0x7f63540cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:18:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.684+0000 7f6358dea640 1 --2- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cd660 0x7f63540cda80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f63440097a0 tx=0x7f634402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63edb98508a85e31 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.687 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.684+0000 7f634bfff640 1 -- 172.21.15.50:0/745531912 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634402f050 con 0x7f63540cd660 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.684+0000 7f634bfff640 1 -- 172.21.15.50:0/745531912 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344031700 con 0x7f63540cd660 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.684+0000 7f634bfff640 1 -- 172.21.15.50:0/745531912 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344031a90 con 0x7f63540cd660 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.684+0000 7f635b84f640 1 -- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cd660 msgr2=0x7f63540cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.684+0000 7f635b84f640 1 --2- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cd660 0x7f63540cda80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f63440097a0 tx=0x7f634402b7a0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.685+0000 7f635b84f640 1 -- 172.21.15.50:0/745531912 shutdown_connections 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.685+0000 7f635b84f640 1 --2- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cd660 0x7f63540cda80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.685+0000 7f635b84f640 1 --2- 172.21.15.50:0/745531912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540b6ac0 0x7f63540cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.685+0000 7f635b84f640 1 -- 172.21.15.50:0/745531912 >> 172.21.15.50:0/745531912 conn(0x7f63540d0de0 msgr2=0x7f63540d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.685+0000 7f635b84f640 1 -- 172.21.15.50:0/745531912 shutdown_connections 2023-12-08T08:18:59.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.685+0000 7f635b84f640 1 -- 172.21.15.50:0/745531912 wait complete. 2023-12-08T08:18:59.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.686+0000 7f635b84f640 1 Processor -- start 2023-12-08T08:18:59.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.686+0000 7f635b84f640 1 -- start start 2023-12-08T08:18:59.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.686+0000 7f635b84f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63540b6ac0 0x7f63540ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f635b84f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540cd660 0x7f6354150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f635b84f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cdfc0 0x7f63540c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f635b84f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635415d080 con 0x7f63540b6ac0 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f635b84f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63540caa50 con 0x7f63540cdfc0 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f635b84f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635409aff0 con 0x7f63540cd660 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63540b6ac0 0x7f63540ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63540b6ac0 0x7f63540ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51888/0 (socket says 172.21.15.50:51888) 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 -- 172.21.15.50:0/3759320399 learned_addr learned my addr 172.21.15.50:0/3759320399 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f6359dec640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cdfc0 0x7f63540c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f6358dea640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540cd660 0x7f6354150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 -- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540cd660 msgr2=0x7f6354150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540cd660 0x7f6354150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 -- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cdfc0 msgr2=0x7f63540c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cdfc0 0x7f63540c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 -- 172.21.15.50:0/3759320399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c009400 con 0x7f63540b6ac0 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f63595eb640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63540b6ac0 0x7f63540ca510 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f634c00e960 tx=0x7f634c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f6349ffb640 1 -- 172.21.15.50:0/3759320399 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c00ca00 con 0x7f63540b6ac0 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f6349ffb640 1 -- 172.21.15.50:0/3759320399 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c00cb60 con 0x7f63540b6ac0 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6344009400 con 0x7f63540b6ac0 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.687+0000 7f6349ffb640 1 -- 172.21.15.50:0/3759320399 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c013470 con 0x7f63540b6ac0 2023-12-08T08:18:59.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.688+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635409b5b0 con 0x7f63540b6ac0 2023-12-08T08:18:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.689+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6354067430 con 0x7f63540b6ac0 2023-12-08T08:18:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.689+0000 7f6349ffb640 1 -- 172.21.15.50:0/3759320399 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f634c0135d0 con 0x7f63540b6ac0 2023-12-08T08:18:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.689+0000 7f6349ffb640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f633806ae40 0x7f633806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.689+0000 7f6349ffb640 1 -- 172.21.15.50:0/3759320399 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f634c089be0 con 0x7f63540b6ac0 2023-12-08T08:18:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.690+0000 7f6358dea640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f633806ae40 0x7f633806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.690+0000 7f6358dea640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f633806ae40 0x7f633806d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6344035000 tx=0x7f6344008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.693+0000 7f6349ffb640 1 -- 172.21.15.50:0/3759320399 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f634c054960 con 0x7f63540b6ac0 2023-12-08T08:18:59.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.869+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f635406d480 con 0x7f63540b6ac0 2023-12-08T08:18:59.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.870+0000 7f6349ffb640 1 -- 172.21.15.50:0/3759320399 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f634c017090 con 0x7f63540b6ac0 2023-12-08T08:18:59.873 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:18:59.873 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f633806ae40 msgr2=0x7f633806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f633806ae40 0x7f633806d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6344035000 tx=0x7f6344008030 comp rx=0 tx=0).stop 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63540b6ac0 msgr2=0x7f63540ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63540b6ac0 0x7f63540ca510 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f634c00e960 tx=0x7f634c00ee20 comp rx=0 tx=0).stop 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 shutdown_connections 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f633806ae40 0x7f633806d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63540cdfc0 0x7f63540c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63540cd660 0x7f6354150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 --2- 172.21.15.50:0/3759320399 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63540b6ac0 0x7f63540ca510 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 >> 172.21.15.50:0/3759320399 conn(0x7f63540d0de0 msgr2=0x7f63540cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 shutdown_connections 2023-12-08T08:18:59.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.872+0000 7f635b84f640 1 -- 172.21.15.50:0/3759320399 wait complete. 2023-12-08T08:18:59.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:18:59.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:18:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.993+0000 7f6ac38c9640 1 Processor -- start 2023-12-08T08:18:59.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.993+0000 7f6ac38c9640 1 -- start start 2023-12-08T08:18:59.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac38c9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6abc0cfa30 0x7f6abc0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac38c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6abc0b4150 0x7f6abc0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:18:59.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac38c9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc0c6be0 con 0x7f6abc0cfe10 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac38c9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0d3ff0 con 0x7f6abc0b4150 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac38c9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0b4860 con 0x7f6abc0cfa30 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac0e64640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6abc0b4150 0x7f6abc0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac0e64640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6abc0b4150 0x7f6abc0b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51890/0 (socket says 172.21.15.50:51890) 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac0e64640 1 -- 172.21.15.50:0/2933221520 learned_addr learned my addr 172.21.15.50:0/2933221520 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac0e64640 1 -- 172.21.15.50:0/2933221520 >> v2:172.21.15.170:3300/0 conn(0x7f6abc0cfa30 msgr2=0x7f6abc0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac0e64640 1 --2- 172.21.15.50:0/2933221520 >> v2:172.21.15.170:3300/0 conn(0x7f6abc0cfa30 0x7f6abc0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac0e64640 1 -- 172.21.15.50:0/2933221520 >> v1:172.21.15.170:6789/0 conn(0x7f6abc0cfe10 legacy=0x7f6abc161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:18:59.997 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.994+0000 7f6ac0e64640 1 -- 172.21.15.50:0/2933221520 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0d3d50 con 0x7f6abc0b4150 2023-12-08T08:18:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ac0e64640 1 --2- 172.21.15.50:0/2933221520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b4150 0x7f6abc0b3460 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6abc08b930 tx=0x7f6aac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7011a08e6a430fe4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:18:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ab3fff640 1 -- 172.21.15.50:0/2933221520 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0317e0 con 0x7f6abc0b4150 2023-12-08T08:18:59.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ab3fff640 1 -- 172.21.15.50:0/2933221520 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac031940 con 0x7f6abc0b4150 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ab3fff640 1 -- 172.21.15.50:0/2933221520 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac031cd0 con 0x7f6abc0b4150 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ac38c9640 1 -- 172.21.15.50:0/2933221520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b4150 msgr2=0x7f6abc0b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/2933221520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b4150 0x7f6abc0b3460 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6abc08b930 tx=0x7f6aac02b880 comp rx=0 tx=0).stop 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ac38c9640 1 -- 172.21.15.50:0/2933221520 shutdown_connections 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/2933221520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0b4150 0x7f6abc0b3460 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/2933221520 >> v2:172.21.15.170:3300/0 conn(0x7f6abc0cfa30 0x7f6abc0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.995+0000 7f6ac38c9640 1 -- 172.21.15.50:0/2933221520 >> 172.21.15.50:0/2933221520 conn(0x7f6abc0d3090 msgr2=0x7f6abc0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.996+0000 7f6ac38c9640 1 -- 172.21.15.50:0/2933221520 shutdown_connections 2023-12-08T08:18:59.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.996+0000 7f6ac38c9640 1 -- 172.21.15.50:0/2933221520 wait complete. 2023-12-08T08:19:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.997+0000 7f6ac38c9640 1 Processor -- start 2023-12-08T08:19:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.997+0000 7f6ac38c9640 1 -- start start 2023-12-08T08:19:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.997+0000 7f6ac38c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6abc0b4150 0x7f6abc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.997+0000 7f6ac38c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0cfa30 0x7f6abc0b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac38c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6abc0cfe10 0x7f6abc0b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac38c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b6940 con 0x7f6abc0cfa30 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac38c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b6c20 con 0x7f6abc0b4150 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac38c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b6f00 con 0x7f6abc0cfe10 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0cfa30 0x7f6abc0b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0cfa30 0x7f6abc0b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51904/0 (socket says 172.21.15.50:51904) 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 -- 172.21.15.50:0/858494918 learned_addr learned my addr 172.21.15.50:0/858494918 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac1665640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6abc0b4150 0x7f6abc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac1e66640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6abc0cfe10 0x7f6abc0b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 -- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6abc0cfe10 msgr2=0x7f6abc0b85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6abc0cfe10 0x7f6abc0b85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 -- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6abc0b4150 msgr2=0x7f6abc1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6abc0b4150 0x7f6abc1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 -- 172.21.15.50:0/858494918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac0094d0 con 0x7f6abc0cfa30 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac1665640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6abc0b4150 0x7f6abc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:00.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac1e66640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6abc0cfe10 0x7f6abc0b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:00.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac0e64640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0cfa30 0x7f6abc0b8070 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ab1ffb640 1 -- 172.21.15.50:0/858494918 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac032880 con 0x7f6abc0cfa30 2023-12-08T08:19:00.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ab1ffb640 1 -- 172.21.15.50:0/858494918 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac0329e0 con 0x7f6abc0cfa30 2023-12-08T08:19:00.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ab1ffb640 1 -- 172.21.15.50:0/858494918 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac032d90 con 0x7f6abc0cfa30 2023-12-08T08:19:00.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.998+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc0b71e0 con 0x7f6abc0cfa30 2023-12-08T08:19:00.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:18:59.999+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc152610 con 0x7f6abc0cfa30 2023-12-08T08:19:00.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.000+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0b3980 con 0x7f6abc0cfa30 2023-12-08T08:19:00.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.000+0000 7f6ab1ffb640 1 -- 172.21.15.50:0/858494918 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6aac04d3f0 con 0x7f6abc0cfa30 2023-12-08T08:19:00.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.000+0000 7f6ab1ffb640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6aa006ae70 0x7f6aa006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.001+0000 7f6ab1ffb640 1 -- 172.21.15.50:0/858494918 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6aac0ab8c0 con 0x7f6abc0cfa30 2023-12-08T08:19:00.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.001+0000 7f6ac1665640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6aa006ae70 0x7f6aa006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.001+0000 7f6ac1665640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6aa006ae70 0x7f6aa006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6abc1f6b30 tx=0x7f6ab8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.005+0000 7f6ab1ffb640 1 -- 172.21.15.50:0/858494918 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6abc0b3980 con 0x7f6abc0cfa30 2023-12-08T08:19:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.181+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6abc0b3980 con 0x7f6abc0cfa30 2023-12-08T08:19:00.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.182+0000 7f6ab1ffb640 1 -- 172.21.15.50:0/858494918 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6abc0b3980 con 0x7f6abc0cfa30 2023-12-08T08:19:00.184 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6aa006ae70 msgr2=0x7f6aa006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6aa006ae70 0x7f6aa006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6abc1f6b30 tx=0x7f6ab8008040 comp rx=0 tx=0).stop 2023-12-08T08:19:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0cfa30 msgr2=0x7f6abc0b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0cfa30 0x7f6abc0b8070 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 shutdown_connections 2023-12-08T08:19:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6aa006ae70 0x7f6aa006d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6abc0cfa30 0x7f6abc0b8070 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6abc0cfe10 0x7f6abc0b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 --2- 172.21.15.50:0/858494918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6abc0b4150 0x7f6abc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 >> 172.21.15.50:0/858494918 conn(0x7f6abc0d3090 msgr2=0x7f6abc06c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.183+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 shutdown_connections 2023-12-08T08:19:00.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.184+0000 7f6ac38c9640 1 -- 172.21.15.50:0/858494918 wait complete. 2023-12-08T08:19:00.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.304+0000 7f94bec1e640 1 Processor -- start 2023-12-08T08:19:00.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.304+0000 7f94bec1e640 1 -- start start 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.304+0000 7f94bec1e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f94b80ce780 0x7f94b815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.304+0000 7f94bec1e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80cf0a0 0x7f94b80cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.304+0000 7f94bec1e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b80b48b0 0x7f94b80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.304+0000 7f94bec1e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80ceb60 con 0x7f94b80b48b0 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.304+0000 7f94bec1e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80b5280 con 0x7f94b80ce780 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bec1e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80cfcc0 con 0x7f94b80cf0a0 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b80b48b0 0x7f94b80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f94b80b48b0 0x7f94b80b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51920/0 (socket says 172.21.15.50:51920) 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 -- 172.21.15.50:0/930210148 learned_addr learned my addr 172.21.15.50:0/930210148 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bc9ba640 1 --2- 172.21.15.50:0/930210148 >> v2:172.21.15.170:3300/0 conn(0x7f94b80ce780 0x7f94b815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 -- 172.21.15.50:0/930210148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80cf0a0 msgr2=0x7f94b80cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94b7fff640 1 --2- 172.21.15.50:0/930210148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80cf0a0 0x7f94b80cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 --2- 172.21.15.50:0/930210148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80cf0a0 0x7f94b80cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 -- 172.21.15.50:0/930210148 >> v2:172.21.15.170:3300/0 conn(0x7f94b80ce780 msgr2=0x7f94b815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 --2- 172.21.15.50:0/930210148 >> v2:172.21.15.170:3300/0 conn(0x7f94b80ce780 0x7f94b815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bd1bb640 1 -- 172.21.15.50:0/930210148 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80cff10 con 0x7f94b80b48b0 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.305+0000 7f94bc9ba640 1 --2- 172.21.15.50:0/930210148 >> v2:172.21.15.170:3300/0 conn(0x7f94b80ce780 0x7f94b815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.306+0000 7f94bd1bb640 1 --2- 172.21.15.50:0/930210148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80b48b0 0x7f94b80b4d40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94b80b53f0 tx=0x7f94b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04d56a629b553ba server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.306+0000 7f94b77fe640 1 -- 172.21.15.50:0/930210148 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b002ca70 con 0x7f94b80b48b0 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.306+0000 7f94b77fe640 1 -- 172.21.15.50:0/930210148 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b002cbd0 con 0x7f94b80b48b0 2023-12-08T08:19:00.309 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.306+0000 7f94b77fe640 1 -- 172.21.15.50:0/930210148 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00343f0 con 0x7f94b80b48b0 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.306+0000 7f94bec1e640 1 -- 172.21.15.50:0/930210148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80b48b0 msgr2=0x7f94b80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.306+0000 7f94bec1e640 1 --2- 172.21.15.50:0/930210148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80b48b0 0x7f94b80b4d40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94b80b53f0 tx=0x7f94b002bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.307+0000 7f94bec1e640 1 -- 172.21.15.50:0/930210148 shutdown_connections 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.307+0000 7f94bec1e640 1 --2- 172.21.15.50:0/930210148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80b48b0 0x7f94b80b4d40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.307+0000 7f94bec1e640 1 --2- 172.21.15.50:0/930210148 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80cf0a0 0x7f94b80cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.307+0000 7f94bec1e640 1 --2- 172.21.15.50:0/930210148 >> v2:172.21.15.170:3300/0 conn(0x7f94b80ce780 0x7f94b815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.307+0000 7f94bec1e640 1 -- 172.21.15.50:0/930210148 >> 172.21.15.50:0/930210148 conn(0x7f94b806b7c0 msgr2=0x7f94b806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.312 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.307+0000 7f94bec1e640 1 -- 172.21.15.50:0/930210148 shutdown_connections 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.307+0000 7f94bec1e640 1 -- 172.21.15.50:0/930210148 wait complete. 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.308+0000 7f94bec1e640 1 Processor -- start 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.308+0000 7f94bec1e640 1 -- start start 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bec1e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80b48b0 0x7f94b8151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bec1e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80ce780 0x7f94b8153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bec1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80cf0a0 0x7f94b8153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bec1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80af820 con 0x7f94b80cf0a0 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bec1e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8151940 con 0x7f94b80b48b0 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bec1e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80aeba0 con 0x7f94b80ce780 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80cf0a0 0x7f94b8153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80cf0a0 0x7f94b8153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51932/0 (socket says 172.21.15.50:51932) 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 -- 172.21.15.50:0/2217440766 learned_addr learned my addr 172.21.15.50:0/2217440766 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bc9ba640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80b48b0 0x7f94b8151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94b7fff640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80ce780 0x7f94b8153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 -- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80ce780 msgr2=0x7f94b8153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80ce780 0x7f94b8153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 -- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80b48b0 msgr2=0x7f94b8151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80b48b0 0x7f94b8151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 -- 172.21.15.50:0/2217440766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0009b30 con 0x7f94b80cf0a0 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94bd1bb640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80cf0a0 0x7f94b8153d10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94b0036040 tx=0x7f94b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.309+0000 7f94b57fa640 1 -- 172.21.15.50:0/2217440766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0009510 con 0x7f94b80cf0a0 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.310+0000 7f94b57fa640 1 -- 172.21.15.50:0/2217440766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b003e450 con 0x7f94b80cf0a0 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.310+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b80aee80 con 0x7f94b80cf0a0 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.310+0000 7f94b57fa640 1 -- 172.21.15.50:0/2217440766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b003e800 con 0x7f94b80cf0a0 2023-12-08T08:19:00.314 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.310+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b80af440 con 0x7f94b80cf0a0 2023-12-08T08:19:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.310+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b80af960 con 0x7f94b80cf0a0 2023-12-08T08:19:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.311+0000 7f94b57fa640 1 -- 172.21.15.50:0/2217440766 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94b003e960 con 0x7f94b80cf0a0 2023-12-08T08:19:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.311+0000 7f94b57fa640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f949c06ae40 0x7f949c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.311+0000 7f94b57fa640 1 -- 172.21.15.50:0/2217440766 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f94b00acb80 con 0x7f94b80cf0a0 2023-12-08T08:19:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.312+0000 7f94bc9ba640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f949c06ae40 0x7f949c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.312+0000 7f94bc9ba640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f949c06ae40 0x7f949c06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00a990 tx=0x7f94ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.316+0000 7f94b57fa640 1 -- 172.21.15.50:0/2217440766 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94b0077900 con 0x7f94b80cf0a0 2023-12-08T08:19:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.490+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94b8067430 con 0x7f94b80cf0a0 2023-12-08T08:19:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.491+0000 7f94b57fa640 1 -- 172.21.15.50:0/2217440766 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94b007af20 con 0x7f94b80cf0a0 2023-12-08T08:19:00.493 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:00.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.492+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f949c06ae40 msgr2=0x7f949c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.492+0000 7f94bec1e640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f949c06ae40 0x7f949c06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00a990 tx=0x7f94ac008040 comp rx=0 tx=0).stop 2023-12-08T08:19:00.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.492+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80cf0a0 msgr2=0x7f94b8153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.492+0000 7f94bec1e640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80cf0a0 0x7f94b8153d10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94b0036040 tx=0x7f94b0004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:00.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 shutdown_connections 2023-12-08T08:19:00.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f949c06ae40 0x7f949c06d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94b80cf0a0 0x7f94b8153d10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94b80ce780 0x7f94b8153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 --2- 172.21.15.50:0/2217440766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94b80b48b0 0x7f94b8151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 >> 172.21.15.50:0/2217440766 conn(0x7f94b806b7c0 msgr2=0x7f94b8157300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 shutdown_connections 2023-12-08T08:19:00.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.493+0000 7f94bec1e640 1 -- 172.21.15.50:0/2217440766 wait complete. 2023-12-08T08:19:00.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:00.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.613+0000 7fccf775a640 1 Processor -- start 2023-12-08T08:19:00.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.613+0000 7fccf775a640 1 -- start start 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.614+0000 7fccf775a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fccf00cde00 0x7fccf00ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.614+0000 7fccf775a640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf00cce00 con 0x7fccf015e790 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.614+0000 7fccf775a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf00b0f00 con 0x7fccf00cc380 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.614+0000 7fccf775a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf00ccb20 con 0x7fccf00cde00 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.614+0000 7fccf54f6640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fccf015e790 0x7fccf00cd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59636/0 (socket says 172.21.15.50:59636) 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.614+0000 7fccf54f6640 1 -- 172.21.15.50:0/299014714 learned_addr learned my addr 172.21.15.50:0/299014714 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.614+0000 7fccf4cf5640 1 --2- 172.21.15.50:0/299014714 >> v2:172.21.15.170:3300/0 conn(0x7fccf00cde00 0x7fccf00ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733825085 0 0) 0x7fccf00cce00 con 0x7fccf015e790 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd8003520 con 0x7fccf015e790 2023-12-08T08:19:00.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163641408 0 0) 0x7fccd8003520 con 0x7fccf015e790 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 >> v2:172.21.15.170:3300/0 conn(0x7fccf00cde00 msgr2=0x7fccf00ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 --2- 172.21.15.50:0/299014714 >> v2:172.21.15.170:3300/0 conn(0x7fccf00cde00 0x7fccf00ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 >> v1:172.21.15.170:6789/0 conn(0x7fccf00cc380 legacy=0x7fccf00b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00b08b0 con 0x7fccf015e790 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fcce8001670 con 0x7fccf015e790 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf4cf5640 1 --2- 172.21.15.50:0/299014714 >> v2:172.21.15.170:3300/0 conn(0x7fccf00cde00 0x7fccf00ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 >> v1:172.21.15.50:6789/0 conn(0x7fccf015e790 legacy=0x7fccf00cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd8003970 0x7fccd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd80047c0 0x7fccd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00ccb20 con 0x7fccd8005180 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd800c120 con 0x7fccd80047c0 2023-12-08T08:19:00.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd800c2e0 con 0x7fccd8003970 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf5cf7640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf4cf5640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd80047c0 0x7fccd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf54f6640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd8003970 0x7fccd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf5cf7640 1 -- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd8003970 msgr2=0x7fccd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf5cf7640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccd8003970 0x7fccd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf5cf7640 1 -- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd80047c0 msgr2=0x7fccd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf5cf7640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccd80047c0 0x7fccd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.615+0000 7fccf5cf7640 1 -- 172.21.15.50:0/299014714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd8003520 con 0x7fccd8005180 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.616+0000 7fccf5cf7640 1 -- 172.21.15.50:0/299014714 reap_dead start 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.616+0000 7fccf5cf7640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccd800b980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcce0001e50 tx=0x7fccd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe9b9cd13a6aff3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.616+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0003b70 con 0x7fccd8005180 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.616+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0003d10 con 0x7fccd8005180 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.616+0000 7fcceffff640 1 -- 172.21.15.50:0/299014714 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0005310 con 0x7fccd8005180 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.617+0000 7fccf775a640 1 -- 172.21.15.50:0/299014714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 msgr2=0x7fccd800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.617+0000 7fccf775a640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccd800b980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcce0001e50 tx=0x7fccd80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.617+0000 7fccf775a640 1 -- 172.21.15.50:0/299014714 shutdown_connections 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.617+0000 7fccf775a640 1 --2- 172.21.15.50:0/299014714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccd800b980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.617+0000 7fccf775a640 1 -- 172.21.15.50:0/299014714 >> 172.21.15.50:0/299014714 conn(0x7fccf00d0e00 msgr2=0x7fccf00d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.617+0000 7fccf775a640 1 -- 172.21.15.50:0/299014714 shutdown_connections 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.617+0000 7fccf775a640 1 -- 172.21.15.50:0/299014714 wait complete. 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.618+0000 7fccf775a640 1 Processor -- start 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.618+0000 7fccf775a640 1 -- start start 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf775a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccf0153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf775a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf0142e40 0x7fccf01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf775a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf0145140 0x7fccf0158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf775a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf006e9e0 con 0x7fccd8005180 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf775a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0155ae0 con 0x7fccf0145140 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf775a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0155db0 con 0x7fccf0142e40 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccf0153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccf0153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51958/0 (socket says 172.21.15.50:51958) 2023-12-08T08:19:00.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 -- 172.21.15.50:0/2246718332 learned_addr learned my addr 172.21.15.50:0/2246718332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 -- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf0142e40 msgr2=0x7fccf01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf0142e40 0x7fccf01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 -- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf0145140 msgr2=0x7fccf0158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf5cf7640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf0145140 0x7fccf0158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf0145140 0x7fccf0158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf54f6640 1 -- 172.21.15.50:0/2246718332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0156090 con 0x7fccd8005180 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.619+0000 7fccf5cf7640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf0145140 0x7fccf0158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.620+0000 7fccf54f6640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccf0153250 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcce80070b0 tx=0x7fcce8007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.620+0000 7fccedffb640 1 -- 172.21.15.50:0/2246718332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800f9c0 con 0x7fccd8005180 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.620+0000 7fccedffb640 1 -- 172.21.15.50:0/2246718332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce800fb40 con 0x7fccd8005180 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.620+0000 7fccedffb640 1 -- 172.21.15.50:0/2246718332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80133f0 con 0x7fccd8005180 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.620+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf006e390 con 0x7fccd8005180 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.620+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf01455f0 con 0x7fccd8005180 2023-12-08T08:19:00.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.621+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0067430 con 0x7fccd8005180 2023-12-08T08:19:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.621+0000 7fccedffb640 1 -- 172.21.15.50:0/2246718332 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcce8013550 con 0x7fccd8005180 2023-12-08T08:19:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.622+0000 7fccedffb640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fccdc06ae70 0x7fccdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.622+0000 7fccedffb640 1 -- 172.21.15.50:0/2246718332 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcce8089bd0 con 0x7fccd8005180 2023-12-08T08:19:00.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.622+0000 7fccf4cf5640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fccdc06ae70 0x7fccdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.622+0000 7fccf4cf5640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fccdc06ae70 0x7fccdc06d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fccf0156ac0 tx=0x7fcce4006a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.626+0000 7fccedffb640 1 -- 172.21.15.50:0/2246718332 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcce80548a0 con 0x7fccd8005180 2023-12-08T08:19:00.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.800+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fccf00b04b0 con 0x7fccd8005180 2023-12-08T08:19:00.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.801+0000 7fccedffb640 1 -- 172.21.15.50:0/2246718332 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcce8057ec0 con 0x7fccd8005180 2023-12-08T08:19:00.803 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:00.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.802+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fccdc06ae70 msgr2=0x7fccdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.802+0000 7fccf775a640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fccdc06ae70 0x7fccdc06d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fccf0156ac0 tx=0x7fcce4006a60 comp rx=0 tx=0).stop 2023-12-08T08:19:00.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.802+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 msgr2=0x7fccf0153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccf0153250 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcce80070b0 tx=0x7fcce8007570 comp rx=0 tx=0).stop 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 shutdown_connections 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fccdc06ae70 0x7fccdc06d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fccf0145140 0x7fccf0158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fccf0142e40 0x7fccf01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 --2- 172.21.15.50:0/2246718332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccd8005180 0x7fccf0153250 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 >> 172.21.15.50:0/2246718332 conn(0x7fccf00d0e00 msgr2=0x7fccf00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 shutdown_connections 2023-12-08T08:19:00.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.803+0000 7fccf775a640 1 -- 172.21.15.50:0/2246718332 wait complete. 2023-12-08T08:19:00.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:19:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.923+0000 7f97313ec640 1 Processor -- start 2023-12-08T08:19:00.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.923+0000 7f97313ec640 1 -- start start 2023-12-08T08:19:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.924+0000 7f97313ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f972c0cf900 0x7f972c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.924+0000 7f97313ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c0b1f00 con 0x7f972c0d0220 2023-12-08T08:19:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.924+0000 7f97313ec640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c0b2150 con 0x7f972c160c00 2023-12-08T08:19:00.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.924+0000 7f97313ec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c0d3b80 con 0x7f972c0cf900 2023-12-08T08:19:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.924+0000 7f972affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f972c0cf900 0x7f972c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.924+0000 7f972a7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f972c0d0220 0x7f972c1604f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59646/0 (socket says 172.21.15.50:59646) 2023-12-08T08:19:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.924+0000 7f972a7fc640 1 -- 172.21.15.50:0/2466235674 learned_addr learned my addr 172.21.15.50:0/2466235674 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.925+0000 7f972affd640 1 -- 172.21.15.50:0/2466235674 >> v1:172.21.15.170:6789/0 conn(0x7f972c160c00 legacy=0x7f972c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.925+0000 7f972affd640 1 -- 172.21.15.50:0/2466235674 >> v1:172.21.15.50:6789/0 conn(0x7f972c0d0220 legacy=0x7f972c1604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.925+0000 7f972affd640 1 -- 172.21.15.50:0/2466235674 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c0d3e60 con 0x7f972c0cf900 2023-12-08T08:19:00.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.925+0000 7f972affd640 1 --2- 172.21.15.50:0/2466235674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c0cf900 0x7f972c0cfce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f971c009d90 tx=0x7f971c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c592361aee07398 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f9729ffb640 1 -- 172.21.15.50:0/2466235674 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c02cc60 con 0x7f972c0cf900 2023-12-08T08:19:00.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f9729ffb640 1 -- 172.21.15.50:0/2466235674 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c02cdc0 con 0x7f972c0cf900 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f9729ffb640 1 -- 172.21.15.50:0/2466235674 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c034660 con 0x7f972c0cf900 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f97313ec640 1 -- 172.21.15.50:0/2466235674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c0cf900 msgr2=0x7f972c0cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f97313ec640 1 --2- 172.21.15.50:0/2466235674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c0cf900 0x7f972c0cfce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f971c009d90 tx=0x7f971c02beb0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f97313ec640 1 -- 172.21.15.50:0/2466235674 shutdown_connections 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f97313ec640 1 --2- 172.21.15.50:0/2466235674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c0cf900 0x7f972c0cfce0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f97313ec640 1 -- 172.21.15.50:0/2466235674 >> 172.21.15.50:0/2466235674 conn(0x7f972c0d3060 msgr2=0x7f972c0d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f97313ec640 1 -- 172.21.15.50:0/2466235674 shutdown_connections 2023-12-08T08:19:00.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.926+0000 7f97313ec640 1 -- 172.21.15.50:0/2466235674 wait complete. 2023-12-08T08:19:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.927+0000 7f97313ec640 1 Processor -- start 2023-12-08T08:19:00.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f97313ec640 1 -- start start 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f97313ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f972c0cf900 0x7f972c09d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f97313ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f972c160c00 0x7f972c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f97313ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c09cf50 0x7f972c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f97313ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c0a0ad0 con 0x7f972c09cf50 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f97313ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c09ff40 con 0x7f972c160c00 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f97313ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c09e010 con 0x7f972c0cf900 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f972b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c09cf50 0x7f972c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f972b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c09cf50 0x7f972c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51962/0 (socket says 172.21.15.50:51962) 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f972b7fe640 1 -- 172.21.15.50:0/1658754329 learned_addr learned my addr 172.21.15.50:0/1658754329 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.928+0000 7f972a7fc640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f972c160c00 0x7f972c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f972affd640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f972c0cf900 0x7f972c09d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f972b7fe640 1 -- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f972c0cf900 msgr2=0x7f972c09d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f972b7fe640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f972c0cf900 0x7f972c09d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f972b7fe640 1 -- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f972c160c00 msgr2=0x7f972c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f972b7fe640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f972c160c00 0x7f972c151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f972b7fe640 1 -- 172.21.15.50:0/1658754329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c009a70 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f972b7fe640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c09cf50 0x7f972c0cdb30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f972400c3c0 tx=0x7f972400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f97137fe640 1 -- 172.21.15.50:0/1658754329 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240052d0 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f97137fe640 1 -- 172.21.15.50:0/1658754329 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724005430 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c0a0130 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f97137fe640 1 -- 172.21.15.50:0/1658754329 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724003810 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.929+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c0a06f0 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.930+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c067ad0 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.930+0000 7f97137fe640 1 -- 172.21.15.50:0/1658754329 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9724003970 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.931+0000 7f97137fe640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f971806ae40 0x7f971806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.931+0000 7f97137fe640 1 -- 172.21.15.50:0/1658754329 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9724088e10 con 0x7f972c09cf50 2023-12-08T08:19:00.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.931+0000 7f972affd640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f971806ae40 0x7f971806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:00.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.932+0000 7f972affd640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f971806ae40 0x7f971806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f971c036000 tx=0x7f971c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:00.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:00.935+0000 7f97137fe640 1 -- 172.21.15.50:0/1658754329 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9724053b90 con 0x7f972c09cf50 2023-12-08T08:19:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.113+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f972c0d2360 con 0x7f972c09cf50 2023-12-08T08:19:01.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.114+0000 7f97137fe640 1 -- 172.21.15.50:0/1658754329 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97240170a0 con 0x7f972c09cf50 2023-12-08T08:19:01.116 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f971806ae40 msgr2=0x7f971806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f971806ae40 0x7f971806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f971c036000 tx=0x7f971c030000 comp rx=0 tx=0).stop 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c09cf50 msgr2=0x7f972c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c09cf50 0x7f972c0cdb30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f972400c3c0 tx=0x7f972400c880 comp rx=0 tx=0).stop 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 shutdown_connections 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f971806ae40 0x7f971806d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f972c09cf50 0x7f972c0cdb30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f972c160c00 0x7f972c151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 --2- 172.21.15.50:0/1658754329 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f972c0cf900 0x7f972c09d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.115+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 >> 172.21.15.50:0/1658754329 conn(0x7f972c0d3060 msgr2=0x7f972c0b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.116+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 shutdown_connections 2023-12-08T08:19:01.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.116+0000 7f97313ec640 1 -- 172.21.15.50:0/1658754329 wait complete. 2023-12-08T08:19:01.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.233+0000 7f5967a3d640 1 Processor -- start 2023-12-08T08:19:01.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.234+0000 7f5967a3d640 1 -- start start 2023-12-08T08:19:01.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.234+0000 7f5967a3d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f59600d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.234+0000 7f5967a3d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59600d20b0 con 0x7f59600b0cf0 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.234+0000 7f5967a3d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59600d1b80 con 0x7f59601608a0 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.234+0000 7f5967a3d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600d0620 con 0x7f59600b1d70 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.234+0000 7f5964fd8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f59600b0cf0 0x7f59600cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59656/0 (socket says 172.21.15.50:59656) 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.234+0000 7f5964fd8640 1 -- 172.21.15.50:0/2175204994 learned_addr learned my addr 172.21.15.50:0/2175204994 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5965fda640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f59600d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126605487 0 0) 0x7f59600d20b0 con 0x7f59600b0cf0 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f594c003520 con 0x7f59600b0cf0 2023-12-08T08:19:01.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591504244 0 0) 0x7f59600d1b80 con 0x7f59601608a0 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59600d20b0 con 0x7f59601608a0 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976929981 0 0) 0x7f594c003520 con 0x7f59600b0cf0 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 msgr2=0x7f59600d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f59600d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 >> v1:172.21.15.170:6789/0 conn(0x7f59601608a0 legacy=0x7f59600d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600d1dd0 con 0x7f59600b0cf0 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f5950001670 con 0x7f59600b0cf0 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5965fda640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f59600d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 >> v1:172.21.15.50:6789/0 conn(0x7f59600b0cf0 legacy=0x7f59600cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f594c003b30 0x7f594c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f594c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c004d00 0x7f594c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600d0620 con 0x7f594c003b30 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594c00ba90 con 0x7f594c004d00 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594c00bc50 con 0x7f59600b1d70 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f59657d9640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f594c003b30 0x7f594c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5965fda640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c004d00 0x7f594c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.235+0000 7f5964fd8640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f594c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f59657d9640 1 -- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 msgr2=0x7f594c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f59657d9640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f594c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f59657d9640 1 -- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c004d00 msgr2=0x7f594c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f59657d9640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c004d00 0x7f594c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f59657d9640 1 -- 172.21.15.50:0/2175204994 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c009a70 con 0x7f594c003b30 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f5965fda640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c004d00 0x7f594c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f5964fd8640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600b1d70 0x7f594c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f59657d9640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f594c003b30 0x7f594c003f30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59580018d0 tx=0x7f594c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b421e049691a4a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580052d0 con 0x7f594c003b30 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958005430 con 0x7f594c003b30 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.236+0000 7f5957fff640 1 -- 172.21.15.50:0/2175204994 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958003810 con 0x7f594c003b30 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.237+0000 7f5967a3d640 1 -- 172.21.15.50:0/2175204994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f594c003b30 msgr2=0x7f594c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.237+0000 7f5967a3d640 1 --2- 172.21.15.50:0/2175204994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f594c003b30 0x7f594c003f30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59580018d0 tx=0x7f594c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.237+0000 7f5965fda640 1 -- 172.21.15.50:0/2175204994 reap_dead start 2023-12-08T08:19:01.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.237+0000 7f5967a3d640 1 -- 172.21.15.50:0/2175204994 shutdown_connections 2023-12-08T08:19:01.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.237+0000 7f5967a3d640 1 -- 172.21.15.50:0/2175204994 >> 172.21.15.50:0/2175204994 conn(0x7f59600d3030 msgr2=0x7f59600d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:01.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.237+0000 7f5967a3d640 1 -- 172.21.15.50:0/2175204994 shutdown_connections 2023-12-08T08:19:01.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.237+0000 7f5967a3d640 1 -- 172.21.15.50:0/2175204994 wait complete. 2023-12-08T08:19:01.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.238+0000 7f5967a3d640 1 Processor -- start 2023-12-08T08:19:01.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.238+0000 7f5967a3d640 1 -- start start 2023-12-08T08:19:01.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5967a3d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c003b30 0x7f59600ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5967a3d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600c9710 0x7f59600b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5967a3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5960156c20 0x7f59601570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5967a3d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600ca100 con 0x7f5960156c20 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5967a3d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59600ceb00 con 0x7f594c003b30 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5967a3d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59600ca350 con 0x7f59600c9710 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5965fda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5960156c20 0x7f59601570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5965fda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5960156c20 0x7f59601570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51992/0 (socket says 172.21.15.50:51992) 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5965fda640 1 -- 172.21.15.50:0/3994818694 learned_addr learned my addr 172.21.15.50:0/3994818694 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f59657d9640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c003b30 0x7f59600ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5964fd8640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600c9710 0x7f59600b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5965fda640 1 -- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600c9710 msgr2=0x7f59600b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5965fda640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600c9710 0x7f59600b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5965fda640 1 -- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c003b30 msgr2=0x7f59600ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.239+0000 7f5965fda640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c003b30 0x7f59600ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.240+0000 7f5965fda640 1 -- 172.21.15.50:0/3994818694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600ca630 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.240+0000 7f5965fda640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5960156c20 0x7f59601570b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f596008b920 tx=0x7f595c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.240+0000 7f5955ffb640 1 -- 172.21.15.50:0/3994818694 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00e070 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.240+0000 7f5955ffb640 1 -- 172.21.15.50:0/3994818694 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c011ed0 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.240+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59600ca910 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.240+0000 7f5955ffb640 1 -- 172.21.15.50:0/3994818694 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c003990 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.240+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59600caed0 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.241+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5960067430 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.241+0000 7f5955ffb640 1 -- 172.21.15.50:0/3994818694 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f595c003af0 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.242+0000 7f5955ffb640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f594406ae40 0x7f594406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.242+0000 7f5955ffb640 1 -- 172.21.15.50:0/3994818694 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f595c08a110 con 0x7f5960156c20 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.242+0000 7f59657d9640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f594406ae40 0x7f594406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.243+0000 7f59657d9640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f594406ae40 0x7f594406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5958034000 tx=0x7f5958031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:01.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.246+0000 7f5955ffb640 1 -- 172.21.15.50:0/3994818694 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f595c054e70 con 0x7f5960156c20 2023-12-08T08:19:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.434+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f59600c6b10 con 0x7f5960156c20 2023-12-08T08:19:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.435+0000 7f5955ffb640 1 -- 172.21.15.50:0/3994818694 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f595c058490 con 0x7f5960156c20 2023-12-08T08:19:01.437 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f594406ae40 msgr2=0x7f594406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f594406ae40 0x7f594406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5958034000 tx=0x7f5958031000 comp rx=0 tx=0).stop 2023-12-08T08:19:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5960156c20 msgr2=0x7f59601570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5960156c20 0x7f59601570b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f596008b920 tx=0x7f595c0115a0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 shutdown_connections 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f594406ae40 0x7f594406d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5960156c20 0x7f59601570b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59600c9710 0x7f59600b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 --2- 172.21.15.50:0/3994818694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f594c003b30 0x7f59600ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 >> 172.21.15.50:0/3994818694 conn(0x7f59600d3030 msgr2=0x7f596006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 shutdown_connections 2023-12-08T08:19:01.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.437+0000 7f5967a3d640 1 -- 172.21.15.50:0/3994818694 wait complete. 2023-12-08T08:19:01.450 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:19:01.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:01.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-08T08:19:01.482 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:01.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:19:01.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:01.482 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-08T08:19:01.538 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:19:01.538 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:01.557 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:19:01.558 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:01.617 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.720+0000 7f7fd3289640 1 Processor -- start 2023-12-08T08:19:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.720+0000 7f7fd3289640 1 -- start start 2023-12-08T08:19:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd3289640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fcc158ee0 0x7f7fcc070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd3289640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 0x7f7fcc06c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd3289640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0720d0 con 0x7f7fcc15b750 2023-12-08T08:19:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd3289640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0cc890 con 0x7f7fcc158ee0 2023-12-08T08:19:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd3289640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0714c0 con 0x7f7fcc0cbd10 2023-12-08T08:19:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd1025640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fcc158ee0 0x7f7fcc070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd1025640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7fcc158ee0 0x7f7fcc070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52008/0 (socket says 172.21.15.50:52008) 2023-12-08T08:19:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.721+0000 7f7fd1025640 1 -- 172.21.15.50:0/3649826950 learned_addr learned my addr 172.21.15.50:0/3649826950 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.722+0000 7f7fd1025640 1 -- 172.21.15.50:0/3649826950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 msgr2=0x7f7fcc06c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.722+0000 7f7fd1025640 1 --2- 172.21.15.50:0/3649826950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 0x7f7fcc06c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.722+0000 7f7fd1025640 1 -- 172.21.15.50:0/3649826950 >> v1:172.21.15.170:6789/0 conn(0x7f7fcc15b750 legacy=0x7f7fcc0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.722+0000 7f7fd1025640 1 -- 172.21.15.50:0/3649826950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0717a0 con 0x7f7fcc158ee0 2023-12-08T08:19:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.722+0000 7f7fd1025640 1 --2- 172.21.15.50:0/3649826950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc158ee0 0x7f7fcc070e30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009e50 tx=0x7f7fc402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78805df285300372 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fcbfff640 1 -- 172.21.15.50:0/3649826950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc402c9e0 con 0x7f7fcc158ee0 2023-12-08T08:19:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fcbfff640 1 -- 172.21.15.50:0/3649826950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc402cb40 con 0x7f7fcc158ee0 2023-12-08T08:19:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fcbfff640 1 -- 172.21.15.50:0/3649826950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc40343f0 con 0x7f7fcc158ee0 2023-12-08T08:19:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 -- 172.21.15.50:0/3649826950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc158ee0 msgr2=0x7f7fcc070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3649826950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc158ee0 0x7f7fcc070e30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009e50 tx=0x7f7fc402be40 comp rx=0 tx=0).stop 2023-12-08T08:19:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 -- 172.21.15.50:0/3649826950 shutdown_connections 2023-12-08T08:19:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3649826950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 0x7f7fcc06c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3649826950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc158ee0 0x7f7fcc070e30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 -- 172.21.15.50:0/3649826950 >> 172.21.15.50:0/3649826950 conn(0x7f7fcc0b09f0 msgr2=0x7f7fcc0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 -- 172.21.15.50:0/3649826950 shutdown_connections 2023-12-08T08:19:01.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.723+0000 7f7fd3289640 1 -- 172.21.15.50:0/3649826950 wait complete. 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.724+0000 7f7fd3289640 1 Processor -- start 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.724+0000 7f7fd3289640 1 -- start start 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd3289640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 0x7f7fcc0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd3289640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fcc158ee0 0x7f7fcc0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd3289640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc15b750 0x7f7fcc150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd3289640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0cfa10 con 0x7f7fcc15b750 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd3289640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0cee00 con 0x7f7fcc158ee0 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd3289640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc0cf0e0 con 0x7f7fcc0cbd10 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd1826640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc15b750 0x7f7fcc150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd1826640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc15b750 0x7f7fcc150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52012/0 (socket says 172.21.15.50:52012) 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.725+0000 7f7fd1826640 1 -- 172.21.15.50:0/3405225671 learned_addr learned my addr 172.21.15.50:0/3405225671 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd1826640 1 -- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 msgr2=0x7f7fcc0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd1025640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 0x7f7fcc0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd0824640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fcc158ee0 0x7f7fcc0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd1826640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 0x7f7fcc0ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd1826640 1 -- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fcc158ee0 msgr2=0x7f7fcc0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd1826640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fcc158ee0 0x7f7fcc0cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd1826640 1 -- 172.21.15.50:0/3405225671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc4009b30 con 0x7f7fcc15b750 2023-12-08T08:19:01.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd1826640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc15b750 0x7f7fcc150210 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009fd0 tx=0x7f7fbc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fc9ffb640 1 -- 172.21.15.50:0/3405225671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc011830 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fc9ffb640 1 -- 172.21.15.50:0/3405225671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc011990 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc0cf3c0 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fc9ffb640 1 -- 172.21.15.50:0/3405225671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc011d20 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.726+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc150750 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.727+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc067430 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.727+0000 7f7fc9ffb640 1 -- 172.21.15.50:0/3405225671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fbc01b460 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.728+0000 7f7fc9ffb640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7fb806ae40 0x7f7fb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.728+0000 7f7fc9ffb640 1 -- 172.21.15.50:0/3405225671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7fbc089900 con 0x7f7fcc15b750 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.728+0000 7f7fd1025640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7fb806ae40 0x7f7fb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:01.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.728+0000 7f7fd1025640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7fb806ae40 0x7f7fb806d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4035000 tx=0x7f7fc4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:01.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.732+0000 7f7fc9ffb640 1 -- 172.21.15.50:0/3405225671 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fbc057fc0 con 0x7f7fcc15b750 2023-12-08T08:19:01.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.911+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fcc06ea40 con 0x7f7fcc15b750 2023-12-08T08:19:01.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.912+0000 7f7fc9ffb640 1 -- 172.21.15.50:0/3405225671 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f7fbc057b50 con 0x7f7fcc15b750 2023-12-08T08:19:01.914 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:01.915 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:01.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7fb806ae40 msgr2=0x7f7fb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7fb806ae40 0x7f7fb806d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4035000 tx=0x7f7fc4030000 comp rx=0 tx=0).stop 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc15b750 msgr2=0x7f7fcc150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc15b750 0x7f7fcc150210 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009fd0 tx=0x7f7fbc00b8e0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 shutdown_connections 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7fb806ae40 0x7f7fb806d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7fcc15b750 0x7f7fcc150210 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7fcc158ee0 0x7f7fcc0cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 --2- 172.21.15.50:0/3405225671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7fcc0cbd10 0x7f7fcc0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 >> 172.21.15.50:0/3405225671 conn(0x7f7fcc0b09f0 msgr2=0x7f7fcc0ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 shutdown_connections 2023-12-08T08:19:01.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:01.914+0000 7f7fd3289640 1 -- 172.21.15.50:0/3405225671 wait complete. 2023-12-08T08:19:01.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:19:01.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.036+0000 7f0336b41640 1 Processor -- start 2023-12-08T08:19:02.038 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.036+0000 7f0336b41640 1 -- start start 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.036+0000 7f0336b41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 0x7f03300cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.036+0000 7f0336b41640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03300ce360 con 0x7f03300cd1c0 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f0336b41640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03300ce640 con 0x7f03300b0c20 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f0336b41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03300cbda0 con 0x7f033015e730 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f03300cd1c0 0x7f03300b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59664/0 (socket says 172.21.15.50:59664) 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032ffff640 1 -- 172.21.15.50:0/1865674806 learned_addr learned my addr 172.21.15.50:0/1865674806 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f03348dd640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 0x7f03300cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523642241 0 0) 0x7f03300ce360 con 0x7f03300cd1c0 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0320003520 con 0x7f03300cd1c0 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2850564785 0 0) 0x7f0320003520 con 0x7f03300cd1c0 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 msgr2=0x7f03300cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 0x7f03300cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 >> v1:172.21.15.170:6789/0 conn(0x7f03300b0c20 legacy=0x7f033015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300cc080 con 0x7f03300cd1c0 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f031c001690 con 0x7f03300cd1c0 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 >> v1:172.21.15.50:6789/0 conn(0x7f03300cd1c0 legacy=0x7f03300b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 0x7f03200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320003ee0 0x7f03200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0320004d00 0x7f0320005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300cbda0 con 0x7f0320003ee0 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032000b9e0 con 0x7f0320004d00 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.037+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032000bba0 con 0x7f033015e730 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f032ffff640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320003ee0 0x7f03200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f03348dd640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 0x7f03200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f03350de640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0320004d00 0x7f0320005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f03348dd640 1 -- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0320004d00 msgr2=0x7f0320005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f03348dd640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0320004d00 0x7f0320005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f03348dd640 1 -- 172.21.15.50:0/1865674806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320003ee0 msgr2=0x7f03200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f03348dd640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320003ee0 0x7f03200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f03348dd640 1 -- 172.21.15.50:0/1865674806 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0320003520 con 0x7f033015e730 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.038+0000 7f032ffff640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0320003ee0 0x7f03200047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f03348dd640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 0x7f03200039a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0324009ac0 tx=0x7f03200057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc52dd9c179a575 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032402c630 con 0x7f033015e730 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032402c790 con 0x7f033015e730 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f032f7fe640 1 -- 172.21.15.50:0/1865674806 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032402cb20 con 0x7f033015e730 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f0336b41640 1 -- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 msgr2=0x7f03200039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f0336b41640 1 --2- 172.21.15.50:0/1865674806 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f033015e730 0x7f03200039a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0324009ac0 tx=0x7f03200057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f03350de640 1 -- 172.21.15.50:0/1865674806 reap_dead start 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f0336b41640 1 -- 172.21.15.50:0/1865674806 shutdown_connections 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f0336b41640 1 -- 172.21.15.50:0/1865674806 >> 172.21.15.50:0/1865674806 conn(0x7f03300d0e10 msgr2=0x7f03300d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f0336b41640 1 -- 172.21.15.50:0/1865674806 shutdown_connections 2023-12-08T08:19:02.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.039+0000 7f0336b41640 1 -- 172.21.15.50:0/1865674806 wait complete. 2023-12-08T08:19:02.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.041+0000 7f0336b41640 1 Processor -- start 2023-12-08T08:19:02.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.041+0000 7f0336b41640 1 -- start start 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f033015e730 0x7f03300c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03300c4940 0x7f03300c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03300c8f30 0x7f03300c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300c5300 con 0x7f03300c4940 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300c98f0 con 0x7f033015e730 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03300c6ec0 con 0x7f03300c8f30 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03300c4940 0x7f03300c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03300c4940 0x7f03300c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52032/0 (socket says 172.21.15.50:52032) 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 -- 172.21.15.50:0/3456479848 learned_addr learned my addr 172.21.15.50:0/3456479848 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f03348dd640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f033015e730 0x7f03300c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f03350de640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03300c8f30 0x7f03300c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 -- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03300c8f30 msgr2=0x7f03300c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03300c8f30 0x7f03300c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 -- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f033015e730 msgr2=0x7f03300c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f033015e730 0x7f03300c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 -- 172.21.15.50:0/3456479848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300c47b0 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f03350de640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03300c8f30 0x7f03300c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032ffff640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03300c4940 0x7f03300c4dc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f031c0072c0 tx=0x7f031c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032d7fa640 1 -- 172.21.15.50:0/3456479848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c007b40 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032d7fa640 1 -- 172.21.15.50:0/3456479848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c00fa00 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03300c9b10 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f032d7fa640 1 -- 172.21.15.50:0/3456479848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00fdb0 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.042+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03300ca0d0 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.043+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0330067430 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.044+0000 7f032d7fa640 1 -- 172.21.15.50:0/3456479848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f031c01e3b0 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.044+0000 7f032d7fa640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f031406ae40 0x7f031406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.044+0000 7f032d7fa640 1 -- 172.21.15.50:0/3456479848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f031c089700 con 0x7f03300c4940 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.045+0000 7f03348dd640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f031406ae40 0x7f031406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.045+0000 7f03348dd640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f031406ae40 0x7f031406d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0324036000 tx=0x7f0324030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.049+0000 7f032d7fa640 1 -- 172.21.15.50:0/3456479848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f031c054510 con 0x7f03300c4940 2023-12-08T08:19:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.223+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03300b6d90 con 0x7f03300c4940 2023-12-08T08:19:02.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.223+0000 7f032d7fa640 1 -- 172.21.15.50:0/3456479848 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f031c057b30 con 0x7f03300c4940 2023-12-08T08:19:02.226 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:02.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f031406ae40 msgr2=0x7f031406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f031406ae40 0x7f031406d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0324036000 tx=0x7f0324030000 comp rx=0 tx=0).stop 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03300c4940 msgr2=0x7f03300c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03300c4940 0x7f03300c4dc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f031c0072c0 tx=0x7f031c007780 comp rx=0 tx=0).stop 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 shutdown_connections 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f031406ae40 0x7f031406d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f03300c4940 0x7f03300c4dc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03300c8f30 0x7f03300c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 --2- 172.21.15.50:0/3456479848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f033015e730 0x7f03300c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 >> 172.21.15.50:0/3456479848 conn(0x7f03300d0e10 msgr2=0x7f03300d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 shutdown_connections 2023-12-08T08:19:02.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.225+0000 7f0336b41640 1 -- 172.21.15.50:0/3456479848 wait complete. 2023-12-08T08:19:02.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.345+0000 7f4e1b3b0640 1 Processor -- start 2023-12-08T08:19:02.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.345+0000 7f4e1b3b0640 1 -- start start 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1b3b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 0x7f4e140ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1b3b0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e140ae350 0x7f4e140ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1b3b0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1406d650 con 0x7f4e140afeb0 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1b3b0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140adbe0 con 0x7f4e140ae350 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1b3b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415d970 con 0x7f4e1415d590 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1894b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4e140afeb0 0x7f4e140cf250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59668/0 (socket says 172.21.15.50:59668) 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1894b640 1 -- 172.21.15.50:0/4208304131 learned_addr learned my addr 172.21.15.50:0/4208304131 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593697956 0 0) 0x7f4e04001110 con 0x7f4e140afeb0 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1914c640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 0x7f4e140ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e1994d640 1 --2- 172.21.15.50:0/4208304131 >> v2:172.21.15.170:3300/0 conn(0x7f4e140ae350 0x7f4e140ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e00003520 con 0x7f4e140afeb0 2023-12-08T08:19:02.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437629047 0 0) 0x7f4e00003520 con 0x7f4e140afeb0 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 msgr2=0x7f4e140ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 0x7f4e140ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 >> v2:172.21.15.170:3300/0 conn(0x7f4e140ae350 msgr2=0x7f4e140ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 --2- 172.21.15.50:0/4208304131 >> v2:172.21.15.170:3300/0 conn(0x7f4e140ae350 0x7f4e140ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1406c810 con 0x7f4e140afeb0 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.346+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f4e04001800 con 0x7f4e140afeb0 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 >> v1:172.21.15.50:6789/0 conn(0x7f4e140afeb0 legacy=0x7f4e140cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e0bfff640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e00003970 0x7f4e00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e0bfff640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e000047c0 0x7f4e00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e0bfff640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 0x7f4e00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140adbe0 con 0x7f4e00003970 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415d970 con 0x7f4e000047c0 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0000b980 con 0x7f4e1415d590 2023-12-08T08:19:02.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1914c640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e00003970 0x7f4e00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1894b640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e000047c0 0x7f4e00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1994d640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 0x7f4e00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1914c640 1 -- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 msgr2=0x7f4e00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1914c640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 0x7f4e00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1914c640 1 -- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e000047c0 msgr2=0x7f4e00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1914c640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e000047c0 0x7f4e00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1914c640 1 -- 172.21.15.50:0/4208304131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00003520 con 0x7f4e00003970 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1994d640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e1415d590 0x7f4e00005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.347+0000 7f4e1894b640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e000047c0 0x7f4e00004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1914c640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e00003970 0x7f4e00003d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009af0 tx=0x7f4e000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4dc0f0ae357653 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1002c6b0 con 0x7f4e00003970 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1002c810 con 0x7f4e00003970 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e0bfff640 1 -- 172.21.15.50:0/4208304131 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1002cba0 con 0x7f4e00003970 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/4208304131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e00003970 msgr2=0x7f4e00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1b3b0640 1 --2- 172.21.15.50:0/4208304131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e00003970 0x7f4e00003d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009af0 tx=0x7f4e000057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1994d640 1 -- 172.21.15.50:0/4208304131 reap_dead start 2023-12-08T08:19:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/4208304131 shutdown_connections 2023-12-08T08:19:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/4208304131 >> 172.21.15.50:0/4208304131 conn(0x7f4e140d0e10 msgr2=0x7f4e140d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/4208304131 shutdown_connections 2023-12-08T08:19:02.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.348+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/4208304131 wait complete. 2023-12-08T08:19:02.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 Processor -- start 2023-12-08T08:19:02.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 -- start start 2023-12-08T08:19:02.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e00003970 0x7f4e1414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e140c6ad0 0x7f4e140c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e140b0310 0x7f4e140b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140b0cb0 con 0x7f4e140b0310 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1414f7b0 con 0x7f4e00003970 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1b3b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140c9830 con 0x7f4e140c6ad0 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1994d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e140b0310 0x7f4e140b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1994d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e140b0310 0x7f4e140b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52042/0 (socket says 172.21.15.50:52042) 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.350+0000 7f4e1994d640 1 -- 172.21.15.50:0/3145772529 learned_addr learned my addr 172.21.15.50:0/3145772529 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1994d640 1 -- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e140c6ad0 msgr2=0x7f4e140c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1994d640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e140c6ad0 0x7f4e140c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1994d640 1 -- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e00003970 msgr2=0x7f4e1414f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1994d640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e00003970 0x7f4e1414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1994d640 1 -- 172.21.15.50:0/3145772529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140c9b10 con 0x7f4e140b0310 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1994d640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e140b0310 0x7f4e140b0770 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4e14070a60 tx=0x7f4e0c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e09ffb640 1 -- 172.21.15.50:0/3145772529 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00e050 con 0x7f4e140b0310 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e09ffb640 1 -- 172.21.15.50:0/3145772529 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00f040 con 0x7f4e140b0310 2023-12-08T08:19:02.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140c9df0 con 0x7f4e140b0310 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e09ffb640 1 -- 172.21.15.50:0/3145772529 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c003bd0 con 0x7f4e140b0310 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.351+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140c9470 con 0x7f4e140b0310 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.352+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1415e110 con 0x7f4e140b0310 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.353+0000 7f4e09ffb640 1 -- 172.21.15.50:0/3145772529 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e0c015440 con 0x7f4e140b0310 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.353+0000 7f4e09ffb640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4df806ae40 0x7f4df806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.353+0000 7f4e09ffb640 1 -- 172.21.15.50:0/3145772529 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4e0c08a3b0 con 0x7f4e140b0310 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.353+0000 7f4e1914c640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4df806ae40 0x7f4df806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.354+0000 7f4e1914c640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4df806ae40 0x7f4df806d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e10036000 tx=0x7f4e1002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.357+0000 7f4e09ffb640 1 -- 172.21.15.50:0/3145772529 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e0c055110 con 0x7f4e140b0310 2023-12-08T08:19:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.533+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e14067430 con 0x7f4e140b0310 2023-12-08T08:19:02.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.533+0000 7f4e09ffb640 1 -- 172.21.15.50:0/3145772529 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e0c058730 con 0x7f4e140b0310 2023-12-08T08:19:02.547 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4df806ae40 msgr2=0x7f4df806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4df806ae40 0x7f4df806d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4e10036000 tx=0x7f4e1002e000 comp rx=0 tx=0).stop 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e140b0310 msgr2=0x7f4e140b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e140b0310 0x7f4e140b0770 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4e14070a60 tx=0x7f4e0c009f90 comp rx=0 tx=0).stop 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 shutdown_connections 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4df806ae40 0x7f4df806d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e140b0310 0x7f4e140b0770 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e140c6ad0 0x7f4e140c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 --2- 172.21.15.50:0/3145772529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e00003970 0x7f4e1414f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 >> 172.21.15.50:0/3145772529 conn(0x7f4e140d0e10 msgr2=0x7f4e140b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:02.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 shutdown_connections 2023-12-08T08:19:02.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.535+0000 7f4e1b3b0640 1 -- 172.21.15.50:0/3145772529 wait complete. 2023-12-08T08:19:02.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:02.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.667+0000 7fd021376640 1 Processor -- start 2023-12-08T08:19:02.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.667+0000 7fd021376640 1 -- start start 2023-12-08T08:19:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd021376640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c15e790 0x7fd01c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd021376640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd01c0cc380 0x7fd01c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd021376640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c0cce00 con 0x7fd01c0cdc30 2023-12-08T08:19:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd021376640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c0ce0c0 con 0x7fd01c0cc380 2023-12-08T08:19:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd021376640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0b0f00 con 0x7fd01c15e790 2023-12-08T08:19:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd01c0cc380 0x7fd01c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd01c0cc380 0x7fd01c0cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52058/0 (socket says 172.21.15.50:52058) 2023-12-08T08:19:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01a7fc640 1 -- 172.21.15.50:0/3754775521 learned_addr learned my addr 172.21.15.50:0/3754775521 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01affd640 1 --2- 172.21.15.50:0/3754775521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c15e790 0x7fd01c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01a7fc640 1 -- 172.21.15.50:0/3754775521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c15e790 msgr2=0x7fd01c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01a7fc640 1 --2- 172.21.15.50:0/3754775521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c15e790 0x7fd01c0ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01a7fc640 1 -- 172.21.15.50:0/3754775521 >> v1:172.21.15.170:6789/0 conn(0x7fd01c0cdc30 legacy=0x7fd01c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.668+0000 7fd01a7fc640 1 -- 172.21.15.50:0/3754775521 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0ccb20 con 0x7fd01c0cc380 2023-12-08T08:19:02.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.669+0000 7fd01a7fc640 1 --2- 172.21.15.50:0/3754775521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c0cc380 0x7fd01c0cd6f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd004009870 tx=0x7fd00402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35ea93d89facd94 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.669+0000 7fd019ffb640 1 -- 172.21.15.50:0/3754775521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040317c0 con 0x7fd01c0cc380 2023-12-08T08:19:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.669+0000 7fd019ffb640 1 -- 172.21.15.50:0/3754775521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004031920 con 0x7fd01c0cc380 2023-12-08T08:19:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.669+0000 7fd019ffb640 1 -- 172.21.15.50:0/3754775521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004031cb0 con 0x7fd01c0cc380 2023-12-08T08:19:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 -- 172.21.15.50:0/3754775521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c0cc380 msgr2=0x7fd01c0cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 --2- 172.21.15.50:0/3754775521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c0cc380 0x7fd01c0cd6f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd004009870 tx=0x7fd00402b860 comp rx=0 tx=0).stop 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 -- 172.21.15.50:0/3754775521 shutdown_connections 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 --2- 172.21.15.50:0/3754775521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c0cc380 0x7fd01c0cd6f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 --2- 172.21.15.50:0/3754775521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c15e790 0x7fd01c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 -- 172.21.15.50:0/3754775521 >> 172.21.15.50:0/3754775521 conn(0x7fd01c0d0e00 msgr2=0x7fd01c0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 -- 172.21.15.50:0/3754775521 shutdown_connections 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.670+0000 7fd021376640 1 -- 172.21.15.50:0/3754775521 wait complete. 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.671+0000 7fd021376640 1 Processor -- start 2023-12-08T08:19:02.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.671+0000 7fd021376640 1 -- start start 2023-12-08T08:19:02.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd021376640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01c0cc380 0x7fd01c1eff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd021376640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c0cdc30 0x7fd01c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd021376640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c15e790 0x7fd01c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd021376640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0b3f40 con 0x7fd01c15e790 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd021376640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0c7f70 con 0x7fd01c0cc380 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd021376640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0c8250 con 0x7fd01c0cdc30 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c15e790 0x7fd01c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c15e790 0x7fd01c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52064/0 (socket says 172.21.15.50:52064) 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 -- 172.21.15.50:0/2776282886 learned_addr learned my addr 172.21.15.50:0/2776282886 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01affd640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01c0cc380 0x7fd01c1eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01a7fc640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c0cdc30 0x7fd01c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 -- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c0cdc30 msgr2=0x7fd01c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c0cdc30 0x7fd01c0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 -- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01c0cc380 msgr2=0x7fd01c1eff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01c0cc380 0x7fd01c1eff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01b7fe640 1 -- 172.21.15.50:0/2776282886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0040094d0 con 0x7fd01c15e790 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01affd640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01c0cc380 0x7fd01c1eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.672+0000 7fd01a7fc640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c0cdc30 0x7fd01c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.673+0000 7fd01b7fe640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c15e790 0x7fd01c159b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c780 tx=0x7fd00c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.673+0000 7fd0137fe640 1 -- 172.21.15.50:0/2776282886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c004b60 con 0x7fd01c15e790 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.673+0000 7fd0137fe640 1 -- 172.21.15.50:0/2776282886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c00ce90 con 0x7fd01c15e790 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.673+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c0c8530 con 0x7fd01c15e790 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.673+0000 7fd0137fe640 1 -- 172.21.15.50:0/2776282886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00a850 con 0x7fd01c15e790 2023-12-08T08:19:02.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.673+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c09e970 con 0x7fd01c15e790 2023-12-08T08:19:02.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.674+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c0c8a50 con 0x7fd01c15e790 2023-12-08T08:19:02.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.674+0000 7fd0137fe640 1 -- 172.21.15.50:0/2776282886 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd00c00a9b0 con 0x7fd01c15e790 2023-12-08T08:19:02.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.675+0000 7fd0137fe640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcffc06ae40 0x7fcffc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.675+0000 7fd0137fe640 1 -- 172.21.15.50:0/2776282886 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd00c089bd0 con 0x7fd01c15e790 2023-12-08T08:19:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.675+0000 7fd01affd640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcffc06ae40 0x7fcffc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.675+0000 7fd01affd640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcffc06ae40 0x7fcffc06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b820 tx=0x7fd014008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.679+0000 7fd0137fe640 1 -- 172.21.15.50:0/2776282886 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd01c0c8a50 con 0x7fd01c15e790 2023-12-08T08:19:02.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.853+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd01c0c8a50 con 0x7fd01c15e790 2023-12-08T08:19:02.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.854+0000 7fd0137fe640 1 -- 172.21.15.50:0/2776282886 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd01c0c8a50 con 0x7fd01c15e790 2023-12-08T08:19:02.857 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcffc06ae40 msgr2=0x7fcffc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcffc06ae40 0x7fcffc06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b820 tx=0x7fd014008040 comp rx=0 tx=0).stop 2023-12-08T08:19:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c15e790 msgr2=0x7fd01c159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c15e790 0x7fd01c159b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c780 tx=0x7fd00c00cc40 comp rx=0 tx=0).stop 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 shutdown_connections 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcffc06ae40 0x7fcffc06d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c15e790 0x7fd01c159b10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd01c0cdc30 0x7fd01c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 --2- 172.21.15.50:0/2776282886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01c0cc380 0x7fd01c1eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.855+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 >> 172.21.15.50:0/2776282886 conn(0x7fd01c0d0e00 msgr2=0x7fd01c15b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.856+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 shutdown_connections 2023-12-08T08:19:02.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.856+0000 7fd021376640 1 -- 172.21.15.50:0/2776282886 wait complete. 2023-12-08T08:19:02.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:19:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.976+0000 7f08c63c9640 1 Processor -- start 2023-12-08T08:19:02.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.976+0000 7f08c63c9640 1 -- start start 2023-12-08T08:19:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08c63c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08c00cd3d0 0x7f08c00712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08c63c9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f08c00cdec0 0x7f08c015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08c63c9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c00ce370 con 0x7f08c006d6a0 2023-12-08T08:19:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08c63c9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c006d280 con 0x7f08c00cd3d0 2023-12-08T08:19:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08c63c9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c0071800 con 0x7f08c00cdec0 2023-12-08T08:19:02.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08bffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08c00cd3d0 0x7f08c00712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08bffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f08c00cd3d0 0x7f08c00712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52072/0 (socket says 172.21.15.50:52072) 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08bffff640 1 -- 172.21.15.50:0/3297349668 learned_addr learned my addr 172.21.15.50:0/3297349668 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08c4966640 1 --2- 172.21.15.50:0/3297349668 >> v2:172.21.15.170:3300/0 conn(0x7f08c00cdec0 0x7f08c015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08bffff640 1 -- 172.21.15.50:0/3297349668 >> v2:172.21.15.170:3300/0 conn(0x7f08c00cdec0 msgr2=0x7f08c015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08bffff640 1 --2- 172.21.15.50:0/3297349668 >> v2:172.21.15.170:3300/0 conn(0x7f08c00cdec0 0x7f08c015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08bffff640 1 -- 172.21.15.50:0/3297349668 >> v1:172.21.15.170:6789/0 conn(0x7f08c006d6a0 legacy=0x7f08c00cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.977+0000 7f08bffff640 1 -- 172.21.15.50:0/3297349668 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c006c8e0 con 0x7f08c00cd3d0 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.978+0000 7f08bffff640 1 --2- 172.21.15.50:0/3297349668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c00712c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f08c006fe70 tx=0x7f08b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c360d51007081f86 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.978+0000 7f08beffd640 1 -- 172.21.15.50:0/3297349668 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0030860 con 0x7f08c00cd3d0 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.978+0000 7f08beffd640 1 -- 172.21.15.50:0/3297349668 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00309c0 con 0x7f08c00cd3d0 2023-12-08T08:19:02.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.978+0000 7f08beffd640 1 -- 172.21.15.50:0/3297349668 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0030d50 con 0x7f08c00cd3d0 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 -- 172.21.15.50:0/3297349668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 msgr2=0x7f08c00712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 --2- 172.21.15.50:0/3297349668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c00712c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f08c006fe70 tx=0x7f08b002b9a0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 -- 172.21.15.50:0/3297349668 shutdown_connections 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 --2- 172.21.15.50:0/3297349668 >> v2:172.21.15.170:3300/0 conn(0x7f08c00cdec0 0x7f08c015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 --2- 172.21.15.50:0/3297349668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c00712c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 -- 172.21.15.50:0/3297349668 >> 172.21.15.50:0/3297349668 conn(0x7f08c00b0850 msgr2=0x7f08c00b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 -- 172.21.15.50:0/3297349668 shutdown_connections 2023-12-08T08:19:02.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.979+0000 7f08c63c9640 1 -- 172.21.15.50:0/3297349668 wait complete. 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.980+0000 7f08c63c9640 1 Processor -- start 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.980+0000 7f08c63c9640 1 -- start start 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c63c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c006d6a0 0x7f08c013d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c63c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c01f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c63c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c00cdec0 0x7f08c01406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c63c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c01587a0 con 0x7f08c00cd3d0 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c63c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c013e0d0 con 0x7f08c006d6a0 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c63c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c013e3b0 con 0x7f08c00cdec0 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c01f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c01f09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52084/0 (socket says 172.21.15.50:52084) 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 -- 172.21.15.50:0/2649958890 learned_addr learned my addr 172.21.15.50:0/2649958890 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c4966640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c00cdec0 0x7f08c01406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bffff640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c006d6a0 0x7f08c013d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 -- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c00cdec0 msgr2=0x7f08c01406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c00cdec0 0x7f08c01406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 -- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c006d6a0 msgr2=0x7f08c013d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c006d6a0 0x7f08c013d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 -- 172.21.15.50:0/2649958890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00094d0 con 0x7f08c00cd3d0 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c4966640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c00cdec0 0x7f08c01406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bffff640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c006d6a0 0x7f08c013d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bf7fe640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c01f09e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c450 tx=0x7f08b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bcff9640 1 -- 172.21.15.50:0/2649958890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40052d0 con 0x7f08c00cd3d0 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bcff9640 1 -- 172.21.15.50:0/2649958890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4005430 con 0x7f08c00cd3d0 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c013e690 con 0x7f08c00cd3d0 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.981+0000 7f08bcff9640 1 -- 172.21.15.50:0/2649958890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4012870 con 0x7f08c00cd3d0 2023-12-08T08:19:02.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.982+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c013da30 con 0x7f08c00cd3d0 2023-12-08T08:19:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.982+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c0157230 con 0x7f08c00cd3d0 2023-12-08T08:19:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.983+0000 7f08bcff9640 1 -- 172.21.15.50:0/2649958890 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08b40129d0 con 0x7f08c00cd3d0 2023-12-08T08:19:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.983+0000 7f08bcff9640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ac06ae40 0x7f08ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.984+0000 7f08bcff9640 1 -- 172.21.15.50:0/2649958890 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f08b4089490 con 0x7f08c00cd3d0 2023-12-08T08:19:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.984+0000 7f08bffff640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ac06ae40 0x7f08ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:02.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.984+0000 7f08bffff640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ac06ae40 0x7f08ac06d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f08b0036000 tx=0x7f08b003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:02.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:02.988+0000 7f08bcff9640 1 -- 172.21.15.50:0/2649958890 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08b40541f0 con 0x7f08c00cd3d0 2023-12-08T08:19:03.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.163+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08c00669e0 con 0x7f08c00cd3d0 2023-12-08T08:19:03.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.164+0000 7f08bcff9640 1 -- 172.21.15.50:0/2649958890 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08b4057810 con 0x7f08c00cd3d0 2023-12-08T08:19:03.166 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ac06ae40 msgr2=0x7f08ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ac06ae40 0x7f08ac06d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f08b0036000 tx=0x7f08b003b040 comp rx=0 tx=0).stop 2023-12-08T08:19:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 msgr2=0x7f08c01f09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c01f09e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f08b400c450 tx=0x7f08b400c910 comp rx=0 tx=0).stop 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 shutdown_connections 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ac06ae40 0x7f08ac06d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f08c00cd3d0 0x7f08c01f09e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c00cdec0 0x7f08c01406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.165+0000 7f08c63c9640 1 --2- 172.21.15.50:0/2649958890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c006d6a0 0x7f08c013d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.166+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 >> 172.21.15.50:0/2649958890 conn(0x7f08c00b0850 msgr2=0x7f08c015b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.166+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 shutdown_connections 2023-12-08T08:19:03.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.166+0000 7f08c63c9640 1 -- 172.21.15.50:0/2649958890 wait complete. 2023-12-08T08:19:03.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:03.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.284+0000 7f601a22b640 1 Processor -- start 2023-12-08T08:19:03.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.284+0000 7f601a22b640 1 -- start start 2023-12-08T08:19:03.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.285+0000 7f601a22b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 0x7f60140d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.285+0000 7f601a22b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601415ee90 con 0x7f601415f890 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.285+0000 7f601a22b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140d0fe0 con 0x7f601415d580 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.285+0000 7f601a22b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60140d1280 con 0x7f60140d1d60 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.285+0000 7f6013fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f601415f890 0x7f601415d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59676/0 (socket says 172.21.15.50:59676) 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.285+0000 7f6013fff640 1 -- 172.21.15.50:0/2391927208 learned_addr learned my addr 172.21.15.50:0/2391927208 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955291973 0 0) 0x7f601415ee90 con 0x7f601415f890 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6012ffd640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 0x7f60140d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ffc003520 con 0x7f601415f890 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 309468012 0 0) 0x7f5ffc003520 con 0x7f601415f890 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 msgr2=0x7f60140d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 0x7f60140d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 >> v1:172.21.15.170:6789/0 conn(0x7f601415d580 legacy=0x7f601415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140d1560 con 0x7f601415f890 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f600c0019f0 con 0x7f601415f890 2023-12-08T08:19:03.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 >> v1:172.21.15.50:6789/0 conn(0x7f601415f890 legacy=0x7f601415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ffc0039a0 0x7f5ffc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ffc0047c0 0x7f5ffc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 0x7f5ffc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140d1280 con 0x7f5ffc0047c0 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc00bae0 con 0x7f5ffc0039a0 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc00bca0 con 0x7f60140d1d60 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6012ffd640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ffc0047c0 0x7f5ffc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f60137fe640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ffc0039a0 0x7f5ffc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6013fff640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 0x7f5ffc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6012ffd640 1 -- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 msgr2=0x7f5ffc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6012ffd640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60140d1d60 0x7f5ffc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6012ffd640 1 -- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ffc0039a0 msgr2=0x7f5ffc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6012ffd640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ffc0039a0 0x7f5ffc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.286+0000 7f6012ffd640 1 -- 172.21.15.50:0/2391927208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc003520 con 0x7f5ffc0047c0 2023-12-08T08:19:03.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.287+0000 7f6012ffd640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ffc0047c0 0x7f5ffc004c40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6008009ac0 tx=0x7f5ffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7460d34cb01f3ae1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.287+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600802c6b0 con 0x7f5ffc0047c0 2023-12-08T08:19:03.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.287+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600802c810 con 0x7f5ffc0047c0 2023-12-08T08:19:03.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.287+0000 7f60127fc640 1 -- 172.21.15.50:0/2391927208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600802cba0 con 0x7f5ffc0047c0 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.288+0000 7f601a22b640 1 -- 172.21.15.50:0/2391927208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ffc0047c0 msgr2=0x7f5ffc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.288+0000 7f601a22b640 1 --2- 172.21.15.50:0/2391927208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ffc0047c0 0x7f5ffc004c40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6008009ac0 tx=0x7f5ffc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.288+0000 7f6013fff640 1 -- 172.21.15.50:0/2391927208 reap_dead start 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.288+0000 7f601a22b640 1 -- 172.21.15.50:0/2391927208 shutdown_connections 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.288+0000 7f601a22b640 1 -- 172.21.15.50:0/2391927208 >> 172.21.15.50:0/2391927208 conn(0x7f60140d2fb0 msgr2=0x7f60140d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.288+0000 7f601a22b640 1 -- 172.21.15.50:0/2391927208 shutdown_connections 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.288+0000 7f601a22b640 1 -- 172.21.15.50:0/2391927208 wait complete. 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.289+0000 7f601a22b640 1 Processor -- start 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.289+0000 7f601a22b640 1 -- start start 2023-12-08T08:19:03.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f601a22b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ffc0047c0 0x7f60140cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f601a22b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6014150a10 0x7f601414d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f601a22b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60140ca470 0x7f60140c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f601a22b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140caa30 con 0x7f60140ca470 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f601a22b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60140cad10 con 0x7f6014150a10 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f601a22b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60140caff0 con 0x7f5ffc0047c0 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f6013fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60140ca470 0x7f60140c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f6013fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60140ca470 0x7f60140c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52102/0 (socket says 172.21.15.50:52102) 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f6013fff640 1 -- 172.21.15.50:0/1338019073 learned_addr learned my addr 172.21.15.50:0/1338019073 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f6013fff640 1 -- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ffc0047c0 msgr2=0x7f60140cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f6013fff640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ffc0047c0 0x7f60140cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f6013fff640 1 -- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6014150a10 msgr2=0x7f601414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.290+0000 7f6013fff640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6014150a10 0x7f601414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.291+0000 7f6013fff640 1 -- 172.21.15.50:0/1338019073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140cb2d0 con 0x7f60140ca470 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.291+0000 7f6013fff640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60140ca470 0x7f60140c8db0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f601408d760 tx=0x7f600c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.291+0000 7f5ffbfff640 1 -- 172.21.15.50:0/1338019073 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00ace0 con 0x7f60140ca470 2023-12-08T08:19:03.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.291+0000 7f5ffbfff640 1 -- 172.21.15.50:0/1338019073 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c00ae80 con 0x7f60140ca470 2023-12-08T08:19:03.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.291+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60140cb5b0 con 0x7f60140ca470 2023-12-08T08:19:03.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.291+0000 7f5ffbfff640 1 -- 172.21.15.50:0/1338019073 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c013630 con 0x7f60140ca470 2023-12-08T08:19:03.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.291+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60140c92f0 con 0x7f60140ca470 2023-12-08T08:19:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.292+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60140d09d0 con 0x7f60140ca470 2023-12-08T08:19:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.292+0000 7f5ffbfff640 1 -- 172.21.15.50:0/1338019073 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f600c013790 con 0x7f60140ca470 2023-12-08T08:19:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.293+0000 7f5ffbfff640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600006ae70 0x7f600006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.293+0000 7f5ffbfff640 1 -- 172.21.15.50:0/1338019073 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f600c08a150 con 0x7f60140ca470 2023-12-08T08:19:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.293+0000 7f60137fe640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600006ae70 0x7f600006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.293+0000 7f60137fe640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600006ae70 0x7f600006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f60040016d0 tx=0x7f6004009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.297+0000 7f5ffbfff640 1 -- 172.21.15.50:0/1338019073 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f600c054ee0 con 0x7f60140ca470 2023-12-08T08:19:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.486+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f60140cb7a0 con 0x7f60140ca470 2023-12-08T08:19:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.487+0000 7f5ffbfff640 1 -- 172.21.15.50:0/1338019073 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f600c058500 con 0x7f60140ca470 2023-12-08T08:19:03.489 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600006ae70 msgr2=0x7f600006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600006ae70 0x7f600006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f60040016d0 tx=0x7f6004009040 comp rx=0 tx=0).stop 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60140ca470 msgr2=0x7f60140c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60140ca470 0x7f60140c8db0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f601408d760 tx=0x7f600c00a6e0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 shutdown_connections 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600006ae70 0x7f600006d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60140ca470 0x7f60140c8db0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6014150a10 0x7f601414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 --2- 172.21.15.50:0/1338019073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ffc0047c0 0x7f60140cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 >> 172.21.15.50:0/1338019073 conn(0x7f60140d2fb0 msgr2=0x7f601415d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 shutdown_connections 2023-12-08T08:19:03.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.489+0000 7f601a22b640 1 -- 172.21.15.50:0/1338019073 wait complete. 2023-12-08T08:19:03.502 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:19:03.502 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:03.525 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.629+0000 7fda9c1de640 1 Processor -- start 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.629+0000 7fda9c1de640 1 -- start start 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9c1de640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fda94158ee0 0x7fda94070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9c1de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda940cbd10 0x7fda9406c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9c1de640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda940720d0 con 0x7fda9415b750 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9c1de640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940cc890 con 0x7fda940cbd10 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9c1de640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940714c0 con 0x7fda94158ee0 2023-12-08T08:19:03.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9a77b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda940cbd10 0x7fda9406c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9a77b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fda940cbd10 0x7fda9406c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52116/0 (socket says 172.21.15.50:52116) 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9a77b640 1 -- 172.21.15.50:0/1746992409 learned_addr learned my addr 172.21.15.50:0/1746992409 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda99f7a640 1 --2- 172.21.15.50:0/1746992409 >> v2:172.21.15.170:3300/0 conn(0x7fda94158ee0 0x7fda94070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9a77b640 1 -- 172.21.15.50:0/1746992409 >> v2:172.21.15.170:3300/0 conn(0x7fda94158ee0 msgr2=0x7fda94070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9a77b640 1 --2- 172.21.15.50:0/1746992409 >> v2:172.21.15.170:3300/0 conn(0x7fda94158ee0 0x7fda94070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9a77b640 1 -- 172.21.15.50:0/1746992409 >> v1:172.21.15.170:6789/0 conn(0x7fda9415b750 legacy=0x7fda940cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda9a77b640 1 -- 172.21.15.50:0/1746992409 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940717a0 con 0x7fda940cbd10 2023-12-08T08:19:03.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.630+0000 7fda99f7a640 1 --2- 172.21.15.50:0/1746992409 >> v2:172.21.15.170:3300/0 conn(0x7fda94158ee0 0x7fda94070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.631+0000 7fda9a77b640 1 --2- 172.21.15.50:0/1746992409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda9406c480 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fda9406e6a0 tx=0x7fda8c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f163d0dbdadecb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.631+0000 7fda98f78640 1 -- 172.21.15.50:0/1746992409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c02c9f0 con 0x7fda940cbd10 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.631+0000 7fda98f78640 1 -- 172.21.15.50:0/1746992409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c02cb50 con 0x7fda940cbd10 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.631+0000 7fda98f78640 1 -- 172.21.15.50:0/1746992409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0343f0 con 0x7fda940cbd10 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 -- 172.21.15.50:0/1746992409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 msgr2=0x7fda9406c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 --2- 172.21.15.50:0/1746992409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda9406c480 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fda9406e6a0 tx=0x7fda8c02be50 comp rx=0 tx=0).stop 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 -- 172.21.15.50:0/1746992409 shutdown_connections 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 --2- 172.21.15.50:0/1746992409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda9406c480 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 --2- 172.21.15.50:0/1746992409 >> v2:172.21.15.170:3300/0 conn(0x7fda94158ee0 0x7fda94070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 -- 172.21.15.50:0/1746992409 >> 172.21.15.50:0/1746992409 conn(0x7fda940b09f0 msgr2=0x7fda940b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 -- 172.21.15.50:0/1746992409 shutdown_connections 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.632+0000 7fda9c1de640 1 -- 172.21.15.50:0/1746992409 wait complete. 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.633+0000 7fda9c1de640 1 Processor -- start 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.633+0000 7fda9c1de640 1 -- start start 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9c1de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda94157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9c1de640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda94158ee0 0x7fda94142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9c1de640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda9415b750 0x7fda94155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9c1de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda94142cc0 con 0x7fda940cbd10 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9c1de640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda941567d0 con 0x7fda9415b750 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9c1de640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda94156ab0 con 0x7fda94158ee0 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda94157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda94157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52120/0 (socket says 172.21.15.50:52120) 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 -- 172.21.15.50:0/685298427 learned_addr learned my addr 172.21.15.50:0/685298427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:03.638 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9a77b640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda9415b750 0x7fda94155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99779640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda94158ee0 0x7fda94142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 -- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda94158ee0 msgr2=0x7fda94142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda94158ee0 0x7fda94142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 -- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda9415b750 msgr2=0x7fda94155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda9415b750 0x7fda94155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 -- 172.21.15.50:0/685298427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009b30 con 0x7fda940cbd10 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99779640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda94158ee0 0x7fda94142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda9a77b640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda9415b750 0x7fda94155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda99f7a640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda94157870 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c7f0 tx=0x7fda9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda8a7fc640 1 -- 172.21.15.50:0/685298427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90007a30 con 0x7fda940cbd10 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda8a7fc640 1 -- 172.21.15.50:0/685298427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90007b90 con 0x7fda940cbd10 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.634+0000 7fda8a7fc640 1 -- 172.21.15.50:0/685298427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000ce40 con 0x7fda940cbd10 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.635+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda94156d90 con 0x7fda940cbd10 2023-12-08T08:19:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.635+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda94157350 con 0x7fda940cbd10 2023-12-08T08:19:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.635+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda94067430 con 0x7fda940cbd10 2023-12-08T08:19:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.636+0000 7fda8a7fc640 1 -- 172.21.15.50:0/685298427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda900113f0 con 0x7fda940cbd10 2023-12-08T08:19:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.636+0000 7fda8a7fc640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fda7806ae70 0x7fda7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.636+0000 7fda8a7fc640 1 -- 172.21.15.50:0/685298427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fda90089be0 con 0x7fda940cbd10 2023-12-08T08:19:03.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.637+0000 7fda99779640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fda7806ae70 0x7fda7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.637+0000 7fda99779640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fda7806ae70 0x7fda7806d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fda84006fd0 tx=0x7fda84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.640+0000 7fda8a7fc640 1 -- 172.21.15.50:0/685298427 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda90054810 con 0x7fda940cbd10 2023-12-08T08:19:03.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.816+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9406df80 con 0x7fda940cbd10 2023-12-08T08:19:03.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.817+0000 7fda8a7fc640 1 -- 172.21.15.50:0/685298427 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7fda9001f090 con 0x7fda940cbd10 2023-12-08T08:19:03.819 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:03.820 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:03.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fda7806ae70 msgr2=0x7fda7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fda7806ae70 0x7fda7806d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fda84006fd0 tx=0x7fda84008040 comp rx=0 tx=0).stop 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 msgr2=0x7fda94157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda94157870 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c7f0 tx=0x7fda9000cbf0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 shutdown_connections 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fda7806ae70 0x7fda7806d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda9415b750 0x7fda94155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda94158ee0 0x7fda94142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 --2- 172.21.15.50:0/685298427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda940cbd10 0x7fda94157870 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 >> 172.21.15.50:0/685298427 conn(0x7fda940b09f0 msgr2=0x7fda940acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 shutdown_connections 2023-12-08T08:19:03.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.819+0000 7fda9c1de640 1 -- 172.21.15.50:0/685298427 wait complete. 2023-12-08T08:19:03.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:19:03.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.940+0000 7f8559a02640 1 Processor -- start 2023-12-08T08:19:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.940+0000 7f8559a02640 1 -- start start 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8559a02640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f855415d480 0x7f85540d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8559a02640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540cecd0 con 0x7f85540d1bc0 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8559a02640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85540b2330 con 0x7f85540ce4a0 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8559a02640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85540b2610 con 0x7f855415d480 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8552ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f855415d480 0x7f85540d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f85537fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85540d1bc0 0x7f85540b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59692/0 (socket says 172.21.15.50:59692) 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f85537fe640 1 -- 172.21.15.50:0/2757689426 learned_addr learned my addr 172.21.15.50:0/2757689426 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8552ffd640 1 -- 172.21.15.50:0/2757689426 >> v1:172.21.15.170:6789/0 conn(0x7f85540ce4a0 legacy=0x7f85540d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8552ffd640 1 -- 172.21.15.50:0/2757689426 >> v1:172.21.15.50:6789/0 conn(0x7f85540d1bc0 legacy=0x7f85540b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8552ffd640 1 -- 172.21.15.50:0/2757689426 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540b28f0 con 0x7f855415d480 2023-12-08T08:19:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.941+0000 7f8551ffb640 1 -- 172.21.15.50:0/2757689426 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926123936 0 0) 0x7f85540cecd0 con 0x7f85540d1bc0 2023-12-08T08:19:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.942+0000 7f8552ffd640 1 --2- 172.21.15.50:0/2757689426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540d3a60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f85440097d0 tx=0x7f854402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25923e07b2046e81 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.942+0000 7f8551ffb640 1 -- 172.21.15.50:0/2757689426 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544031830 con 0x7f855415d480 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.942+0000 7f8551ffb640 1 -- 172.21.15.50:0/2757689426 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544031990 con 0x7f855415d480 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.942+0000 7f8551ffb640 1 -- 172.21.15.50:0/2757689426 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544031d20 con 0x7f855415d480 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.943+0000 7f8559a02640 1 -- 172.21.15.50:0/2757689426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 msgr2=0x7f85540d3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.943+0000 7f8559a02640 1 --2- 172.21.15.50:0/2757689426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540d3a60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f85440097d0 tx=0x7f854402b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.943+0000 7f8559a02640 1 -- 172.21.15.50:0/2757689426 shutdown_connections 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.943+0000 7f8559a02640 1 --2- 172.21.15.50:0/2757689426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540d3a60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.943+0000 7f8559a02640 1 -- 172.21.15.50:0/2757689426 >> 172.21.15.50:0/2757689426 conn(0x7f85540d2ed0 msgr2=0x7f85540d32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.943+0000 7f8559a02640 1 -- 172.21.15.50:0/2757689426 shutdown_connections 2023-12-08T08:19:03.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.943+0000 7f8559a02640 1 -- 172.21.15.50:0/2757689426 wait complete. 2023-12-08T08:19:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.944+0000 7f8559a02640 1 Processor -- start 2023-12-08T08:19:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.944+0000 7f8559a02640 1 -- start start 2023-12-08T08:19:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f8559a02640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85540ce4a0 0x7f8554152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f8559a02640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85540d1bc0 0x7f85540b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f8559a02640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f8559a02640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540cb720 con 0x7f855415d480 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f8559a02640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c8050 con 0x7f85540ce4a0 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f8559a02640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85540c8330 con 0x7f85540d1bc0 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52128/0 (socket says 172.21.15.50:52128) 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 -- 172.21.15.50:0/3630349070 learned_addr learned my addr 172.21.15.50:0/3630349070 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f8552ffd640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85540ce4a0 0x7f8554152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85527fc640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85540d1bc0 0x7f85540b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 -- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85540d1bc0 msgr2=0x7f85540b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85540d1bc0 0x7f85540b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 -- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85540ce4a0 msgr2=0x7f8554152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85540ce4a0 0x7f8554152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 -- 172.21.15.50:0/3630349070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544009400 con 0x7f855415d480 2023-12-08T08:19:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.945+0000 7f85537fe640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540c6fa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f854c00c730 tx=0x7f854c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.946+0000 7f853bfff640 1 -- 172.21.15.50:0/3630349070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00ce40 con 0x7f855415d480 2023-12-08T08:19:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.946+0000 7f853bfff640 1 -- 172.21.15.50:0/3630349070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c00a640 con 0x7f855415d480 2023-12-08T08:19:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.946+0000 7f853bfff640 1 -- 172.21.15.50:0/3630349070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c00aa30 con 0x7f855415d480 2023-12-08T08:19:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.946+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85540c8610 con 0x7f855415d480 2023-12-08T08:19:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.946+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8554152aa0 con 0x7f855415d480 2023-12-08T08:19:03.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.947+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85540673c0 con 0x7f855415d480 2023-12-08T08:19:03.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.947+0000 7f853bfff640 1 -- 172.21.15.50:0/3630349070 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f854c00ab90 con 0x7f855415d480 2023-12-08T08:19:03.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.948+0000 7f853bfff640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f854006ae40 0x7f854006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:03.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.948+0000 7f853bfff640 1 -- 172.21.15.50:0/3630349070 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f854c088f00 con 0x7f855415d480 2023-12-08T08:19:03.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.948+0000 7f8552ffd640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f854006ae40 0x7f854006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:03.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.948+0000 7f8552ffd640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f854006ae40 0x7f854006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8544036000 tx=0x7f8544008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:03.952+0000 7f853bfff640 1 -- 172.21.15.50:0/3630349070 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f854c053bc0 con 0x7f855415d480 2023-12-08T08:19:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.127+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85540cb860 con 0x7f855415d480 2023-12-08T08:19:04.130 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.128+0000 7f853bfff640 1 -- 172.21.15.50:0/3630349070 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f854c018070 con 0x7f855415d480 2023-12-08T08:19:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f854006ae40 msgr2=0x7f854006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f854006ae40 0x7f854006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8544036000 tx=0x7f8544008030 comp rx=0 tx=0).stop 2023-12-08T08:19:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 msgr2=0x7f85540c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540c6fa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f854c00c730 tx=0x7f854c00cbf0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 shutdown_connections 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f854006ae40 0x7f854006d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f855415d480 0x7f85540c6fa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85540d1bc0 0x7f85540b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 --2- 172.21.15.50:0/3630349070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85540ce4a0 0x7f8554152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 >> 172.21.15.50:0/3630349070 conn(0x7f85540d2ed0 msgr2=0x7f855406c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 shutdown_connections 2023-12-08T08:19:04.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.130+0000 7f8559a02640 1 -- 172.21.15.50:0/3630349070 wait complete. 2023-12-08T08:19:04.143 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:04.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.249+0000 7f51d3568640 1 Processor -- start 2023-12-08T08:19:04.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.250+0000 7f51d3568640 1 -- start start 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.250+0000 7f51d3568640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51cc0b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.250+0000 7f51d3568640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc0b2280 con 0x7f51cc15d4f0 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.250+0000 7f51d3568640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc0b1430 con 0x7f51cc0cef90 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.250+0000 7f51d3568640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc06bb40 con 0x7f51cc0b0af0 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51d1304640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f51cc15d4f0 0x7f51cc0b03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59702/0 (socket says 172.21.15.50:59702) 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51d1304640 1 -- 172.21.15.50:0/917699174 learned_addr learned my addr 172.21.15.50:0/917699174 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51d0b03640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51cc0b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001428892 0 0) 0x7f51cc0b2280 con 0x7f51cc15d4f0 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b8003520 con 0x7f51cc15d4f0 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408059218 0 0) 0x7f51cc0b1430 con 0x7f51cc0cef90 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51cc0b2280 con 0x7f51cc0cef90 2023-12-08T08:19:04.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 772481947 0 0) 0x7f51b8003520 con 0x7f51cc15d4f0 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 msgr2=0x7f51cc0b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51cc0b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 >> v1:172.21.15.170:6789/0 conn(0x7f51cc0cef90 legacy=0x7f51cc0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0b2710 con 0x7f51cc15d4f0 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f51c8001670 con 0x7f51cc15d4f0 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51d0b03640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51cc0b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 >> v1:172.21.15.50:6789/0 conn(0x7f51cc15d4f0 legacy=0x7f51cc0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51b8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51b8004070 0x7f51b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b8004d00 0x7f51b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc06bb40 con 0x7f51b8004070 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b800ba30 con 0x7f51b8004d00 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b800bbf0 con 0x7f51cc0b0af0 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.251+0000 7f51d0b03640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51b8004070 0x7f51b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d1304640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51b8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d1b05640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b8004d00 0x7f51b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d0b03640 1 -- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 msgr2=0x7f51b8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d0b03640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51b8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d0b03640 1 -- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b8004d00 msgr2=0x7f51b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d0b03640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b8004d00 0x7f51b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d0b03640 1 -- 172.21.15.50:0/917699174 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc009400 con 0x7f51b8004070 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d1b05640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b8004d00 0x7f51b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d1304640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51cc0b0af0 0x7f51b8003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.252+0000 7f51d0b03640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51b8004070 0x7f51b80047c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009c70 tx=0x7f51b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00e15bef93575ee server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc02c910 con 0x7f51b8004070 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc02ca70 con 0x7f51b8004070 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51c3fff640 1 -- 172.21.15.50:0/917699174 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc02cde0 con 0x7f51b8004070 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51d3568640 1 -- 172.21.15.50:0/917699174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51b8004070 msgr2=0x7f51b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51d3568640 1 --2- 172.21.15.50:0/917699174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51b8004070 0x7f51b80047c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009c70 tx=0x7f51b80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51d1b05640 1 -- 172.21.15.50:0/917699174 reap_dead start 2023-12-08T08:19:04.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51d3568640 1 -- 172.21.15.50:0/917699174 shutdown_connections 2023-12-08T08:19:04.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51d3568640 1 -- 172.21.15.50:0/917699174 >> 172.21.15.50:0/917699174 conn(0x7f51cc0d0e00 msgr2=0x7f51cc0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51d3568640 1 -- 172.21.15.50:0/917699174 shutdown_connections 2023-12-08T08:19:04.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.253+0000 7f51d3568640 1 -- 172.21.15.50:0/917699174 wait complete. 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.254+0000 7f51d3568640 1 Processor -- start 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.254+0000 7f51d3568640 1 -- start start 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d3568640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51b8004070 0x7f51cc158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d3568640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc09ac60 0x7f51cc0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d3568640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51cc0c9140 0x7f51cc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d3568640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0c95c0 con 0x7f51cc09ac60 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d3568640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0cd330 con 0x7f51cc0c9140 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d3568640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc159410 con 0x7f51b8004070 2023-12-08T08:19:04.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d0b03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc09ac60 0x7f51cc0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d0b03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc09ac60 0x7f51cc0c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52138/0 (socket says 172.21.15.50:52138) 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.255+0000 7f51d0b03640 1 -- 172.21.15.50:0/1057276290 learned_addr learned my addr 172.21.15.50:0/1057276290 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d0b03640 1 -- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51b8004070 msgr2=0x7f51cc158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d0b03640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51b8004070 0x7f51cc158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d0b03640 1 -- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51cc0c9140 msgr2=0x7f51cc0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d0b03640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51cc0c9140 0x7f51cc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d0b03640 1 -- 172.21.15.50:0/1057276290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0cca40 con 0x7f51cc09ac60 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d0b03640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc09ac60 0x7f51cc0c8c00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c00 tx=0x7f51bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51c1ffb640 1 -- 172.21.15.50:0/1057276290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc034cc0 con 0x7f51cc09ac60 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51c1ffb640 1 -- 172.21.15.50:0/1057276290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc034e20 con 0x7f51cc09ac60 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51c1ffb640 1 -- 172.21.15.50:0/1057276290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc03e600 con 0x7f51cc09ac60 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc0c97b0 con 0x7f51cc09ac60 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.256+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc0ccce0 con 0x7f51cc09ac60 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.257+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc06b000 con 0x7f51cc09ac60 2023-12-08T08:19:04.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.258+0000 7f51c1ffb640 1 -- 172.21.15.50:0/1057276290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51bc03e760 con 0x7f51cc09ac60 2023-12-08T08:19:04.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.258+0000 7f51c1ffb640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f51b006ae40 0x7f51b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.258+0000 7f51c1ffb640 1 -- 172.21.15.50:0/1057276290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f51bc0aba90 con 0x7f51cc09ac60 2023-12-08T08:19:04.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.258+0000 7f51d1304640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f51b006ae40 0x7f51b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.259+0000 7f51d1304640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f51b006ae40 0x7f51b006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51c80059f0 tx=0x7f51c8001e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.262+0000 7f51c1ffb640 1 -- 172.21.15.50:0/1057276290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51bc076930 con 0x7f51cc09ac60 2023-12-08T08:19:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.438+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51cc067430 con 0x7f51cc09ac60 2023-12-08T08:19:04.441 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.438+0000 7f51c1ffb640 1 -- 172.21.15.50:0/1057276290 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51bc04c020 con 0x7f51cc09ac60 2023-12-08T08:19:04.441 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f51b006ae40 msgr2=0x7f51b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f51b006ae40 0x7f51b006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51c80059f0 tx=0x7f51c8001e50 comp rx=0 tx=0).stop 2023-12-08T08:19:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc09ac60 msgr2=0x7f51cc0c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc09ac60 0x7f51cc0c8c00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f51bc000c00 tx=0x7f51bc004730 comp rx=0 tx=0).stop 2023-12-08T08:19:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 shutdown_connections 2023-12-08T08:19:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f51b006ae40 0x7f51b006d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f51cc09ac60 0x7f51cc0c8c00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51cc0c9140 0x7f51cc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 --2- 172.21.15.50:0/1057276290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f51b8004070 0x7f51cc158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 >> 172.21.15.50:0/1057276290 conn(0x7f51cc0d0e00 msgr2=0x7f51cc0aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 shutdown_connections 2023-12-08T08:19:04.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.440+0000 7f51d3568640 1 -- 172.21.15.50:0/1057276290 wait complete. 2023-12-08T08:19:04.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.560+0000 7f2937ff1640 1 Processor -- start 2023-12-08T08:19:04.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.560+0000 7f2937ff1640 1 -- start start 2023-12-08T08:19:04.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f2937ff1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f2937ff1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29300cfe10 0x7f29300cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f2937ff1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29300c6be0 con 0x7f29300b4150 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f2937ff1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29300d3ff0 con 0x7f29300cfe10 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f2937ff1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29300b4860 con 0x7f29300cfa30 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f293658e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29300cfe10 0x7f29300cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f293658e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29300cfe10 0x7f29300cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52142/0 (socket says 172.21.15.50:52142) 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.561+0000 7f293658e640 1 -- 172.21.15.50:0/3664839658 learned_addr learned my addr 172.21.15.50:0/3664839658 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:04.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.562+0000 7f2935d8d640 1 --2- 172.21.15.50:0/3664839658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.562+0000 7f293658e640 1 -- 172.21.15.50:0/3664839658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 msgr2=0x7f29300b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.562+0000 7f293658e640 1 --2- 172.21.15.50:0/3664839658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.562+0000 7f293658e640 1 -- 172.21.15.50:0/3664839658 >> v1:172.21.15.170:6789/0 conn(0x7f29300b4150 legacy=0x7f29300b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.562+0000 7f293658e640 1 -- 172.21.15.50:0/3664839658 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29300d3d50 con 0x7f29300cfe10 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.562+0000 7f2935d8d640 1 --2- 172.21.15.50:0/3664839658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f293658e640 1 --2- 172.21.15.50:0/3664839658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29300cdf50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2920009e50 tx=0x7f292002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1759ee4444ec46e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2934d8b640 1 -- 172.21.15.50:0/3664839658 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292002c9e0 con 0x7f29300cfe10 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2934d8b640 1 -- 172.21.15.50:0/3664839658 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292002cb40 con 0x7f29300cfe10 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2934d8b640 1 -- 172.21.15.50:0/3664839658 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29200343f0 con 0x7f29300cfe10 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 -- 172.21.15.50:0/3664839658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 msgr2=0x7f29300cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 --2- 172.21.15.50:0/3664839658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29300cdf50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2920009e50 tx=0x7f292002be40 comp rx=0 tx=0).stop 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 -- 172.21.15.50:0/3664839658 shutdown_connections 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 --2- 172.21.15.50:0/3664839658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29300cdf50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 --2- 172.21.15.50:0/3664839658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 -- 172.21.15.50:0/3664839658 >> 172.21.15.50:0/3664839658 conn(0x7f29300d3090 msgr2=0x7f29300d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 -- 172.21.15.50:0/3664839658 shutdown_connections 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.563+0000 7f2937ff1640 1 -- 172.21.15.50:0/3664839658 wait complete. 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.564+0000 7f2937ff1640 1 Processor -- start 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2937ff1640 1 -- start start 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2937ff1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29300b4150 0x7f29300b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2937ff1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2937ff1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29301f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2937ff1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300b16d0 con 0x7f29300cfe10 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2937ff1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29300b61c0 con 0x7f29300b4150 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2937ff1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29300b0aa0 con 0x7f29300cfa30 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f293658e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29301f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f293658e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29301f68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52146/0 (socket says 172.21.15.50:52146) 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f293658e640 1 -- 172.21.15.50:0/616302313 learned_addr learned my addr 172.21.15.50:0/616302313 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.565+0000 7f2935d8d640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29300b4150 0x7f29300b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293558c640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293658e640 1 -- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 msgr2=0x7f29300b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293658e640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293658e640 1 -- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29300b4150 msgr2=0x7f29300b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293658e640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29300b4150 0x7f29300b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293658e640 1 -- 172.21.15.50:0/616302313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920009b30 con 0x7f29300cfe10 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293558c640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f293658e640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29301f68c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2920009e50 tx=0x7f2920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f292e7fc640 1 -- 172.21.15.50:0/616302313 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920009510 con 0x7f29300cfe10 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f292e7fc640 1 -- 172.21.15.50:0/616302313 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292003e450 con 0x7f29300cfe10 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29300b1af0 con 0x7f29300cfe10 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f292e7fc640 1 -- 172.21.15.50:0/616302313 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292003e800 con 0x7f29300cfe10 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.566+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29300b1010 con 0x7f29300cfe10 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.567+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29300b1810 con 0x7f29300cfe10 2023-12-08T08:19:04.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.568+0000 7f292e7fc640 1 -- 172.21.15.50:0/616302313 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f292003e960 con 0x7f29300cfe10 2023-12-08T08:19:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.568+0000 7f292e7fc640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f291c06ae40 0x7f291c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.568+0000 7f292e7fc640 1 -- 172.21.15.50:0/616302313 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f29200ac780 con 0x7f29300cfe10 2023-12-08T08:19:04.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.568+0000 7f2935d8d640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f291c06ae40 0x7f291c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.569+0000 7f2935d8d640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f291c06ae40 0x7f291c06d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f292800aac0 tx=0x7f2928008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.572+0000 7f292e7fc640 1 -- 172.21.15.50:0/616302313 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29300b1810 con 0x7f29300cfe10 2023-12-08T08:19:04.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.749+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29300b1810 con 0x7f29300cfe10 2023-12-08T08:19:04.752 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.749+0000 7f292e7fc640 1 -- 172.21.15.50:0/616302313 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29300b1810 con 0x7f29300cfe10 2023-12-08T08:19:04.752 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f291c06ae40 msgr2=0x7f291c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f291c06ae40 0x7f291c06d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f292800aac0 tx=0x7f2928008040 comp rx=0 tx=0).stop 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 msgr2=0x7f29301f68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29301f68c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2920009e50 tx=0x7f2920004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 shutdown_connections 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f291c06ae40 0x7f291c06d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29300cfe10 0x7f29301f68c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29300cfa30 0x7f29300b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.754 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 --2- 172.21.15.50:0/616302313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29300b4150 0x7f29300b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 >> 172.21.15.50:0/616302313 conn(0x7f29300d3090 msgr2=0x7f29300ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 shutdown_connections 2023-12-08T08:19:04.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.751+0000 7f2937ff1640 1 -- 172.21.15.50:0/616302313 wait complete. 2023-12-08T08:19:04.764 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:19:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.871+0000 7fa1d2fbe640 1 Processor -- start 2023-12-08T08:19:04.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.871+0000 7fa1d2fbe640 1 -- start start 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d2fbe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1cc157a20 0x7fa1cc15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d2fbe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa1cc0cb370 0x7fa1cc15df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d2fbe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc06d7d0 0x7fa1cc15e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d2fbe640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc157e00 con 0x7fa1cc157a20 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d2fbe640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc06dd20 con 0x7fa1cc0cb370 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d2fbe640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc070cd0 con 0x7fa1cc06d7d0 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1cc157a20 0x7fa1cc15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1cc157a20 0x7fa1cc15d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52156/0 (socket says 172.21.15.50:52156) 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 -- 172.21.15.50:0/480189717 learned_addr learned my addr 172.21.15.50:0/480189717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:04.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d155b640 1 --2- 172.21.15.50:0/480189717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc06d7d0 0x7fa1cc15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1cbfff640 1 --2- 172.21.15.50:0/480189717 >> v2:172.21.15.170:3300/0 conn(0x7fa1cc0cb370 0x7fa1cc15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 -- 172.21.15.50:0/480189717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc06d7d0 msgr2=0x7fa1cc15e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 --2- 172.21.15.50:0/480189717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc06d7d0 0x7fa1cc15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 -- 172.21.15.50:0/480189717 >> v2:172.21.15.170:3300/0 conn(0x7fa1cc0cb370 msgr2=0x7fa1cc15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 --2- 172.21.15.50:0/480189717 >> v2:172.21.15.170:3300/0 conn(0x7fa1cc0cb370 0x7fa1cc15df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.872+0000 7fa1d0d5a640 1 -- 172.21.15.50:0/480189717 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc070fb0 con 0x7fa1cc157a20 2023-12-08T08:19:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.873+0000 7fa1d0d5a640 1 --2- 172.21.15.50:0/480189717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15d9d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b17f0 tx=0x7fa1c402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbad2623da9546b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.873+0000 7fa1cb7fe640 1 -- 172.21.15.50:0/480189717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c402ca70 con 0x7fa1cc157a20 2023-12-08T08:19:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.873+0000 7fa1cb7fe640 1 -- 172.21.15.50:0/480189717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c402cbd0 con 0x7fa1cc157a20 2023-12-08T08:19:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.873+0000 7fa1cb7fe640 1 -- 172.21.15.50:0/480189717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40343f0 con 0x7fa1cc157a20 2023-12-08T08:19:04.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/480189717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 msgr2=0x7fa1cc15d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/480189717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15d9d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0b17f0 tx=0x7fa1c402bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/480189717 shutdown_connections 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/480189717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc06d7d0 0x7fa1cc15e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/480189717 >> v2:172.21.15.170:3300/0 conn(0x7fa1cc0cb370 0x7fa1cc15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/480189717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15d9d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/480189717 >> 172.21.15.50:0/480189717 conn(0x7fa1cc0b0850 msgr2=0x7fa1cc0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/480189717 shutdown_connections 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.874+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/480189717 wait complete. 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.875+0000 7fa1d2fbe640 1 Processor -- start 2023-12-08T08:19:04.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.875+0000 7fa1d2fbe640 1 -- start start 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d2fbe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1cc06d7d0 0x7fa1cc155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d2fbe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc0cb370 0x7fa1cc13a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d2fbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d2fbe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc13ae90 con 0x7fa1cc157a20 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d2fbe640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc15e7c0 con 0x7fa1cc06d7d0 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d2fbe640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc156bf0 con 0x7fa1cc0cb370 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52168/0 (socket says 172.21.15.50:52168) 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 -- 172.21.15.50:0/3305599185 learned_addr learned my addr 172.21.15.50:0/3305599185 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d0d5a640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1cc06d7d0 0x7fa1cc155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1cbfff640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc0cb370 0x7fa1cc13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 -- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc0cb370 msgr2=0x7fa1cc13a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc0cb370 0x7fa1cc13a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 -- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1cc06d7d0 msgr2=0x7fa1cc155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1cc06d7d0 0x7fa1cc155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.876+0000 7fa1d155b640 1 -- 172.21.15.50:0/3305599185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009b30 con 0x7fa1cc157a20 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.877+0000 7fa1d155b640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15e280 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400c570 tx=0x7fa1b400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.877+0000 7fa1c97fa640 1 -- 172.21.15.50:0/3305599185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4004220 con 0x7fa1cc157a20 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.877+0000 7fa1c97fa640 1 -- 172.21.15.50:0/3305599185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4004380 con 0x7fa1cc157a20 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.877+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1cc156350 con 0x7fa1cc157a20 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.877+0000 7fa1c97fa640 1 -- 172.21.15.50:0/3305599185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4003830 con 0x7fa1cc157a20 2023-12-08T08:19:04.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.877+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc156910 con 0x7fa1cc157a20 2023-12-08T08:19:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.878+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc067430 con 0x7fa1cc157a20 2023-12-08T08:19:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.878+0000 7fa1c97fa640 1 -- 172.21.15.50:0/3305599185 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa1b4003990 con 0x7fa1cc157a20 2023-12-08T08:19:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.879+0000 7fa1c97fa640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa1ac06ae40 0x7fa1ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.879+0000 7fa1c97fa640 1 -- 172.21.15.50:0/3305599185 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa1b40896c0 con 0x7fa1cc157a20 2023-12-08T08:19:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.879+0000 7fa1d0d5a640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa1ac06ae40 0x7fa1ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:04.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.879+0000 7fa1d0d5a640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa1ac06ae40 0x7fa1ac06d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4035000 tx=0x7fa1c4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:04.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:04.883+0000 7fa1c97fa640 1 -- 172.21.15.50:0/3305599185 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1b4054390 con 0x7fa1cc157a20 2023-12-08T08:19:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.090+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa1cc06bfe0 con 0x7fa1cc157a20 2023-12-08T08:19:05.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.091+0000 7fa1c97fa640 1 -- 172.21.15.50:0/3305599185 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa1b40579b0 con 0x7fa1cc157a20 2023-12-08T08:19:05.093 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa1ac06ae40 msgr2=0x7fa1ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa1ac06ae40 0x7fa1ac06d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4035000 tx=0x7fa1c4030000 comp rx=0 tx=0).stop 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 msgr2=0x7fa1cc15e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15e280 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400c570 tx=0x7fa1b400ca30 comp rx=0 tx=0).stop 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 shutdown_connections 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa1ac06ae40 0x7fa1ac06d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1cc157a20 0x7fa1cc15e280 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1cc0cb370 0x7fa1cc13a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 --2- 172.21.15.50:0/3305599185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1cc06d7d0 0x7fa1cc155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 >> 172.21.15.50:0/3305599185 conn(0x7fa1cc0b0850 msgr2=0x7fa1cc0b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 shutdown_connections 2023-12-08T08:19:05.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.093+0000 7fa1d2fbe640 1 -- 172.21.15.50:0/3305599185 wait complete. 2023-12-08T08:19:05.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.211+0000 7f6a8f24f640 1 Processor -- start 2023-12-08T08:19:05.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.211+0000 7f6a8f24f640 1 -- start start 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8f24f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6a8815b0f0 0x7f6a880cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8f24f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a880cd760 0x7f6a880cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8f24f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a880cf380 con 0x7f6a880d1900 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8f24f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a880ce0d0 con 0x7f6a880cd760 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8f24f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a880cff20 con 0x7f6a8815b0f0 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8d7ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a880cd760 0x7f6a880cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8d7ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6a880cd760 0x7f6a880cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52172/0 (socket says 172.21.15.50:52172) 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/258429219 learned_addr learned my addr 172.21.15.50:0/258429219 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8cfeb640 1 --2- 172.21.15.50:0/258429219 >> v2:172.21.15.170:3300/0 conn(0x7f6a8815b0f0 0x7f6a880cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/258429219 >> v2:172.21.15.170:3300/0 conn(0x7f6a8815b0f0 msgr2=0x7f6a880cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8d7ec640 1 --2- 172.21.15.50:0/258429219 >> v2:172.21.15.170:3300/0 conn(0x7f6a8815b0f0 0x7f6a880cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/258429219 >> v1:172.21.15.170:6789/0 conn(0x7f6a880d1900 legacy=0x7f6a880cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.212+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/258429219 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880cce00 con 0x7f6a880cd760 2023-12-08T08:19:05.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.213+0000 7f6a8d7ec640 1 --2- 172.21.15.50:0/258429219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a880cd760 0x7f6a880cdb90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6a88071080 tx=0x7f6a8002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6b7cca75ef0a19 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.213+0000 7f6a877fe640 1 -- 172.21.15.50:0/258429219 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8002c9f0 con 0x7f6a880cd760 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.213+0000 7f6a877fe640 1 -- 172.21.15.50:0/258429219 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8002cb50 con 0x7f6a880cd760 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.213+0000 7f6a877fe640 1 -- 172.21.15.50:0/258429219 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800343f0 con 0x7f6a880cd760 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 -- 172.21.15.50:0/258429219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a880cd760 msgr2=0x7f6a880cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/258429219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a880cd760 0x7f6a880cdb90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6a88071080 tx=0x7f6a8002be50 comp rx=0 tx=0).stop 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 -- 172.21.15.50:0/258429219 shutdown_connections 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/258429219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a880cd760 0x7f6a880cdb90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/258429219 >> v2:172.21.15.170:3300/0 conn(0x7f6a8815b0f0 0x7f6a880cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 -- 172.21.15.50:0/258429219 >> 172.21.15.50:0/258429219 conn(0x7f6a880d0de0 msgr2=0x7f6a880d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 -- 172.21.15.50:0/258429219 shutdown_connections 2023-12-08T08:19:05.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.214+0000 7f6a8f24f640 1 -- 172.21.15.50:0/258429219 wait complete. 2023-12-08T08:19:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.215+0000 7f6a8f24f640 1 Processor -- start 2023-12-08T08:19:05.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.215+0000 7f6a8f24f640 1 -- start start 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8f24f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a880cd760 0x7f6a8809e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8f24f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a880d1900 0x7f6a8809b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8f24f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a8815b0f0 0x7f6a881539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8f24f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8809d600 con 0x7f6a8815b0f0 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8f24f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8809d8e0 con 0x7f6a880d1900 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8f24f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8809dbc0 con 0x7f6a880cd760 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a8815b0f0 0x7f6a881539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a8815b0f0 0x7f6a881539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52176/0 (socket says 172.21.15.50:52176) 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/1045089890 learned_addr learned my addr 172.21.15.50:0/1045089890 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a87fff640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a880d1900 0x7f6a8809b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8cfeb640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a880cd760 0x7f6a8809e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a880cd760 msgr2=0x7f6a8809e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a880cd760 0x7f6a8809e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a880d1900 msgr2=0x7f6a8809b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a880d1900 0x7f6a8809b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 -- 172.21.15.50:0/1045089890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009b30 con 0x7f6a8815b0f0 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8cfeb640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a880cd760 0x7f6a8809e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a87fff640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a880d1900 0x7f6a8809b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.216+0000 7f6a8d7ec640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a8815b0f0 0x7f6a881539c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6a80036040 tx=0x7f6a80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.217+0000 7f6a857fa640 1 -- 172.21.15.50:0/1045089890 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80009510 con 0x7f6a8815b0f0 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.217+0000 7f6a857fa640 1 -- 172.21.15.50:0/1045089890 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8003e450 con 0x7f6a8815b0f0 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.217+0000 7f6a857fa640 1 -- 172.21.15.50:0/1045089890 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8003e800 con 0x7f6a8815b0f0 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.217+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8809dea0 con 0x7f6a8815b0f0 2023-12-08T08:19:05.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.217+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8809bf10 con 0x7f6a8815b0f0 2023-12-08T08:19:05.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.218+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a88067430 con 0x7f6a8815b0f0 2023-12-08T08:19:05.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.218+0000 7f6a857fa640 1 -- 172.21.15.50:0/1045089890 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a8003e960 con 0x7f6a8815b0f0 2023-12-08T08:19:05.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.219+0000 7f6a857fa640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6a6c06ae40 0x7f6a6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.219+0000 7f6a857fa640 1 -- 172.21.15.50:0/1045089890 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6a800ac710 con 0x7f6a8815b0f0 2023-12-08T08:19:05.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.219+0000 7f6a8cfeb640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6a6c06ae40 0x7f6a6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.219+0000 7f6a8cfeb640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6a6c06ae40 0x7f6a6c06d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c006fd0 tx=0x7f6a7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.223+0000 7f6a857fa640 1 -- 172.21.15.50:0/1045089890 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a80077470 con 0x7f6a8815b0f0 2023-12-08T08:19:05.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.411+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a8809d740 con 0x7f6a8815b0f0 2023-12-08T08:19:05.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.411+0000 7f6a857fa640 1 -- 172.21.15.50:0/1045089890 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a8809d740 con 0x7f6a8815b0f0 2023-12-08T08:19:05.413 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:05.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6a6c06ae40 msgr2=0x7f6a6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6a6c06ae40 0x7f6a6c06d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c006fd0 tx=0x7f6a7c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a8815b0f0 msgr2=0x7f6a881539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a8815b0f0 0x7f6a881539c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6a80036040 tx=0x7f6a80004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 shutdown_connections 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6a6c06ae40 0x7f6a6c06d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a8815b0f0 0x7f6a881539c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a880d1900 0x7f6a8809b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 --2- 172.21.15.50:0/1045089890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a880cd760 0x7f6a8809e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 >> 172.21.15.50:0/1045089890 conn(0x7f6a880d0de0 msgr2=0x7f6a880d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 shutdown_connections 2023-12-08T08:19:05.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.413+0000 7f6a8f24f640 1 -- 172.21.15.50:0/1045089890 wait complete. 2023-12-08T08:19:05.426 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi170.front.sepia.ceph.com... 2023-12-08T08:19:05.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:05.427 DEBUG:teuthology.orchestra.run.smithi170:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-08T08:19:05.459 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:05.459 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:19:05.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:05.460 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-08T08:19:05.517 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-08T08:19:05.517 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.622+0000 7f113ed0c640 1 Processor -- start 2023-12-08T08:19:05.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.622+0000 7f113ed0c640 1 -- start start 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.622+0000 7f113ed0c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f11380cf380 0x7f113806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f113ed0c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11380cf760 0x7f1138161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f113ed0c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1138071b80 0x7f11380acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f113ed0c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11380d0d00 con 0x7f11380cf760 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f113ed0c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1138161bd0 con 0x7f11380cf380 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f113ed0c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113806b070 con 0x7f1138071b80 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11380cf760 0x7f1138161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11380cf760 0x7f1138161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52178/0 (socket says 172.21.15.50:52178) 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 -- 172.21.15.50:0/3942619380 learned_addr learned my addr 172.21.15.50:0/3942619380 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:05.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f113d2a9640 1 --2- 172.21.15.50:0/3942619380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1138071b80 0x7f11380acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f113caa8640 1 --2- 172.21.15.50:0/3942619380 >> v2:172.21.15.170:3300/0 conn(0x7f11380cf380 0x7f113806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 -- 172.21.15.50:0/3942619380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1138071b80 msgr2=0x7f11380acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 --2- 172.21.15.50:0/3942619380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1138071b80 0x7f11380acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 -- 172.21.15.50:0/3942619380 >> v2:172.21.15.170:3300/0 conn(0x7f11380cf380 msgr2=0x7f113806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 --2- 172.21.15.50:0/3942619380 >> v2:172.21.15.170:3300/0 conn(0x7f11380cf380 0x7f113806a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.623+0000 7f1137fff640 1 -- 172.21.15.50:0/3942619380 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113806aab0 con 0x7f11380cf760 2023-12-08T08:19:05.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.624+0000 7f1137fff640 1 --2- 172.21.15.50:0/3942619380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11380cf760 0x7f1138161690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f11380cfd00 tx=0x7f112002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6438fc72a1a93fa5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.624+0000 7f11377fe640 1 -- 172.21.15.50:0/3942619380 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200317c0 con 0x7f11380cf760 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.624+0000 7f11377fe640 1 -- 172.21.15.50:0/3942619380 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120031920 con 0x7f11380cf760 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.624+0000 7f11377fe640 1 -- 172.21.15.50:0/3942619380 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120031cb0 con 0x7f11380cf760 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.624+0000 7f113ed0c640 1 -- 172.21.15.50:0/3942619380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11380cf760 msgr2=0x7f1138161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.624+0000 7f113ed0c640 1 --2- 172.21.15.50:0/3942619380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11380cf760 0x7f1138161690 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f11380cfd00 tx=0x7f112002b860 comp rx=0 tx=0).stop 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.625+0000 7f113ed0c640 1 -- 172.21.15.50:0/3942619380 shutdown_connections 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.625+0000 7f113ed0c640 1 --2- 172.21.15.50:0/3942619380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1138071b80 0x7f11380acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.625+0000 7f113ed0c640 1 --2- 172.21.15.50:0/3942619380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11380cf760 0x7f1138161690 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.625+0000 7f113ed0c640 1 --2- 172.21.15.50:0/3942619380 >> v2:172.21.15.170:3300/0 conn(0x7f11380cf380 0x7f113806a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.625+0000 7f113ed0c640 1 -- 172.21.15.50:0/3942619380 >> 172.21.15.50:0/3942619380 conn(0x7f11380cfda0 msgr2=0x7f11380d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.625+0000 7f113ed0c640 1 -- 172.21.15.50:0/3942619380 shutdown_connections 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.625+0000 7f113ed0c640 1 -- 172.21.15.50:0/3942619380 wait complete. 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.626+0000 7f113ed0c640 1 Processor -- start 2023-12-08T08:19:05.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.626+0000 7f113ed0c640 1 -- start start 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113ed0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1138071b80 0x7f11380adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113ed0c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11380cf380 0x7f11380ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113ed0c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11380cf760 0x7f11380caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113ed0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380b2b60 con 0x7f1138071b80 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113ed0c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380b3120 con 0x7f11380cf760 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113ed0c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11380cb810 con 0x7f11380cf380 2023-12-08T08:19:05.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1138071b80 0x7f11380adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1138071b80 0x7f11380adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52180/0 (socket says 172.21.15.50:52180) 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 -- 172.21.15.50:0/1348716123 learned_addr learned my addr 172.21.15.50:0/1348716123 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113d2a9640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11380cf760 0x7f11380caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f1137fff640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11380cf380 0x7f11380ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 -- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11380cf380 msgr2=0x7f11380ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11380cf380 0x7f11380ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 -- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11380cf760 msgr2=0x7f11380caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11380cf760 0x7f11380caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 -- 172.21.15.50:0/1348716123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200094d0 con 0x7f1138071b80 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113caa8640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1138071b80 0x7f11380adda0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1130007f20 tx=0x7f113000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f11357fa640 1 -- 172.21.15.50:0/1348716123 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130014620 con 0x7f1138071b80 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f11357fa640 1 -- 172.21.15.50:0/1348716123 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130014780 con 0x7f1138071b80 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.627+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11380cbaf0 con 0x7f1138071b80 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.628+0000 7f11357fa640 1 -- 172.21.15.50:0/1348716123 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130014b30 con 0x7f1138071b80 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.628+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113814aaf0 con 0x7f1138071b80 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.628+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113814ad40 con 0x7f1138071b80 2023-12-08T08:19:05.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.629+0000 7f11357fa640 1 -- 172.21.15.50:0/1348716123 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1130014c90 con 0x7f1138071b80 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.629+0000 7f11357fa640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f111806ae40 0x7f111806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.630+0000 7f11357fa640 1 -- 172.21.15.50:0/1348716123 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f113008a1e0 con 0x7f1138071b80 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.630+0000 7f1137fff640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f111806ae40 0x7f111806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.630+0000 7f1137fff640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f111806ae40 0x7f111806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1120036000 tx=0x7f112003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.634+0000 7f11357fa640 1 -- 172.21.15.50:0/1348716123 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1130054ff0 con 0x7f1138071b80 2023-12-08T08:19:05.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.845+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1138067430 con 0x7f1138071b80 2023-12-08T08:19:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.846+0000 7f11357fa640 1 -- 172.21.15.50:0/1348716123 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f1130058610 con 0x7f1138071b80 2023-12-08T08:19:05.848 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:05.848 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:19:05.848 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:19:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f111806ae40 msgr2=0x7f111806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f111806ae40 0x7f111806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1120036000 tx=0x7f112003d040 comp rx=0 tx=0).stop 2023-12-08T08:19:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1138071b80 msgr2=0x7f11380adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1138071b80 0x7f11380adda0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1130007f20 tx=0x7f113000e570 comp rx=0 tx=0).stop 2023-12-08T08:19:05.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 shutdown_connections 2023-12-08T08:19:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f111806ae40 0x7f111806d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11380cf760 0x7f11380caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f11380cf380 0x7f11380ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 --2- 172.21.15.50:0/1348716123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1138071b80 0x7f11380adda0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 >> 172.21.15.50:0/1348716123 conn(0x7f11380cfda0 msgr2=0x7f1138160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 shutdown_connections 2023-12-08T08:19:05.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.848+0000 7f113ed0c640 1 -- 172.21.15.50:0/1348716123 wait complete. 2023-12-08T08:19:05.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.971+0000 7fac67b2c640 1 Processor -- start 2023-12-08T08:19:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.971+0000 7fac67b2c640 1 -- start start 2023-12-08T08:19:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.972+0000 7fac67b2c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac60072630 0x7fac6006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.972+0000 7fac67b2c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6015d700 con 0x7fac60157950 2023-12-08T08:19:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.972+0000 7fac67b2c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6015d9c0 con 0x7fac6006abe0 2023-12-08T08:19:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.972+0000 7fac67b2c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6015dca0 con 0x7fac60072630 2023-12-08T08:19:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.972+0000 7fac660c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fac60072630 0x7fac6006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.972+0000 7fac658c8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fac60157950 0x7fac6006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59716/0 (socket says 172.21.15.50:59716) 2023-12-08T08:19:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.972+0000 7fac658c8640 1 -- 172.21.15.50:0/969349935 learned_addr learned my addr 172.21.15.50:0/969349935 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.973+0000 7fac660c9640 1 -- 172.21.15.50:0/969349935 >> v1:172.21.15.170:6789/0 conn(0x7fac6006abe0 legacy=0x7fac60071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.973+0000 7fac660c9640 1 -- 172.21.15.50:0/969349935 >> v1:172.21.15.50:6789/0 conn(0x7fac60157950 legacy=0x7fac6006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.973+0000 7fac660c9640 1 -- 172.21.15.50:0/969349935 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6015df80 con 0x7fac60072630 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.973+0000 7fac648c6640 1 -- 172.21.15.50:0/969349935 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624234275 0 0) 0x7fac6015d700 con 0x7fac60157950 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.973+0000 7fac660c9640 1 --2- 172.21.15.50:0/969349935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60072630 0x7fac6006e8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fac580097a0 tx=0x7fac5802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cf1bdfeb2203b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac648c6640 1 -- 172.21.15.50:0/969349935 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5802f050 con 0x7fac60072630 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac648c6640 1 -- 172.21.15.50:0/969349935 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac58031700 con 0x7fac60072630 2023-12-08T08:19:05.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac648c6640 1 -- 172.21.15.50:0/969349935 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58031a90 con 0x7fac60072630 2023-12-08T08:19:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac67b2c640 1 -- 172.21.15.50:0/969349935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60072630 msgr2=0x7fac6006e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac67b2c640 1 --2- 172.21.15.50:0/969349935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60072630 0x7fac6006e8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fac580097a0 tx=0x7fac5802b7a0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac67b2c640 1 -- 172.21.15.50:0/969349935 shutdown_connections 2023-12-08T08:19:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac67b2c640 1 --2- 172.21.15.50:0/969349935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60072630 0x7fac6006e8f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac67b2c640 1 -- 172.21.15.50:0/969349935 >> 172.21.15.50:0/969349935 conn(0x7fac600cff90 msgr2=0x7fac600d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac67b2c640 1 -- 172.21.15.50:0/969349935 shutdown_connections 2023-12-08T08:19:05.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.974+0000 7fac67b2c640 1 -- 172.21.15.50:0/969349935 wait complete. 2023-12-08T08:19:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.975+0000 7fac67b2c640 1 Processor -- start 2023-12-08T08:19:05.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.975+0000 7fac67b2c640 1 -- start start 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac67b2c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac6006abe0 0x7fac60149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac67b2c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac60072630 0x7fac600ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac67b2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60157950 0x7fac600ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac67b2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac60155f90 con 0x7fac60157950 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac67b2c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac60149580 con 0x7fac60072630 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac67b2c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac60154ef0 con 0x7fac6006abe0 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac660c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60157950 0x7fac600ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac660c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60157950 0x7fac600ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52188/0 (socket says 172.21.15.50:52188) 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.976+0000 7fac660c9640 1 -- 172.21.15.50:0/730788177 learned_addr learned my addr 172.21.15.50:0/730788177 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac660c9640 1 -- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac6006abe0 msgr2=0x7fac60149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac658c8640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac6006abe0 0x7fac60149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac660c9640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac6006abe0 0x7fac60149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac660c9640 1 -- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac60072630 msgr2=0x7fac600ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac650c7640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac60072630 0x7fac600ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac660c9640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac60072630 0x7fac600ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac660c9640 1 -- 172.21.15.50:0/730788177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58009400 con 0x7fac60157950 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac660c9640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60157950 0x7fac600ced10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fac580097a0 tx=0x7fac580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac5e7fc640 1 -- 172.21.15.50:0/730788177 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58033c70 con 0x7fac60157950 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac5e7fc640 1 -- 172.21.15.50:0/730788177 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac58033dd0 con 0x7fac60157950 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac601551d0 con 0x7fac60157950 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac5e7fc640 1 -- 172.21.15.50:0/730788177 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5803d6b0 con 0x7fac60157950 2023-12-08T08:19:05.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.977+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac60155790 con 0x7fac60157950 2023-12-08T08:19:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.978+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac60067ad0 con 0x7fac60157950 2023-12-08T08:19:05.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.979+0000 7fac5e7fc640 1 -- 172.21.15.50:0/730788177 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac5803a040 con 0x7fac60157950 2023-12-08T08:19:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.979+0000 7fac5e7fc640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fac4c06ae40 0x7fac4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.979+0000 7fac5e7fc640 1 -- 172.21.15.50:0/730788177 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fac580ab9c0 con 0x7fac60157950 2023-12-08T08:19:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.979+0000 7fac658c8640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fac4c06ae40 0x7fac4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:05.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.980+0000 7fac658c8640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fac4c06ae40 0x7fac4c06d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fac500012e0 tx=0x7fac50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:05.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:05.983+0000 7fac5e7fc640 1 -- 172.21.15.50:0/730788177 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac58076570 con 0x7fac60157950 2023-12-08T08:19:06.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.162+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac600af9d0 con 0x7fac60157950 2023-12-08T08:19:06.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.163+0000 7fac5e7fc640 1 -- 172.21.15.50:0/730788177 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7fac58079b90 con 0x7fac60157950 2023-12-08T08:19:06.166 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:06.166 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fac4c06ae40 msgr2=0x7fac4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fac4c06ae40 0x7fac4c06d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fac500012e0 tx=0x7fac50009040 comp rx=0 tx=0).stop 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60157950 msgr2=0x7fac600ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60157950 0x7fac600ced10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fac580097a0 tx=0x7fac580046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 shutdown_connections 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fac4c06ae40 0x7fac4c06d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fac60157950 0x7fac600ced10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac60072630 0x7fac600ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 --2- 172.21.15.50:0/730788177 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac6006abe0 0x7fac60149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 >> 172.21.15.50:0/730788177 conn(0x7fac600cff90 msgr2=0x7fac600ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 shutdown_connections 2023-12-08T08:19:06.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.165+0000 7fac67b2c640 1 -- 172.21.15.50:0/730788177 wait complete. 2023-12-08T08:19:06.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:17:55.091059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:17:56.181435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-08T08:17:59.893782+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-08T08:19:06.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 Processor -- start 2023-12-08T08:19:06.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 -- start start 2023-12-08T08:19:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd340cd3d0 0x7fbd340712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd3406d6a0 0x7fbd340cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbd340cdcf0 0x7fbd340700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3406d280 con 0x7fbd340cd3d0 2023-12-08T08:19:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd34071800 con 0x7fbd340cdcf0 2023-12-08T08:19:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.286+0000 7fbd39c10640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3406c8e0 con 0x7fbd3406d6a0 2023-12-08T08:19:06.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd340cd3d0 0x7fbd340712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbd340cd3d0 0x7fbd340712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52202/0 (socket says 172.21.15.50:52202) 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 -- 172.21.15.50:0/1756872638 learned_addr learned my addr 172.21.15.50:0/1756872638 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd33fff640 1 --2- 172.21.15.50:0/1756872638 >> v2:172.21.15.170:3300/0 conn(0x7fbd340cdcf0 0x7fbd340700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 -- 172.21.15.50:0/1756872638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd3406d6a0 msgr2=0x7fbd340cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd2affd640 1 --2- 172.21.15.50:0/1756872638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd3406d6a0 0x7fbd340cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 --2- 172.21.15.50:0/1756872638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd3406d6a0 0x7fbd340cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 -- 172.21.15.50:0/1756872638 >> v2:172.21.15.170:3300/0 conn(0x7fbd340cdcf0 msgr2=0x7fbd340700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 --2- 172.21.15.50:0/1756872638 >> v2:172.21.15.170:3300/0 conn(0x7fbd340cdcf0 0x7fbd340700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd337fe640 1 -- 172.21.15.50:0/1756872638 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3406cbc0 con 0x7fbd340cd3d0 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.287+0000 7fbd33fff640 1 --2- 172.21.15.50:0/1756872638 >> v2:172.21.15.170:3300/0 conn(0x7fbd340cdcf0 0x7fbd340700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd337fe640 1 --2- 172.21.15.50:0/1756872638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cd3d0 0x7fbd340712c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009870 tx=0x7fbd2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4f27f9bc56e951 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd32ffd640 1 -- 172.21.15.50:0/1756872638 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24031640 con 0x7fbd340cd3d0 2023-12-08T08:19:06.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd32ffd640 1 -- 172.21.15.50:0/1756872638 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd240317a0 con 0x7fbd340cd3d0 2023-12-08T08:19:06.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd32ffd640 1 -- 172.21.15.50:0/1756872638 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24031b30 con 0x7fbd340cd3d0 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 -- 172.21.15.50:0/1756872638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cd3d0 msgr2=0x7fbd340712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 --2- 172.21.15.50:0/1756872638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cd3d0 0x7fbd340712c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009870 tx=0x7fbd2402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 -- 172.21.15.50:0/1756872638 shutdown_connections 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 --2- 172.21.15.50:0/1756872638 >> v2:172.21.15.170:3300/0 conn(0x7fbd340cdcf0 0x7fbd340700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 --2- 172.21.15.50:0/1756872638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd3406d6a0 0x7fbd340cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 --2- 172.21.15.50:0/1756872638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cd3d0 0x7fbd340712c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 -- 172.21.15.50:0/1756872638 >> 172.21.15.50:0/1756872638 conn(0x7fbd340b0850 msgr2=0x7fbd340b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 -- 172.21.15.50:0/1756872638 shutdown_connections 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.288+0000 7fbd39c10640 1 -- 172.21.15.50:0/1756872638 wait complete. 2023-12-08T08:19:06.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.290+0000 7fbd39c10640 1 Processor -- start 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.290+0000 7fbd39c10640 1 -- start start 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.290+0000 7fbd39c10640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406d6a0 0x7fbd340b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.290+0000 7fbd39c10640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd340cd3d0 0x7fbd3413c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.290+0000 7fbd39c10640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cdcf0 0x7fbd3413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd39c10640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340b21a0 con 0x7fbd340cdcf0 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd39c10640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340b2480 con 0x7fbd3406d6a0 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd39c10640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340b2760 con 0x7fbd340cd3d0 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cdcf0 0x7fbd3413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cdcf0 0x7fbd3413c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52216/0 (socket says 172.21.15.50:52216) 2023-12-08T08:19:06.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 -- 172.21.15.50:0/767828800 learned_addr learned my addr 172.21.15.50:0/767828800 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd2affd640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd340cd3d0 0x7fbd3413c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd337fe640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406d6a0 0x7fbd340b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 -- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd340cd3d0 msgr2=0x7fbd3413c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd340cd3d0 0x7fbd3413c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 -- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406d6a0 msgr2=0x7fbd340b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406d6a0 0x7fbd340b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 -- 172.21.15.50:0/767828800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240094d0 con 0x7fbd340cdcf0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd33fff640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cdcf0 0x7fbd3413c9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00cd50 tx=0x7fbd2c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd30ff9640 1 -- 172.21.15.50:0/767828800 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00f680 con 0x7fbd340cdcf0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd30ff9640 1 -- 172.21.15.50:0/767828800 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c00f800 con 0x7fbd340cdcf0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd340b2a40 con 0x7fbd340cdcf0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd30ff9640 1 -- 172.21.15.50:0/767828800 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00fbb0 con 0x7fbd340cdcf0 2023-12-08T08:19:06.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.291+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd340b3780 con 0x7fbd340cdcf0 2023-12-08T08:19:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.292+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd340b2f60 con 0x7fbd340cdcf0 2023-12-08T08:19:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.293+0000 7fbd30ff9640 1 -- 172.21.15.50:0/767828800 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd2c00b040 con 0x7fbd340cdcf0 2023-12-08T08:19:06.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.293+0000 7fbd30ff9640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1406ae40 0x7fbd1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.293+0000 7fbd30ff9640 1 -- 172.21.15.50:0/767828800 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbd2c08a240 con 0x7fbd340cdcf0 2023-12-08T08:19:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.293+0000 7fbd337fe640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1406ae40 0x7fbd1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.294+0000 7fbd337fe640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1406ae40 0x7fbd1406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd24036000 tx=0x7fbd2403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.297+0000 7fbd30ff9640 1 -- 172.21.15.50:0/767828800 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd340b2f60 con 0x7fbd340cdcf0 2023-12-08T08:19:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.471+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd340b2f60 con 0x7fbd340cdcf0 2023-12-08T08:19:06.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.472+0000 7fbd30ff9640 1 -- 172.21.15.50:0/767828800 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd340b2f60 con 0x7fbd340cdcf0 2023-12-08T08:19:06.474 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1406ae40 msgr2=0x7fbd1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1406ae40 0x7fbd1406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbd24036000 tx=0x7fbd2403c040 comp rx=0 tx=0).stop 2023-12-08T08:19:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cdcf0 msgr2=0x7fbd3413c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cdcf0 0x7fbd3413c9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00cd50 tx=0x7fbd2c00a650 comp rx=0 tx=0).stop 2023-12-08T08:19:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 shutdown_connections 2023-12-08T08:19:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbd1406ae40 0x7fbd1406d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbd340cdcf0 0x7fbd3413c9c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd340cd3d0 0x7fbd3413c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 --2- 172.21.15.50:0/767828800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd3406d6a0 0x7fbd340b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.473+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 >> 172.21.15.50:0/767828800 conn(0x7fbd340b0850 msgr2=0x7fbd3406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.474+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 shutdown_connections 2023-12-08T08:19:06.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.474+0000 7fbd39c10640 1 -- 172.21.15.50:0/767828800 wait complete. 2023-12-08T08:19:06.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:06.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.594+0000 7fb79530f640 1 Processor -- start 2023-12-08T08:19:06.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.594+0000 7fb79530f640 1 -- start start 2023-12-08T08:19:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb79530f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 0x7fb7900cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb79530f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7900705b0 con 0x7fb7900c9660 2023-12-08T08:19:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb79530f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7900ac6f0 con 0x7fb790162b00 2023-12-08T08:19:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb79530f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79015b480 con 0x7fb79006c7c0 2023-12-08T08:19:06.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb7867fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb7900c9660 0x7fb79006cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59718/0 (socket says 172.21.15.50:59718) 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb7867fc640 1 -- 172.21.15.50:0/3924591903 learned_addr learned my addr 172.21.15.50:0/3924591903 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78effd640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 0x7fb7900cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998145159 0 0) 0x7fb7900705b0 con 0x7fb7900c9660 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77c003520 con 0x7fb7900c9660 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3195690926 0 0) 0x7fb77c003520 con 0x7fb7900c9660 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 msgr2=0x7fb7900cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 0x7fb7900cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 >> v1:172.21.15.170:6789/0 conn(0x7fb790162b00 legacy=0x7fb790164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7900cb680 con 0x7fb7900c9660 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fb778001670 con 0x7fb7900c9660 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 >> v1:172.21.15.50:6789/0 conn(0x7fb7900c9660 legacy=0x7fb79006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb77c0039a0 0x7fb77c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77c004350 0x7fb77c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 0x7fb77c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79015b480 con 0x7fb77c004350 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c00b980 con 0x7fb77c0039a0 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c00bb40 con 0x7fb79006c7c0 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.595+0000 7fb7867fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77c004350 0x7fb77c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb78effd640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb77c0039a0 0x7fb77c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb78f7fe640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 0x7fb77c005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb7867fc640 1 -- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 msgr2=0x7fb77c005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb7867fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb79006c7c0 0x7fb77c005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb7867fc640 1 -- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb77c0039a0 msgr2=0x7fb77c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb7867fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb77c0039a0 0x7fb77c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb7867fc640 1 -- 172.21.15.50:0/3924591903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c003520 con 0x7fb77c004350 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.596+0000 7fb78effd640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb77c0039a0 0x7fb77c003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb7867fc640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77c004350 0x7fb77c004820 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c210 tx=0x7fb77c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b6c79c86fc12be server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778005ad0 con 0x7fb77c004350 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb778005c50 con 0x7fb77c004350 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb78e7fc640 1 -- 172.21.15.50:0/3924591903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77802c8d0 con 0x7fb77c004350 2023-12-08T08:19:06.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb79530f640 1 -- 172.21.15.50:0/3924591903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77c004350 msgr2=0x7fb77c004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb79530f640 1 --2- 172.21.15.50:0/3924591903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb77c004350 0x7fb77c004820 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c210 tx=0x7fb77c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb78f7fe640 1 -- 172.21.15.50:0/3924591903 reap_dead start 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb79530f640 1 -- 172.21.15.50:0/3924591903 shutdown_connections 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb79530f640 1 -- 172.21.15.50:0/3924591903 >> 172.21.15.50:0/3924591903 conn(0x7fb7900cf010 msgr2=0x7fb7900cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb79530f640 1 -- 172.21.15.50:0/3924591903 shutdown_connections 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.597+0000 7fb79530f640 1 -- 172.21.15.50:0/3924591903 wait complete. 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.598+0000 7fb79530f640 1 Processor -- start 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.599+0000 7fb79530f640 1 -- start start 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.599+0000 7fb79530f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77c004350 0x7fb790153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.599+0000 7fb79530f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901503e0 0x7fb7900af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.599+0000 7fb79530f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7900afc40 0x7fb79014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.599+0000 7fb79530f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900ce1d0 con 0x7fb7901503e0 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.599+0000 7fb79530f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b00d0 con 0x7fb7900afc40 2023-12-08T08:19:06.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.599+0000 7fb79530f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901509a0 con 0x7fb77c004350 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901503e0 0x7fb7900af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901503e0 0x7fb7900af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52240/0 (socket says 172.21.15.50:52240) 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 -- 172.21.15.50:0/2230537690 learned_addr learned my addr 172.21.15.50:0/2230537690 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb78f7fe640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7900afc40 0x7fb79014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb78effd640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77c004350 0x7fb790153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 -- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77c004350 msgr2=0x7fb790153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77c004350 0x7fb790153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 -- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7900afc40 msgr2=0x7fb79014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7900afc40 0x7fb79014f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 -- 172.21.15.50:0/2230537690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790152100 con 0x7fb7901503e0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb78f7fe640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7900afc40 0x7fb79014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb7867fc640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901503e0 0x7fb7900af700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb778001930 tx=0x7fb778001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb787fff640 1 -- 172.21.15.50:0/2230537690 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778039070 con 0x7fb7901503e0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb787fff640 1 -- 172.21.15.50:0/2230537690 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77802cce0 con 0x7fb7901503e0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7901523e0 con 0x7fb7901503e0 2023-12-08T08:19:06.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb787fff640 1 -- 172.21.15.50:0/2230537690 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77803c040 con 0x7fb7901503e0 2023-12-08T08:19:06.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.600+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb790152fc0 con 0x7fb7901503e0 2023-12-08T08:19:06.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.601+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7900ce310 con 0x7fb7901503e0 2023-12-08T08:19:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.602+0000 7fb787fff640 1 -- 172.21.15.50:0/2230537690 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb778032070 con 0x7fb7901503e0 2023-12-08T08:19:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.602+0000 7fb787fff640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb77006ae40 0x7fb77006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.602+0000 7fb787fff640 1 -- 172.21.15.50:0/2230537690 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb7780aad90 con 0x7fb7901503e0 2023-12-08T08:19:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.602+0000 7fb78effd640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb77006ae40 0x7fb77006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.603+0000 7fb78effd640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb77006ae40 0x7fb77006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b5130 tx=0x7fb780008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.609 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.606+0000 7fb787fff640 1 -- 172.21.15.50:0/2230537690 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7900ce310 con 0x7fb7901503e0 2023-12-08T08:19:06.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.783+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7900ce310 con 0x7fb7901503e0 2023-12-08T08:19:06.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.783+0000 7fb787fff640 1 -- 172.21.15.50:0/2230537690 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7900ce310 con 0x7fb7901503e0 2023-12-08T08:19:06.786 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb77006ae40 msgr2=0x7fb77006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb77006ae40 0x7fb77006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b5130 tx=0x7fb780008040 comp rx=0 tx=0).stop 2023-12-08T08:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901503e0 msgr2=0x7fb7900af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901503e0 0x7fb7900af700 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb778001930 tx=0x7fb778001a00 comp rx=0 tx=0).stop 2023-12-08T08:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 shutdown_connections 2023-12-08T08:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb77006ae40 0x7fb77006d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb7901503e0 0x7fb7900af700 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7900afc40 0x7fb79014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 --2- 172.21.15.50:0/2230537690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77c004350 0x7fb790153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 >> 172.21.15.50:0/2230537690 conn(0x7fb7900cf010 msgr2=0x7fb7900aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:06.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 shutdown_connections 2023-12-08T08:19:06.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.786+0000 7fb79530f640 1 -- 172.21.15.50:0/2230537690 wait complete. 2023-12-08T08:19:06.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:06.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.906+0000 7fc52a45d640 1 Processor -- start 2023-12-08T08:19:06.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.906+0000 7fc52a45d640 1 -- start start 2023-12-08T08:19:06.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc52a45d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc5240b0af0 0x7fc5240b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc52a45d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 0x7fc5240cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc52a45d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240b2280 con 0x7fc52415d4f0 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc52a45d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52406bb40 con 0x7fc5240b0af0 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc52a45d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240b1430 con 0x7fc5240cef90 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc523fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc52415d4f0 0x7fc5240b03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59730/0 (socket says 172.21.15.50:59730) 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc523fff640 1 -- 172.21.15.50:0/223314788 learned_addr learned my addr 172.21.15.50:0/223314788 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc5237fe640 1 --2- 172.21.15.50:0/223314788 >> v2:172.21.15.170:3300/0 conn(0x7fc5240b0af0 0x7fc5240b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc5289fa640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 0x7fc5240cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36324473 0 0) 0x7fc5240b2280 con 0x7fc52415d4f0 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.907+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc50c003520 con 0x7fc52415d4f0 2023-12-08T08:19:06.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823230600 0 0) 0x7fc50c003520 con 0x7fc52415d4f0 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 msgr2=0x7fc5240cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 0x7fc5240cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 >> v2:172.21.15.170:3300/0 conn(0x7fc5240b0af0 msgr2=0x7fc5240b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 --2- 172.21.15.50:0/223314788 >> v2:172.21.15.170:3300/0 conn(0x7fc5240b0af0 0x7fc5240b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240b2710 con 0x7fc52415d4f0 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fc518001670 con 0x7fc52415d4f0 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5289fa640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 0x7fc5240cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 >> v1:172.21.15.50:6789/0 conn(0x7fc52415d4f0 legacy=0x7fc5240b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 0x7fc50c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc50c003eb0 0x7fc50c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc50c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52406bb40 con 0x7fc50c004d00 2023-12-08T08:19:06.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240b1430 con 0x7fc50c003eb0 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c00b980 con 0x7fc5240cef90 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5237fe640 1 --2- 172.21.15.50:0/223314788 >> v2:172.21.15.170:3300/0 conn(0x7fc5240b0af0 0x7fc5240b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5289fa640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc50c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc523fff640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 0x7fc50c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5237fe640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc50c003eb0 0x7fc50c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5289fa640 1 -- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 msgr2=0x7fc50c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5289fa640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5240cef90 0x7fc50c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5289fa640 1 -- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc50c003eb0 msgr2=0x7fc50c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5289fa640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc50c003eb0 0x7fc50c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.908+0000 7fc5289fa640 1 -- 172.21.15.50:0/223314788 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c009a70 con 0x7fc50c004d00 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.909+0000 7fc5289fa640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc50c005180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00e350 tx=0x7fc50c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ed95f2cca2152 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.909+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c02cd70 con 0x7fc50c004d00 2023-12-08T08:19:06.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.909+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00f040 con 0x7fc50c004d00 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.909+0000 7fc522ffd640 1 -- 172.21.15.50:0/223314788 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c034640 con 0x7fc50c004d00 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.909+0000 7fc52a45d640 1 -- 172.21.15.50:0/223314788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 msgr2=0x7fc50c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.909+0000 7fc52a45d640 1 --2- 172.21.15.50:0/223314788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc50c005180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00e350 tx=0x7fc50c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.909+0000 7fc5289fa640 1 -- 172.21.15.50:0/223314788 reap_dead start 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.910+0000 7fc52a45d640 1 -- 172.21.15.50:0/223314788 shutdown_connections 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.910+0000 7fc52a45d640 1 -- 172.21.15.50:0/223314788 >> 172.21.15.50:0/223314788 conn(0x7fc5240d0e00 msgr2=0x7fc5240d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.910+0000 7fc52a45d640 1 -- 172.21.15.50:0/223314788 shutdown_connections 2023-12-08T08:19:06.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.910+0000 7fc52a45d640 1 -- 172.21.15.50:0/223314788 wait complete. 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.911+0000 7fc52a45d640 1 Processor -- start 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.911+0000 7fc52a45d640 1 -- start start 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc52a45d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc52409acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc52a45d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc524149240 0x7fc524147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc52a45d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5240c5e70 0x7fc5240c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc52a45d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240c6830 con 0x7fc50c004d00 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc52a45d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241499e0 con 0x7fc5240c5e70 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc52a45d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc524149cc0 con 0x7fc524149240 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc52409acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc52409acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52264/0 (socket says 172.21.15.50:52264) 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 -- 172.21.15.50:0/1153644636 learned_addr learned my addr 172.21.15.50:0/1153644636 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc5289fa640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5240c5e70 0x7fc5240c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc5237fe640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc524149240 0x7fc524147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 -- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc524149240 msgr2=0x7fc524147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc524149240 0x7fc524147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 -- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5240c5e70 msgr2=0x7fc5240c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5240c5e70 0x7fc5240c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 -- 172.21.15.50:0/1153644636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc524149fa0 con 0x7fc50c004d00 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc523fff640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc52409acd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc518007310 tx=0x7fc5180077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc520ff9640 1 -- 172.21.15.50:0/1153644636 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51800fa20 con 0x7fc50c004d00 2023-12-08T08:19:06.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc520ff9640 1 -- 172.21.15.50:0/1153644636 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51800fbc0 con 0x7fc50c004d00 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52414a280 con 0x7fc50c004d00 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.912+0000 7fc520ff9640 1 -- 172.21.15.50:0/1153644636 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180133f0 con 0x7fc50c004d00 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.913+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5241496c0 con 0x7fc50c004d00 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.913+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc524067430 con 0x7fc50c004d00 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.914+0000 7fc520ff9640 1 -- 172.21.15.50:0/1153644636 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc518013550 con 0x7fc50c004d00 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.914+0000 7fc520ff9640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc51006ae40 0x7fc51006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.914+0000 7fc520ff9640 1 -- 172.21.15.50:0/1153644636 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc518089d50 con 0x7fc50c004d00 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.915+0000 7fc5237fe640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc51006ae40 0x7fc51006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:06.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.915+0000 7fc5237fe640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc51006ae40 0x7fc51006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc52409c0d0 tx=0x7fc514008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:06.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:06.919+0000 7fc520ff9640 1 -- 172.21.15.50:0/1153644636 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc51808d030 con 0x7fc50c004d00 2023-12-08T08:19:07.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.095+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc52406c7e0 con 0x7fc50c004d00 2023-12-08T08:19:07.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.096+0000 7fc520ff9640 1 -- 172.21.15.50:0/1153644636 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc518054a20 con 0x7fc50c004d00 2023-12-08T08:19:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:07.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc51006ae40 msgr2=0x7fc51006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc51006ae40 0x7fc51006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc52409c0d0 tx=0x7fc514008040 comp rx=0 tx=0).stop 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 msgr2=0x7fc52409acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc52409acd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc518007310 tx=0x7fc5180077d0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 shutdown_connections 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc51006ae40 0x7fc51006d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5240c5e70 0x7fc5240c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc524149240 0x7fc524147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 --2- 172.21.15.50:0/1153644636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc50c004d00 0x7fc52409acd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 >> 172.21.15.50:0/1153644636 conn(0x7fc5240d0e00 msgr2=0x7fc52415d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 shutdown_connections 2023-12-08T08:19:07.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.098+0000 7fc52a45d640 1 -- 172.21.15.50:0/1153644636 wait complete. 2023-12-08T08:19:07.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-08T08:19:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.218+0000 7f53a7353640 1 Processor -- start 2023-12-08T08:19:07.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.218+0000 7f53a7353640 1 -- start start 2023-12-08T08:19:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a7353640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53a006c7c0 0x7f53a00cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a7353640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53a00c9660 0x7f53a006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a7353640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a00705b0 con 0x7f53a006d0e0 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a7353640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a015b480 con 0x7f53a006c7c0 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a7353640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a00ac6f0 con 0x7f53a00c9660 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a50ef640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53a006c7c0 0x7f53a00cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a58f0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f53a006d0e0 0x7f53a00acb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59744/0 (socket says 172.21.15.50:59744) 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a50ef640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53a006c7c0 0x7f53a00cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52276/0 (socket says 172.21.15.50:52276) 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a58f0640 1 -- 172.21.15.50:0/1287619590 learned_addr learned my addr 172.21.15.50:0/1287619590 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a48ee640 1 --2- 172.21.15.50:0/1287619590 >> v2:172.21.15.170:3300/0 conn(0x7f53a00c9660 0x7f53a006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a50ef640 1 -- 172.21.15.50:0/1287619590 >> v2:172.21.15.170:3300/0 conn(0x7f53a00c9660 msgr2=0x7f53a006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a50ef640 1 --2- 172.21.15.50:0/1287619590 >> v2:172.21.15.170:3300/0 conn(0x7f53a00c9660 0x7f53a006cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a50ef640 1 -- 172.21.15.50:0/1287619590 >> v1:172.21.15.50:6789/0 conn(0x7f53a006d0e0 legacy=0x7f53a00acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f53a50ef640 1 -- 172.21.15.50:0/1287619590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a00cb680 con 0x7f53a006c7c0 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.219+0000 7f5397fff640 1 -- 172.21.15.50:0/1287619590 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241609960 0 0) 0x7f53a00705b0 con 0x7f53a006d0e0 2023-12-08T08:19:07.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.220+0000 7f53a50ef640 1 --2- 172.21.15.50:0/1287619590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006c7c0 0x7f53a00cb030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f53a006be00 tx=0x7f539c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d814f1cfadcec443 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.220+0000 7f5397fff640 1 -- 172.21.15.50:0/1287619590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c031830 con 0x7f53a006c7c0 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.220+0000 7f5397fff640 1 -- 172.21.15.50:0/1287619590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c031990 con 0x7f53a006c7c0 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.220+0000 7f5397fff640 1 -- 172.21.15.50:0/1287619590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c031d20 con 0x7f53a006c7c0 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 -- 172.21.15.50:0/1287619590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006c7c0 msgr2=0x7f53a00cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 --2- 172.21.15.50:0/1287619590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006c7c0 0x7f53a00cb030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f53a006be00 tx=0x7f539c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 -- 172.21.15.50:0/1287619590 shutdown_connections 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 --2- 172.21.15.50:0/1287619590 >> v2:172.21.15.170:3300/0 conn(0x7f53a00c9660 0x7f53a006cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 --2- 172.21.15.50:0/1287619590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006c7c0 0x7f53a00cb030 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 -- 172.21.15.50:0/1287619590 >> 172.21.15.50:0/1287619590 conn(0x7f53a00cf010 msgr2=0x7f53a00cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 -- 172.21.15.50:0/1287619590 shutdown_connections 2023-12-08T08:19:07.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.221+0000 7f53a7353640 1 -- 172.21.15.50:0/1287619590 wait complete. 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.222+0000 7f53a7353640 1 Processor -- start 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.222+0000 7f53a7353640 1 -- start start 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a7353640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a006c7c0 0x7f53a0156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a7353640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006d0e0 0x7f53a015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a7353640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00c9660 0x7f53a015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a7353640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a0156c90 con 0x7f53a006d0e0 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a7353640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a01f0970 con 0x7f53a006c7c0 2023-12-08T08:19:07.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a7353640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a01f4350 con 0x7f53a00c9660 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006d0e0 0x7f53a015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006d0e0 0x7f53a015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52280/0 (socket says 172.21.15.50:52280) 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 -- 172.21.15.50:0/1311110424 learned_addr learned my addr 172.21.15.50:0/1311110424 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a50ef640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a006c7c0 0x7f53a0156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 -- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00c9660 msgr2=0x7f53a015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00c9660 0x7f53a015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 -- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a006c7c0 msgr2=0x7f53a0156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a006c7c0 0x7f53a0156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 -- 172.21.15.50:0/1311110424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c009400 con 0x7f53a006d0e0 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a50ef640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a006c7c0 0x7f53a0156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a48ee640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006d0e0 0x7f53a015b5c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f539000d5f0 tx=0x7f539000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f5395ffb640 1 -- 172.21.15.50:0/1311110424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900125f0 con 0x7f53a006d0e0 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f5395ffb640 1 -- 172.21.15.50:0/1311110424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5390012750 con 0x7f53a006d0e0 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.223+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a01f4630 con 0x7f53a006d0e0 2023-12-08T08:19:07.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.224+0000 7f5395ffb640 1 -- 172.21.15.50:0/1311110424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390012b00 con 0x7f53a006d0e0 2023-12-08T08:19:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.224+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a01f4bf0 con 0x7f53a006d0e0 2023-12-08T08:19:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.225+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a01f0ae0 con 0x7f53a006d0e0 2023-12-08T08:19:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.225+0000 7f5395ffb640 1 -- 172.21.15.50:0/1311110424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5390012c60 con 0x7f53a006d0e0 2023-12-08T08:19:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.225+0000 7f5395ffb640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f538406ae70 0x7f538406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.226+0000 7f5395ffb640 1 -- 172.21.15.50:0/1311110424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5390089ea0 con 0x7f53a006d0e0 2023-12-08T08:19:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.226+0000 7f53a50ef640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f538406ae70 0x7f538406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.226+0000 7f53a50ef640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f538406ae70 0x7f538406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f539c036000 tx=0x7f539c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.230+0000 7f5395ffb640 1 -- 172.21.15.50:0/1311110424 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5390054b60 con 0x7f53a006d0e0 2023-12-08T08:19:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.404+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f53a0067430 con 0x7f53a006d0e0 2023-12-08T08:19:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.405+0000 7f5395ffb640 1 -- 172.21.15.50:0/1311110424 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5390058180 con 0x7f53a006d0e0 2023-12-08T08:19:07.407 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f538406ae70 msgr2=0x7f538406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f538406ae70 0x7f538406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f539c036000 tx=0x7f539c03c040 comp rx=0 tx=0).stop 2023-12-08T08:19:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006d0e0 msgr2=0x7f53a015b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006d0e0 0x7f53a015b5c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f539000d5f0 tx=0x7f539000dab0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 shutdown_connections 2023-12-08T08:19:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f538406ae70 0x7f538406d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53a006d0e0 0x7f53a015b5c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53a00c9660 0x7f53a015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 --2- 172.21.15.50:0/1311110424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53a006c7c0 0x7f53a0156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 >> 172.21.15.50:0/1311110424 conn(0x7f53a00cf010 msgr2=0x7f53a015a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 shutdown_connections 2023-12-08T08:19:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.407+0000 7f53a7353640 1 -- 172.21.15.50:0/1311110424 wait complete. 2023-12-08T08:19:07.420 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:07.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.524+0000 7fa7bb861640 1 Processor -- start 2023-12-08T08:19:07.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.524+0000 7fa7bb861640 1 -- start start 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7bb861640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7bb861640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa7b4144930 0x7fa7b40cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7bb861640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b40cc110 0x7fa7b415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7bb861640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b40ca720 con 0x7fa7b40cc110 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7bb861640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b40cfb50 con 0x7fa7b4144930 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7bb861640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40711e0 con 0x7fa7b4144440 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b40cc110 0x7fa7b415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b40cc110 0x7fa7b415ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52282/0 (socket says 172.21.15.50:52282) 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 -- 172.21.15.50:0/1034438572 learned_addr learned my addr 172.21.15.50:0/1034438572 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b95fd640 1 --2- 172.21.15.50:0/1034438572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b8dfc640 1 --2- 172.21.15.50:0/1034438572 >> v2:172.21.15.170:3300/0 conn(0x7fa7b4144930 0x7fa7b40cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 -- 172.21.15.50:0/1034438572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 msgr2=0x7fa7b40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 --2- 172.21.15.50:0/1034438572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 -- 172.21.15.50:0/1034438572 >> v2:172.21.15.170:3300/0 conn(0x7fa7b4144930 msgr2=0x7fa7b40cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 --2- 172.21.15.50:0/1034438572 >> v2:172.21.15.170:3300/0 conn(0x7fa7b4144930 0x7fa7b40cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.525+0000 7fa7b9dfe640 1 -- 172.21.15.50:0/1034438572 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40714a0 con 0x7fa7b40cc110 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.526+0000 7fa7b9dfe640 1 --2- 172.21.15.50:0/1034438572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b415ebf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40cd860 tx=0x7fa7ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5070a4ace8d5b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.526+0000 7fa7abfff640 1 -- 172.21.15.50:0/1034438572 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac02ca70 con 0x7fa7b40cc110 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.526+0000 7fa7abfff640 1 -- 172.21.15.50:0/1034438572 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac02cbd0 con 0x7fa7b40cc110 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.526+0000 7fa7abfff640 1 -- 172.21.15.50:0/1034438572 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0343f0 con 0x7fa7b40cc110 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 -- 172.21.15.50:0/1034438572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 msgr2=0x7fa7b415ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 --2- 172.21.15.50:0/1034438572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b415ebf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40cd860 tx=0x7fa7ac02bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 -- 172.21.15.50:0/1034438572 shutdown_connections 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 --2- 172.21.15.50:0/1034438572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b415ebf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 --2- 172.21.15.50:0/1034438572 >> v2:172.21.15.170:3300/0 conn(0x7fa7b4144930 0x7fa7b40cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 --2- 172.21.15.50:0/1034438572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 -- 172.21.15.50:0/1034438572 >> 172.21.15.50:0/1034438572 conn(0x7fa7b40cfda0 msgr2=0x7fa7b40d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 -- 172.21.15.50:0/1034438572 shutdown_connections 2023-12-08T08:19:07.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.527+0000 7fa7bb861640 1 -- 172.21.15.50:0/1034438572 wait complete. 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.528+0000 7fa7bb861640 1 Processor -- start 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.528+0000 7fa7bb861640 1 -- start start 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7bb861640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b41f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7bb861640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7bb861640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b4144930 0x7fa7b406d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7bb861640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b41f27f0 con 0x7fa7b40cc110 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7bb861640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40b4c20 con 0x7fa7b4144930 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7bb861640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40b4f00 con 0x7fa7b4144440 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b41f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b41f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52294/0 (socket says 172.21.15.50:52294) 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 -- 172.21.15.50:0/454181692 learned_addr learned my addr 172.21.15.50:0/454181692 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 -- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 msgr2=0x7fa7b40b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b8dfc640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b9dfe640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b4144930 0x7fa7b406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 -- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b4144930 msgr2=0x7fa7b406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b4144930 0x7fa7b406d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.529+0000 7fa7b95fd640 1 -- 172.21.15.50:0/454181692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac009b30 con 0x7fa7b40cc110 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.530+0000 7fa7b95fd640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b41f22b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c7f0 tx=0x7fa7b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.530+0000 7fa7a9ffb640 1 -- 172.21.15.50:0/454181692 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0004220 con 0x7fa7b40cc110 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.530+0000 7fa7a9ffb640 1 -- 172.21.15.50:0/454181692 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b00043a0 con 0x7fa7b40cc110 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.530+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b40b51e0 con 0x7fa7b40cc110 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.530+0000 7fa7a9ffb640 1 -- 172.21.15.50:0/454181692 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0007860 con 0x7fa7b40cc110 2023-12-08T08:19:07.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.530+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b406d2e0 con 0x7fa7b40cc110 2023-12-08T08:19:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.531+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b406d4d0 con 0x7fa7b40cc110 2023-12-08T08:19:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.531+0000 7fa7a9ffb640 1 -- 172.21.15.50:0/454181692 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7b0007bd0 con 0x7fa7b40cc110 2023-12-08T08:19:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.532+0000 7fa7a9ffb640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa79806ae40 0x7fa79806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.532+0000 7fa7a9ffb640 1 -- 172.21.15.50:0/454181692 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa7b00898e0 con 0x7fa7b40cc110 2023-12-08T08:19:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.532+0000 7fa7b8dfc640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa79806ae40 0x7fa79806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.533+0000 7fa7b8dfc640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa79806ae40 0x7fa79806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4143400 tx=0x7fa7a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.536+0000 7fa7a9ffb640 1 -- 172.21.15.50:0/454181692 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7b0054640 con 0x7fa7b40cc110 2023-12-08T08:19:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.750+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7b4067430 con 0x7fa7b40cc110 2023-12-08T08:19:07.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.751+0000 7fa7a9ffb640 1 -- 172.21.15.50:0/454181692 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fa7b001e090 con 0x7fa7b40cc110 2023-12-08T08:19:07.754 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:07.754 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:19:07.754 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa79806ae40 msgr2=0x7fa79806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa79806ae40 0x7fa79806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4143400 tx=0x7fa7a4008040 comp rx=0 tx=0).stop 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 msgr2=0x7fa7b41f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b41f22b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c7f0 tx=0x7fa7b000ccb0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 shutdown_connections 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa79806ae40 0x7fa79806d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7b4144930 0x7fa7b406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa7b4144440 0x7fa7b40b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 --2- 172.21.15.50:0/454181692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b40cc110 0x7fa7b41f22b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 >> 172.21.15.50:0/454181692 conn(0x7fa7b40cfda0 msgr2=0x7fa7b40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 shutdown_connections 2023-12-08T08:19:07.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.753+0000 7fa7bb861640 1 -- 172.21.15.50:0/454181692 wait complete. 2023-12-08T08:19:07.767 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.871+0000 7f142fe17640 1 Processor -- start 2023-12-08T08:19:07.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.872+0000 7f142fe17640 1 -- start start 2023-12-08T08:19:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.872+0000 7f142fe17640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f142815d490 0x7f142806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.872+0000 7f142fe17640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f142806ea40 0x7f14280d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.872+0000 7f142fe17640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280ce270 con 0x7f142806c940 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.872+0000 7f142fe17640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14280ce550 con 0x7f142806ea40 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.872+0000 7f142fe17640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142806b920 con 0x7f142815d490 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142e3b4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f142806ea40 0x7f14280d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142dbb3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f142815d490 0x7f142806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142dbb3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f142815d490 0x7f142806c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:60434/0 (socket says 172.21.15.50:60434) 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142e3b4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f142806ea40 0x7f14280d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:38888/0 (socket says 172.21.15.50:38888) 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142dbb3640 1 -- 172.21.15.50:0/3834214859 learned_addr learned my addr 172.21.15.50:0/3834214859 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:07.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142dbb3640 1 -- 172.21.15.50:0/3834214859 >> v2:172.21.15.170:3300/0 conn(0x7f142806ea40 msgr2=0x7f14280d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142dbb3640 1 --2- 172.21.15.50:0/3834214859 >> v2:172.21.15.170:3300/0 conn(0x7f142806ea40 0x7f14280d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142dbb3640 1 -- 172.21.15.50:0/3834214859 >> v1:172.21.15.170:6789/0 conn(0x7f142806c940 legacy=0x7f142806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142dbb3640 1 -- 172.21.15.50:0/3834214859 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142806bc00 con 0x7f142815d490 2023-12-08T08:19:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142cbb1640 1 -- 172.21.15.50:0/3834214859 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170031784 0 0) 0x7f14280ce270 con 0x7f142806c940 2023-12-08T08:19:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.873+0000 7f142e3b4640 1 --2- 172.21.15.50:0/3834214859 >> v2:172.21.15.170:3300/0 conn(0x7f142806ea40 0x7f14280d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.874+0000 7f142dbb3640 1 --2- 172.21.15.50:0/3834214859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f142815d490 0x7f142806c400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1418009e50 tx=0x7f141802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b34c2519ce5f70 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.874+0000 7f142cbb1640 1 -- 172.21.15.50:0/3834214859 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141802cb00 con 0x7f142815d490 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.874+0000 7f142cbb1640 1 -- 172.21.15.50:0/3834214859 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141802cc60 con 0x7f142815d490 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.874+0000 7f142cbb1640 1 -- 172.21.15.50:0/3834214859 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180343f0 con 0x7f142815d490 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 -- 172.21.15.50:0/3834214859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f142815d490 msgr2=0x7f142806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 --2- 172.21.15.50:0/3834214859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f142815d490 0x7f142806c400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1418009e50 tx=0x7f141802bf60 comp rx=0 tx=0).stop 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 -- 172.21.15.50:0/3834214859 shutdown_connections 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 --2- 172.21.15.50:0/3834214859 >> v2:172.21.15.170:3300/0 conn(0x7f142806ea40 0x7f14280d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 --2- 172.21.15.50:0/3834214859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f142815d490 0x7f142806c400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 -- 172.21.15.50:0/3834214859 >> 172.21.15.50:0/3834214859 conn(0x7f1428099a10 msgr2=0x7f1428099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 -- 172.21.15.50:0/3834214859 shutdown_connections 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.875+0000 7f142fe17640 1 -- 172.21.15.50:0/3834214859 wait complete. 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.876+0000 7f142fe17640 1 Processor -- start 2023-12-08T08:19:07.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.876+0000 7f142fe17640 1 -- start start 2023-12-08T08:19:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142fe17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142806c940 0x7f14280b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142fe17640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14281f2c70 0x7f14280aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142fe17640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14280ca150 0x7f14280ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142fe17640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280cab20 con 0x7f142806c940 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142fe17640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280b5020 con 0x7f14280ca150 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142fe17640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14281f3fe0 con 0x7f14281f2c70 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142806c940 0x7f14280b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142806c940 0x7f14280b6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52300/0 (socket says 172.21.15.50:52300) 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 -- 172.21.15.50:0/3886931963 learned_addr learned my addr 172.21.15.50:0/3886931963 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142e3b4640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14280ca150 0x7f14280ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142d3b2640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14281f2c70 0x7f14280aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 -- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14281f2c70 msgr2=0x7f14280aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14281f2c70 0x7f14280aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 -- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14280ca150 msgr2=0x7f14280ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14280ca150 0x7f14280ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 -- 172.21.15.50:0/3886931963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009400 con 0x7f142806c940 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142dbb3640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142806c940 0x7f14280b6470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1418036040 tx=0x7f1418004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f14267fc640 1 -- 172.21.15.50:0/3886931963 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418040670 con 0x7f142806c940 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f14267fc640 1 -- 172.21.15.50:0/3886931963 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14180407d0 con 0x7f142806c940 2023-12-08T08:19:07.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f14267fc640 1 -- 172.21.15.50:0/3886931963 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418040b80 con 0x7f142806c940 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.877+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1418009b30 con 0x7f142806c940 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.878+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14281f3760 con 0x7f142806c940 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.878+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14281f4200 con 0x7f142806c940 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.879+0000 7f14267fc640 1 -- 172.21.15.50:0/3886931963 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1418040ce0 con 0x7f142806c940 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.879+0000 7f14267fc640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f141406ae40 0x7f141406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.880+0000 7f14267fc640 1 -- 172.21.15.50:0/3886931963 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f14180ac8e0 con 0x7f142806c940 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.880+0000 7f142d3b2640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f141406ae40 0x7f141406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:07.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.880+0000 7f142d3b2640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f141406ae40 0x7f141406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f141c000f60 tx=0x7f141c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:07.887 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:07.884+0000 7f14267fc640 1 -- 172.21.15.50:0/3886931963 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14281f4200 con 0x7f142806c940 2023-12-08T08:19:08.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.060+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14281f4200 con 0x7f142806c940 2023-12-08T08:19:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.061+0000 7f14267fc640 1 -- 172.21.15.50:0/3886931963 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f14281f4200 con 0x7f142806c940 2023-12-08T08:19:08.064 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:08.064 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f141406ae40 msgr2=0x7f141406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f141406ae40 0x7f141406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f141c000f60 tx=0x7f141c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142806c940 msgr2=0x7f14280b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142806c940 0x7f14280b6470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1418036040 tx=0x7f1418004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 shutdown_connections 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f141406ae40 0x7f141406d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14280ca150 0x7f14280ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14281f2c70 0x7f14280aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 --2- 172.21.15.50:0/3886931963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f142806c940 0x7f14280b6470 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 >> 172.21.15.50:0/3886931963 conn(0x7f1428099a10 msgr2=0x7f142806cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 shutdown_connections 2023-12-08T08:19:08.067 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.063+0000 7f142fe17640 1 -- 172.21.15.50:0/3886931963 wait complete. 2023-12-08T08:19:08.077 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:19:08.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:08.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.182+0000 7f19b1e4f640 1 Processor -- start 2023-12-08T08:19:08.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.182+0000 7f19b1e4f640 1 -- start start 2023-12-08T08:19:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.183+0000 7f19b1e4f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f19ac06abe0 0x7f19ac06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.183+0000 7f19b1e4f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac15d700 con 0x7f19ac157950 2023-12-08T08:19:08.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.183+0000 7f19b1e4f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac15d9c0 con 0x7f19ac071f20 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.183+0000 7f19b1e4f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ac15dca0 con 0x7f19ac06abe0 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.183+0000 7f19ab7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19ac157950 0x7f19ac06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59754/0 (socket says 172.21.15.50:59754) 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.183+0000 7f19ab7fe640 1 -- 172.21.15.50:0/124774036 learned_addr learned my addr 172.21.15.50:0/124774036 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276884960 0 0) 0x7f19ac15d700 con 0x7f19ac157950 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aaffd640 1 --2- 172.21.15.50:0/124774036 >> v2:172.21.15.170:3300/0 conn(0x7f19ac06abe0 0x7f19ac06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1994003520 con 0x7f19ac157950 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1612769151 0 0) 0x7f1994003520 con 0x7f19ac157950 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 >> v2:172.21.15.170:3300/0 conn(0x7f19ac06abe0 msgr2=0x7f19ac06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 --2- 172.21.15.50:0/124774036 >> v2:172.21.15.170:3300/0 conn(0x7f19ac06abe0 0x7f19ac06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 >> v1:172.21.15.170:6789/0 conn(0x7f19ac071f20 legacy=0x7f19ac072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac15df80 con 0x7f19ac157950 2023-12-08T08:19:08.190 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f199c001670 con 0x7f19ac157950 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 >> v1:172.21.15.50:6789/0 conn(0x7f19ac157950 legacy=0x7f19ac06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1994003970 0x7f1994003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940047c0 0x7f1994004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19940052a0 0x7f199400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac15dca0 con 0x7f19940052a0 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199400c170 con 0x7f1994003970 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199400c330 con 0x7f19940047c0 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19abfff640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19940052a0 0x7f199400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19ab7fe640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1994003970 0x7f1994003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.184+0000 7f19aaffd640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940047c0 0x7f1994004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19abfff640 1 -- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940047c0 msgr2=0x7f1994004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19abfff640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940047c0 0x7f1994004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19abfff640 1 -- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1994003970 msgr2=0x7f1994003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19abfff640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1994003970 0x7f1994003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19abfff640 1 -- 172.21.15.50:0/124774036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994003520 con 0x7f19940052a0 2023-12-08T08:19:08.191 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19aaffd640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940047c0 0x7f1994004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19ab7fe640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1994003970 0x7f1994003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19abfff640 1 -- 172.21.15.50:0/124774036 reap_dead start 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19abfff640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19940052a0 0x7f199400b980 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f19a4001e20 tx=0x7f19940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8e6146dcf348b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4003b70 con 0x7f19940052a0 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4003cd0 con 0x7f19940052a0 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.185+0000 7f19aa7fc640 1 -- 172.21.15.50:0/124774036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4005310 con 0x7f19940052a0 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.186+0000 7f19b1e4f640 1 -- 172.21.15.50:0/124774036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19940052a0 msgr2=0x7f199400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.186+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19940052a0 0x7f199400b980 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f19a4001e20 tx=0x7f19940057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.186+0000 7f19b1e4f640 1 -- 172.21.15.50:0/124774036 shutdown_connections 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.186+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/124774036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19940052a0 0x7f199400b980 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.186+0000 7f19b1e4f640 1 -- 172.21.15.50:0/124774036 >> 172.21.15.50:0/124774036 conn(0x7f19ac0cff90 msgr2=0x7f19ac0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.186+0000 7f19b1e4f640 1 -- 172.21.15.50:0/124774036 shutdown_connections 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.186+0000 7f19b1e4f640 1 -- 172.21.15.50:0/124774036 wait complete. 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.187+0000 7f19b1e4f640 1 Processor -- start 2023-12-08T08:19:08.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.187+0000 7f19b1e4f640 1 -- start start 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19b1e4f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940052a0 0x7f19ac0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19b1e4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19ac1f23a0 0x7f19ac1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19b1e4f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19ac1f27c0 0x7f19ac1f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19b1e4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac1432a0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19b1e4f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0ce150 con 0x7f19ac1f27c0 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19b1e4f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0ce430 con 0x7f19940052a0 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19aaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19ac1f23a0 0x7f19ac1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19aaffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19ac1f23a0 0x7f19ac1f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52324/0 (socket says 172.21.15.50:52324) 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.188+0000 7f19aaffd640 1 -- 172.21.15.50:0/4022036676 learned_addr learned my addr 172.21.15.50:0/4022036676 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19abfff640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19ac1f27c0 0x7f19ac1f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19ab7fe640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940052a0 0x7f19ac0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19aaffd640 1 -- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940052a0 msgr2=0x7f19ac0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19aaffd640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940052a0 0x7f19ac0cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19aaffd640 1 -- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19ac1f27c0 msgr2=0x7f19ac1f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19aaffd640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19ac1f27c0 0x7f19ac1f6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19aaffd640 1 -- 172.21.15.50:0/4022036676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0ce710 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19aaffd640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19ac1f23a0 0x7f19ac1f6150 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f19a00114e0 tx=0x7f19a00119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f1993fff640 1 -- 172.21.15.50:0/4022036676 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0015870 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f1993fff640 1 -- 172.21.15.50:0/4022036676 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a00159d0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f1993fff640 1 -- 172.21.15.50:0/4022036676 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0015d40 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac0ce9f0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.189+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac1f6db0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.190+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac067ad0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.190+0000 7f1993fff640 1 -- 172.21.15.50:0/4022036676 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19a0013400 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.191+0000 7f1993fff640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f199806ae70 0x7f199806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.191+0000 7f1993fff640 1 -- 172.21.15.50:0/4022036676 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f19a0089de0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.191+0000 7f19ab7fe640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f199806ae70 0x7f199806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.192+0000 7f19ab7fe640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f199806ae70 0x7f199806d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f199c001200 tx=0x7f199c001150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.195+0000 7f1993fff640 1 -- 172.21.15.50:0/4022036676 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19a0054ab0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.405+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19ac1433e0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.405+0000 7f1993fff640 1 -- 172.21.15.50:0/4022036676 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f19ac1433e0 con 0x7f19ac1f23a0 2023-12-08T08:19:08.408 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:08.408 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:19:08.408 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:19:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f199806ae70 msgr2=0x7f199806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f199806ae70 0x7f199806d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f199c001200 tx=0x7f199c001150 comp rx=0 tx=0).stop 2023-12-08T08:19:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19ac1f23a0 msgr2=0x7f19ac1f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19ac1f23a0 0x7f19ac1f6150 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f19a00114e0 tx=0x7f19a00119a0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 shutdown_connections 2023-12-08T08:19:08.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f199806ae70 0x7f199806d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19ac1f23a0 0x7f19ac1f6150 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19ac1f27c0 0x7f19ac1f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 --2- 172.21.15.50:0/4022036676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19940052a0 0x7f19ac0cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.407+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 >> 172.21.15.50:0/4022036676 conn(0x7f19ac0cff90 msgr2=0x7f19ac0ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.408+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 shutdown_connections 2023-12-08T08:19:08.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.408+0000 7f19b1e4f640 1 -- 172.21.15.50:0/4022036676 wait complete. 2023-12-08T08:19:08.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.527+0000 7f518289b640 1 Processor -- start 2023-12-08T08:19:08.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.527+0000 7f518289b640 1 -- start start 2023-12-08T08:19:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f518289b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf380 0x7f517c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f518289b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f517c0cf760 0x7f517c161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f518289b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f517c071b80 0x7f517c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f518289b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c0d0d00 con 0x7f517c0cf760 2023-12-08T08:19:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f518289b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c161bd0 con 0x7f517c071b80 2023-12-08T08:19:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f518289b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c06b070 con 0x7f517c0cf380 2023-12-08T08:19:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f517c0cf760 0x7f517c161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f517c0cf760 0x7f517c161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52330/0 (socket says 172.21.15.50:52330) 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 -- 172.21.15.50:0/2109190786 learned_addr learned my addr 172.21.15.50:0/2109190786 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f5180e38640 1 --2- 172.21.15.50:0/2109190786 >> v2:172.21.15.170:3300/0 conn(0x7f517c071b80 0x7f517c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517bfff640 1 --2- 172.21.15.50:0/2109190786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf380 0x7f517c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 -- 172.21.15.50:0/2109190786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf380 msgr2=0x7f517c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 --2- 172.21.15.50:0/2109190786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf380 0x7f517c06a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 -- 172.21.15.50:0/2109190786 >> v2:172.21.15.170:3300/0 conn(0x7f517c071b80 msgr2=0x7f517c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 --2- 172.21.15.50:0/2109190786 >> v2:172.21.15.170:3300/0 conn(0x7f517c071b80 0x7f517c0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f517b7fe640 1 -- 172.21.15.50:0/2109190786 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c06aab0 con 0x7f517c0cf760 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.528+0000 7f5180e38640 1 --2- 172.21.15.50:0/2109190786 >> v2:172.21.15.170:3300/0 conn(0x7f517c071b80 0x7f517c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.529+0000 7f517b7fe640 1 --2- 172.21.15.50:0/2109190786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf760 0x7f517c161690 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f517c0d0ea0 tx=0x7f517002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6a259e73ef5810 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.529+0000 7f517affd640 1 -- 172.21.15.50:0/2109190786 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51700317c0 con 0x7f517c0cf760 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.529+0000 7f517affd640 1 -- 172.21.15.50:0/2109190786 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5170031920 con 0x7f517c0cf760 2023-12-08T08:19:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.529+0000 7f517affd640 1 -- 172.21.15.50:0/2109190786 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170031cb0 con 0x7f517c0cf760 2023-12-08T08:19:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 -- 172.21.15.50:0/2109190786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf760 msgr2=0x7f517c161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 --2- 172.21.15.50:0/2109190786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf760 0x7f517c161690 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f517c0d0ea0 tx=0x7f517002b860 comp rx=0 tx=0).stop 2023-12-08T08:19:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 -- 172.21.15.50:0/2109190786 shutdown_connections 2023-12-08T08:19:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 --2- 172.21.15.50:0/2109190786 >> v2:172.21.15.170:3300/0 conn(0x7f517c071b80 0x7f517c0acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 --2- 172.21.15.50:0/2109190786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf760 0x7f517c161690 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 --2- 172.21.15.50:0/2109190786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf380 0x7f517c06a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 -- 172.21.15.50:0/2109190786 >> 172.21.15.50:0/2109190786 conn(0x7f517c0cfda0 msgr2=0x7f517c0d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 -- 172.21.15.50:0/2109190786 shutdown_connections 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.530+0000 7f518289b640 1 -- 172.21.15.50:0/2109190786 wait complete. 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.531+0000 7f518289b640 1 Processor -- start 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.531+0000 7f518289b640 1 -- start start 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f518289b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f517c071b80 0x7f517c15f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f518289b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf380 0x7f517c0b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f518289b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf760 0x7f517c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f518289b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0b5bf0 con 0x7f517c0cf380 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f518289b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0ca9e0 con 0x7f517c071b80 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f518289b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0cbd00 con 0x7f517c0cf760 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf380 0x7f517c0b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf380 0x7f517c0b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52336/0 (socket says 172.21.15.50:52336) 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 -- 172.21.15.50:0/1917044576 learned_addr learned my addr 172.21.15.50:0/1917044576 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517bfff640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f517c071b80 0x7f517c15f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f5180e38640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf760 0x7f517c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 -- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf760 msgr2=0x7f517c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf760 0x7f517c06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 -- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f517c071b80 msgr2=0x7f517c15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f517c071b80 0x7f517c15f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 -- 172.21.15.50:0/1917044576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700094d0 con 0x7f517c0cf380 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.532+0000 7f517b7fe640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf380 0x7f517c0b56b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5170000c00 tx=0x7f51700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.533+0000 7f5178ff9640 1 -- 172.21.15.50:0/1917044576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170032860 con 0x7f517c0cf380 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.533+0000 7f5178ff9640 1 -- 172.21.15.50:0/1917044576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51700329e0 con 0x7f517c0cf380 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.533+0000 7f5178ff9640 1 -- 172.21.15.50:0/1917044576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170032d90 con 0x7f517c0cf380 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.533+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c0cac80 con 0x7f517c0cf380 2023-12-08T08:19:08.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.533+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c0cb220 con 0x7f517c0cf380 2023-12-08T08:19:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.534+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c067430 con 0x7f517c0cf380 2023-12-08T08:19:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.534+0000 7f5178ff9640 1 -- 172.21.15.50:0/1917044576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f517004e450 con 0x7f517c0cf380 2023-12-08T08:19:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.535+0000 7f5178ff9640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.535+0000 7f5178ff9640 1 -- 172.21.15.50:0/1917044576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f51700aba50 con 0x7f517c0cf380 2023-12-08T08:19:08.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.535+0000 7f517bfff640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.535+0000 7f517bfff640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f516806ae70 0x7f516806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f516c006fd0 tx=0x7f516c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.539+0000 7f5178ff9640 1 -- 172.21.15.50:0/1917044576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51700767c0 con 0x7f517c0cf380 2023-12-08T08:19:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.750+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f517c0ae820 con 0x7f517c0cf380 2023-12-08T08:19:08.753 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.751+0000 7f5178ff9640 1 -- 172.21.15.50:0/1917044576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f5170079de0 con 0x7f517c0cf380 2023-12-08T08:19:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:08.754 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/2650540528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":2650540528},{"type":"v1","addr":"172.21.15.50:6834","nonce":2650540528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/363554337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":363554337},{"type":"v1","addr":"172.21.15.50:6835","nonce":363554337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/2459225737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":2459225737},{"type":"v1","addr":"172.21.15.170:6836","nonce":2459225737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:17:57.193015+0000","modified":"2023-12-08T08:18:19.281291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6837/728540036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":728540036},{"type":"v1","addr":"172.21.15.170:6837","nonce":728540036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-08T08:19:08.754 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 9 2023-12-08T08:19:08.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f516806ae70 msgr2=0x7f516806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f516806ae70 0x7f516806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f516c006fd0 tx=0x7f516c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:08.755 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf380 msgr2=0x7f517c0b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf380 0x7f517c0b56b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5170000c00 tx=0x7f51700046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 shutdown_connections 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f516806ae70 0x7f516806d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f517c0cf380 0x7f517c0b56b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f517c0cf760 0x7f517c06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 --2- 172.21.15.50:0/1917044576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f517c071b80 0x7f517c15f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 >> 172.21.15.50:0/1917044576 conn(0x7f517c0cfda0 msgr2=0x7f517c06e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 shutdown_connections 2023-12-08T08:19:08.756 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.753+0000 7f518289b640 1 -- 172.21.15.50:0/1917044576 wait complete. 2023-12-08T08:19:08.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:08.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.871+0000 7f6244ce0640 1 Processor -- start 2023-12-08T08:19:08.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.872+0000 7f6244ce0640 1 -- start start 2023-12-08T08:19:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.872+0000 7f6244ce0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f624015d580 0x7f62400d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.872+0000 7f6244ce0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f624015f890 0x7f624015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.872+0000 7f6244ce0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624015ee90 con 0x7f62400d3ad0 2023-12-08T08:19:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.872+0000 7f6244ce0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400d0fe0 con 0x7f624015d580 2023-12-08T08:19:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.872+0000 7f6244ce0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400d1280 con 0x7f624015f890 2023-12-08T08:19:08.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.873+0000 7f623e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f624015d580 0x7f62400d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.873+0000 7f623e59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f624015d580 0x7f62400d1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52344/0 (socket says 172.21.15.50:52344) 2023-12-08T08:19:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.873+0000 7f623e59c640 1 -- 172.21.15.50:0/603654314 learned_addr learned my addr 172.21.15.50:0/603654314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.873+0000 7f623e59c640 1 -- 172.21.15.50:0/603654314 >> v2:172.21.15.170:3300/0 conn(0x7f624015f890 msgr2=0x7f624015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.873+0000 7f623e59c640 1 --2- 172.21.15.50:0/603654314 >> v2:172.21.15.170:3300/0 conn(0x7f624015f890 0x7f624015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.873+0000 7f623e59c640 1 -- 172.21.15.50:0/603654314 >> v1:172.21.15.170:6789/0 conn(0x7f62400d3ad0 legacy=0x7f624015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:08.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.873+0000 7f623e59c640 1 -- 172.21.15.50:0/603654314 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400d1560 con 0x7f624015d580 2023-12-08T08:19:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f623e59c640 1 --2- 172.21.15.50:0/603654314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015d580 0x7f62400d1d60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6238009870 tx=0x7f623802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4695d2a51251828 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f623d59a640 1 -- 172.21.15.50:0/603654314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62380317e0 con 0x7f624015d580 2023-12-08T08:19:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f623d59a640 1 -- 172.21.15.50:0/603654314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238031940 con 0x7f624015d580 2023-12-08T08:19:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f623d59a640 1 -- 172.21.15.50:0/603654314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238031cd0 con 0x7f624015d580 2023-12-08T08:19:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 -- 172.21.15.50:0/603654314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015d580 msgr2=0x7f62400d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 --2- 172.21.15.50:0/603654314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015d580 0x7f62400d1d60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6238009870 tx=0x7f623802b880 comp rx=0 tx=0).stop 2023-12-08T08:19:08.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 -- 172.21.15.50:0/603654314 shutdown_connections 2023-12-08T08:19:08.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 --2- 172.21.15.50:0/603654314 >> v2:172.21.15.170:3300/0 conn(0x7f624015f890 0x7f624015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 --2- 172.21.15.50:0/603654314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015d580 0x7f62400d1d60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 -- 172.21.15.50:0/603654314 >> 172.21.15.50:0/603654314 conn(0x7f62400d2fb0 msgr2=0x7f62400d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:08.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 -- 172.21.15.50:0/603654314 shutdown_connections 2023-12-08T08:19:08.878 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.874+0000 7f6244ce0640 1 -- 172.21.15.50:0/603654314 wait complete. 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 Processor -- start 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 -- start start 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62400d3ad0 0x7f62401f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624015d580 0x7f62401512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015f890 0x7f624015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b7910 con 0x7f624015f890 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b7610 con 0x7f624015d580 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.876+0000 7f6244ce0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62401f6f30 con 0x7f62400d3ad0 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015f890 0x7f624015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015f890 0x7f624015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52352/0 (socket says 172.21.15.50:52352) 2023-12-08T08:19:08.880 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 -- 172.21.15.50:0/1436207938 learned_addr learned my addr 172.21.15.50:0/1436207938 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623e59c640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62400d3ad0 0x7f62401f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623dd9b640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624015d580 0x7f62401512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 -- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62400d3ad0 msgr2=0x7f62401f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62400d3ad0 0x7f62401f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 -- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624015d580 msgr2=0x7f62401512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624015d580 0x7f62401512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 -- 172.21.15.50:0/1436207938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380094d0 con 0x7f624015f890 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f623ed9d640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015f890 0x7f624015b260 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f623000b970 tx=0x7f623000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f6236ffd640 1 -- 172.21.15.50:0/1436207938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623000cb40 con 0x7f624015f890 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f6236ffd640 1 -- 172.21.15.50:0/1436207938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623000ccc0 con 0x7f624015f890 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f6236ffd640 1 -- 172.21.15.50:0/1436207938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230014680 con 0x7f624015f890 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62401f7210 con 0x7f624015f890 2023-12-08T08:19:08.881 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.877+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62401f6bb0 con 0x7f624015f890 2023-12-08T08:19:08.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.878+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62400d09d0 con 0x7f624015f890 2023-12-08T08:19:08.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.879+0000 7f6236ffd640 1 -- 172.21.15.50:0/1436207938 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f623001d3b0 con 0x7f624015f890 2023-12-08T08:19:08.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.879+0000 7f6236ffd640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f622006ae70 0x7f622006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:08.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.879+0000 7f6236ffd640 1 -- 172.21.15.50:0/1436207938 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6230089940 con 0x7f624015f890 2023-12-08T08:19:08.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.879+0000 7f623e59c640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f622006ae70 0x7f622006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:08.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.880+0000 7f623e59c640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f622006ae70 0x7f622006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6238036000 tx=0x7f623803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:08.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:08.883+0000 7f6236ffd640 1 -- 172.21.15.50:0/1436207938 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62300580a0 con 0x7f624015f890 2023-12-08T08:19:09.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.059+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6240067430 con 0x7f624015f890 2023-12-08T08:19:09.062 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.060+0000 7f6236ffd640 1 -- 172.21.15.50:0/1436207938 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18728 (secure 0 0 0) 0x7f6230019090 con 0x7f624015f890 2023-12-08T08:19:09.063 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:09.063 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":26,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:18:37.978140+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:17:55.091059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-08T08:17:56.181435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-08T08:17:59.893782+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f622006ae70 msgr2=0x7f622006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f622006ae70 0x7f622006d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6238036000 tx=0x7f623803d040 comp rx=0 tx=0).stop 2023-12-08T08:19:09.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015f890 msgr2=0x7f624015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015f890 0x7f624015b260 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f623000b970 tx=0x7f623000be30 comp rx=0 tx=0).stop 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 shutdown_connections 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f622006ae70 0x7f622006d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f624015f890 0x7f624015b260 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f624015d580 0x7f62401512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 --2- 172.21.15.50:0/1436207938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62400d3ad0 0x7f62401f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 >> 172.21.15.50:0/1436207938 conn(0x7f62400d2fb0 msgr2=0x7f62400d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 shutdown_connections 2023-12-08T08:19:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.062+0000 7f6244ce0640 1 -- 172.21.15.50:0/1436207938 wait complete. 2023-12-08T08:19:09.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:19:09.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.184+0000 7fca79e61640 1 Processor -- start 2023-12-08T08:19:09.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.184+0000 7fca79e61640 1 -- start start 2023-12-08T08:19:09.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.184+0000 7fca79e61640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca7406bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca79e61640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fca7406c480 0x7fca7415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca79e61640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7406c8e0 con 0x7fca740ccd70 2023-12-08T08:19:09.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca79e61640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca740d0a60 con 0x7fca7406c480 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca79e61640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740ce6f0 con 0x7fca740ce270 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca7406bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca73fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fca7406c480 0x7fca7415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca73fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fca7406c480 0x7fca7415ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:38948/0 (socket says 172.21.15.50:38948) 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca7406bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:60488/0 (socket says 172.21.15.50:60488) 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca72ffd640 1 -- 172.21.15.50:0/543369294 learned_addr learned my addr 172.21.15.50:0/543369294 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca737fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fca740ccd70 0x7fca740cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:43024/0 (socket says 172.21.15.50:43024) 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca727fc640 1 -- 172.21.15.50:0/543369294 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926827622 0 0) 0x7fca7406c8e0 con 0x7fca740ccd70 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca727fc640 1 -- 172.21.15.50:0/543369294 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca5c003520 con 0x7fca740ccd70 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca73fff640 1 -- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 msgr2=0x7fca7406bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:09.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca73fff640 1 --2- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca7406bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca73fff640 1 -- 172.21.15.50:0/543369294 >> v1:172.21.15.170:6789/0 conn(0x7fca740ccd70 legacy=0x7fca740cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca73fff640 1 -- 172.21.15.50:0/543369294 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740cf9c0 con 0x7fca7406c480 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.185+0000 7fca72ffd640 1 --2- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca7406bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.186+0000 7fca73fff640 1 --2- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 0x7fca7415ca50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009d90 tx=0x7fca6c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccfc921effcb7cb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.186+0000 7fca727fc640 1 -- 172.21.15.50:0/543369294 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c02cc50 con 0x7fca7406c480 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.186+0000 7fca727fc640 1 -- 172.21.15.50:0/543369294 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c02cdb0 con 0x7fca7406c480 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.186+0000 7fca727fc640 1 -- 172.21.15.50:0/543369294 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c034640 con 0x7fca7406c480 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 -- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 msgr2=0x7fca7415ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 --2- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 0x7fca7415ca50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009d90 tx=0x7fca6c02bea0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 -- 172.21.15.50:0/543369294 shutdown_connections 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 --2- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 0x7fca7415ca50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 --2- 172.21.15.50:0/543369294 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca7406bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 -- 172.21.15.50:0/543369294 >> 172.21.15.50:0/543369294 conn(0x7fca740d0de0 msgr2=0x7fca740d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 -- 172.21.15.50:0/543369294 shutdown_connections 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.187+0000 7fca79e61640 1 -- 172.21.15.50:0/543369294 wait complete. 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.188+0000 7fca79e61640 1 Processor -- start 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.188+0000 7fca79e61640 1 -- start start 2023-12-08T08:19:09.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca79e61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 0x7fca740c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca79e61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca740ccd70 0x7fca740c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca79e61640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca740ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca79e61640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c8700 con 0x7fca740ccd70 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca79e61640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c89e0 con 0x7fca7406c480 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca79e61640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740c8cc0 con 0x7fca740ce270 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca740ccd70 0x7fca740c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca72ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca740ccd70 0x7fca740c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52366/0 (socket says 172.21.15.50:52366) 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca72ffd640 1 -- 172.21.15.50:0/4144913611 learned_addr learned my addr 172.21.15.50:0/4144913611 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca72ffd640 1 -- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 msgr2=0x7fca740ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca72ffd640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca740ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca72ffd640 1 -- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 msgr2=0x7fca740c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca737fe640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 0x7fca740c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.189+0000 7fca72ffd640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 0x7fca740c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.190+0000 7fca72ffd640 1 -- 172.21.15.50:0/4144913611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca680094d0 con 0x7fca740ccd70 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.190+0000 7fca72ffd640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca740ccd70 0x7fca740c7eb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fca6800e9b0 tx=0x7fca6800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.190+0000 7fca5bfff640 1 -- 172.21.15.50:0/4144913611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800c9a0 con 0x7fca740ccd70 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.190+0000 7fca5bfff640 1 -- 172.21.15.50:0/4144913611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6800cb00 con 0x7fca740ccd70 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.190+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c009a70 con 0x7fca740ccd70 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.190+0000 7fca5bfff640 1 -- 172.21.15.50:0/4144913611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800ce70 con 0x7fca740ccd70 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.190+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca740c9280 con 0x7fca740ccd70 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.191+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca740b6cb0 con 0x7fca740ccd70 2023-12-08T08:19:09.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.191+0000 7fca5bfff640 1 -- 172.21.15.50:0/4144913611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca68013470 con 0x7fca740ccd70 2023-12-08T08:19:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.192+0000 7fca5bfff640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fca6006ae40 0x7fca6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.192+0000 7fca5bfff640 1 -- 172.21.15.50:0/4144913611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fca68089f30 con 0x7fca740ccd70 2023-12-08T08:19:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.192+0000 7fca737fe640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fca6006ae40 0x7fca6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.193+0000 7fca737fe640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fca6006ae40 0x7fca6006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca64000f60 tx=0x7fca64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.196+0000 7fca5bfff640 1 -- 172.21.15.50:0/4144913611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca68054c90 con 0x7fca740ccd70 2023-12-08T08:19:09.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.407+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fca74067430 con 0x7fca740ccd70 2023-12-08T08:19:09.410 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-08T08:19:09.408+0000 7fd76af52640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:19:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.409+0000 7fca5bfff640 1 -- 172.21.15.50:0/4144913611 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fca68017090 con 0x7fca740ccd70 2023-12-08T08:19:09.412 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:19:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fca6006ae40 msgr2=0x7fca6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fca6006ae40 0x7fca6006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca64000f60 tx=0x7fca64009040 comp rx=0 tx=0).stop 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca740ccd70 msgr2=0x7fca740c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca740ccd70 0x7fca740c7eb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fca6800e9b0 tx=0x7fca6800ee70 comp rx=0 tx=0).stop 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 shutdown_connections 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fca6006ae40 0x7fca6006d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca740ccd70 0x7fca740c7eb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca740ce270 0x7fca740ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 --2- 172.21.15.50:0/4144913611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca7406c480 0x7fca740c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 >> 172.21.15.50:0/4144913611 conn(0x7fca740d0de0 msgr2=0x7fca74160620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 shutdown_connections 2023-12-08T08:19:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.412+0000 7fca79e61640 1 -- 172.21.15.50:0/4144913611 wait complete. 2023-12-08T08:19:09.418 INFO:tasks.ceph.mds.d.smithi170.stderr: -4323> 2023-12-08T08:18:01.554+0000 7fcd08001640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:19:09.426 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:19:09.449 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.532+0000 7f4d8201e640 1 Processor -- start 2023-12-08T08:19:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.532+0000 7f4d8201e640 1 -- start start 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d8201e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4d7c0b0af0 0x7f4d7c0b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d8201e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d7c0cef90 0x7f4d7c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d8201e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0b2280 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d8201e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c06bb40 con 0x7f4d7c0cef90 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d8201e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c0b1430 con 0x7f4d7c0b0af0 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d7bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4d7c0cef90 0x7f4d7c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d7b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d7c15d4f0 0x7f4d7c0b03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:59756/0 (socket says 172.21.15.50:59756) 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d7b7fe640 1 -- 172.21.15.50:0/1424120610 learned_addr learned my addr 172.21.15.50:0/1424120610 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d72ffd640 1 --2- 172.21.15.50:0/1424120610 >> v2:172.21.15.170:3300/0 conn(0x7f4d7c0b0af0 0x7f4d7c0b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d7bfff640 1 -- 172.21.15.50:0/1424120610 >> v2:172.21.15.170:3300/0 conn(0x7f4d7c0b0af0 msgr2=0x7f4d7c0b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d7bfff640 1 --2- 172.21.15.50:0/1424120610 >> v2:172.21.15.170:3300/0 conn(0x7f4d7c0b0af0 0x7f4d7c0b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d7bfff640 1 -- 172.21.15.50:0/1424120610 >> v1:172.21.15.50:6789/0 conn(0x7f4d7c15d4f0 legacy=0x7f4d7c0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.533+0000 7f4d7bfff640 1 -- 172.21.15.50:0/1424120610 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0b2710 con 0x7f4d7c0cef90 2023-12-08T08:19:09.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.534+0000 7f4d7bfff640 1 --2- 172.21.15.50:0/1424120610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c0cef90 0x7f4d7c0cf400 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c071250 tx=0x7f4d7402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca07393e18683cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.534+0000 7f4d7affd640 1 -- 172.21.15.50:0/1424120610 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7402cc80 con 0x7f4d7c0cef90 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.534+0000 7f4d7affd640 1 -- 172.21.15.50:0/1424120610 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7402cde0 con 0x7f4d7c0cef90 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.534+0000 7f4d7affd640 1 -- 172.21.15.50:0/1424120610 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74034660 con 0x7f4d7c0cef90 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 -- 172.21.15.50:0/1424120610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c0cef90 msgr2=0x7f4d7c0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 --2- 172.21.15.50:0/1424120610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c0cef90 0x7f4d7c0cf400 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c071250 tx=0x7f4d7402bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 -- 172.21.15.50:0/1424120610 shutdown_connections 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 --2- 172.21.15.50:0/1424120610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c0cef90 0x7f4d7c0cf400 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 --2- 172.21.15.50:0/1424120610 >> v2:172.21.15.170:3300/0 conn(0x7f4d7c0b0af0 0x7f4d7c0b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 -- 172.21.15.50:0/1424120610 >> 172.21.15.50:0/1424120610 conn(0x7f4d7c0d0e00 msgr2=0x7f4d7c0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 -- 172.21.15.50:0/1424120610 shutdown_connections 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.535+0000 7f4d8201e640 1 -- 172.21.15.50:0/1424120610 wait complete. 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.536+0000 7f4d8201e640 1 Processor -- start 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.536+0000 7f4d8201e640 1 -- start start 2023-12-08T08:19:09.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d8201e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d7c0b0af0 0x7f4d7c1f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d8201e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d7c0cef90 0x7f4d7c1efee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d8201e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c15d4f0 0x7f4d7c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d8201e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0cc4e0 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d8201e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1f0420 con 0x7f4d7c0cef90 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d8201e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0cbc40 con 0x7f4d7c0b0af0 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c15d4f0 0x7f4d7c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c15d4f0 0x7f4d7c0cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:52382/0 (socket says 172.21.15.50:52382) 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 -- 172.21.15.50:0/2210957737 learned_addr learned my addr 172.21.15.50:0/2210957737 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d72ffd640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d7c0cef90 0x7f4d7c1efee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7b7fe640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d7c0b0af0 0x7f4d7c1f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 -- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d7c0b0af0 msgr2=0x7f4d7c1f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d7c0b0af0 0x7f4d7c1f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 -- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d7c0cef90 msgr2=0x7f4d7c1efee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d7c0cef90 0x7f4d7c1efee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 -- 172.21.15.50:0/2210957737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74009a70 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7b7fe640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d7c0b0af0 0x7f4d7c1f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.537+0000 7f4d7bfff640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c15d4f0 0x7f4d7c0cb410 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d7402c4e0 tx=0x7f4d74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.538+0000 7f4d78ff9640 1 -- 172.21.15.50:0/2210957737 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74040650 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.538+0000 7f4d78ff9640 1 -- 172.21.15.50:0/2210957737 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d740407b0 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.538+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c0cbf20 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.538+0000 7f4d78ff9640 1 -- 172.21.15.50:0/2210957737 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74040b60 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.538+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c0c8070 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.538+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c0c7ed0 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.539+0000 7f4d78ff9640 1 -- 172.21.15.50:0/2210957737 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d74040cc0 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.539+0000 7f4d78ff9640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d5c06ae70 0x7f4d5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.539+0000 7f4d78ff9640 1 -- 172.21.15.50:0/2210957737 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f4d740ac680 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.540+0000 7f4d7b7fe640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d5c06ae70 0x7f4d5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.540+0000 7f4d7b7fe640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d5c06ae70 0x7f4d5c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005880 tx=0x7f4d6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:09.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.544+0000 7f4d78ff9640 1 -- 172.21.15.50:0/2210957737 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d7c0c7ed0 con 0x7f4d7c15d4f0 2023-12-08T08:19:09.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:09.759+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4d7c0c7ed0 con 0x7f4d7c15d4f0 2023-12-08T08:19:10.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.410+0000 7f4d78ff9640 1 -- 172.21.15.50:0/2210957737 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d7c0c7ed0 con 0x7f4d7c15d4f0 2023-12-08T08:19:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.412+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d5c06ae70 msgr2=0x7f4d5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.412+0000 7f4d8201e640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d5c06ae70 0x7f4d5c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005880 tx=0x7f4d6c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.412+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c15d4f0 msgr2=0x7f4d7c0cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.412+0000 7f4d8201e640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c15d4f0 0x7f4d7c0cb410 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d7402c4e0 tx=0x7f4d74004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 shutdown_connections 2023-12-08T08:19:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d5c06ae70 0x7f4d5c06d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d7c15d4f0 0x7f4d7c0cb410 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d7c0cef90 0x7f4d7c1efee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 --2- 172.21.15.50:0/2210957737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d7c0b0af0 0x7f4d7c1f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 >> 172.21.15.50:0/2210957737 conn(0x7f4d7c0d0e00 msgr2=0x7f4d7c0afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 shutdown_connections 2023-12-08T08:19:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.413+0000 7f4d8201e640 1 -- 172.21.15.50:0/2210957737 wait complete. 2023-12-08T08:19:10.430 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:19:10.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.544+0000 7fad75c17640 1 Processor -- start 2023-12-08T08:19:10.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.544+0000 7fad75c17640 1 -- start start 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad75c17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad700d0090 0x7fad70168050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad75c17640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad700ce850 con 0x7fad700b42f0 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad75c17640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad700ceb30 con 0x7fad70160920 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad75c17640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad700ce640 con 0x7fad700d0090 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad6ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fad700d0090 0x7fad70168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad6effd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fad700b42f0 0x7fad700cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49258/0 (socket says 172.21.15.50:49258) 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad6effd640 1 -- 172.21.15.50:0/3548270501 learned_addr learned my addr 172.21.15.50:0/3548270501 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad6ffff640 1 -- 172.21.15.50:0/3548270501 >> v1:172.21.15.170:6789/0 conn(0x7fad70160920 legacy=0x7fad700d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad6ffff640 1 -- 172.21.15.50:0/3548270501 >> v1:172.21.15.50:6789/0 conn(0x7fad700b42f0 legacy=0x7fad700cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.545+0000 7fad6e7fc640 1 -- 172.21.15.50:0/3548270501 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138374626 0 0) 0x7fad700ce850 con 0x7fad700b42f0 2023-12-08T08:19:10.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.546+0000 7fad6ffff640 1 -- 172.21.15.50:0/3548270501 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700cee10 con 0x7fad700d0090 2023-12-08T08:19:10.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.546+0000 7fad6ffff640 1 --2- 172.21.15.50:0/3548270501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad700d0090 0x7fad70168050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fad68009d90 tx=0x7fad6802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c952af8181bf44e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.546+0000 7fad6e7fc640 1 -- 172.21.15.50:0/3548270501 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6802cc60 con 0x7fad700d0090 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.546+0000 7fad6e7fc640 1 -- 172.21.15.50:0/3548270501 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6802cdc0 con 0x7fad700d0090 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad6e7fc640 1 -- 172.21.15.50:0/3548270501 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68034660 con 0x7fad700d0090 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad75c17640 1 -- 172.21.15.50:0/3548270501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad700d0090 msgr2=0x7fad70168050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad75c17640 1 --2- 172.21.15.50:0/3548270501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad700d0090 0x7fad70168050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fad68009d90 tx=0x7fad6802beb0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad75c17640 1 -- 172.21.15.50:0/3548270501 shutdown_connections 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad75c17640 1 --2- 172.21.15.50:0/3548270501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad700d0090 0x7fad70168050 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad75c17640 1 -- 172.21.15.50:0/3548270501 >> 172.21.15.50:0/3548270501 conn(0x7fad7009c340 msgr2=0x7fad700d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad75c17640 1 -- 172.21.15.50:0/3548270501 shutdown_connections 2023-12-08T08:19:10.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.547+0000 7fad75c17640 1 -- 172.21.15.50:0/3548270501 wait complete. 2023-12-08T08:19:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.548+0000 7fad75c17640 1 Processor -- start 2023-12-08T08:19:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.548+0000 7fad75c17640 1 -- start start 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad75c17640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad700b42f0 0x7fad700cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad75c17640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad700d0090 0x7fad70152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad75c17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad70160920 0x7fad7015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad75c17640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701526a0 con 0x7fad70160920 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad75c17640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700c8180 con 0x7fad700b42f0 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad75c17640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7015c420 con 0x7fad700d0090 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad70160920 0x7fad7015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad70160920 0x7fad7015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51366/0 (socket says 172.21.15.50:51366) 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.549+0000 7fad6ffff640 1 -- 172.21.15.50:0/596559523 learned_addr learned my addr 172.21.15.50:0/596559523 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6effd640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad700d0090 0x7fad70152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6f7fe640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad700b42f0 0x7fad700cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6ffff640 1 -- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad700d0090 msgr2=0x7fad70152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6ffff640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad700d0090 0x7fad70152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6ffff640 1 -- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad700b42f0 msgr2=0x7fad700cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6ffff640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad700b42f0 0x7fad700cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6ffff640 1 -- 172.21.15.50:0/596559523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68009a70 con 0x7fad70160920 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6effd640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad700d0090 0x7fad70152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad6ffff640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad70160920 0x7fad7015bb40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fad68009d90 tx=0x7fad68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad57fff640 1 -- 172.21.15.50:0/596559523 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68040450 con 0x7fad70160920 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad57fff640 1 -- 172.21.15.50:0/596559523 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad680405d0 con 0x7fad70160920 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad700c7850 con 0x7fad70160920 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad57fff640 1 -- 172.21.15.50:0/596559523 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68040980 con 0x7fad70160920 2023-12-08T08:19:10.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.550+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad700c7e10 con 0x7fad70160920 2023-12-08T08:19:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.551+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70067540 con 0x7fad70160920 2023-12-08T08:19:10.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.552+0000 7fad57fff640 1 -- 172.21.15.50:0/596559523 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad68040ae0 con 0x7fad70160920 2023-12-08T08:19:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.552+0000 7fad57fff640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fad5c06ae70 0x7fad5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.552+0000 7fad57fff640 1 -- 172.21.15.50:0/596559523 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fad680abfc0 con 0x7fad70160920 2023-12-08T08:19:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.552+0000 7fad6f7fe640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fad5c06ae70 0x7fad5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:10.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.553+0000 7fad6f7fe640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fad5c06ae70 0x7fad5c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad60000f60 tx=0x7fad60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:10.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.557+0000 7fad57fff640 1 -- 172.21.15.50:0/596559523 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad680dee90 con 0x7fad70160920 2023-12-08T08:19:10.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:10.733+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad700b54f0 con 0x7fad70160920 2023-12-08T08:19:11.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.412+0000 7fad57fff640 1 -- 172.21.15.50:0/596559523 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fad68076d00 con 0x7fad70160920 2023-12-08T08:19:11.415 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:19:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.415+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fad5c06ae70 msgr2=0x7fad5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.415+0000 7fad75c17640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fad5c06ae70 0x7fad5c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad60000f60 tx=0x7fad60009040 comp rx=0 tx=0).stop 2023-12-08T08:19:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.415+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad70160920 msgr2=0x7fad7015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.415+0000 7fad75c17640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad70160920 0x7fad7015bb40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fad68009d90 tx=0x7fad68004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 shutdown_connections 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fad5c06ae70 0x7fad5c06d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fad70160920 0x7fad7015bb40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad700d0090 0x7fad70152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 --2- 172.21.15.50:0/596559523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad700b42f0 0x7fad700cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 >> 172.21.15.50:0/596559523 conn(0x7fad7009c340 msgr2=0x7fad70153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 shutdown_connections 2023-12-08T08:19:11.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.416+0000 7fad75c17640 1 -- 172.21.15.50:0/596559523 wait complete. 2023-12-08T08:19:11.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:19:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.547+0000 7fbe5ed3c640 1 Processor -- start 2023-12-08T08:19:11.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.547+0000 7fbe5ed3c640 1 -- start start 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe5ed3c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe58143720 0x7fbe58071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe5ed3c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe580b2870 con 0x7fbe580b2d00 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe5ed3c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe58071b40 con 0x7fbe58071220 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe5ed3c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe580b1c60 con 0x7fbe58143720 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe5d2d9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe580b2d00 0x7fbe580b3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49268/0 (socket says 172.21.15.50:49268) 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe57fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbe58143720 0x7fbe58071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe5d2d9640 1 -- 172.21.15.50:0/3997143186 learned_addr learned my addr 172.21.15.50:0/3997143186 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe57fff640 1 -- 172.21.15.50:0/3997143186 >> v1:172.21.15.170:6789/0 conn(0x7fbe58071220 legacy=0x7fbe5815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe57fff640 1 -- 172.21.15.50:0/3997143186 >> v1:172.21.15.50:6789/0 conn(0x7fbe580b2d00 legacy=0x7fbe580b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe57fff640 1 -- 172.21.15.50:0/3997143186 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580b1f40 con 0x7fbe58143720 2023-12-08T08:19:11.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.548+0000 7fbe577fe640 1 -- 172.21.15.50:0/3997143186 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273862125 0 0) 0x7fbe580b2870 con 0x7fbe580b2d00 2023-12-08T08:19:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.549+0000 7fbe57fff640 1 --2- 172.21.15.50:0/3997143186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58143720 0x7fbe58071600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb7682645509349 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.549+0000 7fbe577fe640 1 -- 172.21.15.50:0/3997143186 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4402f8a0 con 0x7fbe58143720 2023-12-08T08:19:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.549+0000 7fbe577fe640 1 -- 172.21.15.50:0/3997143186 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4402fa00 con 0x7fbe58143720 2023-12-08T08:19:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.549+0000 7fbe577fe640 1 -- 172.21.15.50:0/3997143186 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4402fd90 con 0x7fbe58143720 2023-12-08T08:19:11.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.550+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/3997143186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58143720 msgr2=0x7fbe58071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.550+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/3997143186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58143720 0x7fbe58071600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402dae0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.550+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/3997143186 shutdown_connections 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.550+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/3997143186 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58143720 0x7fbe58071600 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.550+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/3997143186 >> 172.21.15.50:0/3997143186 conn(0x7fbe580ceba0 msgr2=0x7fbe580cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.550+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/3997143186 shutdown_connections 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.550+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/3997143186 wait complete. 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.551+0000 7fbe5ed3c640 1 Processor -- start 2023-12-08T08:19:11.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.551+0000 7fbe5ed3c640 1 -- start start 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5ed3c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58071220 0x7fbe581ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5ed3c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe580b2d00 0x7fbe58141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5ed3c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe58143720 0x7fbe580cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5ed3c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58137710 con 0x7fbe58071220 2023-12-08T08:19:11.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5ed3c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe581379b0 con 0x7fbe580b2d00 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5ed3c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58137c90 con 0x7fbe58143720 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58071220 0x7fbe581ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58071220 0x7fbe581ee300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51382/0 (socket says 172.21.15.50:51382) 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 -- 172.21.15.50:0/823731121 learned_addr learned my addr 172.21.15.50:0/823731121 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe57fff640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe580b2d00 0x7fbe58141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5d2d9640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe58143720 0x7fbe580cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 -- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe58143720 msgr2=0x7fbe580cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe58143720 0x7fbe580cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 -- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe580b2d00 msgr2=0x7fbe58141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe580b2d00 0x7fbe58141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 -- 172.21.15.50:0/823731121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44009400 con 0x7fbe58071220 2023-12-08T08:19:11.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe57fff640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe580b2d00 0x7fbe58141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5d2d9640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe58143720 0x7fbe580cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.552+0000 7fbe5cad8640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58071220 0x7fbe581ee300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c430 tx=0x7fbe4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.553+0000 7fbe557fa640 1 -- 172.21.15.50:0/823731121 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c011790 con 0x7fbe58071220 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.553+0000 7fbe557fa640 1 -- 172.21.15.50:0/823731121 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c0118f0 con 0x7fbe58071220 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.553+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe58137f70 con 0x7fbe58071220 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.553+0000 7fbe557fa640 1 -- 172.21.15.50:0/823731121 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c011ce0 con 0x7fbe58071220 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.553+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe581ee840 con 0x7fbe58071220 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.553+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe58138490 con 0x7fbe58071220 2023-12-08T08:19:11.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.554+0000 7fbe557fa640 1 -- 172.21.15.50:0/823731121 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe4c01c460 con 0x7fbe58071220 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.554+0000 7fbe557fa640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.555+0000 7fbe557fa640 1 -- 172.21.15.50:0/823731121 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6340+0+0 (secure 0 0 0) 0x7fbe4c089850 con 0x7fbe58071220 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.555+0000 7fbe57fff640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:11.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.555+0000 7fbe57fff640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbe44038000 tx=0x7fbe44008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:11.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.559+0000 7fbe557fa640 1 -- 172.21.15.50:0/823731121 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe58138490 con 0x7fbe58071220 2023-12-08T08:19:11.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:11.738+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe58067540 con 0x7fbe58071220 2023-12-08T08:19:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.416+0000 7fbe557fa640 1 -- 172.21.15.50:0/823731121 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbe4c054680 con 0x7fbe58071220 2023-12-08T08:19:12.420 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-08T08:19:12.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.420+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 msgr2=0x7fbe3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.420+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbe44038000 tx=0x7fbe44008030 comp rx=0 tx=0).stop 2023-12-08T08:19:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.420+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58071220 msgr2=0x7fbe581ee300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.420+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58071220 0x7fbe581ee300 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c430 tx=0x7fbe4c00c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 shutdown_connections 2023-12-08T08:19:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe58143720 0x7fbe580cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe580b2d00 0x7fbe58141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 --2- 172.21.15.50:0/823731121 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe58071220 0x7fbe581ee300 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 >> 172.21.15.50:0/823731121 conn(0x7fbe580ceba0 msgr2=0x7fbe5813e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 shutdown_connections 2023-12-08T08:19:12.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.421+0000 7fbe5ed3c640 1 -- 172.21.15.50:0/823731121 wait complete. 2023-12-08T08:19:12.440 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-08T08:19:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.553+0000 7f267261e640 1 Processor -- start 2023-12-08T08:19:12.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.553+0000 7f267261e640 1 -- start start 2023-12-08T08:19:12.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f267261e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 0x7f266c0cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f267261e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c0cff90 con 0x7f266c15d600 2023-12-08T08:19:12.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f267261e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c0d0270 con 0x7f266c06ecf0 2023-12-08T08:19:12.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f267261e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0d0550 con 0x7f266c0cfa20 2023-12-08T08:19:12.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f266c15d600 0x7f266c0cbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49274/0 (socket says 172.21.15.50:49274) 2023-12-08T08:19:12.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266b7fe640 1 -- 172.21.15.50:0/534241959 learned_addr learned my addr 172.21.15.50:0/534241959 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322455746 0 0) 0x7f266c0cff90 con 0x7f266c15d600 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2658003520 con 0x7f266c15d600 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f2670bbb640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 0x7f266c0cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2195288356 0 0) 0x7f2658003520 con 0x7f266c15d600 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 msgr2=0x7f266c0cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 0x7f266c0cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 >> v1:172.21.15.170:6789/0 conn(0x7f266c06ecf0 legacy=0x7f266c06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0cb3d0 con 0x7f266c15d600 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f265c001670 con 0x7f266c15d600 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.554+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 >> v1:172.21.15.50:6789/0 conn(0x7f266c15d600 legacy=0x7f266c0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266affd640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26580039a0 0x7f2658003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266affd640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580047c0 0x7f2658004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266affd640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 0x7f2658005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0d0550 con 0x7f26580039a0 2023-12-08T08:19:12.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265800ba60 con 0x7f26580047c0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265800bc20 con 0x7f266c0cfa20 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266bfff640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26580039a0 0x7f2658003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266b7fe640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580047c0 0x7f2658004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f2670bbb640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 0x7f2658005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266bfff640 1 -- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 msgr2=0x7f2658005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266bfff640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c0cfa20 0x7f2658005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266bfff640 1 -- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580047c0 msgr2=0x7f2658004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266bfff640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580047c0 0x7f2658004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266bfff640 1 -- 172.21.15.50:0/534241959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658003520 con 0x7f26580039a0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.555+0000 7f266b7fe640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580047c0 0x7f2658004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f266bfff640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26580039a0 0x7f2658003dc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2654001720 tx=0x7f26580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c583cd8f8a4d3512 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540052d0 con 0x7f26580039a0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265402e050 con 0x7f26580039a0 2023-12-08T08:19:12.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f266affd640 1 -- 172.21.15.50:0/534241959 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540035f0 con 0x7f26580039a0 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f267261e640 1 -- 172.21.15.50:0/534241959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26580039a0 msgr2=0x7f2658003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f267261e640 1 --2- 172.21.15.50:0/534241959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f26580039a0 0x7f2658003dc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2654001720 tx=0x7f26580057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f2670bbb640 1 -- 172.21.15.50:0/534241959 reap_dead start 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f267261e640 1 -- 172.21.15.50:0/534241959 shutdown_connections 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f267261e640 1 -- 172.21.15.50:0/534241959 >> 172.21.15.50:0/534241959 conn(0x7f266c0d0d80 msgr2=0x7f266c0d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f267261e640 1 -- 172.21.15.50:0/534241959 shutdown_connections 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.556+0000 7f267261e640 1 -- 172.21.15.50:0/534241959 wait complete. 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.558+0000 7f267261e640 1 Processor -- start 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.558+0000 7f267261e640 1 -- start start 2023-12-08T08:19:12.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.558+0000 7f267261e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580039a0 0x7f266c147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f267261e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266c0c7ee0 0x7f266c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f267261e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c158940 0x7f266c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f267261e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c147750 con 0x7f266c0c7ee0 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f267261e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c159300 con 0x7f26580039a0 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f267261e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0cac60 con 0x7f266c158940 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266c0c7ee0 0x7f266c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266c0c7ee0 0x7f266c0c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51390/0 (socket says 172.21.15.50:51390) 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 -- 172.21.15.50:0/2252903821 learned_addr learned my addr 172.21.15.50:0/2252903821 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266bfff640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580039a0 0x7f266c147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f2670bbb640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c158940 0x7f266c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 -- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c158940 msgr2=0x7f266c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c158940 0x7f266c158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 -- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580039a0 msgr2=0x7f266c147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580039a0 0x7f266c147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 -- 172.21.15.50:0/2252903821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0c9bc0 con 0x7f266c0c7ee0 2023-12-08T08:19:12.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f266b7fe640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266c0c7ee0 0x7f266c0c9270 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f265c000fb0 tx=0x7f265c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f2668ff9640 1 -- 172.21.15.50:0/2252903821 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00c660 con 0x7f266c0c7ee0 2023-12-08T08:19:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f2668ff9640 1 -- 172.21.15.50:0/2252903821 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c00c7c0 con 0x7f266c0c7ee0 2023-12-08T08:19:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f2668ff9640 1 -- 172.21.15.50:0/2252903821 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00cb30 con 0x7f266c0c7ee0 2023-12-08T08:19:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c0c9ea0 con 0x7f266c0c7ee0 2023-12-08T08:19:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.559+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c0ca460 con 0x7f266c0c7ee0 2023-12-08T08:19:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.560+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c067540 con 0x7f266c0c7ee0 2023-12-08T08:19:12.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.561+0000 7f2668ff9640 1 -- 172.21.15.50:0/2252903821 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f265c00cc90 con 0x7f266c0c7ee0 2023-12-08T08:19:12.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.561+0000 7f2668ff9640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f264c06ae70 0x7f264c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:12.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.562+0000 7f2668ff9640 1 -- 172.21.15.50:0/2252903821 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f265c0894d0 con 0x7f266c0c7ee0 2023-12-08T08:19:12.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.562+0000 7f266bfff640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f264c06ae70 0x7f264c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:12.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.562+0000 7f266bfff640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f264c06ae70 0x7f264c06d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2654033000 tx=0x7f2654009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:12.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.566+0000 7f2668ff9640 1 -- 172.21.15.50:0/2252903821 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f265c054530 con 0x7f266c0c7ee0 2023-12-08T08:19:12.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:12.744+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f266c0d0b60 con 0x7f266c0c7ee0 2023-12-08T08:19:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.418+0000 7f2668ff9640 1 -- 172.21.15.50:0/2252903821 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f265c057b50 con 0x7f266c0c7ee0 2023-12-08T08:19:13.421 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data_ec' removed 2023-12-08T08:19:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f264c06ae70 msgr2=0x7f264c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f264c06ae70 0x7f264c06d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2654033000 tx=0x7f2654009030 comp rx=0 tx=0).stop 2023-12-08T08:19:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266c0c7ee0 msgr2=0x7f266c0c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266c0c7ee0 0x7f266c0c9270 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f265c000fb0 tx=0x7f265c00eb90 comp rx=0 tx=0).stop 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 shutdown_connections 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f264c06ae70 0x7f264c06d330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f266c0c7ee0 0x7f266c0c9270 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f266c158940 0x7f266c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 --2- 172.21.15.50:0/2252903821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26580039a0 0x7f266c147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 >> 172.21.15.50:0/2252903821 conn(0x7f266c0d0d80 msgr2=0x7f266c0ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 shutdown_connections 2023-12-08T08:19:13.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.422+0000 7f267261e640 1 -- 172.21.15.50:0/2252903821 wait complete. 2023-12-08T08:19:13.443 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:19:13.443 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:19:13.443 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:19:13.443 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:13.443 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:19:13.443 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:19:13.444 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:19:13.444 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:13.444 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:19:13.444 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:19:13.444 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:19:13.444 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:13.444 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:19:13.444 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:19:13.445 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:19:13.445 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:13.454 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:19:13.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:19:13.455 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:19:13.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:19:13.456 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:19:13.457 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:19:13.457 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:19:13.457 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:19:13.497 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:19:13.497 DEBUG:teuthology.parallel:result is None 2023-12-08T08:19:13.497 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:19:13.498 DEBUG:teuthology.parallel:result is None 2023-12-08T08:19:13.500 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:19:13.500 DEBUG:teuthology.parallel:result is None 2023-12-08T08:19:13.500 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:19:13.500 DEBUG:teuthology.parallel:result is None 2023-12-08T08:19:13.501 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:19:13.582 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2023-12-08T08:19:13.583 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2023-12-08T08:19:13.586 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-08T08:19:13.586 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-08T08:19:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.616+0000 7f295f01e640 1 Processor -- start 2023-12-08T08:19:13.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.616+0000 7f295f01e640 1 -- start start 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f295f01e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f29581608a0 0x7f29580d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f295f01e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29580b1d70 0x7f29580d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f295f01e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580afce0 0x7f29580b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f295f01e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580d0620 con 0x7f29580b1d70 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f295f01e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580d20b0 con 0x7f29581608a0 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f295f01e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580d1dd0 con 0x7f29580afce0 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f2957fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29580b1d70 0x7f29580d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f2957fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29580b1d70 0x7f29580d1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51444/0 (socket says 172.21.15.50:51444) 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f2957fff640 1 -- 172.21.15.50:0/3025133354 learned_addr learned my addr 172.21.15.50:0/3025133354 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.617+0000 7f295cdba640 1 --2- 172.21.15.50:0/3025133354 >> v2:172.21.15.170:3300/0 conn(0x7f29581608a0 0x7f29580d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.618+0000 7f295d5bb640 1 --2- 172.21.15.50:0/3025133354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580afce0 0x7f29580b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.618+0000 7f2957fff640 1 -- 172.21.15.50:0/3025133354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580afce0 msgr2=0x7f29580b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.618+0000 7f2957fff640 1 --2- 172.21.15.50:0/3025133354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580afce0 0x7f29580b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.618+0000 7f2957fff640 1 -- 172.21.15.50:0/3025133354 >> v2:172.21.15.170:3300/0 conn(0x7f29581608a0 msgr2=0x7f29580d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.618+0000 7f2957fff640 1 --2- 172.21.15.50:0/3025133354 >> v2:172.21.15.170:3300/0 conn(0x7f29581608a0 0x7f29580d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.618+0000 7f2957fff640 1 -- 172.21.15.50:0/3025133354 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580cff60 con 0x7f29580b1d70 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.618+0000 7f2957fff640 1 --2- 172.21.15.50:0/3025133354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580b1d70 0x7f29580d1470 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f295808b770 tx=0x7f294c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377f580e34dfdda server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f29577fe640 1 -- 172.21.15.50:0/3025133354 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c0317e0 con 0x7f29580b1d70 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f29577fe640 1 -- 172.21.15.50:0/3025133354 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c031940 con 0x7f29580b1d70 2023-12-08T08:19:13.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f29577fe640 1 -- 172.21.15.50:0/3025133354 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c031cd0 con 0x7f29580b1d70 2023-12-08T08:19:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 -- 172.21.15.50:0/3025133354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580b1d70 msgr2=0x7f29580d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 --2- 172.21.15.50:0/3025133354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580b1d70 0x7f29580d1470 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f295808b770 tx=0x7f294c02b880 comp rx=0 tx=0).stop 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 -- 172.21.15.50:0/3025133354 shutdown_connections 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 --2- 172.21.15.50:0/3025133354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580afce0 0x7f29580b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 --2- 172.21.15.50:0/3025133354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580b1d70 0x7f29580d1470 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 --2- 172.21.15.50:0/3025133354 >> v2:172.21.15.170:3300/0 conn(0x7f29581608a0 0x7f29580d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 -- 172.21.15.50:0/3025133354 >> 172.21.15.50:0/3025133354 conn(0x7f29580d3030 msgr2=0x7f29580d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 -- 172.21.15.50:0/3025133354 shutdown_connections 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.619+0000 7f295f01e640 1 -- 172.21.15.50:0/3025133354 wait complete. 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.621+0000 7f295f01e640 1 Processor -- start 2023-12-08T08:19:13.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.621+0000 7f295f01e640 1 -- start start 2023-12-08T08:19:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295f01e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580afce0 0x7f29581f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295f01e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580b1d70 0x7f295806c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295f01e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29581608a0 0x7f295806c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580afce0 0x7f29581f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580afce0 0x7f29581f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51450/0 (socket says 172.21.15.50:51450) 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 -- 172.21.15.50:0/2931949864 learned_addr learned my addr 172.21.15.50:0/2931949864 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295f01e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295815cb80 con 0x7f29580afce0 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295815bf70 con 0x7f29581608a0 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295815c250 con 0x7f29580b1d70 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f2957fff640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580b1d70 0x7f295806c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295d5bb640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29581608a0 0x7f295806c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 -- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580b1d70 msgr2=0x7f295806c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580b1d70 0x7f295806c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 -- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29581608a0 msgr2=0x7f295806c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29581608a0 0x7f295806c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295cdba640 1 -- 172.21.15.50:0/2931949864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c0094d0 con 0x7f29580afce0 2023-12-08T08:19:13.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f2957fff640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580b1d70 0x7f295806c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.622+0000 7f295d5bb640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29581608a0 0x7f295806c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.623+0000 7f295cdba640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580afce0 0x7f29581f5f90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f294800e870 tx=0x7f294800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.623+0000 7f29557fa640 1 -- 172.21.15.50:0/2931949864 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29480094f0 con 0x7f29580afce0 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.623+0000 7f29557fa640 1 -- 172.21.15.50:0/2931949864 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294800c940 con 0x7f29580afce0 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.623+0000 7f29557fa640 1 -- 172.21.15.50:0/2931949864 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294800ccf0 con 0x7f29580afce0 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.623+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295815c530 con 0x7f29580afce0 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.623+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29581f64d0 con 0x7f29580afce0 2023-12-08T08:19:13.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.624+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2958067430 con 0x7f29580afce0 2023-12-08T08:19:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.625+0000 7f29557fa640 1 -- 172.21.15.50:0/2931949864 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2948013470 con 0x7f29580afce0 2023-12-08T08:19:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.625+0000 7f29557fa640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f294406ae70 0x7f294406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.625+0000 7f29557fa640 1 -- 172.21.15.50:0/2931949864 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2948089ca0 con 0x7f29580afce0 2023-12-08T08:19:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.625+0000 7f2957fff640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f294406ae70 0x7f294406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:13.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.626+0000 7f2957fff640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f294406ae70 0x7f294406d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f294c036000 tx=0x7f294c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:13.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.629+0000 7f29557fa640 1 -- 172.21.15.50:0/2931949864 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2948054f60 con 0x7f29580afce0 2023-12-08T08:19:13.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:13.821+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f29580b2db0 con 0x7f29580afce0 2023-12-08T08:19:14.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.433+0000 7f29557fa640 1 -- 172.21.15.50:0/2931949864 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2948021080 con 0x7f29580afce0 2023-12-08T08:19:14.436 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-08T08:19:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.435+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f294406ae70 msgr2=0x7f294406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.435+0000 7f295f01e640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f294406ae70 0x7f294406d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f294c036000 tx=0x7f294c03d040 comp rx=0 tx=0).stop 2023-12-08T08:19:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.435+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580afce0 msgr2=0x7f29581f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.435+0000 7f295f01e640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580afce0 0x7f29581f5f90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f294800e870 tx=0x7f294800ed30 comp rx=0 tx=0).stop 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 shutdown_connections 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f294406ae70 0x7f294406d330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29581608a0 0x7f295806c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29580b1d70 0x7f295806c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 --2- 172.21.15.50:0/2931949864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29580afce0 0x7f29581f5f90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 >> 172.21.15.50:0/2931949864 conn(0x7f29580d3030 msgr2=0x7f29580b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 shutdown_connections 2023-12-08T08:19:14.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.436+0000 7f295f01e640 1 -- 172.21.15.50:0/2931949864 wait complete. 2023-12-08T08:19:14.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:19:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.558+0000 7f077346b640 1 Processor -- start 2023-12-08T08:19:14.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.558+0000 7f077346b640 1 -- start start 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f077346b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f076c0b6ac0 0x7f076c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f077346b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f076c0ce1c0 0x7f076c0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f077346b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c0d0070 con 0x7f076c0cd660 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f077346b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c160cb0 con 0x7f076c0ce1c0 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f077346b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0d02b0 con 0x7f076c0b6ac0 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771a08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f076c0ce1c0 0x7f076c0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771a08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f076c0ce1c0 0x7f076c0cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51462/0 (socket says 172.21.15.50:51462) 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771a08640 1 -- 172.21.15.50:0/2029448535 learned_addr learned my addr 172.21.15.50:0/2029448535 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771207640 1 --2- 172.21.15.50:0/2029448535 >> v2:172.21.15.170:3300/0 conn(0x7f076c0b6ac0 0x7f076c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771a08640 1 -- 172.21.15.50:0/2029448535 >> v2:172.21.15.170:3300/0 conn(0x7f076c0b6ac0 msgr2=0x7f076c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771a08640 1 --2- 172.21.15.50:0/2029448535 >> v2:172.21.15.170:3300/0 conn(0x7f076c0b6ac0 0x7f076c0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771a08640 1 -- 172.21.15.50:0/2029448535 >> v1:172.21.15.170:6789/0 conn(0x7f076c0cd660 legacy=0x7f076c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:14.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.559+0000 7f0771a08640 1 -- 172.21.15.50:0/2029448535 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0cb430 con 0x7f076c0ce1c0 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.560+0000 7f0771a08640 1 --2- 172.21.15.50:0/2029448535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0ce1c0 0x7f076c0cc1f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f076c0ce8e0 tx=0x7f076402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394a933938e5b930 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.560+0000 7f0763fff640 1 -- 172.21.15.50:0/2029448535 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076402c960 con 0x7f076c0ce1c0 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.560+0000 7f0763fff640 1 -- 172.21.15.50:0/2029448535 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076402cac0 con 0x7f076c0ce1c0 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.560+0000 7f0763fff640 1 -- 172.21.15.50:0/2029448535 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076402ce50 con 0x7f076c0ce1c0 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 -- 172.21.15.50:0/2029448535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0ce1c0 msgr2=0x7f076c0cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 --2- 172.21.15.50:0/2029448535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0ce1c0 0x7f076c0cc1f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f076c0ce8e0 tx=0x7f076402bdc0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 -- 172.21.15.50:0/2029448535 shutdown_connections 2023-12-08T08:19:14.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 --2- 172.21.15.50:0/2029448535 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0ce1c0 0x7f076c0cc1f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 --2- 172.21.15.50:0/2029448535 >> v2:172.21.15.170:3300/0 conn(0x7f076c0b6ac0 0x7f076c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 -- 172.21.15.50:0/2029448535 >> 172.21.15.50:0/2029448535 conn(0x7f076c0d0de0 msgr2=0x7f076c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 -- 172.21.15.50:0/2029448535 shutdown_connections 2023-12-08T08:19:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.561+0000 7f077346b640 1 -- 172.21.15.50:0/2029448535 wait complete. 2023-12-08T08:19:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.562+0000 7f077346b640 1 Processor -- start 2023-12-08T08:19:14.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.562+0000 7f077346b640 1 -- start start 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f077346b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076c0b6ac0 0x7f076c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f077346b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0cd660 0x7f076c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f077346b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f076c0ce1c0 0x7f076c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f077346b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c153880 con 0x7f076c0cd660 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f077346b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09b870 con 0x7f076c0b6ac0 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f077346b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09bb50 con 0x7f076c0ce1c0 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0cd660 0x7f076c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0cd660 0x7f076c152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51464/0 (socket says 172.21.15.50:51464) 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 -- 172.21.15.50:0/3030760521 learned_addr learned my addr 172.21.15.50:0/3030760521 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0771a08640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f076c0ce1c0 0x7f076c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0771207640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076c0b6ac0 0x7f076c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 -- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f076c0ce1c0 msgr2=0x7f076c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f076c0ce1c0 0x7f076c153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 -- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076c0b6ac0 msgr2=0x7f076c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076c0b6ac0 0x7f076c0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 -- 172.21.15.50:0/3030760521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009b30 con 0x7f076c0cd660 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0771a08640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f076c0ce1c0 0x7f076c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0771207640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076c0b6ac0 0x7f076c0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.563+0000 7f0770a06640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0cd660 0x7f076c152e00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f075c00b3e0 tx=0x7f075c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.564+0000 7f0761ffb640 1 -- 172.21.15.50:0/3030760521 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c011830 con 0x7f076c0cd660 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.564+0000 7f0761ffb640 1 -- 172.21.15.50:0/3030760521 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c0119b0 con 0x7f076c0cd660 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.564+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c0c7f50 con 0x7f076c0cd660 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.564+0000 7f0761ffb640 1 -- 172.21.15.50:0/3030760521 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c011d60 con 0x7f076c0cd660 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.564+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c0c8510 con 0x7f076c0cd660 2023-12-08T08:19:14.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.565+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c0c8730 con 0x7f076c0cd660 2023-12-08T08:19:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.565+0000 7f0761ffb640 1 -- 172.21.15.50:0/3030760521 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f075c01a400 con 0x7f076c0cd660 2023-12-08T08:19:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.565+0000 7f0761ffb640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f075006ae40 0x7f075006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.566+0000 7f0761ffb640 1 -- 172.21.15.50:0/3030760521 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f075c089580 con 0x7f076c0cd660 2023-12-08T08:19:14.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.566+0000 7f0771207640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f075006ae40 0x7f075006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.566+0000 7f0771207640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f075006ae40 0x7f075006d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f076800b820 tx=0x7f0768008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.570+0000 7f0761ffb640 1 -- 172.21.15.50:0/3030760521 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f075c054830 con 0x7f076c0cd660 2023-12-08T08:19:14.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.812+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f076c067430 con 0x7f076c0cd660 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.812+0000 7f0761ffb640 1 -- 172.21.15.50:0/3030760521 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f075c015090 con 0x7f076c0cd660 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlaG07MRAAZ2C/ACHBbMU0P3IDa4516A==", 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:19:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJl0UcYAxAAc5kskq3L748xnYJS3a/PqQ==", 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlvkB4ORAAEQfiX2naCRnFje/FOMizXg==", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJlrYp1ChAAxmo/NoWZQ0WYvxrDQHg4eQ==", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:19:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD60HJlpPofNBAA0REn7uUB/Aw/ZUIJbVXi6w==", 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD90HJlbeXjMhAAlllaC0AovOXt52peQyZxUA==", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAA0XJl1wG0MRAAMSfSCEAMMoaZg2yN34XAOg==", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAD0XJl07uHMBAATuVeBNRe/TDGswgteMtbbA==", 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAI0XJlnhr4ABAAd/FP6Mh+uBHwROBFS1NtLQ==", 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAK0XJl6ll3OhAADDM1OFDZ7Gj4TR221Emwkg==", 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-08T08:19:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAN0XJl3hN1OBAA3tbsaT8CSnH4UUqbPlXpug==", 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQ0XJldVlvNhAAHkTT6FkK2/lqQ7CNO2e3wA==", 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw==", 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-08T08:19:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJlQLWGFhAAwqipxJ5qn/WzWLns1fy2BA==", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJl8yrWEhAA8ZmN36Sg2PS+3amjVbA14g==", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-08T08:19:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJlgnHlGRAAgLbG+IB+A9ncV9o+9antbA==", 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlv7lkExAAPyIJa8imvyFOTuoaWv3Rkg==", 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mds", 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAc0XJlhLEbARAAuxHMDRfCHyW/fEwPrhBTuw==", 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mds" 2023-12-08T08:19:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-mgr", 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAc0XJlwbsbARAAUmc0cmO1DtLLeyK/zDOk3g==", 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-osd", 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAc0XJlpMMbARAA/F1C4TvsZ48uRJjK94digw==", 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-osd" 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd", 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAc0XJlP8sbARAAvItSxKUuIyuoKnr3aLgccw==", 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAc0XJly9IbARAAvjSVDSNzsb6MzAt9gqStqg==", 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.bootstrap-rgw", 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAc0XJlltobARAAgWjlo10vveN3eHl3weeOuw==", 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlau9hLRAAS/TfKtA/MZF8TMtkAvCD7A==", 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlGu+ZKRAAIlksM6WcF58EtQMpAY6OGg==", 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-08T08:19:14.831 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f075006ae40 msgr2=0x7f075006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f075006ae40 0x7f075006d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f076800b820 tx=0x7f0768008040 comp rx=0 tx=0).stop 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0cd660 msgr2=0x7f076c152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0cd660 0x7f076c152e00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f075c00b3e0 tx=0x7f075c00b8a0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 shutdown_connections 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f075006ae40 0x7f075006d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f076c0cd660 0x7f076c152e00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f076c0ce1c0 0x7f076c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 --2- 172.21.15.50:0/3030760521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f076c0b6ac0 0x7f076c0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 >> 172.21.15.50:0/3030760521 conn(0x7f076c0d0de0 msgr2=0x7f076c06f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 shutdown_connections 2023-12-08T08:19:14.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.814+0000 7f077346b640 1 -- 172.21.15.50:0/3030760521 wait complete. 2023-12-08T08:19:14.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-08T08:19:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.938+0000 7f332f52c640 1 Processor -- start 2023-12-08T08:19:14.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.939+0000 7f332f52c640 1 -- start start 2023-12-08T08:19:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.939+0000 7f332f52c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3328071dc0 0x7f3328070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.939+0000 7f332f52c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332806dae0 con 0x7f3328159a10 2023-12-08T08:19:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.939+0000 7f332f52c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280ae2e0 con 0x7f33280b1cf0 2023-12-08T08:19:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.939+0000 7f332f52c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332806dd30 con 0x7f3328071dc0 2023-12-08T08:19:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f332cac7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3328071dc0 0x7f3328070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f332d2c8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3328159a10 0x7f33280b3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49296/0 (socket says 172.21.15.50:49296) 2023-12-08T08:19:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f332d2c8640 1 -- 172.21.15.50:0/2450631129 learned_addr learned my addr 172.21.15.50:0/2450631129 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f332cac7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3328071dc0 0x7f3328070750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51480/0 (socket says 172.21.15.50:51480) 2023-12-08T08:19:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f332cac7640 1 -- 172.21.15.50:0/2450631129 >> v1:172.21.15.170:6789/0 conn(0x7f33280b1cf0 legacy=0x7f3328070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f332cac7640 1 -- 172.21.15.50:0/2450631129 >> v1:172.21.15.50:6789/0 conn(0x7f3328159a10 legacy=0x7f33280b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f331ffff640 1 -- 172.21.15.50:0/2450631129 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617012321 0 0) 0x7f332806dae0 con 0x7f3328159a10 2023-12-08T08:19:14.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.940+0000 7f332cac7640 1 -- 172.21.15.50:0/2450631129 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332806e010 con 0x7f3328071dc0 2023-12-08T08:19:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.941+0000 7f332cac7640 1 --2- 172.21.15.50:0/2450631129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3328071dc0 0x7f3328070750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33180097a0 tx=0x7f331802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45ab87beea48437 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.941+0000 7f331ffff640 1 -- 172.21.15.50:0/2450631129 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331802e070 con 0x7f3328071dc0 2023-12-08T08:19:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.941+0000 7f331ffff640 1 -- 172.21.15.50:0/2450631129 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33180315a0 con 0x7f3328071dc0 2023-12-08T08:19:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.941+0000 7f331ffff640 1 -- 172.21.15.50:0/2450631129 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318031930 con 0x7f3328071dc0 2023-12-08T08:19:14.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.941+0000 7f332f52c640 1 -- 172.21.15.50:0/2450631129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3328071dc0 msgr2=0x7f3328070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.941+0000 7f332f52c640 1 --2- 172.21.15.50:0/2450631129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3328071dc0 0x7f3328070750 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33180097a0 tx=0x7f331802b840 comp rx=0 tx=0).stop 2023-12-08T08:19:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.942+0000 7f332f52c640 1 -- 172.21.15.50:0/2450631129 shutdown_connections 2023-12-08T08:19:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.942+0000 7f332f52c640 1 --2- 172.21.15.50:0/2450631129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3328071dc0 0x7f3328070750 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.942+0000 7f332f52c640 1 -- 172.21.15.50:0/2450631129 >> 172.21.15.50:0/2450631129 conn(0x7f33280b09f0 msgr2=0x7f33280b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.942+0000 7f332f52c640 1 -- 172.21.15.50:0/2450631129 shutdown_connections 2023-12-08T08:19:14.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.942+0000 7f332f52c640 1 -- 172.21.15.50:0/2450631129 wait complete. 2023-12-08T08:19:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.943+0000 7f332f52c640 1 Processor -- start 2023-12-08T08:19:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.943+0000 7f332f52c640 1 -- start start 2023-12-08T08:19:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332f52c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3328071dc0 0x7f3328147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332f52c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33280b1cf0 0x7f33280abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332f52c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3328159a10 0x7f3328156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332f52c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33281476a0 con 0x7f33280b1cf0 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332f52c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332814c4b0 con 0x7f3328071dc0 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332f52c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332814b8a0 con 0x7f3328159a10 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33280b1cf0 0x7f33280abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33280b1cf0 0x7f33280abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51488/0 (socket says 172.21.15.50:51488) 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 -- 172.21.15.50:0/543678041 learned_addr learned my addr 172.21.15.50:0/543678041 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332d2c8640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3328071dc0 0x7f3328147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332dac9640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3328159a10 0x7f3328156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 -- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3328159a10 msgr2=0x7f3328156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3328159a10 0x7f3328156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 -- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3328071dc0 msgr2=0x7f3328147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3328071dc0 0x7f3328147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:14.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 -- 172.21.15.50:0/543678041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318009400 con 0x7f33280b1cf0 2023-12-08T08:19:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332dac9640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3328159a10 0x7f3328156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332cac7640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33280b1cf0 0x7f33280abd40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f33180097a0 tx=0x7f33180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f331dffb640 1 -- 172.21.15.50:0/543678041 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318004230 con 0x7f33280b1cf0 2023-12-08T08:19:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f331dffb640 1 -- 172.21.15.50:0/543678041 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318004390 con 0x7f33280b1cf0 2023-12-08T08:19:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332814bb80 con 0x7f33280b1cf0 2023-12-08T08:19:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.944+0000 7f331dffb640 1 -- 172.21.15.50:0/543678041 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318032940 con 0x7f33280b1cf0 2023-12-08T08:19:14.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.945+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332814c140 con 0x7f33280b1cf0 2023-12-08T08:19:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.946+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328067430 con 0x7f33280b1cf0 2023-12-08T08:19:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.946+0000 7f331dffb640 1 -- 172.21.15.50:0/543678041 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3318032aa0 con 0x7f33280b1cf0 2023-12-08T08:19:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.947+0000 7f331dffb640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f330c06ae40 0x7f330c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.947+0000 7f331dffb640 1 -- 172.21.15.50:0/543678041 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f33180ab5d0 con 0x7f33280b1cf0 2023-12-08T08:19:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.947+0000 7f332d2c8640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f330c06ae40 0x7f330c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:14.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.947+0000 7f332d2c8640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f330c06ae40 0x7f330c06d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3324000f60 tx=0x7f3324007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:14.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:14.951+0000 7f331dffb640 1 -- 172.21.15.50:0/543678041 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33180767f0 con 0x7f33280b1cf0 2023-12-08T08:19:15.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.193+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3328071850 con 0x7f33280b1cf0 2023-12-08T08:19:15.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.195+0000 7f331dffb640 1 -- 172.21.15.50:0/543678041 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3318079e10 con 0x7f33280b1cf0 2023-12-08T08:19:15.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f330c06ae40 msgr2=0x7f330c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f330c06ae40 0x7f330c06d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3324000f60 tx=0x7f3324007e40 comp rx=0 tx=0).stop 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33280b1cf0 msgr2=0x7f33280abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33280b1cf0 0x7f33280abd40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f33180097a0 tx=0x7f33180046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 shutdown_connections 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f330c06ae40 0x7f330c06d300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33280b1cf0 0x7f33280abd40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3328159a10 0x7f3328156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 --2- 172.21.15.50:0/543678041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3328071dc0 0x7f3328147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 >> 172.21.15.50:0/543678041 conn(0x7f33280b09f0 msgr2=0x7f3328157850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 shutdown_connections 2023-12-08T08:19:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.197+0000 7f332f52c640 1 -- 172.21.15.50:0/543678041 wait complete. 2023-12-08T08:19:15.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-08T08:19:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.315+0000 7f6bc8dc5640 1 Processor -- start 2023-12-08T08:19:15.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.315+0000 7f6bc8dc5640 1 -- start start 2023-12-08T08:19:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.316+0000 7f6bc8dc5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6bc415b0f0 0x7f6bc40cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.316+0000 7f6bc8dc5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc40cd760 0x7f6bc40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.316+0000 7f6bc8dc5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40cf380 con 0x7f6bc40d1900 2023-12-08T08:19:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.316+0000 7f6bc8dc5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40ce110 con 0x7f6bc415b0f0 2023-12-08T08:19:15.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.316+0000 7f6bc8dc5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40cff20 con 0x7f6bc40cd760 2023-12-08T08:19:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.316+0000 7f6bc259c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6bc415b0f0 0x7f6bc40cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.316+0000 7f6bc2d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc40cd760 0x7f6bc40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc1d9b640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f6bc40d1900 0x7f6bc40cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:57520/0 (socket says 172.21.15.50:57520) 2023-12-08T08:19:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc1d9b640 1 -- 172.21.15.50:0/2980959939 learned_addr learned my addr 172.21.15.50:0/2980959939 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc159a640 1 -- 172.21.15.50:0/2980959939 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953594617 0 0) 0x7f6bc40cf380 con 0x7f6bc40d1900 2023-12-08T08:19:15.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc159a640 1 -- 172.21.15.50:0/2980959939 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb0003520 con 0x7f6bc40d1900 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc2d9d640 1 -- 172.21.15.50:0/2980959939 >> v2:172.21.15.170:3300/0 conn(0x7f6bc415b0f0 msgr2=0x7f6bc40cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc2d9d640 1 --2- 172.21.15.50:0/2980959939 >> v2:172.21.15.170:3300/0 conn(0x7f6bc415b0f0 0x7f6bc40cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc2d9d640 1 -- 172.21.15.50:0/2980959939 >> v1:172.21.15.170:6789/0 conn(0x7f6bc40d1900 legacy=0x7f6bc40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc2d9d640 1 -- 172.21.15.50:0/2980959939 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40cce00 con 0x7f6bc40cd760 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.317+0000 7f6bc259c640 1 --2- 172.21.15.50:0/2980959939 >> v2:172.21.15.170:3300/0 conn(0x7f6bc415b0f0 0x7f6bc40cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.318+0000 7f6bc2d9d640 1 --2- 172.21.15.50:0/2980959939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc40cd760 0x7f6bc40cdbd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d90 tx=0x7f6bb402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85cbe764045b63b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.318+0000 7f6bc159a640 1 -- 172.21.15.50:0/2980959939 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb402cbc0 con 0x7f6bc40cd760 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.318+0000 7f6bc159a640 1 -- 172.21.15.50:0/2980959939 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb402cd20 con 0x7f6bc40cd760 2023-12-08T08:19:15.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.318+0000 7f6bc159a640 1 -- 172.21.15.50:0/2980959939 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4034640 con 0x7f6bc40cd760 2023-12-08T08:19:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.318+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/2980959939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc40cd760 msgr2=0x7f6bc40cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.318+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/2980959939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc40cd760 0x7f6bc40cdbd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d90 tx=0x7f6bb402be10 comp rx=0 tx=0).stop 2023-12-08T08:19:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.319+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/2980959939 shutdown_connections 2023-12-08T08:19:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.319+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/2980959939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc40cd760 0x7f6bc40cdbd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.319+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/2980959939 >> v2:172.21.15.170:3300/0 conn(0x7f6bc415b0f0 0x7f6bc40cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.319+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/2980959939 >> 172.21.15.50:0/2980959939 conn(0x7f6bc40d0de0 msgr2=0x7f6bc40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.319+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/2980959939 shutdown_connections 2023-12-08T08:19:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.319+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/2980959939 wait complete. 2023-12-08T08:19:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.320+0000 7f6bc8dc5640 1 Processor -- start 2023-12-08T08:19:15.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.320+0000 7f6bc8dc5640 1 -- start start 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bc40cd760 0x7f6bc40b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bc40d1900 0x7f6bc41498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc415b0f0 0x7f6bc40c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4147b60 con 0x7f6bc40cd760 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40b2e10 con 0x7f6bc40d1900 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc41471c0 con 0x7f6bc415b0f0 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bc40cd760 0x7f6bc40b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bc40cd760 0x7f6bc40b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51496/0 (socket says 172.21.15.50:51496) 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 -- 172.21.15.50:0/3882667226 learned_addr learned my addr 172.21.15.50:0/3882667226 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc2d9d640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc415b0f0 0x7f6bc40c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc1d9b640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bc40d1900 0x7f6bc41498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 -- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc415b0f0 msgr2=0x7f6bc40c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc415b0f0 0x7f6bc40c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 -- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bc40d1900 msgr2=0x7f6bc41498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bc40d1900 0x7f6bc41498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 -- 172.21.15.50:0/3882667226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009400 con 0x7f6bc40cd760 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc259c640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bc40cd760 0x7f6bc40b28d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00e960 tx=0x7f6bbc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bbaffd640 1 -- 172.21.15.50:0/3882667226 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00ca00 con 0x7f6bc40cd760 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bbaffd640 1 -- 172.21.15.50:0/3882667226 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00cb60 con 0x7f6bc40cd760 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb4009a70 con 0x7f6bc40cd760 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bbaffd640 1 -- 172.21.15.50:0/3882667226 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc013470 con 0x7f6bc40cd760 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.322+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc4147780 con 0x7f6bc40cd760 2023-12-08T08:19:15.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.323+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc40cfa40 con 0x7f6bc40cd760 2023-12-08T08:19:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.323+0000 7f6bbaffd640 1 -- 172.21.15.50:0/3882667226 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6bbc0135d0 con 0x7f6bc40cd760 2023-12-08T08:19:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.324+0000 7f6bbaffd640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6ba406ae70 0x7f6ba406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.324+0000 7f6bbaffd640 1 -- 172.21.15.50:0/3882667226 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6bbc089640 con 0x7f6bc40cd760 2023-12-08T08:19:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.324+0000 7f6bc1d9b640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6ba406ae70 0x7f6ba406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.324+0000 7f6bc1d9b640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6ba406ae70 0x7f6ba406d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40cb010 tx=0x7f6bac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.328+0000 7f6bbaffd640 1 -- 172.21.15.50:0/3882667226 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6bbc054920 con 0x7f6bc40cd760 2023-12-08T08:19:15.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.572+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f6bc4067430 con 0x7f6bc40cd760 2023-12-08T08:19:15.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.574+0000 7f6bbaffd640 1 -- 172.21.15.50:0/3882667226 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6bbc057f40 con 0x7f6bc40cd760 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6ba406ae70 msgr2=0x7f6ba406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6ba406ae70 0x7f6ba406d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40cb010 tx=0x7f6bac009040 comp rx=0 tx=0).stop 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bc40cd760 msgr2=0x7f6bc40b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bc40cd760 0x7f6bc40b28d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00e960 tx=0x7f6bbc00ee20 comp rx=0 tx=0).stop 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 shutdown_connections 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6ba406ae70 0x7f6ba406d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6bc415b0f0 0x7f6bc40c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6bc40d1900 0x7f6bc41498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 --2- 172.21.15.50:0/3882667226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6bc40cd760 0x7f6bc40b28d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 >> 172.21.15.50:0/3882667226 conn(0x7f6bc40d0de0 msgr2=0x7f6bc40c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 shutdown_connections 2023-12-08T08:19:15.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.577+0000 7f6bc8dc5640 1 -- 172.21.15.50:0/3882667226 wait complete. 2023-12-08T08:19:15.590 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-08T08:19:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 Processor -- start 2023-12-08T08:19:15.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 -- start start 2023-12-08T08:19:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc8140d3ad0 0x7fc81415f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc81415f6c0 0x7fc81415fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81415ee90 con 0x7fc81415f6c0 2023-12-08T08:19:15.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8140d0fe0 con 0x7fc8140d3ad0 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc819161640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140d1280 con 0x7fc81415d580 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc81415f6c0 0x7fc81415fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc81415f6c0 0x7fc81415fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51506/0 (socket says 172.21.15.50:51506) 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 -- 172.21.15.50:0/1799164011 learned_addr learned my addr 172.21.15.50:0/1799164011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc812d9d640 1 --2- 172.21.15.50:0/1799164011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc80bfff640 1 --2- 172.21.15.50:0/1799164011 >> v2:172.21.15.170:3300/0 conn(0x7fc8140d3ad0 0x7fc81415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 -- 172.21.15.50:0/1799164011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 msgr2=0x7fc8140d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 --2- 172.21.15.50:0/1799164011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 -- 172.21.15.50:0/1799164011 >> v2:172.21.15.170:3300/0 conn(0x7fc8140d3ad0 msgr2=0x7fc81415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 --2- 172.21.15.50:0/1799164011 >> v2:172.21.15.170:3300/0 conn(0x7fc8140d3ad0 0x7fc81415f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc81359e640 1 -- 172.21.15.50:0/1799164011 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140d1560 con 0x7fc81415f6c0 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.695+0000 7fc80bfff640 1 --2- 172.21.15.50:0/1799164011 >> v2:172.21.15.170:3300/0 conn(0x7fc8140d3ad0 0x7fc81415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.696+0000 7fc81359e640 1 --2- 172.21.15.50:0/1799164011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc81415f6c0 0x7fc81415fb50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc81408b770 tx=0x7fc80c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58d846e65b2aeb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.696+0000 7fc81259c640 1 -- 172.21.15.50:0/1799164011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c02c9f0 con 0x7fc81415f6c0 2023-12-08T08:19:15.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.696+0000 7fc81259c640 1 -- 172.21.15.50:0/1799164011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c02cb50 con 0x7fc81415f6c0 2023-12-08T08:19:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.696+0000 7fc81259c640 1 -- 172.21.15.50:0/1799164011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0343f0 con 0x7fc81415f6c0 2023-12-08T08:19:15.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 -- 172.21.15.50:0/1799164011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc81415f6c0 msgr2=0x7fc81415fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 --2- 172.21.15.50:0/1799164011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc81415f6c0 0x7fc81415fb50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc81408b770 tx=0x7fc80c02be50 comp rx=0 tx=0).stop 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 -- 172.21.15.50:0/1799164011 shutdown_connections 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 --2- 172.21.15.50:0/1799164011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc81415f6c0 0x7fc81415fb50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 --2- 172.21.15.50:0/1799164011 >> v2:172.21.15.170:3300/0 conn(0x7fc8140d3ad0 0x7fc81415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 --2- 172.21.15.50:0/1799164011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 -- 172.21.15.50:0/1799164011 >> 172.21.15.50:0/1799164011 conn(0x7fc8140d2fb0 msgr2=0x7fc8140d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 -- 172.21.15.50:0/1799164011 shutdown_connections 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.697+0000 7fc819161640 1 -- 172.21.15.50:0/1799164011 wait complete. 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.698+0000 7fc819161640 1 Processor -- start 2023-12-08T08:19:15.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.698+0000 7fc819161640 1 -- start start 2023-12-08T08:19:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc819161640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8140d3ad0 0x7fc8140b8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc819161640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc819161640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81415f6c0 0x7fc81415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc819161640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140cb470 con 0x7fc8140d3ad0 2023-12-08T08:19:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc819161640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140ca5c0 con 0x7fc81415f6c0 2023-12-08T08:19:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc819161640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140ca7f0 con 0x7fc81415d580 2023-12-08T08:19:15.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8140d3ad0 0x7fc8140b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8140d3ad0 0x7fc8140b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51510/0 (socket says 172.21.15.50:51510) 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 -- 172.21.15.50:0/4035730536 learned_addr learned my addr 172.21.15.50:0/4035730536 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc81359e640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81415f6c0 0x7fc81415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc80bfff640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 -- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 msgr2=0x7fc8140ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 -- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81415f6c0 msgr2=0x7fc81415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81415f6c0 0x7fc81415b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 -- 172.21.15.50:0/4035730536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c009b30 con 0x7fc8140d3ad0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc80bfff640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.699+0000 7fc812d9d640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8140d3ad0 0x7fc8140b8600 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc80400d800 tx=0x7fc80400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.700+0000 7fc80b7fe640 1 -- 172.21.15.50:0/4035730536 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400b6c0 con 0x7fc8140d3ad0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.700+0000 7fc80b7fe640 1 -- 172.21.15.50:0/4035730536 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80400b820 con 0x7fc8140d3ad0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.700+0000 7fc80b7fe640 1 -- 172.21.15.50:0/4035730536 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400bbb0 con 0x7fc8140d3ad0 2023-12-08T08:19:15.705 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.700+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8140caad0 con 0x7fc8140d3ad0 2023-12-08T08:19:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.700+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8140cb090 con 0x7fc8140d3ad0 2023-12-08T08:19:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.701+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8140d09d0 con 0x7fc8140d3ad0 2023-12-08T08:19:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.701+0000 7fc80b7fe640 1 -- 172.21.15.50:0/4035730536 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc80400bd10 con 0x7fc8140d3ad0 2023-12-08T08:19:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.701+0000 7fc80b7fe640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc7f406ae40 0x7fc7f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:15.706 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.702+0000 7fc80b7fe640 1 -- 172.21.15.50:0/4035730536 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc8040898d0 con 0x7fc8140d3ad0 2023-12-08T08:19:15.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.702+0000 7fc80bfff640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc7f406ae40 0x7fc7f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:15.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.702+0000 7fc80bfff640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc7f406ae40 0x7fc7f406d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc81415c420 tx=0x7fc7fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:15.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.707+0000 7fc80b7fe640 1 -- 172.21.15.50:0/4035730536 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc804054b90 con 0x7fc8140d3ad0 2023-12-08T08:19:15.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.952+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc814067430 con 0x7fc8140d3ad0 2023-12-08T08:19:15.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.954+0000 7fc80b7fe640 1 -- 172.21.15.50:0/4035730536 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc8040581b0 con 0x7fc8140d3ad0 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc7f406ae40 msgr2=0x7fc7f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc7f406ae40 0x7fc7f406d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc81415c420 tx=0x7fc7fc008040 comp rx=0 tx=0).stop 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8140d3ad0 msgr2=0x7fc8140b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8140d3ad0 0x7fc8140b8600 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc80400d800 tx=0x7fc80400dcc0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 shutdown_connections 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc7f406ae40 0x7fc7f406d300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc81415f6c0 0x7fc81415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc81415d580 0x7fc8140ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 --2- 172.21.15.50:0/4035730536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8140d3ad0 0x7fc8140b8600 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 >> 172.21.15.50:0/4035730536 conn(0x7fc8140d2fb0 msgr2=0x7fc8140cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:15.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 shutdown_connections 2023-12-08T08:19:15.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:15.956+0000 7fc819161640 1 -- 172.21.15.50:0/4035730536 wait complete. 2023-12-08T08:19:15.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-08T08:19:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.074+0000 7f896a46b640 1 Processor -- start 2023-12-08T08:19:16.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.074+0000 7f896a46b640 1 -- start start 2023-12-08T08:19:16.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f896a46b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8964140a10 0x7f89640cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f896a46b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89640b2640 0x7f89640ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f896a46b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8964070db0 con 0x7f8964071e50 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f896a46b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8964070ba0 con 0x7f89640b2640 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f896a46b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8964071090 con 0x7f8964140a10 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f8968a08640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89640b2640 0x7f89640ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f89637fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8964071e50 0x7f89640b1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49304/0 (socket says 172.21.15.50:49304) 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f89637fe640 1 -- 172.21.15.50:0/2860132284 learned_addr learned my addr 172.21.15.50:0/2860132284 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f8963fff640 1 --2- 172.21.15.50:0/2860132284 >> v2:172.21.15.170:3300/0 conn(0x7f8964140a10 0x7f89640cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f8968a08640 1 -- 172.21.15.50:0/2860132284 >> v2:172.21.15.170:3300/0 conn(0x7f8964140a10 msgr2=0x7f89640cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f8968a08640 1 --2- 172.21.15.50:0/2860132284 >> v2:172.21.15.170:3300/0 conn(0x7f8964140a10 0x7f89640cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f8968a08640 1 -- 172.21.15.50:0/2860132284 >> v1:172.21.15.50:6789/0 conn(0x7f8964071e50 legacy=0x7f89640b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f8962ffd640 1 -- 172.21.15.50:0/2860132284 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096456844 0 0) 0x7f8964070db0 con 0x7f8964071e50 2023-12-08T08:19:16.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.075+0000 7f8968a08640 1 -- 172.21.15.50:0/2860132284 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8964071370 con 0x7f89640b2640 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.076+0000 7f8968a08640 1 --2- 172.21.15.50:0/2860132284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640b2640 0x7f89640ce210 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8964066ae0 tx=0x7f895c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545257a982aa7096 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.076+0000 7f8962ffd640 1 -- 172.21.15.50:0/2860132284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c02cd00 con 0x7f89640b2640 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.076+0000 7f8962ffd640 1 -- 172.21.15.50:0/2860132284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c02ce60 con 0x7f89640b2640 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.076+0000 7f8962ffd640 1 -- 172.21.15.50:0/2860132284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c034660 con 0x7f89640b2640 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 -- 172.21.15.50:0/2860132284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640b2640 msgr2=0x7f89640ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 --2- 172.21.15.50:0/2860132284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640b2640 0x7f89640ce210 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8964066ae0 tx=0x7f895c02bf50 comp rx=0 tx=0).stop 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 -- 172.21.15.50:0/2860132284 shutdown_connections 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 --2- 172.21.15.50:0/2860132284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640b2640 0x7f89640ce210 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 --2- 172.21.15.50:0/2860132284 >> v2:172.21.15.170:3300/0 conn(0x7f8964140a10 0x7f89640cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 -- 172.21.15.50:0/2860132284 >> 172.21.15.50:0/2860132284 conn(0x7f89640b09f0 msgr2=0x7f89640b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 -- 172.21.15.50:0/2860132284 shutdown_connections 2023-12-08T08:19:16.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.077+0000 7f896a46b640 1 -- 172.21.15.50:0/2860132284 wait complete. 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.078+0000 7f896a46b640 1 Processor -- start 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.078+0000 7f896a46b640 1 -- start start 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f896a46b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8964071e50 0x7f89640c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f896a46b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89640b2640 0x7f89641f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f896a46b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964140a10 0x7f89640abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f896a46b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89641f2c40 con 0x7f8964140a10 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f896a46b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89641f6770 con 0x7f89640b2640 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f896a46b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896409c880 con 0x7f8964071e50 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964140a10 0x7f89640abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964140a10 0x7f89640abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51528/0 (socket says 172.21.15.50:51528) 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 -- 172.21.15.50:0/4187195818 learned_addr learned my addr 172.21.15.50:0/4187195818 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8963fff640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8964071e50 0x7f89640c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f89637fe640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89640b2640 0x7f89641f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 -- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8964071e50 msgr2=0x7f89640c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8964071e50 0x7f89640c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 -- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89640b2640 msgr2=0x7f89641f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89640b2640 0x7f89641f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.079+0000 7f8968a08640 1 -- 172.21.15.50:0/4187195818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009a70 con 0x7f8964140a10 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.080+0000 7f8968a08640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964140a10 0x7f89640abd40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f895c02c560 tx=0x7f895c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.080+0000 7f8960ff9640 1 -- 172.21.15.50:0/4187195818 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c03d600 con 0x7f8964140a10 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.080+0000 7f8960ff9640 1 -- 172.21.15.50:0/4187195818 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c03d780 con 0x7f8964140a10 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.080+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89641f69a0 con 0x7f8964140a10 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.080+0000 7f8960ff9640 1 -- 172.21.15.50:0/4187195818 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c03db30 con 0x7f8964140a10 2023-12-08T08:19:16.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.080+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89641f6f60 con 0x7f8964140a10 2023-12-08T08:19:16.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.081+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964067430 con 0x7f8964140a10 2023-12-08T08:19:16.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.081+0000 7f8960ff9640 1 -- 172.21.15.50:0/4187195818 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f895c03b040 con 0x7f8964140a10 2023-12-08T08:19:16.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.082+0000 7f8960ff9640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f895006ae40 0x7f895006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.082+0000 7f8960ff9640 1 -- 172.21.15.50:0/4187195818 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f895c0ab900 con 0x7f8964140a10 2023-12-08T08:19:16.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.082+0000 7f8963fff640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f895006ae40 0x7f895006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.082+0000 7f8963fff640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f895006ae40 0x7f895006d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f89640cb7b0 tx=0x7f8954008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.086+0000 7f8960ff9640 1 -- 172.21.15.50:0/4187195818 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f895c076e20 con 0x7f8964140a10 2023-12-08T08:19:16.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.335+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f89640cb490 con 0x7f8964140a10 2023-12-08T08:19:16.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.337+0000 7f8960ff9640 1 -- 172.21.15.50:0/4187195818 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f895c04e0a0 con 0x7f8964140a10 2023-12-08T08:19:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f895006ae40 msgr2=0x7f895006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f895006ae40 0x7f895006d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f89640cb7b0 tx=0x7f8954008040 comp rx=0 tx=0).stop 2023-12-08T08:19:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964140a10 msgr2=0x7f89640abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964140a10 0x7f89640abd40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f895c02c560 tx=0x7f895c004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:16.341 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 shutdown_connections 2023-12-08T08:19:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f895006ae40 0x7f895006d300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964140a10 0x7f89640abd40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89640b2640 0x7f89641f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 --2- 172.21.15.50:0/4187195818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8964071e50 0x7f89640c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 >> 172.21.15.50:0/4187195818 conn(0x7f89640b09f0 msgr2=0x7f89640b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 shutdown_connections 2023-12-08T08:19:16.342 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.339+0000 7f896a46b640 1 -- 172.21.15.50:0/4187195818 wait complete. 2023-12-08T08:19:16.352 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-08T08:19:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.457+0000 7f932af25640 1 Processor -- start 2023-12-08T08:19:16.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.457+0000 7f932af25640 1 -- start start 2023-12-08T08:19:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f932af25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f93240d1b20 0x7f93240ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f932af25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 0x7f93240b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f932af25640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93240b2910 con 0x7f93240d1030 2023-12-08T08:19:16.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f932af25640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93240ceb10 con 0x7f93240d1b20 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f932af25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93240b31b0 con 0x7f93240b3640 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f9328cc1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93240d1030 0x7f93240d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49318/0 (socket says 172.21.15.50:49318) 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f9328cc1640 1 -- 172.21.15.50:0/2852091616 learned_addr learned my addr 172.21.15.50:0/2852091616 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787157714 0 0) 0x7f93240b2910 con 0x7f93240d1030 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9314003520 con 0x7f93240d1030 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93294c2640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 0x7f93240b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f9323fff640 1 --2- 172.21.15.50:0/2852091616 >> v2:172.21.15.170:3300/0 conn(0x7f93240d1b20 0x7f93240ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311143182 0 0) 0x7f9314003520 con 0x7f93240d1030 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 msgr2=0x7f93240b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 0x7f93240b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 >> v2:172.21.15.170:3300/0 conn(0x7f93240d1b20 msgr2=0x7f93240ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 --2- 172.21.15.50:0/2852091616 >> v2:172.21.15.170:3300/0 conn(0x7f93240d1b20 0x7f93240ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240ced20 con 0x7f93240d1030 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.458+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f9318001670 con 0x7f93240d1030 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 >> v1:172.21.15.50:6789/0 conn(0x7f93240d1030 legacy=0x7f93240d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93237fe640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9314003970 0x7f9314003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93237fe640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93140047c0 0x7f9314004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93237fe640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 0x7f9314005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240ceb10 con 0x7f9314003970 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240b31b0 con 0x7f93140047c0 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931400b9b0 con 0x7f93240b3640 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f9328cc1640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9314003970 0x7f9314003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f93294c2640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 0x7f9314005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f9323fff640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93140047c0 0x7f9314004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f9328cc1640 1 -- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 msgr2=0x7f9314005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f9328cc1640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f93240b3640 0x7f9314005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f9328cc1640 1 -- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93140047c0 msgr2=0x7f9314004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f9328cc1640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93140047c0 0x7f9314004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.459+0000 7f9328cc1640 1 -- 172.21.15.50:0/2852091616 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314003520 con 0x7f9314003970 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f9328cc1640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9314003970 0x7f9314003d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f931800c210 tx=0x7f93140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0782f0582d02a4b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318005ad0 con 0x7f9314003970 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318005c30 con 0x7f9314003970 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f93237fe640 1 -- 172.21.15.50:0/2852091616 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931802c8c0 con 0x7f9314003970 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f932af25640 1 -- 172.21.15.50:0/2852091616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9314003970 msgr2=0x7f9314003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f932af25640 1 --2- 172.21.15.50:0/2852091616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9314003970 0x7f9314003d90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f931800c210 tx=0x7f93140057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f93294c2640 1 -- 172.21.15.50:0/2852091616 reap_dead start 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f932af25640 1 -- 172.21.15.50:0/2852091616 shutdown_connections 2023-12-08T08:19:16.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f932af25640 1 -- 172.21.15.50:0/2852091616 >> 172.21.15.50:0/2852091616 conn(0x7f932409c280 msgr2=0x7f93240d2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.460+0000 7f932af25640 1 -- 172.21.15.50:0/2852091616 shutdown_connections 2023-12-08T08:19:16.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.461+0000 7f932af25640 1 -- 172.21.15.50:0/2852091616 wait complete. 2023-12-08T08:19:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.462+0000 7f932af25640 1 Processor -- start 2023-12-08T08:19:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.462+0000 7f932af25640 1 -- start start 2023-12-08T08:19:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9314003970 0x7f93240c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9324151590 0x7f9324150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f932415d670 0x7f932415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932415e030 con 0x7f932415d670 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240ca930 con 0x7f9314003970 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93240c89f0 con 0x7f9324151590 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f932415d670 0x7f932415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f932415d670 0x7f932415daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51550/0 (socket says 172.21.15.50:51550) 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 -- 172.21.15.50:0/2369432852 learned_addr learned my addr 172.21.15.50:0/2369432852 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f9323fff640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9324151590 0x7f9324150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f9328cc1640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9314003970 0x7f93240c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 -- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9324151590 msgr2=0x7f9324150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9324151590 0x7f9324150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 -- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9314003970 msgr2=0x7f93240c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9314003970 0x7f93240c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 -- 172.21.15.50:0/2369432852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240c8cd0 con 0x7f932415d670 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f9323fff640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9324151590 0x7f9324150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93294c2640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f932415d670 0x7f932415daf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f93240d1f00 tx=0x7f931c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93217fa640 1 -- 172.21.15.50:0/2369432852 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00e040 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93217fa640 1 -- 172.21.15.50:0/2369432852 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c00f040 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93240c8fb0 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f93217fa640 1 -- 172.21.15.50:0/2369432852 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c015430 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.463+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93240c86e0 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.464+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93240cae10 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.465+0000 7f93217fa640 1 -- 172.21.15.50:0/2369432852 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f931c015590 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.465+0000 7f93217fa640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f930806ae70 0x7f930806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.466+0000 7f93217fa640 1 -- 172.21.15.50:0/2369432852 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f931c089b10 con 0x7f932415d670 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.466+0000 7f9328cc1640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f930806ae70 0x7f930806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.466+0000 7f9328cc1640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f930806ae70 0x7f930806d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9318034000 tx=0x7f9318007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.470+0000 7f93217fa640 1 -- 172.21.15.50:0/2369432852 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93240cae10 con 0x7f932415d670 2023-12-08T08:19:16.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.713+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f93240cae10 con 0x7f932415d670 2023-12-08T08:19:16.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.715+0000 7f93217fa640 1 -- 172.21.15.50:0/2369432852 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f93240cae10 con 0x7f932415d670 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f930806ae70 msgr2=0x7f930806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f930806ae70 0x7f930806d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9318034000 tx=0x7f9318007000 comp rx=0 tx=0).stop 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f932415d670 msgr2=0x7f932415daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f932415d670 0x7f932415daf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f93240d1f00 tx=0x7f931c00f580 comp rx=0 tx=0).stop 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 shutdown_connections 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f930806ae70 0x7f930806d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f932415d670 0x7f932415daf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9324151590 0x7f9324150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 --2- 172.21.15.50:0/2369432852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9314003970 0x7f93240c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 >> 172.21.15.50:0/2369432852 conn(0x7f932409c280 msgr2=0x7f93240afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:16.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 shutdown_connections 2023-12-08T08:19:16.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.717+0000 7f932af25640 1 -- 172.21.15.50:0/2369432852 wait complete. 2023-12-08T08:19:16.730 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-08T08:19:16.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.836+0000 7fbe60cd4640 1 Processor -- start 2023-12-08T08:19:16.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.836+0000 7fbe60cd4640 1 -- start start 2023-12-08T08:19:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.837+0000 7fbe60cd4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbe5c1608a0 0x7fbe5c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.837+0000 7fbe60cd4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0d20b0 con 0x7fbe5c0b1d70 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.837+0000 7fbe60cd4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0d1b80 con 0x7fbe5c0b0cf0 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.837+0000 7fbe60cd4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0d0620 con 0x7fbe5c1608a0 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe59d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbe5c0b1d70 0x7fbe5c0d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49328/0 (socket says 172.21.15.50:49328) 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe59d9b640 1 -- 172.21.15.50:0/1899315265 learned_addr learned my addr 172.21.15.50:0/1899315265 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe5a59c640 1 --2- 172.21.15.50:0/1899315265 >> v2:172.21.15.170:3300/0 conn(0x7fbe5c1608a0 0x7fbe5c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe5959a640 1 -- 172.21.15.50:0/1899315265 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820338629 0 0) 0x7fbe5c0d20b0 con 0x7fbe5c0b1d70 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe5959a640 1 -- 172.21.15.50:0/1899315265 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe44003520 con 0x7fbe5c0b1d70 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe5a59c640 1 -- 172.21.15.50:0/1899315265 >> v1:172.21.15.170:6789/0 conn(0x7fbe5c0b0cf0 legacy=0x7fbe5c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe5959a640 1 -- 172.21.15.50:0/1899315265 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 910346957 0 0) 0x7fbe44003520 con 0x7fbe5c0b1d70 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe5a59c640 1 -- 172.21.15.50:0/1899315265 >> v1:172.21.15.50:6789/0 conn(0x7fbe5c0b1d70 legacy=0x7fbe5c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.838+0000 7fbe5a59c640 1 -- 172.21.15.50:0/1899315265 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c0d1dd0 con 0x7fbe5c1608a0 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.839+0000 7fbe5a59c640 1 --2- 172.21.15.50:0/1899315265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0d0f30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0097a0 tx=0x7fbe4c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65a11d2d5282267f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.839+0000 7fbe5959a640 1 -- 172.21.15.50:0/1899315265 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50001670 con 0x7fbe5c1608a0 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.839+0000 7fbe5959a640 1 -- 172.21.15.50:0/1899315265 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c02e050 con 0x7fbe5c1608a0 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.839+0000 7fbe5959a640 1 -- 172.21.15.50:0/1899315265 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c030710 con 0x7fbe5c1608a0 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.840+0000 7fbe60cd4640 1 -- 172.21.15.50:0/1899315265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c1608a0 msgr2=0x7fbe5c0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.840+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/1899315265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0d0f30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0097a0 tx=0x7fbe4c02b790 comp rx=0 tx=0).stop 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.840+0000 7fbe60cd4640 1 -- 172.21.15.50:0/1899315265 shutdown_connections 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.840+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/1899315265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0d0f30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.840+0000 7fbe60cd4640 1 -- 172.21.15.50:0/1899315265 >> 172.21.15.50:0/1899315265 conn(0x7fbe5c0d3030 msgr2=0x7fbe5c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.840+0000 7fbe60cd4640 1 -- 172.21.15.50:0/1899315265 shutdown_connections 2023-12-08T08:19:16.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.840+0000 7fbe60cd4640 1 -- 172.21.15.50:0/1899315265 wait complete. 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.841+0000 7fbe60cd4640 1 Processor -- start 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.841+0000 7fbe60cd4640 1 -- start start 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe60cd4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5c0b0cf0 0x7fbe5c1f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe60cd4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c0b1d70 0x7fbe5c151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe60cd4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe60cd4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c151a80 con 0x7fbe5c1608a0 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe60cd4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1f7230 con 0x7fbe5c0b1d70 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe60cd4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0cb000 con 0x7fbe5c0b0cf0 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51554/0 (socket says 172.21.15.50:51554) 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 -- 172.21.15.50:0/4208685742 learned_addr learned my addr 172.21.15.50:0/4208685742 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5a59c640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5c0b0cf0 0x7fbe5c1f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe59d9b640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c0b1d70 0x7fbe5c151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 -- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5c0b0cf0 msgr2=0x7fbe5c1f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5c0b0cf0 0x7fbe5c1f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 -- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c0b1d70 msgr2=0x7fbe5c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c0b1d70 0x7fbe5c151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.842+0000 7fbe5ad9d640 1 -- 172.21.15.50:0/4208685742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009400 con 0x7fbe5c1608a0 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.843+0000 7fbe5ad9d640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0caac0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c730 tx=0x7fbe5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.843+0000 7fbe4affd640 1 -- 172.21.15.50:0/4208685742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54003b70 con 0x7fbe5c1608a0 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.843+0000 7fbe4affd640 1 -- 172.21.15.50:0/4208685742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe54003cd0 con 0x7fbe5c1608a0 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.843+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c1f6990 con 0x7fbe5c1608a0 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.843+0000 7fbe4affd640 1 -- 172.21.15.50:0/4208685742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400aa90 con 0x7fbe5c1608a0 2023-12-08T08:19:16.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.843+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c1f6f50 con 0x7fbe5c1608a0 2023-12-08T08:19:16.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.844+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c067430 con 0x7fbe5c1608a0 2023-12-08T08:19:16.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.845+0000 7fbe4affd640 1 -- 172.21.15.50:0/4208685742 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe5400abf0 con 0x7fbe5c1608a0 2023-12-08T08:19:16.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.845+0000 7fbe4affd640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:16.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.845+0000 7fbe4affd640 1 -- 172.21.15.50:0/4208685742 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbe54089040 con 0x7fbe5c1608a0 2023-12-08T08:19:16.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.845+0000 7fbe5a59c640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:16.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.846+0000 7fbe5a59c640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c034000 tx=0x7fbe4c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:16.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:16.849+0000 7fbe4affd640 1 -- 172.21.15.50:0/4208685742 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe54054440 con 0x7fbe5c1608a0 2023-12-08T08:19:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.094+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fbe5c0ce930 con 0x7fbe5c1608a0 2023-12-08T08:19:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.096+0000 7fbe4affd640 1 -- 172.21.15.50:0/4208685742 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbe54057a60 con 0x7fbe5c1608a0 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 msgr2=0x7fbe3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c034000 tx=0x7fbe4c02f000 comp rx=0 tx=0).stop 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5c1608a0 msgr2=0x7fbe5c0caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0caac0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400c730 tx=0x7fbe5400cbf0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 shutdown_connections 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbe3c06ae40 0x7fbe3c06d300 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe5c1608a0 0x7fbe5c0caac0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbe5c0b1d70 0x7fbe5c151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 --2- 172.21.15.50:0/4208685742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbe5c0b0cf0 0x7fbe5c1f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.098+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 >> 172.21.15.50:0/4208685742 conn(0x7fbe5c0d3030 msgr2=0x7fbe5c06bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.099+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 shutdown_connections 2023-12-08T08:19:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.099+0000 7fbe60cd4640 1 -- 172.21.15.50:0/4208685742 wait complete. 2023-12-08T08:19:17.112 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:17.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.216+0000 7f777c848640 1 Processor -- start 2023-12-08T08:19:17.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.216+0000 7f777c848640 1 -- start start 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f777c848640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f77780ce270 0x7f777806bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f777c848640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f777806c480 0x7f777815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f777c848640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77780ce6f0 con 0x7f77780ccd70 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f777c848640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780d0a60 con 0x7f777806c480 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f777c848640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777806c910 con 0x7f77780ce270 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7776d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f777806c480 0x7f777815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7776d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f777806c480 0x7f777815ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51560/0 (socket says 172.21.15.50:51560) 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7776d9d640 1 -- 172.21.15.50:0/1884865574 learned_addr learned my addr 172.21.15.50:0/1884865574 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7775d9b640 1 --2- 172.21.15.50:0/1884865574 >> v2:172.21.15.170:3300/0 conn(0x7f77780ce270 0x7f777806bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7776d9d640 1 -- 172.21.15.50:0/1884865574 >> v2:172.21.15.170:3300/0 conn(0x7f77780ce270 msgr2=0x7f777806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7776d9d640 1 --2- 172.21.15.50:0/1884865574 >> v2:172.21.15.170:3300/0 conn(0x7f77780ce270 0x7f777806bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7776d9d640 1 -- 172.21.15.50:0/1884865574 >> v1:172.21.15.170:6789/0 conn(0x7f77780ccd70 legacy=0x7f77780cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.217+0000 7f7776d9d640 1 -- 172.21.15.50:0/1884865574 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77780cf9c0 con 0x7f777806c480 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.218+0000 7f7776d9d640 1 --2- 172.21.15.50:0/1884865574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777806c480 0x7f777815ca50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7778070cb0 tx=0x7f776802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781e3f07b30113c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.218+0000 7f777559a640 1 -- 172.21.15.50:0/1884865574 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776802ca80 con 0x7f777806c480 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.218+0000 7f777559a640 1 -- 172.21.15.50:0/1884865574 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776802cbe0 con 0x7f777806c480 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.218+0000 7f777559a640 1 -- 172.21.15.50:0/1884865574 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680343f0 con 0x7f777806c480 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 -- 172.21.15.50:0/1884865574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777806c480 msgr2=0x7f777815ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 --2- 172.21.15.50:0/1884865574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777806c480 0x7f777815ca50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7778070cb0 tx=0x7f776802bee0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 -- 172.21.15.50:0/1884865574 shutdown_connections 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 --2- 172.21.15.50:0/1884865574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f777806c480 0x7f777815ca50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 --2- 172.21.15.50:0/1884865574 >> v2:172.21.15.170:3300/0 conn(0x7f77780ce270 0x7f777806bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 -- 172.21.15.50:0/1884865574 >> 172.21.15.50:0/1884865574 conn(0x7f77780d0de0 msgr2=0x7f77780d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 -- 172.21.15.50:0/1884865574 shutdown_connections 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.219+0000 7f777c848640 1 -- 172.21.15.50:0/1884865574 wait complete. 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.220+0000 7f777c848640 1 Processor -- start 2023-12-08T08:19:17.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.220+0000 7f777c848640 1 -- start start 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f777c848640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f777806c480 0x7f7778151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f777c848640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77780ccd70 0x7f77781f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f777c848640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780ce270 0x7f77781f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f777c848640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77781f71d0 con 0x7f77780ce270 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f777c848640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777814ddc0 con 0x7f777806c480 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f777c848640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777814e0a0 con 0x7f77780ccd70 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f7776d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780ce270 0x7f77781f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f7776d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780ce270 0x7f77781f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51566/0 (socket says 172.21.15.50:51566) 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f7776d9d640 1 -- 172.21.15.50:0/1724352732 learned_addr learned my addr 172.21.15.50:0/1724352732 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f7775d9b640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77780ccd70 0x7f77781f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.221+0000 7f777659c640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f777806c480 0x7f7778151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f7776d9d640 1 -- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77780ccd70 msgr2=0x7f77781f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f7776d9d640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77780ccd70 0x7f77781f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f7776d9d640 1 -- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f777806c480 msgr2=0x7f7778151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f7776d9d640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f777806c480 0x7f7778151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f7776d9d640 1 -- 172.21.15.50:0/1724352732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768009b30 con 0x7f77780ce270 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f777659c640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f777806c480 0x7f7778151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f7776d9d640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780ce270 0x7f77781f6c90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e50 tx=0x7f7768004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f776effd640 1 -- 172.21.15.50:0/1724352732 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768009510 con 0x7f77780ce270 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f776effd640 1 -- 172.21.15.50:0/1724352732 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776803e450 con 0x7f77780ce270 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777814e380 con 0x7f77780ce270 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f776effd640 1 -- 172.21.15.50:0/1724352732 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776803e800 con 0x7f77780ce270 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.222+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777814e940 con 0x7f77780ce270 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.223+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778067430 con 0x7f77780ce270 2023-12-08T08:19:17.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.223+0000 7f776effd640 1 -- 172.21.15.50:0/1724352732 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f776802cd50 con 0x7f77780ce270 2023-12-08T08:19:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.224+0000 7f776effd640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775806ae40 0x7f775806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.224+0000 7f776effd640 1 -- 172.21.15.50:0/1724352732 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f77680abe70 con 0x7f77780ce270 2023-12-08T08:19:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.224+0000 7f777659c640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775806ae40 0x7f775806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.225+0000 7f777659c640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775806ae40 0x7f775806d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7770006fd0 tx=0x7f7770008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.228+0000 7f776effd640 1 -- 172.21.15.50:0/1724352732 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7768077120 con 0x7f77780ce270 2023-12-08T08:19:17.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.405+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7778072520 con 0x7f77780ce270 2023-12-08T08:19:17.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.405+0000 7f776effd640 1 -- 172.21.15.50:0/1724352732 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f776807a740 con 0x7f77780ce270 2023-12-08T08:19:17.408 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:17.408 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":34,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:14.440748+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775806ae40 msgr2=0x7f775806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775806ae40 0x7f775806d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7770006fd0 tx=0x7f7770008040 comp rx=0 tx=0).stop 2023-12-08T08:19:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780ce270 msgr2=0x7f77781f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780ce270 0x7f77781f6c90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7768009e50 tx=0x7f7768004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 shutdown_connections 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f775806ae40 0x7f775806d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780ce270 0x7f77781f6c90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f77780ccd70 0x7f77781f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 --2- 172.21.15.50:0/1724352732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f777806c480 0x7f7778151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 >> 172.21.15.50:0/1724352732 conn(0x7f77780d0de0 msgr2=0x7f77780aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 shutdown_connections 2023-12-08T08:19:17.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.408+0000 7f777c848640 1 -- 172.21.15.50:0/1724352732 wait complete. 2023-12-08T08:19:17.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:17.421 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.529+0000 7fe8f450f640 1 Processor -- start 2023-12-08T08:19:17.531 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.529+0000 7fe8f450f640 1 -- start start 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f450f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe8ec145d80 0x7fe8ec071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f450f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 0x7fe8ec0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f450f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec0b4e00 con 0x7fe8ec0ad290 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f450f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec0b50e0 con 0x7fe8ec145d80 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f450f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec06cfb0 con 0x7fe8ec0b4920 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f2aac640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe8ec0ad290 0x7fe8ec06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49340/0 (socket says 172.21.15.50:49340) 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f2aac640 1 -- 172.21.15.50:0/3422828171 learned_addr learned my addr 172.21.15.50:0/3422828171 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:17.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477625974 0 0) 0x7fe8ec0b4e00 con 0x7fe8ec0ad290 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f1aaa640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 0x7fe8ec0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f22ab640 1 --2- 172.21.15.50:0/3422828171 >> v2:172.21.15.170:3300/0 conn(0x7fe8ec145d80 0x7fe8ec071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d8003520 con 0x7fe8ec0ad290 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150524723 0 0) 0x7fe8d8003520 con 0x7fe8ec0ad290 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 msgr2=0x7fe8ec0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.530+0000 7fe8f12a9640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 0x7fe8ec0acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 >> v2:172.21.15.170:3300/0 conn(0x7fe8ec145d80 msgr2=0x7fe8ec071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 --2- 172.21.15.50:0/3422828171 >> v2:172.21.15.170:3300/0 conn(0x7fe8ec145d80 0x7fe8ec071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec06d290 con 0x7fe8ec0ad290 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fe8e40019f0 con 0x7fe8ec0ad290 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 >> v1:172.21.15.50:6789/0 conn(0x7fe8ec0ad290 legacy=0x7fe8ec06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 0x7fe8d8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d8003f40 0x7fe8d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0b50e0 con 0x7fe8d8004d00 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec06cfb0 con 0x7fe8d8003f40 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d800b980 con 0x7fe8ec0b4920 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f2aac640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f22ab640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 0x7fe8d8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f1aaa640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d8003f40 0x7fe8d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f2aac640 1 -- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 msgr2=0x7fe8d8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f2aac640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0b4920 0x7fe8d8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f2aac640 1 -- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d8003f40 msgr2=0x7fe8d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f2aac640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d8003f40 0x7fe8d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.531+0000 7fe8f2aac640 1 -- 172.21.15.50:0/3422828171 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8003520 con 0x7fe8d8004d00 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.532+0000 7fe8f2aac640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8d8005180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0ad690 tx=0x7fe8d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55afff07d4622ece server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.532+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4034630 con 0x7fe8d8004d00 2023-12-08T08:19:17.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.532+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e402f070 con 0x7fe8d8004d00 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.532+0000 7fe8f12a9640 1 -- 172.21.15.50:0/3422828171 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4034a10 con 0x7fe8d8004d00 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.533+0000 7fe8f450f640 1 -- 172.21.15.50:0/3422828171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 msgr2=0x7fe8d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.533+0000 7fe8f450f640 1 --2- 172.21.15.50:0/3422828171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8d8005180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec0ad690 tx=0x7fe8d80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.533+0000 7fe8f2aac640 1 -- 172.21.15.50:0/3422828171 reap_dead start 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.533+0000 7fe8f450f640 1 -- 172.21.15.50:0/3422828171 shutdown_connections 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.533+0000 7fe8f450f640 1 -- 172.21.15.50:0/3422828171 >> 172.21.15.50:0/3422828171 conn(0x7fe8ec06b7c0 msgr2=0x7fe8ec06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.533+0000 7fe8f450f640 1 -- 172.21.15.50:0/3422828171 shutdown_connections 2023-12-08T08:19:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.533+0000 7fe8f450f640 1 -- 172.21.15.50:0/3422828171 wait complete. 2023-12-08T08:19:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.534+0000 7fe8f450f640 1 Processor -- start 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.534+0000 7fe8f450f640 1 -- start start 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8ec0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0afa10 0x7fe8ec13cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8ec1e2cb0 0x7fe8ec1e3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec1e3670 con 0x7fe8d8004d00 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0ae710 con 0x7fe8ec1e2cb0 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0ae9f0 con 0x7fe8ec0afa10 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8ec0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8ec0ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51580/0 (socket says 172.21.15.50:51580) 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 -- 172.21.15.50:0/833689183 learned_addr learned my addr 172.21.15.50:0/833689183 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f1aaa640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0afa10 0x7fe8ec13cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f2aac640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8ec1e2cb0 0x7fe8ec1e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 -- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0afa10 msgr2=0x7fe8ec13cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0afa10 0x7fe8ec13cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 -- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8ec1e2cb0 msgr2=0x7fe8ec1e3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8ec1e2cb0 0x7fe8ec1e3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 -- 172.21.15.50:0/833689183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec0aecd0 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f22ab640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8ec0ae080 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8011a70 tx=0x7fe8e8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8e2ffd640 1 -- 172.21.15.50:0/833689183 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8009680 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8e2ffd640 1 -- 172.21.15.50:0/833689183 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e800fa90 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec0aefb0 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8e2ffd640 1 -- 172.21.15.50:0/833689183 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800fe20 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.535+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec13d070 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.536+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec071460 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.537+0000 7fe8e2ffd640 1 -- 172.21.15.50:0/833689183 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8e8014440 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.537+0000 7fe8e2ffd640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe8d006ae40 0x7fe8d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.537+0000 7fe8e2ffd640 1 -- 172.21.15.50:0/833689183 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe8e8089c40 con 0x7fe8d8004d00 2023-12-08T08:19:17.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.537+0000 7fe8f1aaa640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe8d006ae40 0x7fe8d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.538+0000 7fe8f1aaa640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe8d006ae40 0x7fe8d006d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec140490 tx=0x7fe8dc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.541+0000 7fe8e2ffd640 1 -- 172.21.15.50:0/833689183 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe8e8054f00 con 0x7fe8d8004d00 2023-12-08T08:19:17.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.715+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8ec067430 con 0x7fe8d8004d00 2023-12-08T08:19:17.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.716+0000 7fe8e2ffd640 1 -- 172.21.15.50:0/833689183 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8e8058520 con 0x7fe8d8004d00 2023-12-08T08:19:17.718 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.717+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe8d006ae40 msgr2=0x7fe8d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.717+0000 7fe8f450f640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe8d006ae40 0x7fe8d006d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec140490 tx=0x7fe8dc009190 comp rx=0 tx=0).stop 2023-12-08T08:19:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.717+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 msgr2=0x7fe8ec0ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.717+0000 7fe8f450f640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8ec0ae080 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8011a70 tx=0x7fe8e8011e70 comp rx=0 tx=0).stop 2023-12-08T08:19:17.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 shutdown_connections 2023-12-08T08:19:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe8d006ae40 0x7fe8d006d300 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8ec1e2cb0 0x7fe8ec1e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8ec0afa10 0x7fe8ec13cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 --2- 172.21.15.50:0/833689183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe8d8004d00 0x7fe8ec0ae080 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 >> 172.21.15.50:0/833689183 conn(0x7fe8ec06b7c0 msgr2=0x7fe8ec0b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 shutdown_connections 2023-12-08T08:19:17.721 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.718+0000 7fe8f450f640 1 -- 172.21.15.50:0/833689183 wait complete. 2023-12-08T08:19:17.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:19:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.835+0000 7f65082ec640 1 Processor -- start 2023-12-08T08:19:17.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.835+0000 7f65082ec640 1 -- start start 2023-12-08T08:19:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f65082ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65000ce3e0 0x7f65000b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f65082ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6500071e50 0x7f65000b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f65082ec640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65000b29b0 con 0x7f6500140a10 2023-12-08T08:19:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f65082ec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6500070ba0 con 0x7f65000ce3e0 2023-12-08T08:19:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f65082ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6500070db0 con 0x7f6500071e50 2023-12-08T08:19:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6505887640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65000ce3e0 0x7f65000b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6505887640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f65000ce3e0 0x7f65000b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51590/0 (socket says 172.21.15.50:51590) 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6505887640 1 -- 172.21.15.50:0/1360934005 learned_addr learned my addr 172.21.15.50:0/1360934005 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6506889640 1 --2- 172.21.15.50:0/1360934005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6500071e50 0x7f65000b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6505887640 1 -- 172.21.15.50:0/1360934005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6500071e50 msgr2=0x7f65000b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6505887640 1 --2- 172.21.15.50:0/1360934005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6500071e50 0x7f65000b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6505887640 1 -- 172.21.15.50:0/1360934005 >> v1:172.21.15.170:6789/0 conn(0x7f6500140a10 legacy=0x7f65000cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6505887640 1 -- 172.21.15.50:0/1360934005 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500071090 con 0x7f65000ce3e0 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.836+0000 7f6506889640 1 --2- 172.21.15.50:0/1360934005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6500071e50 0x7f65000b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:17.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.837+0000 7f6505887640 1 --2- 172.21.15.50:0/1360934005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65000ce3e0 0x7f65000b1f30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009870 tx=0x7f64f002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafef364e442cd61 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.837+0000 7f6505086640 1 -- 172.21.15.50:0/1360934005 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0030840 con 0x7f65000ce3e0 2023-12-08T08:19:17.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.837+0000 7f6505086640 1 -- 172.21.15.50:0/1360934005 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f00309a0 con 0x7f65000ce3e0 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.837+0000 7f6505086640 1 -- 172.21.15.50:0/1360934005 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0030d30 con 0x7f65000ce3e0 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 -- 172.21.15.50:0/1360934005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65000ce3e0 msgr2=0x7f65000b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 --2- 172.21.15.50:0/1360934005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65000ce3e0 0x7f65000b1f30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009870 tx=0x7f64f002b980 comp rx=0 tx=0).stop 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 -- 172.21.15.50:0/1360934005 shutdown_connections 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 --2- 172.21.15.50:0/1360934005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6500071e50 0x7f65000b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 --2- 172.21.15.50:0/1360934005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f65000ce3e0 0x7f65000b1f30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 -- 172.21.15.50:0/1360934005 >> 172.21.15.50:0/1360934005 conn(0x7f65000b09f0 msgr2=0x7f65000b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 -- 172.21.15.50:0/1360934005 shutdown_connections 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.838+0000 7f65082ec640 1 -- 172.21.15.50:0/1360934005 wait complete. 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.839+0000 7f65082ec640 1 Processor -- start 2023-12-08T08:19:17.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.839+0000 7f65082ec640 1 -- start start 2023-12-08T08:19:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f65082ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6500071e50 0x7f6500154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f65082ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65000ce3e0 0x7f6500156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f65082ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6500140a10 0x7f6500156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f65082ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6500157d60 con 0x7f6500071e50 2023-12-08T08:19:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f65082ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650013ac90 con 0x7f6500140a10 2023-12-08T08:19:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f65082ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6500155400 con 0x7f65000ce3e0 2023-12-08T08:19:17.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6500071e50 0x7f6500154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6500071e50 0x7f6500154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51600/0 (socket says 172.21.15.50:51600) 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 -- 172.21.15.50:0/1767360397 learned_addr learned my addr 172.21.15.50:0/1767360397 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506889640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6500140a10 0x7f6500156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6505887640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65000ce3e0 0x7f6500156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 -- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65000ce3e0 msgr2=0x7f6500156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65000ce3e0 0x7f6500156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 -- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6500140a10 msgr2=0x7f6500156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6500140a10 0x7f6500156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6506088640 1 -- 172.21.15.50:0/1767360397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f00094d0 con 0x7f6500071e50 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.840+0000 7f6505887640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65000ce3e0 0x7f6500156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.841+0000 7f6506088640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6500071e50 0x7f6500154ec0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b420 tx=0x7f64fc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.841+0000 7f64f6ffd640 1 -- 172.21.15.50:0/1767360397 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011830 con 0x7f6500071e50 2023-12-08T08:19:17.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.841+0000 7f64f6ffd640 1 -- 172.21.15.50:0/1767360397 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc011990 con 0x7f6500071e50 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.841+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65000c8070 con 0x7f6500071e50 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.841+0000 7f64f6ffd640 1 -- 172.21.15.50:0/1767360397 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011d40 con 0x7f6500071e50 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.841+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65000ad1d0 con 0x7f6500071e50 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.842+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650006eb30 con 0x7f6500071e50 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.842+0000 7f64f6ffd640 1 -- 172.21.15.50:0/1767360397 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64fc01b460 con 0x7f6500071e50 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.843+0000 7f64f6ffd640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64e406ae40 0x7f64e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.843+0000 7f64f6ffd640 1 -- 172.21.15.50:0/1767360397 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f64fc088f00 con 0x7f6500071e50 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.843+0000 7f6505887640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64e406ae40 0x7f64e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:17.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.843+0000 7f6505887640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64e406ae40 0x7f64e406d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f64f0036000 tx=0x7f64f0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:17.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:17.847+0000 7f64f6ffd640 1 -- 172.21.15.50:0/1767360397 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f64fc054130 con 0x7f6500071e50 2023-12-08T08:19:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.026+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6500067430 con 0x7f6500071e50 2023-12-08T08:19:18.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.026+0000 7f64f6ffd640 1 -- 172.21.15.50:0/1767360397 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f64fc057750 con 0x7f6500071e50 2023-12-08T08:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-08T08:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-08T08:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-08T08:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:18.029 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-08T08:19:18.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64e406ae40 msgr2=0x7f64e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64e406ae40 0x7f64e406d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f64f0036000 tx=0x7f64f0008030 comp rx=0 tx=0).stop 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6500071e50 msgr2=0x7f6500154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6500071e50 0x7f6500154ec0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00b420 tx=0x7f64fc00b8e0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 shutdown_connections 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f64e406ae40 0x7f64e406d300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6500140a10 0x7f6500156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65000ce3e0 0x7f6500156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 --2- 172.21.15.50:0/1767360397 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6500071e50 0x7f6500154ec0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 >> 172.21.15.50:0/1767360397 conn(0x7f65000b09f0 msgr2=0x7f65000cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 shutdown_connections 2023-12-08T08:19:18.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.028+0000 7f65082ec640 1 -- 172.21.15.50:0/1767360397 wait complete. 2023-12-08T08:19:18.041 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:19:18.041 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:19:18.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.149+0000 7fcdb330f640 1 Processor -- start 2023-12-08T08:19:18.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.149+0000 7fcdb330f640 1 -- start start 2023-12-08T08:19:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb330f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcdac0cf970 0x7fcdac0cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb330f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcdac0d0290 0x7fcdac0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb330f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb330f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0ce880 con 0x7fcdac0d0290 2023-12-08T08:19:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb330f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0b21f0 con 0x7fcdac0cf970 2023-12-08T08:19:18.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb330f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0cea90 con 0x7fcdac0b00c0 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcdac0d0290 0x7fcdac0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcdac0d0290 0x7fcdac0afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51606/0 (socket says 172.21.15.50:51606) 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 -- 172.21.15.50:0/99094039 learned_addr learned my addr 172.21.15.50:0/99094039 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb18ac640 1 --2- 172.21.15.50:0/99094039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb10ab640 1 --2- 172.21.15.50:0/99094039 >> v2:172.21.15.170:3300/0 conn(0x7fcdac0cf970 0x7fcdac0cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 -- 172.21.15.50:0/99094039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 msgr2=0x7fcdac0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 --2- 172.21.15.50:0/99094039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 -- 172.21.15.50:0/99094039 >> v2:172.21.15.170:3300/0 conn(0x7fcdac0cf970 msgr2=0x7fcdac0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 --2- 172.21.15.50:0/99094039 >> v2:172.21.15.170:3300/0 conn(0x7fcdac0cf970 0x7fcdac0cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.150+0000 7fcdb08aa640 1 -- 172.21.15.50:0/99094039 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0ced70 con 0x7fcdac0d0290 2023-12-08T08:19:18.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.151+0000 7fcdb08aa640 1 --2- 172.21.15.50:0/99094039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0d0290 0x7fcdac0afb80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcdac08cb00 tx=0x7fcda002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb7a2532526ba48 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.151+0000 7fcdabfff640 1 -- 172.21.15.50:0/99094039 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0031870 con 0x7fcdac0d0290 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.151+0000 7fcdabfff640 1 -- 172.21.15.50:0/99094039 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00319d0 con 0x7fcdac0d0290 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.151+0000 7fcdabfff640 1 -- 172.21.15.50:0/99094039 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0031d60 con 0x7fcdac0d0290 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 -- 172.21.15.50:0/99094039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0d0290 msgr2=0x7fcdac0afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 --2- 172.21.15.50:0/99094039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0d0290 0x7fcdac0afb80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcdac08cb00 tx=0x7fcda002b910 comp rx=0 tx=0).stop 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 -- 172.21.15.50:0/99094039 shutdown_connections 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 --2- 172.21.15.50:0/99094039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 --2- 172.21.15.50:0/99094039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0d0290 0x7fcdac0afb80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 --2- 172.21.15.50:0/99094039 >> v2:172.21.15.170:3300/0 conn(0x7fcdac0cf970 0x7fcdac0cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 -- 172.21.15.50:0/99094039 >> 172.21.15.50:0/99094039 conn(0x7fcdac0d2f80 msgr2=0x7fcdac0d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 -- 172.21.15.50:0/99094039 shutdown_connections 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.152+0000 7fcdb330f640 1 -- 172.21.15.50:0/99094039 wait complete. 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.153+0000 7fcdb330f640 1 Processor -- start 2023-12-08T08:19:18.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.153+0000 7fcdb330f640 1 -- start start 2023-12-08T08:19:18.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb330f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb330f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0cf970 0x7fcdac0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb330f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdac0d0290 0x7fcdac1f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb330f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b3520 con 0x7fcdac0cf970 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb330f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b2910 con 0x7fcdac0d0290 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb330f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b2bf0 con 0x7fcdac0b00c0 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0cf970 0x7fcdac0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0cf970 0x7fcdac0cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51610/0 (socket says 172.21.15.50:51610) 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 -- 172.21.15.50:0/1525033307 learned_addr learned my addr 172.21.15.50:0/1525033307 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 -- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 msgr2=0x7fcdac0b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb10ab640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 -- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdac0d0290 msgr2=0x7fcdac1f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb18ac640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdac0d0290 0x7fcdac1f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdac0d0290 0x7fcdac1f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.154+0000 7fcdb08aa640 1 -- 172.21.15.50:0/1525033307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00094d0 con 0x7fcdac0cf970 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.155+0000 7fcdb08aa640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0cf970 0x7fcdac0cbf30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcda002b950 tx=0x7fcda00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.155+0000 7fcda9ffb640 1 -- 172.21.15.50:0/1525033307 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda003acb0 con 0x7fcdac0cf970 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.155+0000 7fcda9ffb640 1 -- 172.21.15.50:0/1525033307 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda003ae10 con 0x7fcdac0cf970 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.155+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac0b2ed0 con 0x7fcdac0cf970 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.155+0000 7fcda9ffb640 1 -- 172.21.15.50:0/1525033307 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0044630 con 0x7fcdac0cf970 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.155+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac0cc470 con 0x7fcdac0cf970 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.156+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0b3690 con 0x7fcdac0cf970 2023-12-08T08:19:18.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.156+0000 7fcda9ffb640 1 -- 172.21.15.50:0/1525033307 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcda004d450 con 0x7fcdac0cf970 2023-12-08T08:19:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.157+0000 7fcda9ffb640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcd9806ae40 0x7fcd9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.157+0000 7fcda9ffb640 1 -- 172.21.15.50:0/1525033307 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcda002d040 con 0x7fcdac0cf970 2023-12-08T08:19:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.157+0000 7fcdb10ab640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcd9806ae40 0x7fcd9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.158+0000 7fcdb10ab640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcd9806ae40 0x7fcd9806d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcda4006fd0 tx=0x7fcda4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.161+0000 7fcda9ffb640 1 -- 172.21.15.50:0/1525033307 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcda0076c50 con 0x7fcdac0cf970 2023-12-08T08:19:18.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.336+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcdac067540 con 0x7fcdac0cf970 2023-12-08T08:19:18.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.441+0000 7fcda9ffb640 1 -- 172.21.15.50:0/1525033307 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcda00350b0 con 0x7fcdac0cf970 2023-12-08T08:19:18.444 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-08T08:19:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcd9806ae40 msgr2=0x7fcd9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcd9806ae40 0x7fcd9806d300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcda4006fd0 tx=0x7fcda4008040 comp rx=0 tx=0).stop 2023-12-08T08:19:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0cf970 msgr2=0x7fcdac0cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0cf970 0x7fcdac0cbf30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcda002b950 tx=0x7fcda00046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 shutdown_connections 2023-12-08T08:19:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcd9806ae40 0x7fcd9806d300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcdac0cf970 0x7fcdac0cbf30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcdac0d0290 0x7fcdac1f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 --2- 172.21.15.50:0/1525033307 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcdac0b00c0 0x7fcdac0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 >> 172.21.15.50:0/1525033307 conn(0x7fcdac0d2f80 msgr2=0x7fcdac0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 shutdown_connections 2023-12-08T08:19:18.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.444+0000 7fcdb330f640 1 -- 172.21.15.50:0/1525033307 wait complete. 2023-12-08T08:19:18.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:19:18.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.571+0000 7f7eb2b01640 1 Processor -- start 2023-12-08T08:19:18.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.571+0000 7f7eb2b01640 1 -- start start 2023-12-08T08:19:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.571+0000 7f7eb2b01640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac0d06c0 0x7f7eac0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.571+0000 7f7eb2b01640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7eac15d930 0x7f7eac0b6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.571+0000 7f7eb2b01640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0b5dd0 con 0x7f7eac15d550 2023-12-08T08:19:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.571+0000 7f7eb2b01640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0b60b0 con 0x7f7eac15d930 2023-12-08T08:19:18.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.571+0000 7f7eb2b01640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0ce820 con 0x7f7eac0d06c0 2023-12-08T08:19:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eabfff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac0d06c0 0x7f7eac0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eb109e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7eac15d930 0x7f7eac0b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eb089d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7eac15d550 0x7f7eac0d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:57558/0 (socket says 172.21.15.50:57558) 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eb089d640 1 -- 172.21.15.50:0/1436812508 learned_addr learned my addr 172.21.15.50:0/1436812508 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eb109e640 1 -- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac0d06c0 msgr2=0x7f7eac0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eb109e640 1 --2- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac0d06c0 0x7f7eac0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eb109e640 1 -- 172.21.15.50:0/1436812508 >> v1:172.21.15.170:6789/0 conn(0x7f7eac15d550 legacy=0x7f7eac0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eab7fe640 1 -- 172.21.15.50:0/1436812508 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741784463 0 0) 0x7f7eac0b5dd0 con 0x7f7eac15d550 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eb109e640 1 -- 172.21.15.50:0/1436812508 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0ceb00 con 0x7f7eac15d930 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.572+0000 7f7eabfff640 1 --2- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac0d06c0 0x7f7eac0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.573+0000 7f7eb109e640 1 --2- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15d930 0x7f7eac0b6540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009d90 tx=0x7f7ea402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d51fb950d70a9db server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.573+0000 7f7eab7fe640 1 -- 172.21.15.50:0/1436812508 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea402cc50 con 0x7f7eac15d930 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.573+0000 7f7eab7fe640 1 -- 172.21.15.50:0/1436812508 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea402cdb0 con 0x7f7eac15d930 2023-12-08T08:19:18.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.573+0000 7f7eab7fe640 1 -- 172.21.15.50:0/1436812508 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4034660 con 0x7f7eac15d930 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15d930 msgr2=0x7f7eac0b6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15d930 0x7f7eac0b6540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009d90 tx=0x7f7ea402bea0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1436812508 shutdown_connections 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15d930 0x7f7eac0b6540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1436812508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac0d06c0 0x7f7eac0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1436812508 >> 172.21.15.50:0/1436812508 conn(0x7f7eac0d2f80 msgr2=0x7f7eac0d3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1436812508 shutdown_connections 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.574+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1436812508 wait complete. 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.575+0000 7f7eb2b01640 1 Processor -- start 2023-12-08T08:19:18.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.575+0000 7f7eb2b01640 1 -- start start 2023-12-08T08:19:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb2b01640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eac15d550 0x7f7eac0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb2b01640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac15d930 0x7f7eac0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb2b01640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15aa00 0x7f7eac15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb2b01640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0cb0d0 con 0x7f7eac15d550 2023-12-08T08:19:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb2b01640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15b3c0 con 0x7f7eac15aa00 2023-12-08T08:19:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb2b01640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c84f0 con 0x7f7eac15d930 2023-12-08T08:19:18.580 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb089d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eac15d550 0x7f7eac0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb089d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eac15d550 0x7f7eac0c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51626/0 (socket says 172.21.15.50:51626) 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb089d640 1 -- 172.21.15.50:0/1089980717 learned_addr learned my addr 172.21.15.50:0/1089980717 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eb109e640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15aa00 0x7f7eac15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.576+0000 7f7eabfff640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac15d930 0x7f7eac0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb089d640 1 -- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac15d930 msgr2=0x7f7eac0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb089d640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac15d930 0x7f7eac0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb089d640 1 -- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15aa00 msgr2=0x7f7eac15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb089d640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15aa00 0x7f7eac15ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb089d640 1 -- 172.21.15.50:0/1089980717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98009400 con 0x7f7eac15d550 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb089d640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eac15d550 0x7f7eac0c7fb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000c4d0 tx=0x7f7ea000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7ea97fa640 1 -- 172.21.15.50:0/1089980717 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00074e0 con 0x7f7eac15d550 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea4009a70 con 0x7f7eac15d550 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7ea97fa640 1 -- 172.21.15.50:0/1089980717 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0007660 con 0x7f7eac15d550 2023-12-08T08:19:18.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7ea97fa640 1 -- 172.21.15.50:0/1089980717 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0004a20 con 0x7f7eac15d550 2023-12-08T08:19:18.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.577+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac0cadf0 con 0x7f7eac15d550 2023-12-08T08:19:18.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.578+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac067430 con 0x7f7eac15d550 2023-12-08T08:19:18.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.579+0000 7f7ea97fa640 1 -- 172.21.15.50:0/1089980717 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ea0004b80 con 0x7f7eac15d550 2023-12-08T08:19:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.579+0000 7f7ea97fa640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e9006ae40 0x7f7e9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.579+0000 7f7ea97fa640 1 -- 172.21.15.50:0/1089980717 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f7ea00887d0 con 0x7f7eac15d550 2023-12-08T08:19:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.579+0000 7f7eabfff640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e9006ae40 0x7f7e9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:18.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.580+0000 7f7eabfff640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e9006ae40 0x7f7e9006d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0d2420 tx=0x7f7e98009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:18.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.583+0000 7f7ea97fa640 1 -- 172.21.15.50:0/1089980717 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ea00538b0 con 0x7f7eac15d550 2023-12-08T08:19:18.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:18.761+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7eac08c6e0 con 0x7f7eac15d550 2023-12-08T08:19:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.444+0000 7f7ea97fa640 1 -- 172.21.15.50:0/1089980717 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ea0056ed0 con 0x7f7eac15d550 2023-12-08T08:19:19.447 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-08T08:19:19.450 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e9006ae40 msgr2=0x7f7e9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e9006ae40 0x7f7e9006d300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0d2420 tx=0x7f7e98009190 comp rx=0 tx=0).stop 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eac15d550 msgr2=0x7f7eac0c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eac15d550 0x7f7eac0c7fb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000c4d0 tx=0x7f7ea000c990 comp rx=0 tx=0).stop 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 shutdown_connections 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7e9006ae40 0x7f7e9006d300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eac15aa00 0x7f7eac15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7eac15d930 0x7f7eac0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 --2- 172.21.15.50:0/1089980717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7eac15d550 0x7f7eac0c7fb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.448+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 >> 172.21.15.50:0/1089980717 conn(0x7f7eac0d2f80 msgr2=0x7f7eac0d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:19.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.449+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 shutdown_connections 2023-12-08T08:19:19.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.453+0000 7f7eb2b01640 1 -- 172.21.15.50:0/1089980717 wait complete. 2023-12-08T08:19:19.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:19:19.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.591+0000 7f42d759e640 1 Processor -- start 2023-12-08T08:19:19.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.591+0000 7f42d759e640 1 -- start start 2023-12-08T08:19:19.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.592+0000 7f42d759e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 0x7f42d80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.592+0000 7f42d759e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80b3db0 con 0x7f42d806d840 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.592+0000 7f42d759e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80b31a0 con 0x7f42d80717a0 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.592+0000 7f42d759e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d815a2d0 con 0x7f42d8159ef0 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.592+0000 7f42d5d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f42d806d840 0x7f42d8071090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49342/0 (socket says 172.21.15.50:49342) 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.592+0000 7f42d5d9b640 1 -- 172.21.15.50:0/2639376604 learned_addr learned my addr 172.21.15.50:0/2639376604 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d659c640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 0x7f42d80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3575221925 0 0) 0x7f42d80b3db0 con 0x7f42d806d840 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c4003520 con 0x7f42d806d840 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2887827870 0 0) 0x7f42c4003520 con 0x7f42d806d840 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 msgr2=0x7f42d80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 0x7f42d80b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 >> v1:172.21.15.170:6789/0 conn(0x7f42d80717a0 legacy=0x7f42d80cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80b3480 con 0x7f42d806d840 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f42c0001670 con 0x7f42d806d840 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 >> v1:172.21.15.50:6789/0 conn(0x7f42d806d840 legacy=0x7f42d8071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 0x7f42c40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4003ee0 0x7f42c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c4004d00 0x7f42c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d815a2d0 con 0x7f42c4004d00 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c400b9e0 con 0x7f42c4003ee0 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c400bba0 con 0x7f42d8159ef0 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d6d9d640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c4004d00 0x7f42c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d5d9b640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4003ee0 0x7f42c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.593+0000 7f42d659c640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 0x7f42c40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.594+0000 7f42d6d9d640 1 -- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 msgr2=0x7f42c40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.594+0000 7f42d6d9d640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8159ef0 0x7f42c40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.594+0000 7f42d6d9d640 1 -- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4003ee0 msgr2=0x7f42c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.594+0000 7f42d6d9d640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4003ee0 0x7f42c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.594+0000 7f42d6d9d640 1 -- 172.21.15.50:0/2639376604 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4003520 con 0x7f42c4004d00 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.594+0000 7f42d6d9d640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c4004d00 0x7f42c4005180 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001910 tx=0x7f42c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e702669d0137bf7a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.594+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0032620 con 0x7f42c4004d00 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d0032780 con 0x7f42c4004d00 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d559a640 1 -- 172.21.15.50:0/2639376604 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d0032b50 con 0x7f42c4004d00 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d759e640 1 -- 172.21.15.50:0/2639376604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c4004d00 msgr2=0x7f42c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d759e640 1 --2- 172.21.15.50:0/2639376604 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42c4004d00 0x7f42c4005180 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001910 tx=0x7f42c40057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d6d9d640 1 -- 172.21.15.50:0/2639376604 reap_dead start 2023-12-08T08:19:19.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d759e640 1 -- 172.21.15.50:0/2639376604 shutdown_connections 2023-12-08T08:19:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d759e640 1 -- 172.21.15.50:0/2639376604 >> 172.21.15.50:0/2639376604 conn(0x7f42d80b1860 msgr2=0x7f42d80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d759e640 1 -- 172.21.15.50:0/2639376604 shutdown_connections 2023-12-08T08:19:19.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.595+0000 7f42d759e640 1 -- 172.21.15.50:0/2639376604 wait complete. 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.596+0000 7f42d759e640 1 Processor -- start 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d759e640 1 -- start start 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d759e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d00 0x7f42d81455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d806a4d0 0x7f42d806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d759e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8156d80 0x7f42d8157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d759e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d806ae90 con 0x7f42d806a4d0 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d759e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8157770 con 0x7f42c4004d00 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d759e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d814e2c0 con 0x7f42d8156d80 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d806a4d0 0x7f42d806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d5d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d806a4d0 0x7f42d806a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51640/0 (socket says 172.21.15.50:51640) 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d5d9b640 1 -- 172.21.15.50:0/3609873018 learned_addr learned my addr 172.21.15.50:0/3609873018 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.597+0000 7f42d659c640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d00 0x7f42d81455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d6d9d640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8156d80 0x7f42d8157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d5d9b640 1 -- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8156d80 msgr2=0x7f42d8157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d5d9b640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8156d80 0x7f42d8157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d5d9b640 1 -- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d00 msgr2=0x7f42d81455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d5d9b640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d00 0x7f42d81455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d5d9b640 1 -- 172.21.15.50:0/3609873018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d814e560 con 0x7f42d806a4d0 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d6d9d640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8156d80 0x7f42d8157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d5d9b640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d806a4d0 0x7f42d806a950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f42c0001ae0 tx=0x7f42c0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42ceffd640 1 -- 172.21.15.50:0/3609873018 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000f960 con 0x7f42d806a4d0 2023-12-08T08:19:19.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42ceffd640 1 -- 172.21.15.50:0/3609873018 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000fae0 con 0x7f42d806a4d0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d814e840 con 0x7f42d806a4d0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42ceffd640 1 -- 172.21.15.50:0/3609873018 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000fe90 con 0x7f42d806a4d0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.598+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d814ee00 con 0x7f42d806a4d0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.599+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d8067ad0 con 0x7f42d806a4d0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.600+0000 7f42ceffd640 1 -- 172.21.15.50:0/3609873018 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42c001d460 con 0x7f42d806a4d0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.600+0000 7f42ceffd640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42b806ae40 0x7f42b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.600+0000 7f42ceffd640 1 -- 172.21.15.50:0/3609873018 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f42c0089700 con 0x7f42d806a4d0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.600+0000 7f42d659c640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42b806ae40 0x7f42b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.601+0000 7f42d659c640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42b806ae40 0x7f42b806d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42c8014510 tx=0x7f42c800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:19.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.604+0000 7f42ceffd640 1 -- 172.21.15.50:0/3609873018 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42c0054760 con 0x7f42d806a4d0 2023-12-08T08:19:19.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:19.819+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f42d80720a0 con 0x7f42d806a4d0 2023-12-08T08:19:20.481 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 5 and data pool 6 2023-12-08T08:19:20.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.472+0000 7f42ceffd640 1 -- 172.21.15.50:0/3609873018 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f42c0057d80 con 0x7f42d806a4d0 2023-12-08T08:19:20.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.481+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42b806ae40 msgr2=0x7f42b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.481+0000 7f42d759e640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42b806ae40 0x7f42b806d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42c8014510 tx=0x7f42c800b040 comp rx=0 tx=0).stop 2023-12-08T08:19:20.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.481+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d806a4d0 msgr2=0x7f42d806a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.481+0000 7f42d759e640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d806a4d0 0x7f42d806a950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f42c0001ae0 tx=0x7f42c0007720 comp rx=0 tx=0).stop 2023-12-08T08:19:20.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.483+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 shutdown_connections 2023-12-08T08:19:20.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.483+0000 7f42d759e640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f42b806ae40 0x7f42b806d300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.483+0000 7f42d759e640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42d806a4d0 0x7f42d806a950 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.483+0000 7f42d759e640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8156d80 0x7f42d8157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.483+0000 7f42d759e640 1 --2- 172.21.15.50:0/3609873018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d00 0x7f42d81455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.483+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 >> 172.21.15.50:0/3609873018 conn(0x7f42d80b1860 msgr2=0x7f42d80cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:20.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.485+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 shutdown_connections 2023-12-08T08:19:20.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.486+0000 7f42d759e640 1 -- 172.21.15.50:0/3609873018 wait complete. 2023-12-08T08:19:20.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:20.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.613+0000 7f37812f3640 1 Processor -- start 2023-12-08T08:19:20.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.613+0000 7f37812f3640 1 -- start start 2023-12-08T08:19:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f37812f3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f377c15b0f0 0x7f377c0cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f37812f3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c0d1900 0x7f377c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f37812f3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c0cf380 con 0x7f377c0cd760 2023-12-08T08:19:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f37812f3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0cce00 con 0x7f377c15b0f0 2023-12-08T08:19:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f37812f3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0cea50 con 0x7f377c0d1900 2023-12-08T08:19:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f377c15b0f0 0x7f377c0cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377affd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f377c15b0f0 0x7f377c0cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37608/0 (socket says 172.21.15.50:37608) 2023-12-08T08:19:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377affd640 1 -- 172.21.15.50:0/924090447 learned_addr learned my addr 172.21.15.50:0/924090447 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377a7fc640 1 --2- 172.21.15.50:0/924090447 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c0d1900 0x7f377c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377affd640 1 -- 172.21.15.50:0/924090447 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c0d1900 msgr2=0x7f377c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377affd640 1 --2- 172.21.15.50:0/924090447 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c0d1900 0x7f377c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377affd640 1 -- 172.21.15.50:0/924090447 >> v1:172.21.15.170:6789/0 conn(0x7f377c0cd760 legacy=0x7f377c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.614+0000 7f377affd640 1 -- 172.21.15.50:0/924090447 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0ced30 con 0x7f377c15b0f0 2023-12-08T08:19:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.615+0000 7f377affd640 1 --2- 172.21.15.50:0/924090447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c15b0f0 0x7f377c0cc5b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f376c009870 tx=0x7f376c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d61fb0b01ca8827 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.615+0000 7f3779ffb640 1 -- 172.21.15.50:0/924090447 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0317c0 con 0x7f377c15b0f0 2023-12-08T08:19:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.615+0000 7f3779ffb640 1 -- 172.21.15.50:0/924090447 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c031920 con 0x7f377c15b0f0 2023-12-08T08:19:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.615+0000 7f3779ffb640 1 -- 172.21.15.50:0/924090447 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c031cb0 con 0x7f377c15b0f0 2023-12-08T08:19:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 -- 172.21.15.50:0/924090447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c15b0f0 msgr2=0x7f377c0cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 --2- 172.21.15.50:0/924090447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c15b0f0 0x7f377c0cc5b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f376c009870 tx=0x7f376c02b860 comp rx=0 tx=0).stop 2023-12-08T08:19:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 -- 172.21.15.50:0/924090447 shutdown_connections 2023-12-08T08:19:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 --2- 172.21.15.50:0/924090447 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c0d1900 0x7f377c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 --2- 172.21.15.50:0/924090447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c15b0f0 0x7f377c0cc5b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 -- 172.21.15.50:0/924090447 >> 172.21.15.50:0/924090447 conn(0x7f377c0d0de0 msgr2=0x7f377c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 -- 172.21.15.50:0/924090447 shutdown_connections 2023-12-08T08:19:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.616+0000 7f37812f3640 1 -- 172.21.15.50:0/924090447 wait complete. 2023-12-08T08:19:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.617+0000 7f37812f3640 1 Processor -- start 2023-12-08T08:19:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.617+0000 7f37812f3640 1 -- start start 2023-12-08T08:19:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f37812f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c0cd760 0x7f377c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f37812f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c0d1900 0x7f377c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f37812f3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c15b0f0 0x7f377c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f37812f3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c14fc30 con 0x7f377c0cd760 2023-12-08T08:19:20.628 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f37812f3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c149ad0 con 0x7f377c0d1900 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f37812f3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c149d70 con 0x7f377c15b0f0 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c0cd760 0x7f377c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c0cd760 0x7f377c14fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37610/0 (socket says 172.21.15.50:37610) 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 -- 172.21.15.50:0/2405005795 learned_addr learned my addr 172.21.15.50:0/2405005795 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377a7fc640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c0d1900 0x7f377c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377b7fe640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c15b0f0 0x7f377c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 -- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c15b0f0 msgr2=0x7f377c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c15b0f0 0x7f377c15cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 -- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c0d1900 msgr2=0x7f377c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c0d1900 0x7f377c15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.618+0000 7f377affd640 1 -- 172.21.15.50:0/2405005795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0094d0 con 0x7f377c0cd760 2023-12-08T08:19:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.619+0000 7f377affd640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c0cd760 0x7f377c14fe30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f376c02b8a0 tx=0x7f376c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.619+0000 7f37637fe640 1 -- 172.21.15.50:0/2405005795 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c032860 con 0x7f377c0cd760 2023-12-08T08:19:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.619+0000 7f37637fe640 1 -- 172.21.15.50:0/2405005795 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0329e0 con 0x7f377c0cd760 2023-12-08T08:19:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.619+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c14c350 con 0x7f377c0cd760 2023-12-08T08:19:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.619+0000 7f37637fe640 1 -- 172.21.15.50:0/2405005795 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c032d90 con 0x7f377c0cd760 2023-12-08T08:19:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.619+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c14c910 con 0x7f377c0cd760 2023-12-08T08:19:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.620+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c067430 con 0x7f377c0cd760 2023-12-08T08:19:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.620+0000 7f37637fe640 1 -- 172.21.15.50:0/2405005795 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f376c04e450 con 0x7f377c0cd760 2023-12-08T08:19:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.621+0000 7f37637fe640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f376806ae40 0x7f376806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.621+0000 7f37637fe640 1 -- 172.21.15.50:0/2405005795 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f376c0ab8e0 con 0x7f377c0cd760 2023-12-08T08:19:20.632 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.621+0000 7f377a7fc640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f376806ae40 0x7f376806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.622+0000 7f377a7fc640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f376806ae40 0x7f376806d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f377c15e7a0 tx=0x7f3770008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.625+0000 7f37637fe640 1 -- 172.21.15.50:0/2405005795 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f376c076960 con 0x7f377c0cd760 2023-12-08T08:19:20.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.801+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f377c149eb0 con 0x7f377c0cd760 2023-12-08T08:19:20.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.802+0000 7f37637fe640 1 -- 172.21.15.50:0/2405005795 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16787 (secure 0 0 0) 0x7f376c079f80 con 0x7f377c0cd760 2023-12-08T08:19:20.805 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:20.805 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":37,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:19.820514+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f376806ae40 msgr2=0x7f376806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f376806ae40 0x7f376806d300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f377c15e7a0 tx=0x7f3770008040 comp rx=0 tx=0).stop 2023-12-08T08:19:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c0cd760 msgr2=0x7f377c14fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c0cd760 0x7f377c14fe30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f376c02b8a0 tx=0x7f376c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 shutdown_connections 2023-12-08T08:19:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f376806ae40 0x7f376806d300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f377c15b0f0 0x7f377c15cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c0d1900 0x7f377c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 --2- 172.21.15.50:0/2405005795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f377c0cd760 0x7f377c14fe30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 >> 172.21.15.50:0/2405005795 conn(0x7f377c0d0de0 msgr2=0x7f377c0b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 shutdown_connections 2023-12-08T08:19:20.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.804+0000 7f37812f3640 1 -- 172.21.15.50:0/2405005795 wait complete. 2023-12-08T08:19:20.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.922+0000 7fbce9e61640 1 Processor -- start 2023-12-08T08:19:20.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.922+0000 7fbce9e61640 1 -- start start 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce9e61640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce9e61640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbce40c4440 0x7fbce40cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce9e61640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce415fb00 con 0x7fbce415e6d0 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce9e61640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce415fde0 con 0x7fbce40c4440 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce9e61640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40b1df0 con 0x7fbce40b3420 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbce415e6d0 0x7fbce415ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45592/0 (socket says 172.21.15.50:45592) 2023-12-08T08:19:20.926 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce37fe640 1 -- 172.21.15.50:0/1929088748 learned_addr learned my addr 172.21.15.50:0/1929088748 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce3fff640 1 --2- 172.21.15.50:0/1929088748 >> v2:172.21.15.50:3300/0 conn(0x7fbce40c4440 0x7fbce40cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.923+0000 7fbce2ffd640 1 --2- 172.21.15.50:0/1929088748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.924+0000 7fbce27fc640 1 -- 172.21.15.50:0/1929088748 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016035834 0 0) 0x7fbce415fb00 con 0x7fbce415e6d0 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.924+0000 7fbce27fc640 1 -- 172.21.15.50:0/1929088748 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbccc003520 con 0x7fbce415e6d0 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.924+0000 7fbce3fff640 1 -- 172.21.15.50:0/1929088748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 msgr2=0x7fbce40cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.924+0000 7fbce3fff640 1 --2- 172.21.15.50:0/1929088748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.924+0000 7fbce3fff640 1 -- 172.21.15.50:0/1929088748 >> v1:172.21.15.50:6789/0 conn(0x7fbce415e6d0 legacy=0x7fbce415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.924+0000 7fbce3fff640 1 -- 172.21.15.50:0/1929088748 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40cf860 con 0x7fbce40c4440 2023-12-08T08:19:20.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.924+0000 7fbce3fff640 1 --2- 172.21.15.50:0/1929088748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce40cc0e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009dc0 tx=0x7fbcdc02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137be22e868d8294 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce27fc640 1 -- 172.21.15.50:0/1929088748 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc02cc40 con 0x7fbce40c4440 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce27fc640 1 -- 172.21.15.50:0/1929088748 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc02cda0 con 0x7fbce40c4440 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce27fc640 1 -- 172.21.15.50:0/1929088748 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc034660 con 0x7fbce40c4440 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 -- 172.21.15.50:0/1929088748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 msgr2=0x7fbce40cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 --2- 172.21.15.50:0/1929088748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce40cc0e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009dc0 tx=0x7fbcdc02be90 comp rx=0 tx=0).stop 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 -- 172.21.15.50:0/1929088748 shutdown_connections 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 --2- 172.21.15.50:0/1929088748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce40cc0e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 --2- 172.21.15.50:0/1929088748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 -- 172.21.15.50:0/1929088748 >> 172.21.15.50:0/1929088748 conn(0x7fbce40b2900 msgr2=0x7fbce40b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 -- 172.21.15.50:0/1929088748 shutdown_connections 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.925+0000 7fbce9e61640 1 -- 172.21.15.50:0/1929088748 wait complete. 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.926+0000 7fbce9e61640 1 Processor -- start 2023-12-08T08:19:20.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce9e61640 1 -- start start 2023-12-08T08:19:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce9e61640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.934 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce9e61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce9e61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce415e6d0 0x7fbce40aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce9e61640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40ca380 con 0x7fbce40c4440 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce9e61640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce406cc00 con 0x7fbce415e6d0 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce9e61640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40c8510 con 0x7fbce40b3420 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37628/0 (socket says 172.21.15.50:37628) 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.927+0000 7fbce2ffd640 1 -- 172.21.15.50:0/900439988 learned_addr learned my addr 172.21.15.50:0/900439988 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce37fe640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce3fff640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce415e6d0 0x7fbce40aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce2ffd640 1 -- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 msgr2=0x7fbce40c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce2ffd640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce2ffd640 1 -- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce415e6d0 msgr2=0x7fbce40aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce2ffd640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce415e6d0 0x7fbce40aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce2ffd640 1 -- 172.21.15.50:0/900439988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009a70 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce3fff640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce415e6d0 0x7fbce40aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce37fe640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce2ffd640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce406c6c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800e840 tx=0x7fbcd800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbccbfff640 1 -- 172.21.15.50:0/900439988 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80094f0 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbccbfff640 1 -- 172.21.15.50:0/900439988 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800c940 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce415ec30 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbccbfff640 1 -- 172.21.15.50:0/900439988 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800ccd0 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.928+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce406bbe0 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.929+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce4067430 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.930+0000 7fbccbfff640 1 -- 172.21.15.50:0/900439988 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbcd8013470 con 0x7fbce40c4440 2023-12-08T08:19:20.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.930+0000 7fbccbfff640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcd006ae40 0x7fbcd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.930+0000 7fbccbfff640 1 -- 172.21.15.50:0/900439988 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbcd8089760 con 0x7fbce40c4440 2023-12-08T08:19:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.930+0000 7fbce37fe640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcd006ae40 0x7fbcd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.931+0000 7fbce37fe640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcd006ae40 0x7fbcd006d300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40011e0 tx=0x7fbcd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:20.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:20.934+0000 7fbccbfff640 1 -- 172.21.15.50:0/900439988 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbcd8054760 con 0x7fbce40c4440 2023-12-08T08:19:21.117 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.115+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbce40b0c10 con 0x7fbce40c4440 2023-12-08T08:19:21.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.116+0000 7fbccbfff640 1 -- 172.21.15.50:0/900439988 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16787 (secure 0 0 0) 0x7fbcd8057d80 con 0x7fbce40c4440 2023-12-08T08:19:21.118 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:21.118 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":37,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:19.820514+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:21.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcd006ae40 msgr2=0x7fbcd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcd006ae40 0x7fbcd006d300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40011e0 tx=0x7fbcd4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:21.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 msgr2=0x7fbce406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce406c6c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800e840 tx=0x7fbcd800ed00 comp rx=0 tx=0).stop 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 shutdown_connections 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcd006ae40 0x7fbcd006d300 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbce40c4440 0x7fbce406c6c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbce415e6d0 0x7fbce40aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 --2- 172.21.15.50:0/900439988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbce40b3420 0x7fbce40c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 >> 172.21.15.50:0/900439988 conn(0x7fbce40b2900 msgr2=0x7fbce4158d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 shutdown_connections 2023-12-08T08:19:21.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.118+0000 7fbce9e61640 1 -- 172.21.15.50:0/900439988 wait complete. 2023-12-08T08:19:21.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:19:21.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.238+0000 7f602c6e7640 1 Processor -- start 2023-12-08T08:19:21.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.238+0000 7f602c6e7640 1 -- start start 2023-12-08T08:19:21.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602c6e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240ce3c0 0x7f6024161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602c6e7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60240707c0 0x7f602406be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602c6e7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240723b0 con 0x7f60240b1f30 2023-12-08T08:19:21.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602c6e7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240b3240 con 0x7f60240707c0 2023-12-08T08:19:21.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602c6e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240b23b0 con 0x7f60240ce3c0 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602ac84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60240707c0 0x7f602406be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602ac84640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f60240707c0 0x7f602406be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37640/0 (socket says 172.21.15.50:37640) 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602ac84640 1 -- 172.21.15.50:0/3316437007 learned_addr learned my addr 172.21.15.50:0/3316437007 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602a483640 1 --2- 172.21.15.50:0/3316437007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240ce3c0 0x7f6024161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602ac84640 1 -- 172.21.15.50:0/3316437007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240ce3c0 msgr2=0x7f6024161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602ac84640 1 --2- 172.21.15.50:0/3316437007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240ce3c0 0x7f6024161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602ac84640 1 -- 172.21.15.50:0/3316437007 >> v1:172.21.15.170:6789/0 conn(0x7f60240b1f30 legacy=0x7f60240700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.239+0000 7f602ac84640 1 -- 172.21.15.50:0/3316437007 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240b2630 con 0x7f60240707c0 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.240+0000 7f602ac84640 1 --2- 172.21.15.50:0/3316437007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240707c0 0x7f602406be30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f601c009e50 tx=0x7f601c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc8e675d604720b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.240+0000 7f6029481640 1 -- 172.21.15.50:0/3316437007 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c02ca70 con 0x7f60240707c0 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.240+0000 7f6029481640 1 -- 172.21.15.50:0/3316437007 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c02cbd0 con 0x7f60240707c0 2023-12-08T08:19:21.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.240+0000 7f6029481640 1 -- 172.21.15.50:0/3316437007 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0343f0 con 0x7f60240707c0 2023-12-08T08:19:21.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 -- 172.21.15.50:0/3316437007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240707c0 msgr2=0x7f602406be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 --2- 172.21.15.50:0/3316437007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240707c0 0x7f602406be30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f601c009e50 tx=0x7f601c02bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 -- 172.21.15.50:0/3316437007 shutdown_connections 2023-12-08T08:19:21.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 --2- 172.21.15.50:0/3316437007 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240707c0 0x7f602406be30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 --2- 172.21.15.50:0/3316437007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240ce3c0 0x7f6024161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 -- 172.21.15.50:0/3316437007 >> 172.21.15.50:0/3316437007 conn(0x7f60240b0850 msgr2=0x7f60240b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 -- 172.21.15.50:0/3316437007 shutdown_connections 2023-12-08T08:19:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.241+0000 7f602c6e7640 1 -- 172.21.15.50:0/3316437007 wait complete. 2023-12-08T08:19:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.242+0000 7f602c6e7640 1 Processor -- start 2023-12-08T08:19:21.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.242+0000 7f602c6e7640 1 -- start start 2023-12-08T08:19:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240707c0 0x7f6024151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60240b1f30 0x7f6024142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240ce3c0 0x7f6024157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241502f0 con 0x7f60240ce3c0 2023-12-08T08:19:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241513b0 con 0x7f60240b1f30 2023-12-08T08:19:21.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6024152340 con 0x7f60240707c0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240ce3c0 0x7f6024157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240ce3c0 0x7f6024157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37642/0 (socket says 172.21.15.50:37642) 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 -- 172.21.15.50:0/362761733 learned_addr learned my addr 172.21.15.50:0/362761733 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602a483640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240707c0 0x7f6024151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f6029c82640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60240b1f30 0x7f6024142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 -- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240707c0 msgr2=0x7f6024151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240707c0 0x7f6024151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 -- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60240b1f30 msgr2=0x7f6024142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60240b1f30 0x7f6024142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 -- 172.21.15.50:0/362761733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009b30 con 0x7f60240ce3c0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602a483640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240707c0 0x7f6024151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f6029c82640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60240b1f30 0x7f6024142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602ac84640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240ce3c0 0x7f6024157830 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f601c009e50 tx=0x7f601c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f601affd640 1 -- 172.21.15.50:0/362761733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c009510 con 0x7f60240ce3c0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f601affd640 1 -- 172.21.15.50:0/362761733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c03e450 con 0x7f60240ce3c0 2023-12-08T08:19:21.248 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6024153570 con 0x7f60240ce3c0 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f601affd640 1 -- 172.21.15.50:0/362761733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c03e7e0 con 0x7f60240ce3c0 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.243+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6024153b30 con 0x7f60240ce3c0 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.244+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6024067430 con 0x7f60240ce3c0 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.245+0000 7f601affd640 1 -- 172.21.15.50:0/362761733 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f601c03e940 con 0x7f60240ce3c0 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.245+0000 7f601affd640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600806ae40 0x7f600806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.245+0000 7f601affd640 1 -- 172.21.15.50:0/362761733 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f601c0ac520 con 0x7f60240ce3c0 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.246+0000 7f602a483640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600806ae40 0x7f600806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.249 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.246+0000 7f602a483640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600806ae40 0x7f600806d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6020006fd0 tx=0x7f6020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.251 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.249+0000 7f601affd640 1 -- 172.21.15.50:0/362761733 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f601c077490 con 0x7f60240ce3c0 2023-12-08T08:19:21.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.462+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f60240b3b40 con 0x7f60240ce3c0 2023-12-08T08:19:21.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.465+0000 7f601affd640 1 -- 172.21.15.50:0/362761733 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f601c07aab0 con 0x7f60240ce3c0 2023-12-08T08:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600806ae40 msgr2=0x7f600806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600806ae40 0x7f600806d300 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6020006fd0 tx=0x7f6020008040 comp rx=0 tx=0).stop 2023-12-08T08:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240ce3c0 msgr2=0x7f6024157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240ce3c0 0x7f6024157830 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f601c009e50 tx=0x7f601c004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 shutdown_connections 2023-12-08T08:19:21.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f600806ae40 0x7f600806d300 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60240ce3c0 0x7f6024157830 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60240b1f30 0x7f6024142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 --2- 172.21.15.50:0/362761733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60240707c0 0x7f6024151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 >> 172.21.15.50:0/362761733 conn(0x7f60240b0850 msgr2=0x7f602406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 shutdown_connections 2023-12-08T08:19:21.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.467+0000 7f602c6e7640 1 -- 172.21.15.50:0/362761733 wait complete. 2023-12-08T08:19:21.481 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:19:21.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:19:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.587+0000 7f63e750c640 1 Processor -- start 2023-12-08T08:19:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.588+0000 7f63e750c640 1 -- start start 2023-12-08T08:19:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.588+0000 7f63e750c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f63e00d1950 0x7f63e00cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.588+0000 7f63e750c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00cc9f0 0x7f63e00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.588+0000 7f63e750c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00ceba0 con 0x7f63e015e6a0 2023-12-08T08:19:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.588+0000 7f63e750c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00cee80 con 0x7f63e00d1950 2023-12-08T08:19:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.588+0000 7f63e750c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00cbcb0 con 0x7f63e00cc9f0 2023-12-08T08:19:21.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e4aa7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f63e00d1950 0x7f63e00cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e52a8640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f63e015e6a0 0x7f63e00ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:44000/0 (socket says 172.21.15.50:44000) 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e52a8640 1 -- 172.21.15.50:0/2116000991 learned_addr learned my addr 172.21.15.50:0/2116000991 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e5aa9640 1 --2- 172.21.15.50:0/2116000991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00cc9f0 0x7f63e00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e5aa9640 1 -- 172.21.15.50:0/2116000991 >> v2:172.21.15.170:3300/0 conn(0x7f63e00d1950 msgr2=0x7f63e00cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e5aa9640 1 --2- 172.21.15.50:0/2116000991 >> v2:172.21.15.170:3300/0 conn(0x7f63e00d1950 0x7f63e00cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e5aa9640 1 -- 172.21.15.50:0/2116000991 >> v1:172.21.15.170:6789/0 conn(0x7f63e015e6a0 legacy=0x7f63e00ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e5aa9640 1 -- 172.21.15.50:0/2116000991 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00cbf90 con 0x7f63e00cc9f0 2023-12-08T08:19:21.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.589+0000 7f63e4aa7640 1 --2- 172.21.15.50:0/2116000991 >> v2:172.21.15.170:3300/0 conn(0x7f63e00d1950 0x7f63e00cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:21.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.590+0000 7f63e5aa9640 1 --2- 172.21.15.50:0/2116000991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00cc9f0 0x7f63e00b3c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63d00097a0 tx=0x7f63d002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8016ec7341a1812c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.590+0000 7f63dffff640 1 -- 172.21.15.50:0/2116000991 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0031830 con 0x7f63e00cc9f0 2023-12-08T08:19:21.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.590+0000 7f63dffff640 1 -- 172.21.15.50:0/2116000991 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0031990 con 0x7f63e00cc9f0 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.590+0000 7f63dffff640 1 -- 172.21.15.50:0/2116000991 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0031d20 con 0x7f63e00cc9f0 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 -- 172.21.15.50:0/2116000991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00cc9f0 msgr2=0x7f63e00b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 --2- 172.21.15.50:0/2116000991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00cc9f0 0x7f63e00b3c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63d00097a0 tx=0x7f63d002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 -- 172.21.15.50:0/2116000991 shutdown_connections 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 --2- 172.21.15.50:0/2116000991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00cc9f0 0x7f63e00b3c80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 --2- 172.21.15.50:0/2116000991 >> v2:172.21.15.170:3300/0 conn(0x7f63e00d1950 0x7f63e00cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 -- 172.21.15.50:0/2116000991 >> 172.21.15.50:0/2116000991 conn(0x7f63e00d0e30 msgr2=0x7f63e00d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 -- 172.21.15.50:0/2116000991 shutdown_connections 2023-12-08T08:19:21.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.591+0000 7f63e750c640 1 -- 172.21.15.50:0/2116000991 wait complete. 2023-12-08T08:19:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.592+0000 7f63e750c640 1 Processor -- start 2023-12-08T08:19:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.592+0000 7f63e750c640 1 -- start start 2023-12-08T08:19:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e750c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e00cc9f0 0x7f63e00c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e750c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00d1950 0x7f63e0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e750c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63e015e6a0 0x7f63e0153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e750c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e01f5550 con 0x7f63e00cc9f0 2023-12-08T08:19:21.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e750c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e01f5970 con 0x7f63e015e6a0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e750c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e01f4bf0 con 0x7f63e00d1950 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e00cc9f0 0x7f63e00c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e00cc9f0 0x7f63e00c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37652/0 (socket says 172.21.15.50:37652) 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 -- 172.21.15.50:0/2224648485 learned_addr learned my addr 172.21.15.50:0/2224648485 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e5aa9640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63e015e6a0 0x7f63e0153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e4aa7640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00d1950 0x7f63e0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 -- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00d1950 msgr2=0x7f63e0153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00d1950 0x7f63e0153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 -- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63e015e6a0 msgr2=0x7f63e0153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63e015e6a0 0x7f63e0153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 -- 172.21.15.50:0/2224648485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d4009400 con 0x7f63e00cc9f0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e52a8640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e00cc9f0 0x7f63e00c4e80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f63d800cbc0 tx=0x7f63d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63ddffb640 1 -- 172.21.15.50:0/2224648485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800aca0 con 0x7f63e00cc9f0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63ddffb640 1 -- 172.21.15.50:0/2224648485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800ae00 con 0x7f63e00cc9f0 2023-12-08T08:19:21.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0009400 con 0x7f63e00cc9f0 2023-12-08T08:19:21.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.593+0000 7f63ddffb640 1 -- 172.21.15.50:0/2224648485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8012600 con 0x7f63e00cc9f0 2023-12-08T08:19:21.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.594+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e01f5170 con 0x7f63e00cc9f0 2023-12-08T08:19:21.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.595+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e01f5690 con 0x7f63e00cc9f0 2023-12-08T08:19:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.595+0000 7f63ddffb640 1 -- 172.21.15.50:0/2224648485 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63d8007070 con 0x7f63e00cc9f0 2023-12-08T08:19:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.595+0000 7f63ddffb640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f63cc06ae40 0x7f63cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.595+0000 7f63ddffb640 1 -- 172.21.15.50:0/2224648485 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f63d8089550 con 0x7f63e00cc9f0 2023-12-08T08:19:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.596+0000 7f63e4aa7640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f63cc06ae40 0x7f63cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:21.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.596+0000 7f63e4aa7640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f63cc06ae40 0x7f63cc06d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f63e006aaf0 tx=0x7f63d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:21.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.599+0000 7f63ddffb640 1 -- 172.21.15.50:0/2224648485 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63d8054600 con 0x7f63e00cc9f0 2023-12-08T08:19:21.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:21.811+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f63e0067ad0 con 0x7f63e00cc9f0 2023-12-08T08:19:22.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.472+0000 7f63ddffb640 1 -- 172.21.15.50:0/2224648485 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f63d8057c20 con 0x7f63e00cc9f0 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f63cc06ae40 msgr2=0x7f63cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f63cc06ae40 0x7f63cc06d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f63e006aaf0 tx=0x7f63d4008040 comp rx=0 tx=0).stop 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e00cc9f0 msgr2=0x7f63e00c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e00cc9f0 0x7f63e00c4e80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f63d800cbc0 tx=0x7f63d800a060 comp rx=0 tx=0).stop 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 shutdown_connections 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f63cc06ae40 0x7f63cc06d300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63e015e6a0 0x7f63e0153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63e00d1950 0x7f63e0153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 --2- 172.21.15.50:0/2224648485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63e00cc9f0 0x7f63e00c4e80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 >> 172.21.15.50:0/2224648485 conn(0x7f63e00d0e30 msgr2=0x7f63e00cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 shutdown_connections 2023-12-08T08:19:22.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.475+0000 7f63e750c640 1 -- 172.21.15.50:0/2224648485 wait complete. 2023-12-08T08:19:22.491 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:19:22.491 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.601+0000 7f7ecf8f3640 1 Processor -- start 2023-12-08T08:19:22.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.601+0000 7f7ecf8f3640 1 -- start start 2023-12-08T08:19:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecf8f3640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7ec80ad290 0x7f7ec806ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecf8f3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad710 0x7f7ec806d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecf8f3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec806aee0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecf8f3640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec806bd40 con 0x7f7ec80ad290 2023-12-08T08:19:22.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecf8f3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec806b130 con 0x7f7ec80ad710 2023-12-08T08:19:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecce8e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7ec80ad290 0x7f7ec806ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecde90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad710 0x7f7ec806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecd68f640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7ec8160ca0 0x7f7ec8161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:44004/0 (socket says 172.21.15.50:44004) 2023-12-08T08:19:22.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecce8e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7ec80ad290 0x7f7ec806ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:51790/0 (socket says 172.21.15.50:51790) 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecd68f640 1 -- 172.21.15.50:0/1260316241 learned_addr learned my addr 172.21.15.50:0/1260316241 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ebffff640 1 -- 172.21.15.50:0/1260316241 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784633968 0 0) 0x7f7ec806aee0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ebffff640 1 -- 172.21.15.50:0/1260316241 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb4003520 con 0x7f7ec8160ca0 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecde90640 1 -- 172.21.15.50:0/1260316241 >> v2:172.21.15.170:3300/0 conn(0x7f7ec80ad290 msgr2=0x7f7ec806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecde90640 1 --2- 172.21.15.50:0/1260316241 >> v2:172.21.15.170:3300/0 conn(0x7f7ec80ad290 0x7f7ec806ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecde90640 1 -- 172.21.15.50:0/1260316241 >> v1:172.21.15.170:6789/0 conn(0x7f7ec8160ca0 legacy=0x7f7ec8161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.602+0000 7f7ecde90640 1 -- 172.21.15.50:0/1260316241 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec806b410 con 0x7f7ec80ad710 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.603+0000 7f7ecce8e640 1 --2- 172.21.15.50:0/1260316241 >> v2:172.21.15.170:3300/0 conn(0x7f7ec80ad290 0x7f7ec806ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:22.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.603+0000 7f7ecde90640 1 --2- 172.21.15.50:0/1260316241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad710 0x7f7ec806d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009d90 tx=0x7f7ec002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1ad10b2ab9592a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ebffff640 1 -- 172.21.15.50:0/1260316241 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec002cc50 con 0x7f7ec80ad710 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ebffff640 1 -- 172.21.15.50:0/1260316241 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec002cdb0 con 0x7f7ec80ad710 2023-12-08T08:19:22.607 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ebffff640 1 -- 172.21.15.50:0/1260316241 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0034660 con 0x7f7ec80ad710 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/1260316241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad710 msgr2=0x7f7ec806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/1260316241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad710 0x7f7ec806d350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009d90 tx=0x7f7ec002bea0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/1260316241 shutdown_connections 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/1260316241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad710 0x7f7ec806d350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/1260316241 >> v2:172.21.15.170:3300/0 conn(0x7f7ec80ad290 0x7f7ec806ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/1260316241 >> 172.21.15.50:0/1260316241 conn(0x7f7ec80cf470 msgr2=0x7f7ec80cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/1260316241 shutdown_connections 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.604+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/1260316241 wait complete. 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.605+0000 7f7ecf8f3640 1 Processor -- start 2023-12-08T08:19:22.608 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.605+0000 7f7ecf8f3640 1 -- start start 2023-12-08T08:19:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecf8f3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad290 0x7f7ec813e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecf8f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec80ad710 0x7f7ec81f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecf8f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec8160ca0 0x7f7ec81f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecf8f3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec814c670 con 0x7f7ec8160ca0 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecf8f3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec814e680 con 0x7f7ec80ad710 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecf8f3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec814e920 con 0x7f7ec80ad290 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecde90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec8160ca0 0x7f7ec81f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecde90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec8160ca0 0x7f7ec81f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37654/0 (socket says 172.21.15.50:37654) 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecde90640 1 -- 172.21.15.50:0/3800967977 learned_addr learned my addr 172.21.15.50:0/3800967977 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.606+0000 7f7ecce8e640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec80ad710 0x7f7ec81f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecd68f640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad290 0x7f7ec813e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecde90640 1 -- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad290 msgr2=0x7f7ec813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecde90640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad290 0x7f7ec813e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecde90640 1 -- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec80ad710 msgr2=0x7f7ec81f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecde90640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec80ad710 0x7f7ec81f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecde90640 1 -- 172.21.15.50:0/3800967977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8009400 con 0x7f7ec8160ca0 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecde90640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec8160ca0 0x7f7ec81f67e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009d90 tx=0x7f7ec0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.611 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ebdffb640 1 -- 172.21.15.50:0/3800967977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0040650 con 0x7f7ec8160ca0 2023-12-08T08:19:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ebdffb640 1 -- 172.21.15.50:0/3800967977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec00407b0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec0009a70 con 0x7f7ec8160ca0 2023-12-08T08:19:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ebdffb640 1 -- 172.21.15.50:0/3800967977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0040b60 con 0x7f7ec8160ca0 2023-12-08T08:19:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.607+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec814eee0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.608+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec8067430 con 0x7f7ec8160ca0 2023-12-08T08:19:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.609+0000 7f7ebdffb640 1 -- 172.21.15.50:0/3800967977 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ec0040cc0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.609+0000 7f7ebdffb640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7eac06ae40 0x7f7eac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.609+0000 7f7ebdffb640 1 -- 172.21.15.50:0/3800967977 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7ec00ac4d0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.610+0000 7f7ecd68f640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7eac06ae40 0x7f7eac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.610+0000 7f7ecd68f640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7eac06ae40 0x7f7eac06d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40011e0 tx=0x7f7ec4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.614+0000 7f7ebdffb640 1 -- 172.21.15.50:0/3800967977 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ec00773a0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.826+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ec8073ce0 con 0x7f7ec8160ca0 2023-12-08T08:19:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.826+0000 7f7ebdffb640 1 -- 172.21.15.50:0/3800967977 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f7ec0009450 con 0x7f7ec8160ca0 2023-12-08T08:19:22.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:22.829 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:19.820822+0000","modified":"2023-12-08T08:19:21.813122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/209897774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":209897774},{"type":"v1","addr":"172.21.15.50:6835","nonce":209897774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:19:22.829 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 16 2023-12-08T08:19:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7eac06ae40 msgr2=0x7f7eac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7eac06ae40 0x7f7eac06d300 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7ec40011e0 tx=0x7f7ec4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec8160ca0 msgr2=0x7f7ec81f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec8160ca0 0x7f7ec81f67e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009d90 tx=0x7f7ec0004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 shutdown_connections 2023-12-08T08:19:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7eac06ae40 0x7f7eac06d300 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.831 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7ec8160ca0 0x7f7ec81f67e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec80ad710 0x7f7ec81f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 --2- 172.21.15.50:0/3800967977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec80ad290 0x7f7ec813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.828+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 >> 172.21.15.50:0/3800967977 conn(0x7f7ec80cf470 msgr2=0x7f7ec80af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.829+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 shutdown_connections 2023-12-08T08:19:22.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.829+0000 7f7ecf8f3640 1 -- 172.21.15.50:0/3800967977 wait complete. 2023-12-08T08:19:22.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.946+0000 7f5d9ec90640 1 Processor -- start 2023-12-08T08:19:22.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.946+0000 7f5d9ec90640 1 -- start start 2023-12-08T08:19:22.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9ec90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980b6ac0 0x7f5d980cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9ec90640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d980ce190 0x7f5d980cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9ec90640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d980d0070 con 0x7f5d980cd660 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9ec90640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d98160cb0 con 0x7f5d980ce190 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9ec90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980d02b0 con 0x7f5d980b6ac0 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9d22d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d980ce190 0x7f5d980cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9d22d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5d980ce190 0x7f5d980cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37662/0 (socket says 172.21.15.50:37662) 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9d22d640 1 -- 172.21.15.50:0/790721798 learned_addr learned my addr 172.21.15.50:0/790721798 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9ca2c640 1 --2- 172.21.15.50:0/790721798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980b6ac0 0x7f5d980cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9d22d640 1 -- 172.21.15.50:0/790721798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980b6ac0 msgr2=0x7f5d980cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9d22d640 1 --2- 172.21.15.50:0/790721798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980b6ac0 0x7f5d980cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9d22d640 1 -- 172.21.15.50:0/790721798 >> v1:172.21.15.170:6789/0 conn(0x7f5d980cd660 legacy=0x7f5d980cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.947+0000 7f5d9d22d640 1 -- 172.21.15.50:0/790721798 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980cb430 con 0x7f5d980ce190 2023-12-08T08:19:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.948+0000 7f5d9d22d640 1 --2- 172.21.15.50:0/790721798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980ce190 0x7f5d980cc1f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009e50 tx=0x7f5d9002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b70e72ab511532 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.948+0000 7f5d977fe640 1 -- 172.21.15.50:0/790721798 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9002c9f0 con 0x7f5d980ce190 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.948+0000 7f5d977fe640 1 -- 172.21.15.50:0/790721798 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9002cb50 con 0x7f5d980ce190 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.948+0000 7f5d977fe640 1 -- 172.21.15.50:0/790721798 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d900343f0 con 0x7f5d980ce190 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.948+0000 7f5d9ec90640 1 -- 172.21.15.50:0/790721798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980ce190 msgr2=0x7f5d980cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.948+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/790721798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980ce190 0x7f5d980cc1f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009e50 tx=0x7f5d9002be50 comp rx=0 tx=0).stop 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.949+0000 7f5d9ec90640 1 -- 172.21.15.50:0/790721798 shutdown_connections 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.949+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/790721798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980ce190 0x7f5d980cc1f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.949+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/790721798 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980b6ac0 0x7f5d980cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.949+0000 7f5d9ec90640 1 -- 172.21.15.50:0/790721798 >> 172.21.15.50:0/790721798 conn(0x7f5d980d0de0 msgr2=0x7f5d980d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.949+0000 7f5d9ec90640 1 -- 172.21.15.50:0/790721798 shutdown_connections 2023-12-08T08:19:22.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.949+0000 7f5d9ec90640 1 -- 172.21.15.50:0/790721798 wait complete. 2023-12-08T08:19:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.950+0000 7f5d9ec90640 1 Processor -- start 2023-12-08T08:19:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.950+0000 7f5d9ec90640 1 -- start start 2023-12-08T08:19:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ec90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980b6ac0 0x7f5d9814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ec90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980cd660 0x7f5d981f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ec90640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d980ce190 0x7f5d9814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ec90640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9814b470 con 0x7f5d980b6ac0 2023-12-08T08:19:22.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ec90640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9814d760 con 0x7f5d980ce190 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ec90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9814e200 con 0x7f5d980cd660 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980b6ac0 0x7f5d9814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980b6ac0 0x7f5d9814d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37666/0 (socket says 172.21.15.50:37666) 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 -- 172.21.15.50:0/882173511 learned_addr learned my addr 172.21.15.50:0/882173511 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d97fff640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980cd660 0x7f5d981f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9d22d640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d980ce190 0x7f5d9814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 -- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980cd660 msgr2=0x7f5d981f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980cd660 0x7f5d981f6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 -- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d980ce190 msgr2=0x7f5d9814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d980ce190 0x7f5d9814a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 -- 172.21.15.50:0/882173511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d90009b30 con 0x7f5d980b6ac0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ca2c640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980b6ac0 0x7f5d9814d220 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00d5f0 tx=0x7f5d8c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d957fa640 1 -- 172.21.15.50:0/882173511 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0125f0 con 0x7f5d980b6ac0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d957fa640 1 -- 172.21.15.50:0/882173511 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c012750 con 0x7f5d980b6ac0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d981f71f0 con 0x7f5d980b6ac0 2023-12-08T08:19:22.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.951+0000 7f5d957fa640 1 -- 172.21.15.50:0/882173511 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c012b00 con 0x7f5d980b6ac0 2023-12-08T08:19:22.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.952+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9814dc40 con 0x7f5d980b6ac0 2023-12-08T08:19:22.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.952+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d980b6f80 con 0x7f5d980b6ac0 2023-12-08T08:19:22.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.953+0000 7f5d957fa640 1 -- 172.21.15.50:0/882173511 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d8c012c60 con 0x7f5d980b6ac0 2023-12-08T08:19:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.953+0000 7f5d957fa640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d7c06ae40 0x7f5d7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.954+0000 7f5d957fa640 1 -- 172.21.15.50:0/882173511 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5d8c089a00 con 0x7f5d980b6ac0 2023-12-08T08:19:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.954+0000 7f5d97fff640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d7c06ae40 0x7f5d7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:22.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.954+0000 7f5d97fff640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d7c06ae40 0x7f5d7c06d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d9806e210 tx=0x7f5d84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:22.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:22.958+0000 7f5d957fa640 1 -- 172.21.15.50:0/882173511 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d8c054ab0 con 0x7f5d980b6ac0 2023-12-08T08:19:23.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.134+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d98067430 con 0x7f5d980b6ac0 2023-12-08T08:19:23.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.135+0000 7f5d957fa640 1 -- 172.21.15.50:0/882173511 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f5d8c0580d0 con 0x7f5d980b6ac0 2023-12-08T08:19:23.149 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:23.150 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":38,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:21.454773+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d7c06ae40 msgr2=0x7f5d7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d7c06ae40 0x7f5d7c06d300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5d9806e210 tx=0x7f5d84009040 comp rx=0 tx=0).stop 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980b6ac0 msgr2=0x7f5d9814d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980b6ac0 0x7f5d9814d220 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00d5f0 tx=0x7f5d8c00dab0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 shutdown_connections 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d7c06ae40 0x7f5d7c06d300 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d980ce190 0x7f5d9814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d980cd660 0x7f5d981f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 --2- 172.21.15.50:0/882173511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d980b6ac0 0x7f5d9814d220 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 >> 172.21.15.50:0/882173511 conn(0x7f5d980d0de0 msgr2=0x7f5d980cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 shutdown_connections 2023-12-08T08:19:23.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.138+0000 7f5d9ec90640 1 -- 172.21.15.50:0/882173511 wait complete. 2023-12-08T08:19:23.152 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:19:23.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.256+0000 7f1dd6378640 1 Processor -- start 2023-12-08T08:19:23.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.256+0000 7f1dd6378640 1 -- start start 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.257+0000 7f1dd6378640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1dd01608a0 0x7f1dd00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.257+0000 7f1dd6378640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00d20b0 con 0x7f1dd00b0cf0 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.257+0000 7f1dd6378640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00d1b80 con 0x7f1dd00b1d70 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.257+0000 7f1dd6378640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00d0620 con 0x7f1dd01608a0 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.257+0000 7f1dcffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1dd01608a0 0x7f1dd00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.257+0000 7f1dd4915640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1dd00b0cf0 0x7f1dd00cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45596/0 (socket says 172.21.15.50:45596) 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.257+0000 7f1dd4915640 1 -- 172.21.15.50:0/3561066759 learned_addr learned my addr 172.21.15.50:0/3561066759 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.258+0000 7f1dcffff640 1 -- 172.21.15.50:0/3561066759 >> v1:172.21.15.170:6789/0 conn(0x7f1dd00b1d70 legacy=0x7f1dd00d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.258+0000 7f1dcffff640 1 -- 172.21.15.50:0/3561066759 >> v1:172.21.15.50:6789/0 conn(0x7f1dd00b0cf0 legacy=0x7f1dd00cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.261 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.258+0000 7f1dcffff640 1 -- 172.21.15.50:0/3561066759 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00d1dd0 con 0x7f1dd01608a0 2023-12-08T08:19:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.258+0000 7f1dceffd640 1 -- 172.21.15.50:0/3561066759 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856300731 0 0) 0x7f1dd00d20b0 con 0x7f1dd00b0cf0 2023-12-08T08:19:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.258+0000 7f1dcffff640 1 --2- 172.21.15.50:0/3561066759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd00d0f30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097a0 tx=0x7f1dc002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bbc883bfe69bd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dceffd640 1 -- 172.21.15.50:0/3561066759 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc002e070 con 0x7f1dd01608a0 2023-12-08T08:19:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dceffd640 1 -- 172.21.15.50:0/3561066759 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc00315a0 con 0x7f1dd01608a0 2023-12-08T08:19:23.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dceffd640 1 -- 172.21.15.50:0/3561066759 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0031930 con 0x7f1dd01608a0 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dd6378640 1 -- 172.21.15.50:0/3561066759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 msgr2=0x7f1dd00d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3561066759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd00d0f30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097a0 tx=0x7f1dc002b840 comp rx=0 tx=0).stop 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dd6378640 1 -- 172.21.15.50:0/3561066759 shutdown_connections 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3561066759 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd00d0f30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dd6378640 1 -- 172.21.15.50:0/3561066759 >> 172.21.15.50:0/3561066759 conn(0x7f1dd00d3030 msgr2=0x7f1dd00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dd6378640 1 -- 172.21.15.50:0/3561066759 shutdown_connections 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.259+0000 7f1dd6378640 1 -- 172.21.15.50:0/3561066759 wait complete. 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.260+0000 7f1dd6378640 1 Processor -- start 2023-12-08T08:19:23.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd6378640 1 -- start start 2023-12-08T08:19:23.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd6378640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dd00b0cf0 0x7f1dd00b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd6378640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1dd00b1d70 0x7f1dd00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd6378640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd01578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd6378640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00c8870 con 0x7f1dd01608a0 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd6378640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd0157de0 con 0x7f1dd00b0cf0 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd6378640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00cccf0 con 0x7f1dd00b1d70 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.261+0000 7f1dd4915640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd01578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd01578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37688/0 (socket says 172.21.15.50:37688) 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 -- 172.21.15.50:0/3275775375 learned_addr learned my addr 172.21.15.50:0/3275775375 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dcf7fe640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1dd00b1d70 0x7f1dd00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dcffff640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dd00b0cf0 0x7f1dd00b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 -- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1dd00b1d70 msgr2=0x7f1dd00ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1dd00b1d70 0x7f1dd00ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 -- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dd00b0cf0 msgr2=0x7f1dd00b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dd00b0cf0 0x7f1dd00b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 -- 172.21.15.50:0/3275775375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc0009400 con 0x7f1dd01608a0 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd4915640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd01578a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8001560 tx=0x7f1dc800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dccff9640 1 -- 172.21.15.50:0/3275775375 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800a640 con 0x7f1dd01608a0 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dccff9640 1 -- 172.21.15.50:0/3275775375 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800a7a0 con 0x7f1dd01608a0 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00ccfd0 con 0x7f1dd01608a0 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dccff9640 1 -- 172.21.15.50:0/3275775375 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800ab30 con 0x7f1dd01608a0 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.262+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd00c8500 con 0x7f1dd01608a0 2023-12-08T08:19:23.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.263+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd00c89e0 con 0x7f1dd01608a0 2023-12-08T08:19:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.264+0000 7f1dccff9640 1 -- 172.21.15.50:0/3275775375 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dc800ac90 con 0x7f1dd01608a0 2023-12-08T08:19:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.264+0000 7f1dccff9640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1db006ae40 0x7f1db006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.264+0000 7f1dccff9640 1 -- 172.21.15.50:0/3275775375 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1dc8088f10 con 0x7f1dd01608a0 2023-12-08T08:19:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.264+0000 7f1dcffff640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1db006ae40 0x7f1db006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.265+0000 7f1dcffff640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1db006ae40 0x7f1db006d300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0036000 tx=0x7f1dc003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.273 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.269+0000 7f1dccff9640 1 -- 172.21.15.50:0/3275775375 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dc8053f30 con 0x7f1dd01608a0 2023-12-08T08:19:23.443 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.440+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1dd00b30d0 con 0x7f1db006ae40 2023-12-08T08:19:23.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.448+0000 7f1dccff9640 1 -- 172.21.15.50:0/3275775375 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277618 (secure 0 0 0) 0x7f1dd00b30d0 con 0x7f1db006ae40 2023-12-08T08:19:23.454 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:23.455 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:19:23.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1db006ae40 msgr2=0x7f1db006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1db006ae40 0x7f1db006d300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0036000 tx=0x7f1dc003d040 comp rx=0 tx=0).stop 2023-12-08T08:19:23.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 msgr2=0x7f1dd01578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd01578a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8001560 tx=0x7f1dc800cc70 comp rx=0 tx=0).stop 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 shutdown_connections 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1db006ae40 0x7f1db006d300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1dd01608a0 0x7f1dd01578a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1dd00b1d70 0x7f1dd00ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 --2- 172.21.15.50:0/3275775375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dd00b0cf0 0x7f1dd00b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 >> 172.21.15.50:0/3275775375 conn(0x7f1dd00d3030 msgr2=0x7f1dd00b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 shutdown_connections 2023-12-08T08:19:23.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.451+0000 7f1dd6378640 1 -- 172.21.15.50:0/3275775375 wait complete. 2023-12-08T08:19:23.464 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-12-08T08:19:22.134407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253740,"kb_used_data":4268,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720980,"statfs":{"total":773094113280,"available":772834283520,"internally_reserved":0,"allocated":4370432,"data_stored":2514067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000864"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449114+0000","last_change":"2023-12-08T08:19:18.449114+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449114+0000","last_undegraded":"2023-12-08T08:19:18.449114+0000","last_fullsized":"2023-12-08T08:19:18.449114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449664+0000","last_change":"2023-12-08T08:19:18.449664+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449664+0000","last_undegraded":"2023-12-08T08:19:18.449664+0000","last_fullsized":"2023-12-08T08:19:18.449664+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446014+0000","last_change":"2023-12-08T08:19:18.446014+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446014+0000","last_undegraded":"2023-12-08T08:19:18.446014+0000","last_fullsized":"2023-12-08T08:19:18.446014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446212+0000","last_change":"2023-12-08T08:19:18.446212+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446212+0000","last_undegraded":"2023-12-08T08:19:18.446212+0000","last_fullsized":"2023-12-08T08:19:18.446212+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448701+0000","last_change":"2023-12-08T08:19:18.448701+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448701+0000","last_undegraded":"2023-12-08T08:19:18.448701+0000","last_fullsized":"2023-12-08T08:19:18.448701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445383+0000","last_change":"2023-12-08T08:19:18.445383+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445383+0000","last_undegraded":"2023-12-08T08:19:18.445383+0000","last_fullsized":"2023-12-08T08:19:18.445383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446004+0000","last_change":"2023-12-08T08:19:18.446004+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446004+0000","last_undegraded":"2023-12-08T08:19:18.446004+0000","last_fullsized":"2023-12-08T08:19:18.446004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445298+0000","last_change":"2023-12-08T08:19:18.445298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445298+0000","last_undegraded":"2023-12-08T08:19:18.445298+0000","last_fullsized":"2023-12-08T08:19:18.445298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447618+0000","last_change":"2023-12-08T08:19:18.447618+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447618+0000","last_undegraded":"2023-12-08T08:19:18.447618+0000","last_fullsized":"2023-12-08T08:19:18.447618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448690+0000","last_change":"2023-12-08T08:19:18.448690+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448690+0000","last_undegraded":"2023-12-08T08:19:18.448690+0000","last_fullsized":"2023-12-08T08:19:18.448690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448738+0000","last_change":"2023-12-08T08:19:18.448738+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448738+0000","last_undegraded":"2023-12-08T08:19:18.448738+0000","last_fullsized":"2023-12-08T08:19:18.448738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447611+0000","last_change":"2023-12-08T08:19:18.447611+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447611+0000","last_undegraded":"2023-12-08T08:19:18.447611+0000","last_fullsized":"2023-12-08T08:19:18.447611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447537+0000","last_change":"2023-12-08T08:19:18.447537+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447537+0000","last_undegraded":"2023-12-08T08:19:18.447537+0000","last_fullsized":"2023-12-08T08:19:18.447537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445878+0000","last_change":"2023-12-08T08:19:18.445878+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445878+0000","last_undegraded":"2023-12-08T08:19:18.445878+0000","last_fullsized":"2023-12-08T08:19:18.445878+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449061+0000","last_change":"2023-12-08T08:19:18.449061+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449061+0000","last_undegraded":"2023-12-08T08:19:18.449061+0000","last_fullsized":"2023-12-08T08:19:18.449061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445613+0000","last_change":"2023-12-08T08:19:18.445613+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445613+0000","last_undegraded":"2023-12-08T08:19:18.445613+0000","last_fullsized":"2023-12-08T08:19:18.445613+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449298+0000","last_change":"2023-12-08T08:19:18.449298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449298+0000","last_undegraded":"2023-12-08T08:19:18.449298+0000","last_fullsized":"2023-12-08T08:19:18.449298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445323+0000","last_change":"2023-12-08T08:19:18.445323+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445323+0000","last_undegraded":"2023-12-08T08:19:18.445323+0000","last_fullsized":"2023-12-08T08:19:18.445323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448937+0000","last_change":"2023-12-08T08:19:18.448937+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448937+0000","last_undegraded":"2023-12-08T08:19:18.448937+0000","last_fullsized":"2023-12-08T08:19:18.448937+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445847+0000","last_change":"2023-12-08T08:19:18.445847+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445847+0000","last_undegraded":"2023-12-08T08:19:18.445847+0000","last_fullsized":"2023-12-08T08:19:18.445847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448670+0000","last_change":"2023-12-08T08:19:18.448670+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448670+0000","last_undegraded":"2023-12-08T08:19:18.448670+0000","last_fullsized":"2023-12-08T08:19:18.448670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448653+0000","last_change":"2023-12-08T08:19:18.448653+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448653+0000","last_undegraded":"2023-12-08T08:19:18.448653+0000","last_fullsized":"2023-12-08T08:19:18.448653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445923+0000","last_change":"2023-12-08T08:19:18.445923+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445923+0000","last_undegraded":"2023-12-08T08:19:18.445923+0000","last_fullsized":"2023-12-08T08:19:18.445923+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448635+0000","last_change":"2023-12-08T08:19:18.448635+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448635+0000","last_undegraded":"2023-12-08T08:19:18.448635+0000","last_fullsized":"2023-12-08T08:19:18.448635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448727+0000","last_change":"2023-12-08T08:19:18.448727+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448727+0000","last_undegraded":"2023-12-08T08:19:18.448727+0000","last_fullsized":"2023-12-08T08:19:18.448727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448747+0000","last_change":"2023-12-08T08:19:18.448747+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448747+0000","last_undegraded":"2023-12-08T08:19:18.448747+0000","last_fullsized":"2023-12-08T08:19:18.448747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450113+0000","last_change":"2023-12-08T08:19:18.450113+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450113+0000","last_undegraded":"2023-12-08T08:19:18.450113+0000","last_fullsized":"2023-12-08T08:19:18.450113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450823+0000","last_change":"2023-12-08T08:19:18.450823+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450823+0000","last_undegraded":"2023-12-08T08:19:18.450823+0000","last_fullsized":"2023-12-08T08:19:18.450823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449662+0000","last_change":"2023-12-08T08:19:18.449662+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449662+0000","last_undegraded":"2023-12-08T08:19:18.449662+0000","last_fullsized":"2023-12-08T08:19:18.449662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445471+0000","last_change":"2023-12-08T08:19:18.445471+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445471+0000","last_undegraded":"2023-12-08T08:19:18.445471+0000","last_fullsized":"2023-12-08T08:19:18.445471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447603+0000","last_change":"2023-12-08T08:19:18.447603+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447603+0000","last_undegraded":"2023-12-08T08:19:18.447603+0000","last_fullsized":"2023-12-08T08:19:18.447603+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446169+0000","last_change":"2023-12-08T08:19:18.446169+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446169+0000","last_undegraded":"2023-12-08T08:19:18.446169+0000","last_fullsized":"2023-12-08T08:19:18.446169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.443386+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:19:14.443386+0000","last_peered":"2023-12-08T08:19:14.443386+0000","last_clean":"2023-12-08T08:19:14.443386+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:19:14.443386+0000","last_undegraded":"2023-12-08T08:19:14.443386+0000","last_fullsized":"2023-12-08T08:19:14.443386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":983040,"data_stored":752559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.629},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.745}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.82099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.621}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.496}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.496}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.435},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.313}]},{"osd":4,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.628}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.315},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":757677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:23.470 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.610+0000 7f0a434d3640 1 Processor -- start 2023-12-08T08:19:23.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.610+0000 7f0a434d3640 1 -- start start 2023-12-08T08:19:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a434d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a3c0cfb30 0x7f0a3c0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a434d3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0d02b0 con 0x7f0a3c0cc1f0 2023-12-08T08:19:23.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a434d3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0cb430 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a434d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c160cb0 con 0x7f0a3c0cfb30 2023-12-08T08:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a40a6e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a3c0cfb30 0x7f0a3c0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a41a70640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a3c0cc1f0 0x7f0a3c0cc640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45602/0 (socket says 172.21.15.50:45602) 2023-12-08T08:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a41a70640 1 -- 172.21.15.50:0/820451421 learned_addr learned my addr 172.21.15.50:0/820451421 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a40a6e640 1 -- 172.21.15.50:0/820451421 >> v1:172.21.15.170:6789/0 conn(0x7f0a3c0b6ac0 legacy=0x7f0a3c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a40a6e640 1 -- 172.21.15.50:0/820451421 >> v1:172.21.15.50:6789/0 conn(0x7f0a3c0cc1f0 legacy=0x7f0a3c0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.611+0000 7f0a40a6e640 1 -- 172.21.15.50:0/820451421 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0cb710 con 0x7f0a3c0cfb30 2023-12-08T08:19:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.612+0000 7f0a40a6e640 1 --2- 172.21.15.50:0/820451421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c0cdd70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0a380097a0 tx=0x7f0a3802b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4686a8d74edc57 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.612+0000 7f0a33fff640 1 -- 172.21.15.50:0/820451421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38030710 con 0x7f0a3c0cfb30 2023-12-08T08:19:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.612+0000 7f0a33fff640 1 -- 172.21.15.50:0/820451421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3802e050 con 0x7f0a3c0cfb30 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.612+0000 7f0a33fff640 1 -- 172.21.15.50:0/820451421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38030a90 con 0x7f0a3c0cfb30 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.613+0000 7f0a434d3640 1 -- 172.21.15.50:0/820451421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0cfb30 msgr2=0x7f0a3c0cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.613+0000 7f0a434d3640 1 --2- 172.21.15.50:0/820451421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c0cdd70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0a380097a0 tx=0x7f0a3802b680 comp rx=0 tx=0).stop 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.613+0000 7f0a434d3640 1 -- 172.21.15.50:0/820451421 shutdown_connections 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.613+0000 7f0a434d3640 1 --2- 172.21.15.50:0/820451421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c0cdd70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.613+0000 7f0a434d3640 1 -- 172.21.15.50:0/820451421 >> 172.21.15.50:0/820451421 conn(0x7f0a3c0d0de0 msgr2=0x7f0a3c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.613+0000 7f0a434d3640 1 -- 172.21.15.50:0/820451421 shutdown_connections 2023-12-08T08:19:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.613+0000 7f0a434d3640 1 -- 172.21.15.50:0/820451421 wait complete. 2023-12-08T08:19:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.614+0000 7f0a434d3640 1 Processor -- start 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.614+0000 7f0a434d3640 1 -- start start 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a434d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0b6ac0 0x7f0a3c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a434d3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3c0cc1f0 0x7f0a3c1f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a434d3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a434d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c1f34c0 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a434d3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c1f37a0 con 0x7f0a3c0cfb30 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a434d3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c1f3a80 con 0x7f0a3c0cc1f0 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0b6ac0 0x7f0a3c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0b6ac0 0x7f0a3c0caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37698/0 (socket says 172.21.15.50:37698) 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 -- 172.21.15.50:0/1667404917 learned_addr learned my addr 172.21.15.50:0/1667404917 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a41a70640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 -- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3c0cc1f0 msgr2=0x7f0a3c1f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a40a6e640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3c0cc1f0 0x7f0a3c1f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3c0cc1f0 0x7f0a3c1f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 -- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3c0cfb30 msgr2=0x7f0a3c15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 -- 172.21.15.50:0/1667404917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009400 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a41a70640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a40a6e640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3c0cc1f0 0x7f0a3c1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a4126f640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0b6ac0 0x7f0a3c0caae0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c400 tx=0x7f0a2c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.615+0000 7f0a31ffb640 1 -- 172.21.15.50:0/1667404917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0052d0 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.616+0000 7f0a31ffb640 1 -- 172.21.15.50:0/1667404917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c005430 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.616+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c1f3d60 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.616+0000 7f0a31ffb640 1 -- 172.21.15.50:0/1667404917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c003830 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.616+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c1f3160 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.617+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c15a6f0 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.617+0000 7f0a31ffb640 1 -- 172.21.15.50:0/1667404917 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a2c003990 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.617+0000 7f0a31ffb640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2006ae40 0x7f0a2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.617+0000 7f0a31ffb640 1 -- 172.21.15.50:0/1667404917 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0a2c088cd0 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.618+0000 7f0a40a6e640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2006ae40 0x7f0a2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.618+0000 7f0a40a6e640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2006ae40 0x7f0a2006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0a38034000 tx=0x7f0a38008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.622+0000 7f0a31ffb640 1 -- 172.21.15.50:0/1667404917 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a3c15a6f0 con 0x7f0a3c0b6ac0 2023-12-08T08:19:23.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.792+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a3c0c7d40 con 0x7f0a2006ae40 2023-12-08T08:19:23.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.800+0000 7f0a31ffb640 1 -- 172.21.15.50:0/1667404917 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277618 (secure 0 0 0) 0x7f0a3c0c7d40 con 0x7f0a2006ae40 2023-12-08T08:19:23.805 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:23.807 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:19:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2006ae40 msgr2=0x7f0a2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2006ae40 0x7f0a2006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0a38034000 tx=0x7f0a38008030 comp rx=0 tx=0).stop 2023-12-08T08:19:23.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0b6ac0 msgr2=0x7f0a3c0caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0b6ac0 0x7f0a3c0caae0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00c400 tx=0x7f0a2c00c8c0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 shutdown_connections 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2006ae40 0x7f0a2006d300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3c0cfb30 0x7f0a3c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3c0cc1f0 0x7f0a3c1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 --2- 172.21.15.50:0/1667404917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a3c0b6ac0 0x7f0a3c0caae0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 >> 172.21.15.50:0/1667404917 conn(0x7f0a3c0d0de0 msgr2=0x7f0a3c0cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 shutdown_connections 2023-12-08T08:19:23.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.803+0000 7f0a434d3640 1 -- 172.21.15.50:0/1667404917 wait complete. 2023-12-08T08:19:23.816 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-12-08T08:19:22.134407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253740,"kb_used_data":4268,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720980,"statfs":{"total":773094113280,"available":772834283520,"internally_reserved":0,"allocated":4370432,"data_stored":2514067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000864"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449114+0000","last_change":"2023-12-08T08:19:18.449114+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449114+0000","last_undegraded":"2023-12-08T08:19:18.449114+0000","last_fullsized":"2023-12-08T08:19:18.449114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449664+0000","last_change":"2023-12-08T08:19:18.449664+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449664+0000","last_undegraded":"2023-12-08T08:19:18.449664+0000","last_fullsized":"2023-12-08T08:19:18.449664+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446014+0000","last_change":"2023-12-08T08:19:18.446014+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446014+0000","last_undegraded":"2023-12-08T08:19:18.446014+0000","last_fullsized":"2023-12-08T08:19:18.446014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446212+0000","last_change":"2023-12-08T08:19:18.446212+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446212+0000","last_undegraded":"2023-12-08T08:19:18.446212+0000","last_fullsized":"2023-12-08T08:19:18.446212+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448701+0000","last_change":"2023-12-08T08:19:18.448701+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448701+0000","last_undegraded":"2023-12-08T08:19:18.448701+0000","last_fullsized":"2023-12-08T08:19:18.448701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445383+0000","last_change":"2023-12-08T08:19:18.445383+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445383+0000","last_undegraded":"2023-12-08T08:19:18.445383+0000","last_fullsized":"2023-12-08T08:19:18.445383+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446004+0000","last_change":"2023-12-08T08:19:18.446004+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446004+0000","last_undegraded":"2023-12-08T08:19:18.446004+0000","last_fullsized":"2023-12-08T08:19:18.446004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445298+0000","last_change":"2023-12-08T08:19:18.445298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445298+0000","last_undegraded":"2023-12-08T08:19:18.445298+0000","last_fullsized":"2023-12-08T08:19:18.445298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447618+0000","last_change":"2023-12-08T08:19:18.447618+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447618+0000","last_undegraded":"2023-12-08T08:19:18.447618+0000","last_fullsized":"2023-12-08T08:19:18.447618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448690+0000","last_change":"2023-12-08T08:19:18.448690+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448690+0000","last_undegraded":"2023-12-08T08:19:18.448690+0000","last_fullsized":"2023-12-08T08:19:18.448690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448738+0000","last_change":"2023-12-08T08:19:18.448738+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448738+0000","last_undegraded":"2023-12-08T08:19:18.448738+0000","last_fullsized":"2023-12-08T08:19:18.448738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447611+0000","last_change":"2023-12-08T08:19:18.447611+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447611+0000","last_undegraded":"2023-12-08T08:19:18.447611+0000","last_fullsized":"2023-12-08T08:19:18.447611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447537+0000","last_change":"2023-12-08T08:19:18.447537+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447537+0000","last_undegraded":"2023-12-08T08:19:18.447537+0000","last_fullsized":"2023-12-08T08:19:18.447537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445878+0000","last_change":"2023-12-08T08:19:18.445878+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445878+0000","last_undegraded":"2023-12-08T08:19:18.445878+0000","last_fullsized":"2023-12-08T08:19:18.445878+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449061+0000","last_change":"2023-12-08T08:19:18.449061+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449061+0000","last_undegraded":"2023-12-08T08:19:18.449061+0000","last_fullsized":"2023-12-08T08:19:18.449061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445613+0000","last_change":"2023-12-08T08:19:18.445613+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445613+0000","last_undegraded":"2023-12-08T08:19:18.445613+0000","last_fullsized":"2023-12-08T08:19:18.445613+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449298+0000","last_change":"2023-12-08T08:19:18.449298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449298+0000","last_undegraded":"2023-12-08T08:19:18.449298+0000","last_fullsized":"2023-12-08T08:19:18.449298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445323+0000","last_change":"2023-12-08T08:19:18.445323+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445323+0000","last_undegraded":"2023-12-08T08:19:18.445323+0000","last_fullsized":"2023-12-08T08:19:18.445323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448937+0000","last_change":"2023-12-08T08:19:18.448937+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448937+0000","last_undegraded":"2023-12-08T08:19:18.448937+0000","last_fullsized":"2023-12-08T08:19:18.448937+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445847+0000","last_change":"2023-12-08T08:19:18.445847+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445847+0000","last_undegraded":"2023-12-08T08:19:18.445847+0000","last_fullsized":"2023-12-08T08:19:18.445847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448670+0000","last_change":"2023-12-08T08:19:18.448670+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448670+0000","last_undegraded":"2023-12-08T08:19:18.448670+0000","last_fullsized":"2023-12-08T08:19:18.448670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448653+0000","last_change":"2023-12-08T08:19:18.448653+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448653+0000","last_undegraded":"2023-12-08T08:19:18.448653+0000","last_fullsized":"2023-12-08T08:19:18.448653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445923+0000","last_change":"2023-12-08T08:19:18.445923+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445923+0000","last_undegraded":"2023-12-08T08:19:18.445923+0000","last_fullsized":"2023-12-08T08:19:18.445923+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448635+0000","last_change":"2023-12-08T08:19:18.448635+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448635+0000","last_undegraded":"2023-12-08T08:19:18.448635+0000","last_fullsized":"2023-12-08T08:19:18.448635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448727+0000","last_change":"2023-12-08T08:19:18.448727+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448727+0000","last_undegraded":"2023-12-08T08:19:18.448727+0000","last_fullsized":"2023-12-08T08:19:18.448727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448747+0000","last_change":"2023-12-08T08:19:18.448747+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448747+0000","last_undegraded":"2023-12-08T08:19:18.448747+0000","last_fullsized":"2023-12-08T08:19:18.448747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450113+0000","last_change":"2023-12-08T08:19:18.450113+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450113+0000","last_undegraded":"2023-12-08T08:19:18.450113+0000","last_fullsized":"2023-12-08T08:19:18.450113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450823+0000","last_change":"2023-12-08T08:19:18.450823+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450823+0000","last_undegraded":"2023-12-08T08:19:18.450823+0000","last_fullsized":"2023-12-08T08:19:18.450823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449662+0000","last_change":"2023-12-08T08:19:18.449662+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449662+0000","last_undegraded":"2023-12-08T08:19:18.449662+0000","last_fullsized":"2023-12-08T08:19:18.449662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445471+0000","last_change":"2023-12-08T08:19:18.445471+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445471+0000","last_undegraded":"2023-12-08T08:19:18.445471+0000","last_fullsized":"2023-12-08T08:19:18.445471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447603+0000","last_change":"2023-12-08T08:19:18.447603+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447603+0000","last_undegraded":"2023-12-08T08:19:18.447603+0000","last_fullsized":"2023-12-08T08:19:18.447603+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446169+0000","last_change":"2023-12-08T08:19:18.446169+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446169+0000","last_undegraded":"2023-12-08T08:19:18.446169+0000","last_fullsized":"2023-12-08T08:19:18.446169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-08T08:19:14.443386+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:19:14.443386+0000","last_peered":"2023-12-08T08:19:14.443386+0000","last_clean":"2023-12-08T08:19:14.443386+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:19:14.443386+0000","last_undegraded":"2023-12-08T08:19:14.443386+0000","last_fullsized":"2023-12-08T08:19:14.443386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":983040,"data_stored":752559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.629},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.745}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.82099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.621}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.496}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.496}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.435},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.313}]},{"osd":4,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.628}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.315},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":757677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:23.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:23.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.960+0000 7f32067ec640 1 Processor -- start 2023-12-08T08:19:23.963 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.960+0000 7f32067ec640 1 -- start start 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f32067ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 0x7f32000d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f32067ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320015ee90 con 0x7f32000d3ad0 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f32067ec640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32000d0fe0 con 0x7f320015f890 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f32067ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000d1280 con 0x7f320015d580 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f31ff7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f32000d3ad0 0x7f320015f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45614/0 (socket says 172.21.15.50:45614) 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f31ff7fe640 1 -- 172.21.15.50:0/2043946760 learned_addr learned my addr 172.21.15.50:0/2043946760 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f31fffff640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 0x7f32000d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633182548 0 0) 0x7f320015ee90 con 0x7f32000d3ad0 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.961+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e8003520 con 0x7f32000d3ad0 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701160650 0 0) 0x7f31e8003520 con 0x7f32000d3ad0 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 msgr2=0x7f32000d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:23.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 0x7f32000d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 >> v1:172.21.15.170:6789/0 conn(0x7f320015f890 legacy=0x7f320015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000d1560 con 0x7f32000d3ad0 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f31f0001670 con 0x7f32000d3ad0 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 >> v1:172.21.15.50:6789/0 conn(0x7f32000d3ad0 legacy=0x7f320015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80039a0 0x7f31e8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31e8004350 0x7f31e8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 0x7f31e8005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000d1280 con 0x7f31e80039a0 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e800ba30 con 0x7f31e8004350 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e800bbf0 con 0x7f320015d580 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31fffff640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80039a0 0x7f31e8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31e8004350 0x7f31e8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f3204d89640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 0x7f31e8005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31fffff640 1 -- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 msgr2=0x7f31e8005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31fffff640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f320015d580 0x7f31e8005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.967 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31fffff640 1 -- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31e8004350 msgr2=0x7f31e8004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31fffff640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31e8004350 0x7f31e8004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31fffff640 1 -- 172.21.15.50:0/2043946760 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8003520 con 0x7f31e80039a0 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.962+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31e8004350 0x7f31e8004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f31fffff640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80039a0 0x7f31e8003d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009ac0 tx=0x7f31e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e469fb484243a71 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f402c6b0 con 0x7f31e80039a0 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f402c810 con 0x7f31e80039a0 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f31feffd640 1 -- 172.21.15.50:0/2043946760 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f402cba0 con 0x7f31e80039a0 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f32067ec640 1 -- 172.21.15.50:0/2043946760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80039a0 msgr2=0x7f31e8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f32067ec640 1 --2- 172.21.15.50:0/2043946760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f31e80039a0 0x7f31e8003d80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009ac0 tx=0x7f31e80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f3204d89640 1 -- 172.21.15.50:0/2043946760 reap_dead start 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f32067ec640 1 -- 172.21.15.50:0/2043946760 shutdown_connections 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f32067ec640 1 -- 172.21.15.50:0/2043946760 >> 172.21.15.50:0/2043946760 conn(0x7f32000d2fb0 msgr2=0x7f32000d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f32067ec640 1 -- 172.21.15.50:0/2043946760 shutdown_connections 2023-12-08T08:19:23.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.963+0000 7f32067ec640 1 -- 172.21.15.50:0/2043946760 wait complete. 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.965+0000 7f32067ec640 1 Processor -- start 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.965+0000 7f32067ec640 1 -- start start 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.965+0000 7f32067ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31e80039a0 0x7f32001f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.965+0000 7f32067ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000cbe50 0x7f32000b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f32067ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32000cc2d0 0x7f32000b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f32067ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000cb9c0 con 0x7f32000cbe50 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f32067ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000cab10 con 0x7f32000cc2d0 2023-12-08T08:19:23.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f32067ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000cadb0 con 0x7f31e80039a0 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000cbe50 0x7f32000b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000cbe50 0x7f32000b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37716/0 (socket says 172.21.15.50:37716) 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 -- 172.21.15.50:0/3924817803 learned_addr learned my addr 172.21.15.50:0/3924817803 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f3204d89640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32000cc2d0 0x7f32000b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31fffff640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31e80039a0 0x7f32001f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 -- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31e80039a0 msgr2=0x7f32001f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31e80039a0 0x7f32001f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 -- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32000cc2d0 msgr2=0x7f32000b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32000cc2d0 0x7f32000b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 -- 172.21.15.50:0/3924817803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000cb090 con 0x7f32000cbe50 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f3204d89640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32000cc2d0 0x7f32000b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31ff7fe640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000cbe50 0x7f32000b8500 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e700 tx=0x7f31f000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31fcff9640 1 -- 172.21.15.50:0/3924817803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000ee10 con 0x7f32000cbe50 2023-12-08T08:19:23.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31fcff9640 1 -- 172.21.15.50:0/3924817803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000c870 con 0x7f32000cbe50 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f31fcff9640 1 -- 172.21.15.50:0/3924817803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000cbe0 con 0x7f32000cbe50 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32000cb370 con 0x7f32000cbe50 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.966+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32001f4000 con 0x7f32000cbe50 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.967+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32000d09d0 con 0x7f32000cbe50 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.968+0000 7f31fcff9640 1 -- 172.21.15.50:0/3924817803 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31f000cd40 con 0x7f32000cbe50 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.968+0000 7f31fcff9640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31ec06ae40 0x7f31ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.968+0000 7f31fcff9640 1 -- 172.21.15.50:0/3924817803 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f31f0089740 con 0x7f32000cbe50 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.968+0000 7f31fffff640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31ec06ae40 0x7f31ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:23.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.969+0000 7f31fffff640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31ec06ae40 0x7f31ec06d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f31f4036000 tx=0x7f31f4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:23.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:23.972+0000 7f31fcff9640 1 -- 172.21.15.50:0/3924817803 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31f00580a0 con 0x7f32000cbe50 2023-12-08T08:19:24.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.146+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32000b33c0 con 0x7f31ec06ae40 2023-12-08T08:19:24.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.153+0000 7f31fcff9640 1 -- 172.21.15.50:0/3924817803 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279333 (secure 0 0 0) 0x7f31f4034440 con 0x7f31ec06ae40 2023-12-08T08:19:24.159 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:24.160 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:19:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.156+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31ec06ae40 msgr2=0x7f31ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31ec06ae40 0x7f31ec06d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f31f4036000 tx=0x7f31f4030000 comp rx=0 tx=0).stop 2023-12-08T08:19:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000cbe50 msgr2=0x7f32000b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000cbe50 0x7f32000b8500 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e700 tx=0x7f31f000ebc0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 shutdown_connections 2023-12-08T08:19:24.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f31ec06ae40 0x7f31ec06d300 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32000cbe50 0x7f32000b8500 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32000cc2d0 0x7f32000b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 --2- 172.21.15.50:0/3924817803 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31e80039a0 0x7f32001f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 >> 172.21.15.50:0/3924817803 conn(0x7f32000d2fb0 msgr2=0x7f32000b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 shutdown_connections 2023-12-08T08:19:24.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.157+0000 7f32067ec640 1 -- 172.21.15.50:0/3924817803 wait complete. 2023-12-08T08:19:24.170 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-08T08:19:24.134874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253788,"kb_used_data":4332,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720932,"statfs":{"total":773094113280,"available":772834234368,"internally_reserved":0,"allocated":4435968,"data_stored":2542196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.691362"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458855+0000","last_change":"2023-12-08T08:19:20.471509+0000","last_active":"2023-12-08T08:19:21.458855+0000","last_peered":"2023-12-08T08:19:21.458855+0000","last_clean":"2023-12-08T08:19:21.458855+0000","last_became_active":"2023-12-08T08:19:20.471266+0000","last_became_peered":"2023-12-08T08:19:20.471266+0000","last_unstale":"2023-12-08T08:19:21.458855+0000","last_undegraded":"2023-12-08T08:19:21.458855+0000","last_fullsized":"2023-12-08T08:19:21.458855+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:42.253282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460110+0000","last_change":"2023-12-08T08:19:20.472107+0000","last_active":"2023-12-08T08:19:21.460110+0000","last_peered":"2023-12-08T08:19:21.460110+0000","last_clean":"2023-12-08T08:19:21.460110+0000","last_became_active":"2023-12-08T08:19:20.471846+0000","last_became_peered":"2023-12-08T08:19:20.471846+0000","last_unstale":"2023-12-08T08:19:21.460110+0000","last_undegraded":"2023-12-08T08:19:21.460110+0000","last_fullsized":"2023-12-08T08:19:21.460110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:07:46.974601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459347+0000","last_change":"2023-12-08T08:19:20.465241+0000","last_active":"2023-12-08T08:19:21.459347+0000","last_peered":"2023-12-08T08:19:21.459347+0000","last_clean":"2023-12-08T08:19:21.459347+0000","last_became_active":"2023-12-08T08:19:20.464981+0000","last_became_peered":"2023-12-08T08:19:20.464981+0000","last_unstale":"2023-12-08T08:19:21.459347+0000","last_undegraded":"2023-12-08T08:19:21.459347+0000","last_fullsized":"2023-12-08T08:19:21.459347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:02:18.997136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459819+0000","last_change":"2023-12-08T08:19:20.465816+0000","last_active":"2023-12-08T08:19:21.459819+0000","last_peered":"2023-12-08T08:19:21.459819+0000","last_clean":"2023-12-08T08:19:21.459819+0000","last_became_active":"2023-12-08T08:19:20.465564+0000","last_became_peered":"2023-12-08T08:19:20.465564+0000","last_unstale":"2023-12-08T08:19:21.459819+0000","last_undegraded":"2023-12-08T08:19:21.459819+0000","last_fullsized":"2023-12-08T08:19:21.459819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:35.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459899+0000","last_change":"2023-12-08T08:19:20.470544+0000","last_active":"2023-12-08T08:19:21.459899+0000","last_peered":"2023-12-08T08:19:21.459899+0000","last_clean":"2023-12-08T08:19:21.459899+0000","last_became_active":"2023-12-08T08:19:20.469531+0000","last_became_peered":"2023-12-08T08:19:20.469531+0000","last_unstale":"2023-12-08T08:19:21.459899+0000","last_undegraded":"2023-12-08T08:19:21.459899+0000","last_fullsized":"2023-12-08T08:19:21.459899+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:27:04.510041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449114+0000","last_change":"2023-12-08T08:19:18.449114+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449114+0000","last_undegraded":"2023-12-08T08:19:18.449114+0000","last_fullsized":"2023-12-08T08:19:18.449114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449664+0000","last_change":"2023-12-08T08:19:18.449664+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449664+0000","last_undegraded":"2023-12-08T08:19:18.449664+0000","last_fullsized":"2023-12-08T08:19:18.449664+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446014+0000","last_change":"2023-12-08T08:19:18.446014+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446014+0000","last_undegraded":"2023-12-08T08:19:18.446014+0000","last_fullsized":"2023-12-08T08:19:18.446014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446212+0000","last_change":"2023-12-08T08:19:18.446212+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446212+0000","last_undegraded":"2023-12-08T08:19:18.446212+0000","last_fullsized":"2023-12-08T08:19:18.446212+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448701+0000","last_change":"2023-12-08T08:19:18.448701+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448701+0000","last_undegraded":"2023-12-08T08:19:18.448701+0000","last_fullsized":"2023-12-08T08:19:18.448701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.487504+0000","last_change":"2023-12-08T08:19:19.454482+0000","last_active":"2023-12-08T08:19:20.487504+0000","last_peered":"2023-12-08T08:19:20.487504+0000","last_clean":"2023-12-08T08:19:20.487504+0000","last_became_active":"2023-12-08T08:19:19.453976+0000","last_became_peered":"2023-12-08T08:19:19.453976+0000","last_unstale":"2023-12-08T08:19:20.487504+0000","last_undegraded":"2023-12-08T08:19:20.487504+0000","last_fullsized":"2023-12-08T08:19:20.487504+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:02.773526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446004+0000","last_change":"2023-12-08T08:19:18.446004+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446004+0000","last_undegraded":"2023-12-08T08:19:18.446004+0000","last_fullsized":"2023-12-08T08:19:18.446004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445298+0000","last_change":"2023-12-08T08:19:18.445298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445298+0000","last_undegraded":"2023-12-08T08:19:18.445298+0000","last_fullsized":"2023-12-08T08:19:18.445298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447618+0000","last_change":"2023-12-08T08:19:18.447618+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447618+0000","last_undegraded":"2023-12-08T08:19:18.447618+0000","last_fullsized":"2023-12-08T08:19:18.447618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460076+0000","last_change":"2023-12-08T08:19:20.474759+0000","last_active":"2023-12-08T08:19:21.460076+0000","last_peered":"2023-12-08T08:19:21.460076+0000","last_clean":"2023-12-08T08:19:21.460076+0000","last_became_active":"2023-12-08T08:19:20.474520+0000","last_became_peered":"2023-12-08T08:19:20.474520+0000","last_unstale":"2023-12-08T08:19:21.460076+0000","last_undegraded":"2023-12-08T08:19:21.460076+0000","last_fullsized":"2023-12-08T08:19:21.460076+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:54:11.990189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448690+0000","last_change":"2023-12-08T08:19:18.448690+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448690+0000","last_undegraded":"2023-12-08T08:19:18.448690+0000","last_fullsized":"2023-12-08T08:19:18.448690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448738+0000","last_change":"2023-12-08T08:19:18.448738+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448738+0000","last_undegraded":"2023-12-08T08:19:18.448738+0000","last_fullsized":"2023-12-08T08:19:18.448738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447611+0000","last_change":"2023-12-08T08:19:18.447611+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447611+0000","last_undegraded":"2023-12-08T08:19:18.447611+0000","last_fullsized":"2023-12-08T08:19:18.447611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447537+0000","last_change":"2023-12-08T08:19:18.447537+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447537+0000","last_undegraded":"2023-12-08T08:19:18.447537+0000","last_fullsized":"2023-12-08T08:19:18.447537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445878+0000","last_change":"2023-12-08T08:19:18.445878+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445878+0000","last_undegraded":"2023-12-08T08:19:18.445878+0000","last_fullsized":"2023-12-08T08:19:18.445878+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460009+0000","last_change":"2023-12-08T08:19:20.467487+0000","last_active":"2023-12-08T08:19:21.460009+0000","last_peered":"2023-12-08T08:19:21.460009+0000","last_clean":"2023-12-08T08:19:21.460009+0000","last_became_active":"2023-12-08T08:19:20.467220+0000","last_became_peered":"2023-12-08T08:19:20.467220+0000","last_unstale":"2023-12-08T08:19:21.460009+0000","last_undegraded":"2023-12-08T08:19:21.460009+0000","last_fullsized":"2023-12-08T08:19:21.460009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:00.202918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449061+0000","last_change":"2023-12-08T08:19:18.449061+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449061+0000","last_undegraded":"2023-12-08T08:19:18.449061+0000","last_fullsized":"2023-12-08T08:19:18.449061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489658+0000","last_change":"2023-12-08T08:19:19.463045+0000","last_active":"2023-12-08T08:19:20.489658+0000","last_peered":"2023-12-08T08:19:20.489658+0000","last_clean":"2023-12-08T08:19:20.489658+0000","last_became_active":"2023-12-08T08:19:19.462783+0000","last_became_peered":"2023-12-08T08:19:19.462783+0000","last_unstale":"2023-12-08T08:19:20.489658+0000","last_undegraded":"2023-12-08T08:19:20.489658+0000","last_fullsized":"2023-12-08T08:19:20.489658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:22:15.844857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449298+0000","last_change":"2023-12-08T08:19:18.449298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449298+0000","last_undegraded":"2023-12-08T08:19:18.449298+0000","last_fullsized":"2023-12-08T08:19:18.449298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445323+0000","last_change":"2023-12-08T08:19:18.445323+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445323+0000","last_undegraded":"2023-12-08T08:19:18.445323+0000","last_fullsized":"2023-12-08T08:19:18.445323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448937+0000","last_change":"2023-12-08T08:19:18.448937+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448937+0000","last_undegraded":"2023-12-08T08:19:18.448937+0000","last_fullsized":"2023-12-08T08:19:18.448937+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445847+0000","last_change":"2023-12-08T08:19:18.445847+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445847+0000","last_undegraded":"2023-12-08T08:19:18.445847+0000","last_fullsized":"2023-12-08T08:19:18.445847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458963+0000","last_change":"2023-12-08T08:19:20.470369+0000","last_active":"2023-12-08T08:19:21.458963+0000","last_peered":"2023-12-08T08:19:21.458963+0000","last_clean":"2023-12-08T08:19:21.458963+0000","last_became_active":"2023-12-08T08:19:20.470009+0000","last_became_peered":"2023-12-08T08:19:20.470009+0000","last_unstale":"2023-12-08T08:19:21.458963+0000","last_undegraded":"2023-12-08T08:19:21.458963+0000","last_fullsized":"2023-12-08T08:19:21.458963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:08:58.309555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448670+0000","last_change":"2023-12-08T08:19:18.448670+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448670+0000","last_undegraded":"2023-12-08T08:19:18.448670+0000","last_fullsized":"2023-12-08T08:19:18.448670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448653+0000","last_change":"2023-12-08T08:19:18.448653+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448653+0000","last_undegraded":"2023-12-08T08:19:18.448653+0000","last_fullsized":"2023-12-08T08:19:18.448653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.459683+0000","last_change":"2023-12-08T08:19:19.459100+0000","last_active":"2023-12-08T08:19:20.459683+0000","last_peered":"2023-12-08T08:19:20.459683+0000","last_clean":"2023-12-08T08:19:20.459683+0000","last_became_active":"2023-12-08T08:19:19.458783+0000","last_became_peered":"2023-12-08T08:19:19.458783+0000","last_unstale":"2023-12-08T08:19:20.459683+0000","last_undegraded":"2023-12-08T08:19:20.459683+0000","last_fullsized":"2023-12-08T08:19:20.459683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:07.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448635+0000","last_change":"2023-12-08T08:19:18.448635+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448635+0000","last_undegraded":"2023-12-08T08:19:18.448635+0000","last_fullsized":"2023-12-08T08:19:18.448635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448727+0000","last_change":"2023-12-08T08:19:18.448727+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448727+0000","last_undegraded":"2023-12-08T08:19:18.448727+0000","last_fullsized":"2023-12-08T08:19:18.448727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460233+0000","last_change":"2023-12-08T08:19:20.474162+0000","last_active":"2023-12-08T08:19:21.460233+0000","last_peered":"2023-12-08T08:19:21.460233+0000","last_clean":"2023-12-08T08:19:21.460233+0000","last_became_active":"2023-12-08T08:19:20.473900+0000","last_became_peered":"2023-12-08T08:19:20.473900+0000","last_unstale":"2023-12-08T08:19:21.460233+0000","last_undegraded":"2023-12-08T08:19:21.460233+0000","last_fullsized":"2023-12-08T08:19:21.460233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:38:51.566456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448747+0000","last_change":"2023-12-08T08:19:18.448747+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448747+0000","last_undegraded":"2023-12-08T08:19:18.448747+0000","last_fullsized":"2023-12-08T08:19:18.448747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450113+0000","last_change":"2023-12-08T08:19:18.450113+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450113+0000","last_undegraded":"2023-12-08T08:19:18.450113+0000","last_fullsized":"2023-12-08T08:19:18.450113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450823+0000","last_change":"2023-12-08T08:19:18.450823+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450823+0000","last_undegraded":"2023-12-08T08:19:18.450823+0000","last_fullsized":"2023-12-08T08:19:18.450823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449662+0000","last_change":"2023-12-08T08:19:18.449662+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449662+0000","last_undegraded":"2023-12-08T08:19:18.449662+0000","last_fullsized":"2023-12-08T08:19:18.449662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445471+0000","last_change":"2023-12-08T08:19:18.445471+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445471+0000","last_undegraded":"2023-12-08T08:19:18.445471+0000","last_fullsized":"2023-12-08T08:19:18.445471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459720+0000","last_change":"2023-12-08T08:19:20.474218+0000","last_active":"2023-12-08T08:19:21.459720+0000","last_peered":"2023-12-08T08:19:21.459720+0000","last_clean":"2023-12-08T08:19:21.459720+0000","last_became_active":"2023-12-08T08:19:20.473994+0000","last_became_peered":"2023-12-08T08:19:20.473994+0000","last_unstale":"2023-12-08T08:19:21.459720+0000","last_undegraded":"2023-12-08T08:19:21.459720+0000","last_fullsized":"2023-12-08T08:19:21.459720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:14.336038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447603+0000","last_change":"2023-12-08T08:19:18.447603+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447603+0000","last_undegraded":"2023-12-08T08:19:18.447603+0000","last_fullsized":"2023-12-08T08:19:18.447603+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.460288+0000","last_change":"2023-12-08T08:19:19.456284+0000","last_active":"2023-12-08T08:19:20.460288+0000","last_peered":"2023-12-08T08:19:20.460288+0000","last_clean":"2023-12-08T08:19:20.460288+0000","last_became_active":"2023-12-08T08:19:19.456035+0000","last_became_peered":"2023-12-08T08:19:19.456035+0000","last_unstale":"2023-12-08T08:19:20.460288+0000","last_undegraded":"2023-12-08T08:19:20.460288+0000","last_fullsized":"2023-12-08T08:19:20.460288+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:01.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.459631+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:19:20.459631+0000","last_peered":"2023-12-08T08:19:20.459631+0000","last_clean":"2023-12-08T08:19:20.459631+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:19:20.459631+0000","last_undegraded":"2023-12-08T08:19:20.459631+0000","last_fullsized":"2023-12-08T08:19:20.459631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.623},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.745}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.82099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.621}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.496}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.496}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.435},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.313}]},{"osd":4,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.628}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.315},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":757677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:24.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-12-08T08:19:24.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-12-08T08:19:24.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-12-08T08:19:24.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.449114+0000', 'last_change': '2023-12-08T08:19:18.449114+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.449114+0000', 'last_undegraded': '2023-12-08T08:19:18.449114+0000', 'last_fullsized': '2023-12-08T08:19:18.449114+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-08T08:19:24.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.449664+0000', 'last_change': '2023-12-08T08:19:18.449664+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.449664+0000', 'last_undegraded': '2023-12-08T08:19:18.449664+0000', 'last_fullsized': '2023-12-08T08:19:18.449664+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.446014+0000', 'last_change': '2023-12-08T08:19:18.446014+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.446014+0000', 'last_undegraded': '2023-12-08T08:19:18.446014+0000', 'last_fullsized': '2023-12-08T08:19:18.446014+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.446212+0000', 'last_change': '2023-12-08T08:19:18.446212+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.446212+0000', 'last_undegraded': '2023-12-08T08:19:18.446212+0000', 'last_fullsized': '2023-12-08T08:19:18.446212+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-12-08T08:19:24.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448701+0000', 'last_change': '2023-12-08T08:19:18.448701+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448701+0000', 'last_undegraded': '2023-12-08T08:19:18.448701+0000', 'last_fullsized': '2023-12-08T08:19:18.448701+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.446004+0000', 'last_change': '2023-12-08T08:19:18.446004+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.446004+0000', 'last_undegraded': '2023-12-08T08:19:18.446004+0000', 'last_fullsized': '2023-12-08T08:19:18.446004+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.445298+0000', 'last_change': '2023-12-08T08:19:18.445298+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.445298+0000', 'last_undegraded': '2023-12-08T08:19:18.445298+0000', 'last_fullsized': '2023-12-08T08:19:18.445298+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.447618+0000', 'last_change': '2023-12-08T08:19:18.447618+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.447618+0000', 'last_undegraded': '2023-12-08T08:19:18.447618+0000', 'last_fullsized': '2023-12-08T08:19:18.447618+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448690+0000', 'last_change': '2023-12-08T08:19:18.448690+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448690+0000', 'last_undegraded': '2023-12-08T08:19:18.448690+0000', 'last_fullsized': '2023-12-08T08:19:18.448690+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-08T08:19:24.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448738+0000', 'last_change': '2023-12-08T08:19:18.448738+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448738+0000', 'last_undegraded': '2023-12-08T08:19:18.448738+0000', 'last_fullsized': '2023-12-08T08:19:18.448738+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.447611+0000', 'last_change': '2023-12-08T08:19:18.447611+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.447611+0000', 'last_undegraded': '2023-12-08T08:19:18.447611+0000', 'last_fullsized': '2023-12-08T08:19:18.447611+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.447537+0000', 'last_change': '2023-12-08T08:19:18.447537+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.447537+0000', 'last_undegraded': '2023-12-08T08:19:18.447537+0000', 'last_fullsized': '2023-12-08T08:19:18.447537+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-12-08T08:19:24.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.445878+0000', 'last_change': '2023-12-08T08:19:18.445878+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.445878+0000', 'last_undegraded': '2023-12-08T08:19:18.445878+0000', 'last_fullsized': '2023-12-08T08:19:18.445878+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.449061+0000', 'last_change': '2023-12-08T08:19:18.449061+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.449061+0000', 'last_undegraded': '2023-12-08T08:19:18.449061+0000', 'last_fullsized': '2023-12-08T08:19:18.449061+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.449298+0000', 'last_change': '2023-12-08T08:19:18.449298+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.449298+0000', 'last_undegraded': '2023-12-08T08:19:18.449298+0000', 'last_fullsized': '2023-12-08T08:19:18.449298+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.445323+0000', 'last_change': '2023-12-08T08:19:18.445323+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.445323+0000', 'last_undegraded': '2023-12-08T08:19:18.445323+0000', 'last_fullsized': '2023-12-08T08:19:18.445323+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448937+0000', 'last_change': '2023-12-08T08:19:18.448937+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448937+0000', 'last_undegraded': '2023-12-08T08:19:18.448937+0000', 'last_fullsized': '2023-12-08T08:19:18.448937+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.445847+0000', 'last_change': '2023-12-08T08:19:18.445847+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.445847+0000', 'last_undegraded': '2023-12-08T08:19:18.445847+0000', 'last_fullsized': '2023-12-08T08:19:18.445847+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-08T08:19:24.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448670+0000', 'last_change': '2023-12-08T08:19:18.448670+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448670+0000', 'last_undegraded': '2023-12-08T08:19:18.448670+0000', 'last_fullsized': '2023-12-08T08:19:18.448670+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448653+0000', 'last_change': '2023-12-08T08:19:18.448653+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448653+0000', 'last_undegraded': '2023-12-08T08:19:18.448653+0000', 'last_fullsized': '2023-12-08T08:19:18.448653+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448635+0000', 'last_change': '2023-12-08T08:19:18.448635+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448635+0000', 'last_undegraded': '2023-12-08T08:19:18.448635+0000', 'last_fullsized': '2023-12-08T08:19:18.448635+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-12-08T08:19:24.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448727+0000', 'last_change': '2023-12-08T08:19:18.448727+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448727+0000', 'last_undegraded': '2023-12-08T08:19:18.448727+0000', 'last_fullsized': '2023-12-08T08:19:18.448727+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.448747+0000', 'last_change': '2023-12-08T08:19:18.448747+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.448747+0000', 'last_undegraded': '2023-12-08T08:19:18.448747+0000', 'last_fullsized': '2023-12-08T08:19:18.448747+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.450113+0000', 'last_change': '2023-12-08T08:19:18.450113+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.450113+0000', 'last_undegraded': '2023-12-08T08:19:18.450113+0000', 'last_fullsized': '2023-12-08T08:19:18.450113+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-08T08:19:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.450823+0000', 'last_change': '2023-12-08T08:19:18.450823+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.450823+0000', 'last_undegraded': '2023-12-08T08:19:18.450823+0000', 'last_fullsized': '2023-12-08T08:19:18.450823+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.449662+0000', 'last_change': '2023-12-08T08:19:18.449662+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.449662+0000', 'last_undegraded': '2023-12-08T08:19:18.449662+0000', 'last_fullsized': '2023-12-08T08:19:18.449662+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.445471+0000', 'last_change': '2023-12-08T08:19:18.445471+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.445471+0000', 'last_undegraded': '2023-12-08T08:19:18.445471+0000', 'last_fullsized': '2023-12-08T08:19:18.445471+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-12-08T08:19:18.447603+0000', 'last_change': '2023-12-08T08:19:18.447603+0000', 'last_active': '2023-12-08T08:19:18.438652+0000', 'last_peered': '2023-12-08T08:19:18.438652+0000', 'last_clean': '2023-12-08T08:19:18.438652+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:18.447603+0000', 'last_undegraded': '2023-12-08T08:19:18.447603+0000', 'last_fullsized': '2023-12-08T08:19:18.447603+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:18.438652+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-12-08T08:19:24.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-08T08:19:19.442785+0000', 'last_change': '2023-12-08T08:19:19.442785+0000', 'last_active': '2023-12-08T08:19:19.442785+0000', 'last_peered': '2023-12-08T08:19:19.442785+0000', 'last_clean': '2023-12-08T08:19:19.442785+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-08T08:19:19.442785+0000', 'last_undegraded': '2023-12-08T08:19:19.442785+0000', 'last_fullsized': '2023-12-08T08:19:19.442785+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'last_clean_scrub_stamp': '2023-12-08T08:19:19.442785+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-08T08:19:24.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-08T08:19:24.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.313+0000 7f74a0ee7640 1 Processor -- start 2023-12-08T08:19:24.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.313+0000 7f74a0ee7640 1 -- start start 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f74a0ee7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f749c0ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f74a0ee7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749c15a3a0 con 0x7f749c13d590 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f74a0ee7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749c15a660 con 0x7f749c13cd20 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f74a0ee7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15b2e0 con 0x7f749c0cf490 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f7499d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f749c13d590 0x7f749c0ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45620/0 (socket says 172.21.15.50:45620) 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f7499d9b640 1 -- 172.21.15.50:0/934050730 learned_addr learned my addr 172.21.15.50:0/934050730 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749ad9d640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f749c0ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688819050 0 0) 0x7f749c15a3a0 con 0x7f749c13d590 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7484003520 con 0x7f749c13d590 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045085800 0 0) 0x7f749c15a660 con 0x7f749c13cd20 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f749c15a3a0 con 0x7f749c13cd20 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1751609057 0 0) 0x7f7484003520 con 0x7f749c13d590 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 msgr2=0x7f749c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f749c0ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.319 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 >> v1:172.21.15.170:6789/0 conn(0x7f749c13cd20 legacy=0x7f749c0b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c15a940 con 0x7f749c13d590 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f7490001670 con 0x7f749c13d590 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749ad9d640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f749c0ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.314+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 >> v1:172.21.15.50:6789/0 conn(0x7f749c13d590 legacy=0x7f749c0ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749959a640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7484003b30 0x7f7484003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749959a640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f7484004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749959a640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f7484005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15b2e0 con 0x7f74840047c0 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748400b9e0 con 0x7f7484003b30 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748400bba0 con 0x7f749c0cf490 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f7499d9b640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f7484004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749a59c640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7484003b30 0x7f7484003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749ad9d640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f7484005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f7499d9b640 1 -- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 msgr2=0x7f7484005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:24.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f7499d9b640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f7484005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f7499d9b640 1 -- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7484003b30 msgr2=0x7f7484003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f7499d9b640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7484003b30 0x7f7484003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f7499d9b640 1 -- 172.21.15.50:0/934050730 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009a70 con 0x7f74840047c0 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749a59c640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7484003b30 0x7f7484003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.315+0000 7f749ad9d640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cf490 0x7f7484005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f7499d9b640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f7484004c40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7490001eb0 tx=0x7f74840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6178184621248275 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490005ad0 con 0x7f74840047c0 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490005c50 con 0x7f74840047c0 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f749959a640 1 -- 172.21.15.50:0/934050730 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749002c7d0 con 0x7f74840047c0 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f74a0ee7640 1 -- 172.21.15.50:0/934050730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 msgr2=0x7f7484004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f74a0ee7640 1 --2- 172.21.15.50:0/934050730 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f7484004c40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7490001eb0 tx=0x7f74840057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f749ad9d640 1 -- 172.21.15.50:0/934050730 reap_dead start 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f74a0ee7640 1 -- 172.21.15.50:0/934050730 shutdown_connections 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f74a0ee7640 1 -- 172.21.15.50:0/934050730 >> 172.21.15.50:0/934050730 conn(0x7f749c06a6b0 msgr2=0x7f749c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f74a0ee7640 1 -- 172.21.15.50:0/934050730 shutdown_connections 2023-12-08T08:19:24.322 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.316+0000 7f74a0ee7640 1 -- 172.21.15.50:0/934050730 wait complete. 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.318+0000 7f74a0ee7640 1 Processor -- start 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.318+0000 7f74a0ee7640 1 -- start start 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.318+0000 7f74a0ee7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f749c1396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.318+0000 7f74a0ee7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cb5c0 0x7f749c0cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.318+0000 7f74a0ee7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f749c0718b0 0x7f749c071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.318+0000 7f74a0ee7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c139be0 con 0x7f74840047c0 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.318+0000 7f74a0ee7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c0cbf80 con 0x7f749c0718b0 2023-12-08T08:19:24.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f74a0ee7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c13a770 con 0x7f749c0cb5c0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f749c1396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f749c1396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37746/0 (socket says 172.21.15.50:37746) 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 -- 172.21.15.50:0/450287545 learned_addr learned my addr 172.21.15.50:0/450287545 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f7499d9b640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cb5c0 0x7f749c0cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749ad9d640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f749c0718b0 0x7f749c071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 -- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cb5c0 msgr2=0x7f749c0cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cb5c0 0x7f749c0cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 -- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f749c0718b0 msgr2=0x7f749c071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f749c0718b0 0x7f749c071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 -- 172.21.15.50:0/450287545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c13aa50 con 0x7f74840047c0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f749a59c640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f749c1396a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f748c0079a0 tx=0x7f748c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f748affd640 1 -- 172.21.15.50:0/450287545 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c017070 con 0x7f74840047c0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f748affd640 1 -- 172.21.15.50:0/450287545 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c0050d0 con 0x7f74840047c0 2023-12-08T08:19:24.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c13ad30 con 0x7f74840047c0 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f748affd640 1 -- 172.21.15.50:0/450287545 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c005240 con 0x7f74840047c0 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.319+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c13b2f0 con 0x7f74840047c0 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.320+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c06dfe0 con 0x7f74840047c0 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.321+0000 7f748affd640 1 -- 172.21.15.50:0/450287545 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f748c007020 con 0x7f74840047c0 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.321+0000 7f748affd640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f747c06ae70 0x7f747c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.321+0000 7f748affd640 1 -- 172.21.15.50:0/450287545 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f748c088ea0 con 0x7f74840047c0 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.322+0000 7f7499d9b640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f747c06ae70 0x7f747c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.322+0000 7f7499d9b640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f747c06ae70 0x7f747c06d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7490034000 tx=0x7f7490007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.326+0000 7f748affd640 1 -- 172.21.15.50:0/450287545 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f748c053ec0 con 0x7f74840047c0 2023-12-08T08:19:24.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.569+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f749c067540 con 0x7f74840047c0 2023-12-08T08:19:24.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.569+0000 7f748affd640 1 -- 172.21.15.50:0/450287545 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1170 (secure 0 0 0) 0x7f748c0574e0 con 0x7f74840047c0 2023-12-08T08:19:24.572 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:24.572 INFO:teuthology.orchestra.run.smithi050.stdout:{"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":112,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1702023463,"num_in_osds":8,"osd_in_since":1702023455,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":54},{"state_name":"creating+peering","count":28},{"state_name":"active+clean","count":15}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590368,"bytes_used":259878912,"bytes_avail":772834234368,"bytes_total":773094113280,"unknown_pgs_ratio":0.55670100450515747,"inactive_pgs_ratio":0.28865978121757507,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5260}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-08T08:19:02.130072+0000","services":{}},"progress_events":{}} 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f747c06ae70 msgr2=0x7f747c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f747c06ae70 0x7f747c06d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7490034000 tx=0x7f7490007000 comp rx=0 tx=0).stop 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 msgr2=0x7f749c1396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f749c1396a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f748c0079a0 tx=0x7f748c00ec10 comp rx=0 tx=0).stop 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 shutdown_connections 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f747c06ae70 0x7f747c06d330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f749c0718b0 0x7f749c071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f749c0cb5c0 0x7f749c0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 --2- 172.21.15.50:0/450287545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74840047c0 0x7f749c1396a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 >> 172.21.15.50:0/450287545 conn(0x7f749c06a6b0 msgr2=0x7f749c13f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 shutdown_connections 2023-12-08T08:19:24.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.571+0000 7f74a0ee7640 1 -- 172.21.15.50:0/450287545 wait complete. 2023-12-08T08:19:24.584 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-08T08:19:24.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:24.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:24.646 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:24.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.688+0000 7fbcd0bc5640 1 Processor -- start 2023-12-08T08:19:24.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.688+0000 7fbcd0bc5640 1 -- start start 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcd0bc5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbccc0b0cf0 0x7fbccc0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcd0bc5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbccc0b1d70 0x7fbccc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcd0bc5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc0d20b0 con 0x7fbccc1608a0 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcd0bc5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0d0620 con 0x7fbccc0b1d70 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcd0bc5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0d1b80 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbccad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbccc0b1d70 0x7fbccc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcca59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbccc1608a0 0x7fbccc0d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45636/0 (socket says 172.21.15.50:45636) 2023-12-08T08:19:24.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcca59c640 1 -- 172.21.15.50:0/366159506 learned_addr learned my addr 172.21.15.50:0/366159506 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbcc9d9b640 1 --2- 172.21.15.50:0/366159506 >> v2:172.21.15.170:3300/0 conn(0x7fbccc0b0cf0 0x7fbccc0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.689+0000 7fbccad9d640 1 -- 172.21.15.50:0/366159506 >> v2:172.21.15.170:3300/0 conn(0x7fbccc0b0cf0 msgr2=0x7fbccc0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbccad9d640 1 --2- 172.21.15.50:0/366159506 >> v2:172.21.15.170:3300/0 conn(0x7fbccc0b0cf0 0x7fbccc0d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbccad9d640 1 -- 172.21.15.50:0/366159506 >> v1:172.21.15.50:6789/0 conn(0x7fbccc1608a0 legacy=0x7fbccc0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbccad9d640 1 -- 172.21.15.50:0/366159506 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0d1dd0 con 0x7fbccc0b1d70 2023-12-08T08:19:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbcc959a640 1 -- 172.21.15.50:0/366159506 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610319470 0 0) 0x7fbccc0d20b0 con 0x7fbccc1608a0 2023-12-08T08:19:24.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbcc9d9b640 1 --2- 172.21.15.50:0/366159506 >> v2:172.21.15.170:3300/0 conn(0x7fbccc0b0cf0 0x7fbccc0d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:24.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbccad9d640 1 --2- 172.21.15.50:0/366159506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b1d70 0x7fbccc0cdc40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0d4130 tx=0x7fbcc402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8440162f85e30b6e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbcc959a640 1 -- 172.21.15.50:0/366159506 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc402cbf0 con 0x7fbccc0b1d70 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbcc959a640 1 -- 172.21.15.50:0/366159506 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc402cd50 con 0x7fbccc0b1d70 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.690+0000 7fbcc959a640 1 -- 172.21.15.50:0/366159506 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4034660 con 0x7fbccc0b1d70 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/366159506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b1d70 msgr2=0x7fbccc0cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/366159506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b1d70 0x7fbccc0cdc40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0d4130 tx=0x7fbcc402be40 comp rx=0 tx=0).stop 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/366159506 shutdown_connections 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/366159506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b1d70 0x7fbccc0cdc40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/366159506 >> v2:172.21.15.170:3300/0 conn(0x7fbccc0b0cf0 0x7fbccc0d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/366159506 >> 172.21.15.50:0/366159506 conn(0x7fbccc0d3030 msgr2=0x7fbccc0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/366159506 shutdown_connections 2023-12-08T08:19:24.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.691+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/366159506 wait complete. 2023-12-08T08:19:24.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 Processor -- start 2023-12-08T08:19:24.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 -- start start 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b0cf0 0x7fbccc0c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc0b1d70 0x7fbccc0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc1608a0 0x7fbccc0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc15ec10 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0c7a40 con 0x7fbccc0b1d70 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcd0bc5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0cb220 con 0x7fbccc1608a0 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcca59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b0cf0 0x7fbccc0c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcca59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b0cf0 0x7fbccc0c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37770/0 (socket says 172.21.15.50:37770) 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.693+0000 7fbcca59c640 1 -- 172.21.15.50:0/1991640102 learned_addr learned my addr 172.21.15.50:0/1991640102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcc9d9b640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc0b1d70 0x7fbccc0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbccad9d640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc1608a0 0x7fbccc0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcca59c640 1 -- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc1608a0 msgr2=0x7fbccc0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcca59c640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc1608a0 0x7fbccc0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcca59c640 1 -- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc0b1d70 msgr2=0x7fbccc0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcca59c640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc0b1d70 0x7fbccc0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcca59c640 1 -- 172.21.15.50:0/1991640102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc4009a70 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcca59c640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b0cf0 0x7fbccc0c7500 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c430 tx=0x7fbcc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcbaffd640 1 -- 172.21.15.50:0/1991640102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00074e0 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcbaffd640 1 -- 172.21.15.50:0/1991640102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc0007660 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc0cb500 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcbaffd640 1 -- 172.21.15.50:0/1991640102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0004a20 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.694+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc0cbac0 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.695+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc067430 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.696+0000 7fbcbaffd640 1 -- 172.21.15.50:0/1991640102 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbcc0004b80 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.696+0000 7fbcbaffd640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcac06ae70 0x7fbcac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.696+0000 7fbcbaffd640 1 -- 172.21.15.50:0/1991640102 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbcc0089430 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.696+0000 7fbcc9d9b640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcac06ae70 0x7fbcac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:24.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.697+0000 7fbcc9d9b640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcac06ae70 0x7fbcac06d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0b2460 tx=0x7fbcbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:24.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.700+0000 7fbcbaffd640 1 -- 172.21.15.50:0/1991640102 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbcc0054450 con 0x7fbccc0b0cf0 2023-12-08T08:19:24.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.872+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbccc160c80 con 0x7fbcac06ae70 2023-12-08T08:19:24.882 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.879+0000 7fbcbaffd640 1 -- 172.21.15.50:0/1991640102 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279333 (secure 0 0 0) 0x7fbcbc00c040 con 0x7fbcac06ae70 2023-12-08T08:19:24.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:24.886 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcac06ae70 msgr2=0x7fbcac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcac06ae70 0x7fbcac06d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0b2460 tx=0x7fbcbc008040 comp rx=0 tx=0).stop 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b0cf0 msgr2=0x7fbccc0c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b0cf0 0x7fbccc0c7500 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c430 tx=0x7fbcc000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 shutdown_connections 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbcac06ae70 0x7fbcac06d330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc1608a0 0x7fbccc0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc0b1d70 0x7fbccc0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 --2- 172.21.15.50:0/1991640102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbccc0b0cf0 0x7fbccc0c7500 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 >> 172.21.15.50:0/1991640102 conn(0x7fbccc0d3030 msgr2=0x7fbccc0ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 shutdown_connections 2023-12-08T08:19:24.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:24.883+0000 7fbcd0bc5640 1 -- 172.21.15.50:0/1991640102 wait complete. 2023-12-08T08:19:24.896 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-08T08:19:24.134874+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253788,"kb_used_data":4332,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720932,"statfs":{"total":773094113280,"available":772834234368,"internally_reserved":0,"allocated":4435968,"data_stored":2542196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.691362"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458855+0000","last_change":"2023-12-08T08:19:20.471509+0000","last_active":"2023-12-08T08:19:21.458855+0000","last_peered":"2023-12-08T08:19:21.458855+0000","last_clean":"2023-12-08T08:19:21.458855+0000","last_became_active":"2023-12-08T08:19:20.471266+0000","last_became_peered":"2023-12-08T08:19:20.471266+0000","last_unstale":"2023-12-08T08:19:21.458855+0000","last_undegraded":"2023-12-08T08:19:21.458855+0000","last_fullsized":"2023-12-08T08:19:21.458855+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:42.253282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460110+0000","last_change":"2023-12-08T08:19:20.472107+0000","last_active":"2023-12-08T08:19:21.460110+0000","last_peered":"2023-12-08T08:19:21.460110+0000","last_clean":"2023-12-08T08:19:21.460110+0000","last_became_active":"2023-12-08T08:19:20.471846+0000","last_became_peered":"2023-12-08T08:19:20.471846+0000","last_unstale":"2023-12-08T08:19:21.460110+0000","last_undegraded":"2023-12-08T08:19:21.460110+0000","last_fullsized":"2023-12-08T08:19:21.460110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:07:46.974601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459347+0000","last_change":"2023-12-08T08:19:20.465241+0000","last_active":"2023-12-08T08:19:21.459347+0000","last_peered":"2023-12-08T08:19:21.459347+0000","last_clean":"2023-12-08T08:19:21.459347+0000","last_became_active":"2023-12-08T08:19:20.464981+0000","last_became_peered":"2023-12-08T08:19:20.464981+0000","last_unstale":"2023-12-08T08:19:21.459347+0000","last_undegraded":"2023-12-08T08:19:21.459347+0000","last_fullsized":"2023-12-08T08:19:21.459347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:02:18.997136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459819+0000","last_change":"2023-12-08T08:19:20.465816+0000","last_active":"2023-12-08T08:19:21.459819+0000","last_peered":"2023-12-08T08:19:21.459819+0000","last_clean":"2023-12-08T08:19:21.459819+0000","last_became_active":"2023-12-08T08:19:20.465564+0000","last_became_peered":"2023-12-08T08:19:20.465564+0000","last_unstale":"2023-12-08T08:19:21.459819+0000","last_undegraded":"2023-12-08T08:19:21.459819+0000","last_fullsized":"2023-12-08T08:19:21.459819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:35.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459899+0000","last_change":"2023-12-08T08:19:20.470544+0000","last_active":"2023-12-08T08:19:21.459899+0000","last_peered":"2023-12-08T08:19:21.459899+0000","last_clean":"2023-12-08T08:19:21.459899+0000","last_became_active":"2023-12-08T08:19:20.469531+0000","last_became_peered":"2023-12-08T08:19:20.469531+0000","last_unstale":"2023-12-08T08:19:21.459899+0000","last_undegraded":"2023-12-08T08:19:21.459899+0000","last_fullsized":"2023-12-08T08:19:21.459899+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:27:04.510041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449114+0000","last_change":"2023-12-08T08:19:18.449114+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449114+0000","last_undegraded":"2023-12-08T08:19:18.449114+0000","last_fullsized":"2023-12-08T08:19:18.449114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449664+0000","last_change":"2023-12-08T08:19:18.449664+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449664+0000","last_undegraded":"2023-12-08T08:19:18.449664+0000","last_fullsized":"2023-12-08T08:19:18.449664+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446014+0000","last_change":"2023-12-08T08:19:18.446014+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446014+0000","last_undegraded":"2023-12-08T08:19:18.446014+0000","last_fullsized":"2023-12-08T08:19:18.446014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446212+0000","last_change":"2023-12-08T08:19:18.446212+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446212+0000","last_undegraded":"2023-12-08T08:19:18.446212+0000","last_fullsized":"2023-12-08T08:19:18.446212+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448701+0000","last_change":"2023-12-08T08:19:18.448701+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448701+0000","last_undegraded":"2023-12-08T08:19:18.448701+0000","last_fullsized":"2023-12-08T08:19:18.448701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.487504+0000","last_change":"2023-12-08T08:19:19.454482+0000","last_active":"2023-12-08T08:19:20.487504+0000","last_peered":"2023-12-08T08:19:20.487504+0000","last_clean":"2023-12-08T08:19:20.487504+0000","last_became_active":"2023-12-08T08:19:19.453976+0000","last_became_peered":"2023-12-08T08:19:19.453976+0000","last_unstale":"2023-12-08T08:19:20.487504+0000","last_undegraded":"2023-12-08T08:19:20.487504+0000","last_fullsized":"2023-12-08T08:19:20.487504+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:02.773526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.446004+0000","last_change":"2023-12-08T08:19:18.446004+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.446004+0000","last_undegraded":"2023-12-08T08:19:18.446004+0000","last_fullsized":"2023-12-08T08:19:18.446004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445298+0000","last_change":"2023-12-08T08:19:18.445298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445298+0000","last_undegraded":"2023-12-08T08:19:18.445298+0000","last_fullsized":"2023-12-08T08:19:18.445298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447618+0000","last_change":"2023-12-08T08:19:18.447618+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447618+0000","last_undegraded":"2023-12-08T08:19:18.447618+0000","last_fullsized":"2023-12-08T08:19:18.447618+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460076+0000","last_change":"2023-12-08T08:19:20.474759+0000","last_active":"2023-12-08T08:19:21.460076+0000","last_peered":"2023-12-08T08:19:21.460076+0000","last_clean":"2023-12-08T08:19:21.460076+0000","last_became_active":"2023-12-08T08:19:20.474520+0000","last_became_peered":"2023-12-08T08:19:20.474520+0000","last_unstale":"2023-12-08T08:19:21.460076+0000","last_undegraded":"2023-12-08T08:19:21.460076+0000","last_fullsized":"2023-12-08T08:19:21.460076+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:54:11.990189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448690+0000","last_change":"2023-12-08T08:19:18.448690+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448690+0000","last_undegraded":"2023-12-08T08:19:18.448690+0000","last_fullsized":"2023-12-08T08:19:18.448690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448738+0000","last_change":"2023-12-08T08:19:18.448738+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448738+0000","last_undegraded":"2023-12-08T08:19:18.448738+0000","last_fullsized":"2023-12-08T08:19:18.448738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447611+0000","last_change":"2023-12-08T08:19:18.447611+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447611+0000","last_undegraded":"2023-12-08T08:19:18.447611+0000","last_fullsized":"2023-12-08T08:19:18.447611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447537+0000","last_change":"2023-12-08T08:19:18.447537+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447537+0000","last_undegraded":"2023-12-08T08:19:18.447537+0000","last_fullsized":"2023-12-08T08:19:18.447537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445878+0000","last_change":"2023-12-08T08:19:18.445878+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445878+0000","last_undegraded":"2023-12-08T08:19:18.445878+0000","last_fullsized":"2023-12-08T08:19:18.445878+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460009+0000","last_change":"2023-12-08T08:19:20.467487+0000","last_active":"2023-12-08T08:19:21.460009+0000","last_peered":"2023-12-08T08:19:21.460009+0000","last_clean":"2023-12-08T08:19:21.460009+0000","last_became_active":"2023-12-08T08:19:20.467220+0000","last_became_peered":"2023-12-08T08:19:20.467220+0000","last_unstale":"2023-12-08T08:19:21.460009+0000","last_undegraded":"2023-12-08T08:19:21.460009+0000","last_fullsized":"2023-12-08T08:19:21.460009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:00.202918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449061+0000","last_change":"2023-12-08T08:19:18.449061+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449061+0000","last_undegraded":"2023-12-08T08:19:18.449061+0000","last_fullsized":"2023-12-08T08:19:18.449061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489658+0000","last_change":"2023-12-08T08:19:19.463045+0000","last_active":"2023-12-08T08:19:20.489658+0000","last_peered":"2023-12-08T08:19:20.489658+0000","last_clean":"2023-12-08T08:19:20.489658+0000","last_became_active":"2023-12-08T08:19:19.462783+0000","last_became_peered":"2023-12-08T08:19:19.462783+0000","last_unstale":"2023-12-08T08:19:20.489658+0000","last_undegraded":"2023-12-08T08:19:20.489658+0000","last_fullsized":"2023-12-08T08:19:20.489658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:22:15.844857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449298+0000","last_change":"2023-12-08T08:19:18.449298+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449298+0000","last_undegraded":"2023-12-08T08:19:18.449298+0000","last_fullsized":"2023-12-08T08:19:18.449298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445323+0000","last_change":"2023-12-08T08:19:18.445323+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445323+0000","last_undegraded":"2023-12-08T08:19:18.445323+0000","last_fullsized":"2023-12-08T08:19:18.445323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448937+0000","last_change":"2023-12-08T08:19:18.448937+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448937+0000","last_undegraded":"2023-12-08T08:19:18.448937+0000","last_fullsized":"2023-12-08T08:19:18.448937+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445847+0000","last_change":"2023-12-08T08:19:18.445847+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445847+0000","last_undegraded":"2023-12-08T08:19:18.445847+0000","last_fullsized":"2023-12-08T08:19:18.445847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458963+0000","last_change":"2023-12-08T08:19:20.470369+0000","last_active":"2023-12-08T08:19:21.458963+0000","last_peered":"2023-12-08T08:19:21.458963+0000","last_clean":"2023-12-08T08:19:21.458963+0000","last_became_active":"2023-12-08T08:19:20.470009+0000","last_became_peered":"2023-12-08T08:19:20.470009+0000","last_unstale":"2023-12-08T08:19:21.458963+0000","last_undegraded":"2023-12-08T08:19:21.458963+0000","last_fullsized":"2023-12-08T08:19:21.458963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:08:58.309555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448670+0000","last_change":"2023-12-08T08:19:18.448670+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448670+0000","last_undegraded":"2023-12-08T08:19:18.448670+0000","last_fullsized":"2023-12-08T08:19:18.448670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448653+0000","last_change":"2023-12-08T08:19:18.448653+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448653+0000","last_undegraded":"2023-12-08T08:19:18.448653+0000","last_fullsized":"2023-12-08T08:19:18.448653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.459683+0000","last_change":"2023-12-08T08:19:19.459100+0000","last_active":"2023-12-08T08:19:20.459683+0000","last_peered":"2023-12-08T08:19:20.459683+0000","last_clean":"2023-12-08T08:19:20.459683+0000","last_became_active":"2023-12-08T08:19:19.458783+0000","last_became_peered":"2023-12-08T08:19:19.458783+0000","last_unstale":"2023-12-08T08:19:20.459683+0000","last_undegraded":"2023-12-08T08:19:20.459683+0000","last_fullsized":"2023-12-08T08:19:20.459683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:07.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448635+0000","last_change":"2023-12-08T08:19:18.448635+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448635+0000","last_undegraded":"2023-12-08T08:19:18.448635+0000","last_fullsized":"2023-12-08T08:19:18.448635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448727+0000","last_change":"2023-12-08T08:19:18.448727+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448727+0000","last_undegraded":"2023-12-08T08:19:18.448727+0000","last_fullsized":"2023-12-08T08:19:18.448727+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460233+0000","last_change":"2023-12-08T08:19:20.474162+0000","last_active":"2023-12-08T08:19:21.460233+0000","last_peered":"2023-12-08T08:19:21.460233+0000","last_clean":"2023-12-08T08:19:21.460233+0000","last_became_active":"2023-12-08T08:19:20.473900+0000","last_became_peered":"2023-12-08T08:19:20.473900+0000","last_unstale":"2023-12-08T08:19:21.460233+0000","last_undegraded":"2023-12-08T08:19:21.460233+0000","last_fullsized":"2023-12-08T08:19:21.460233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:38:51.566456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.448747+0000","last_change":"2023-12-08T08:19:18.448747+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.448747+0000","last_undegraded":"2023-12-08T08:19:18.448747+0000","last_fullsized":"2023-12-08T08:19:18.448747+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450113+0000","last_change":"2023-12-08T08:19:18.450113+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450113+0000","last_undegraded":"2023-12-08T08:19:18.450113+0000","last_fullsized":"2023-12-08T08:19:18.450113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.450823+0000","last_change":"2023-12-08T08:19:18.450823+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.450823+0000","last_undegraded":"2023-12-08T08:19:18.450823+0000","last_fullsized":"2023-12-08T08:19:18.450823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.449662+0000","last_change":"2023-12-08T08:19:18.449662+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.449662+0000","last_undegraded":"2023-12-08T08:19:18.449662+0000","last_fullsized":"2023-12-08T08:19:18.449662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.445471+0000","last_change":"2023-12-08T08:19:18.445471+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.445471+0000","last_undegraded":"2023-12-08T08:19:18.445471+0000","last_fullsized":"2023-12-08T08:19:18.445471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459720+0000","last_change":"2023-12-08T08:19:20.474218+0000","last_active":"2023-12-08T08:19:21.459720+0000","last_peered":"2023-12-08T08:19:21.459720+0000","last_clean":"2023-12-08T08:19:21.459720+0000","last_became_active":"2023-12-08T08:19:20.473994+0000","last_became_peered":"2023-12-08T08:19:20.473994+0000","last_unstale":"2023-12-08T08:19:21.459720+0000","last_undegraded":"2023-12-08T08:19:21.459720+0000","last_fullsized":"2023-12-08T08:19:21.459720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:14.336038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-12-08T08:19:18.447603+0000","last_change":"2023-12-08T08:19:18.447603+0000","last_active":"2023-12-08T08:19:18.438652+0000","last_peered":"2023-12-08T08:19:18.438652+0000","last_clean":"2023-12-08T08:19:18.438652+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:18.447603+0000","last_undegraded":"2023-12-08T08:19:18.447603+0000","last_fullsized":"2023-12-08T08:19:18.447603+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:19:19.442785+0000","last_change":"2023-12-08T08:19:19.442785+0000","last_active":"2023-12-08T08:19:19.442785+0000","last_peered":"2023-12-08T08:19:19.442785+0000","last_clean":"2023-12-08T08:19:19.442785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:19:19.442785+0000","last_undegraded":"2023-12-08T08:19:19.442785+0000","last_fullsized":"2023-12-08T08:19:19.442785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.460288+0000","last_change":"2023-12-08T08:19:19.456284+0000","last_active":"2023-12-08T08:19:20.460288+0000","last_peered":"2023-12-08T08:19:20.460288+0000","last_clean":"2023-12-08T08:19:20.460288+0000","last_became_active":"2023-12-08T08:19:19.456035+0000","last_became_peered":"2023-12-08T08:19:19.456035+0000","last_unstale":"2023-12-08T08:19:20.460288+0000","last_undegraded":"2023-12-08T08:19:20.460288+0000","last_fullsized":"2023-12-08T08:19:20.460288+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:01.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.459631+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:19:20.459631+0000","last_peered":"2023-12-08T08:19:20.459631+0000","last_clean":"2023-12-08T08:19:20.459631+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:19:20.459631+0000","last_undegraded":"2023-12-08T08:19:20.459631+0000","last_fullsized":"2023-12-08T08:19:20.459631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.623},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.67200000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.745}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.82099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.38900000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":389120,"data_stored":162191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.621}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.496}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.496}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.435},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.313}]},{"osd":4,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.628}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.748},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":168328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.35299999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.315},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":991232,"data_stored":757677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:25.441 INFO:tasks.ceph.mds.a.smithi050.stderr:2023-12-08T08:19:25.439+0000 7fb407f3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:19:27.901 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:19:28.020 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.018+0000 7f6e5b05c640 1 Processor -- start 2023-12-08T08:19:28.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.018+0000 7f6e5b05c640 1 -- start start 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e5b05c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e540b6ac0 0x7f6e540cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e5b05c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6e540ce1c0 0x7f6e540cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e5b05c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e540d0070 con 0x7f6e540cd660 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e5b05c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e54160cb0 con 0x7f6e540b6ac0 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e5b05c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e540d02b0 con 0x7f6e540ce1c0 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e58df8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e540b6ac0 0x7f6e540cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e53fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e540cd660 0x7f6e540cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45650/0 (socket says 172.21.15.50:45650) 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e53fff640 1 -- 172.21.15.50:0/796304819 learned_addr learned my addr 172.21.15.50:0/796304819 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e58df8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e540b6ac0 0x7f6e540cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37772/0 (socket says 172.21.15.50:37772) 2023-12-08T08:19:28.022 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e595f9640 1 --2- 172.21.15.50:0/796304819 >> v2:172.21.15.170:3300/0 conn(0x7f6e540ce1c0 0x7f6e540cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e58df8640 1 -- 172.21.15.50:0/796304819 >> v2:172.21.15.170:3300/0 conn(0x7f6e540ce1c0 msgr2=0x7f6e540cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e58df8640 1 --2- 172.21.15.50:0/796304819 >> v2:172.21.15.170:3300/0 conn(0x7f6e540ce1c0 0x7f6e540cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.019+0000 7f6e537fe640 1 -- 172.21.15.50:0/796304819 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991280347 0 0) 0x7f6e48001110 con 0x7f6e540cd660 2023-12-08T08:19:28.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.020+0000 7f6e58df8640 1 -- 172.21.15.50:0/796304819 >> v1:172.21.15.50:6789/0 conn(0x7f6e540cd660 legacy=0x7f6e540cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.020+0000 7f6e58df8640 1 -- 172.21.15.50:0/796304819 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540cb430 con 0x7f6e540b6ac0 2023-12-08T08:19:28.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.020+0000 7f6e595f9640 1 --2- 172.21.15.50:0/796304819 >> v2:172.21.15.170:3300/0 conn(0x7f6e540ce1c0 0x7f6e540cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.020+0000 7f6e58df8640 1 --2- 172.21.15.50:0/796304819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e540cfb30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6e54071ae0 tx=0x7f6e4402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6034e2d6df7302 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.020+0000 7f6e537fe640 1 -- 172.21.15.50:0/796304819 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44031710 con 0x7f6e540b6ac0 2023-12-08T08:19:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.020+0000 7f6e537fe640 1 -- 172.21.15.50:0/796304819 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4402f050 con 0x7f6e540b6ac0 2023-12-08T08:19:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.020+0000 7f6e537fe640 1 -- 172.21.15.50:0/796304819 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44031a90 con 0x7f6e540b6ac0 2023-12-08T08:19:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 -- 172.21.15.50:0/796304819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 msgr2=0x7f6e540cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/796304819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e540cfb30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6e54071ae0 tx=0x7f6e4402b7b0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 -- 172.21.15.50:0/796304819 shutdown_connections 2023-12-08T08:19:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/796304819 >> v2:172.21.15.170:3300/0 conn(0x7f6e540ce1c0 0x7f6e540cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/796304819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e540cfb30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 -- 172.21.15.50:0/796304819 >> 172.21.15.50:0/796304819 conn(0x7f6e540d0de0 msgr2=0x7f6e540d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 -- 172.21.15.50:0/796304819 shutdown_connections 2023-12-08T08:19:28.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.021+0000 7f6e5b05c640 1 -- 172.21.15.50:0/796304819 wait complete. 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.022+0000 7f6e5b05c640 1 Processor -- start 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.022+0000 7f6e5b05c640 1 -- start start 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.023+0000 7f6e5b05c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e5409e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.023+0000 7f6e5b05c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e540cd660 0x7f6e5415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.023+0000 7f6e5b05c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e540ce1c0 0x7f6e5415f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.023+0000 7f6e5b05c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e541f7200 con 0x7f6e540b6ac0 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.023+0000 7f6e5b05c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e541f3110 con 0x7f6e540cd660 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.023+0000 7f6e5b05c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e541f33f0 con 0x7f6e540ce1c0 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.023+0000 7f6e58df8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e5409e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e5409e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37788/0 (socket says 172.21.15.50:37788) 2023-12-08T08:19:28.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 -- 172.21.15.50:0/1749645072 learned_addr learned my addr 172.21.15.50:0/1749645072 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e53fff640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e540cd660 0x7f6e5415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e595f9640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e540ce1c0 0x7f6e5415f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 -- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e540ce1c0 msgr2=0x7f6e5415f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e540ce1c0 0x7f6e5415f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 -- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e540cd660 msgr2=0x7f6e5415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e540cd660 0x7f6e5415f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 -- 172.21.15.50:0/1749645072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44009400 con 0x7f6e540b6ac0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e595f9640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e540ce1c0 0x7f6e5415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e58df8640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e5409e350 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000c00 tx=0x7f6e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e517fa640 1 -- 172.21.15.50:0/1749645072 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440339d0 con 0x7f6e540b6ac0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e517fa640 1 -- 172.21.15.50:0/1749645072 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e44033b30 con 0x7f6e540b6ac0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e541f36d0 con 0x7f6e540b6ac0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e517fa640 1 -- 172.21.15.50:0/1749645072 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4403c400 con 0x7f6e540b6ac0 2023-12-08T08:19:28.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.024+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5409e890 con 0x7f6e540b6ac0 2023-12-08T08:19:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.025+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e54067430 con 0x7f6e540b6ac0 2023-12-08T08:19:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.026+0000 7f6e517fa640 1 -- 172.21.15.50:0/1749645072 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e4403a040 con 0x7f6e540b6ac0 2023-12-08T08:19:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.026+0000 7f6e517fa640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6e4006ae40 0x7f6e4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.026+0000 7f6e517fa640 1 -- 172.21.15.50:0/1749645072 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e440aad60 con 0x7f6e540b6ac0 2023-12-08T08:19:28.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.026+0000 7f6e53fff640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6e4006ae40 0x7f6e4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.027+0000 7f6e53fff640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6e4006ae40 0x7f6e4006d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e541f09b0 tx=0x7f6e48007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.033 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.031+0000 7f6e517fa640 1 -- 172.21.15.50:0/1749645072 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e44075ce0 con 0x7f6e540b6ac0 2023-12-08T08:19:28.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.208+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e541f2fa0 con 0x7f6e4006ae40 2023-12-08T08:19:28.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.216+0000 7f6e517fa640 1 -- 172.21.15.50:0/1749645072 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289513 (secure 0 0 0) 0x7f6e541f2fa0 con 0x7f6e4006ae40 2023-12-08T08:19:28.222 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:28.223 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6e4006ae40 msgr2=0x7f6e4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6e4006ae40 0x7f6e4006d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e541f09b0 tx=0x7f6e48007de0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 msgr2=0x7f6e5409e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e5409e350 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000c00 tx=0x7f6e440046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 shutdown_connections 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6e4006ae40 0x7f6e4006d300 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e540ce1c0 0x7f6e5415f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e540cd660 0x7f6e5415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 --2- 172.21.15.50:0/1749645072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e540b6ac0 0x7f6e5409e350 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 >> 172.21.15.50:0/1749645072 conn(0x7f6e540d0de0 msgr2=0x7f6e5406f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 shutdown_connections 2023-12-08T08:19:28.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.220+0000 7f6e5b05c640 1 -- 172.21.15.50:0/1749645072 wait complete. 2023-12-08T08:19:28.233 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-12-08T08:19:28.135870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254084,"kb_used_data":4644,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720636,"statfs":{"total":773094113280,"available":772833931264,"internally_reserved":0,"allocated":4755456,"data_stored":2693641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001909"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477555+0000","last_change":"2023-12-08T08:19:20.473662+0000","last_active":"2023-12-08T08:19:21.477555+0000","last_peered":"2023-12-08T08:19:21.477555+0000","last_clean":"2023-12-08T08:19:21.477555+0000","last_became_active":"2023-12-08T08:19:20.473109+0000","last_became_peered":"2023-12-08T08:19:20.473109+0000","last_unstale":"2023-12-08T08:19:21.477555+0000","last_undegraded":"2023-12-08T08:19:21.477555+0000","last_fullsized":"2023-12-08T08:19:21.477555+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:38:48.492329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477365+0000","last_change":"2023-12-08T08:19:20.472078+0000","last_active":"2023-12-08T08:19:21.477365+0000","last_peered":"2023-12-08T08:19:21.477365+0000","last_clean":"2023-12-08T08:19:21.477365+0000","last_became_active":"2023-12-08T08:19:20.471770+0000","last_became_peered":"2023-12-08T08:19:20.471770+0000","last_unstale":"2023-12-08T08:19:21.477365+0000","last_undegraded":"2023-12-08T08:19:21.477365+0000","last_fullsized":"2023-12-08T08:19:21.477365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:04:17.725745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477049+0000","last_change":"2023-12-08T08:19:20.481156+0000","last_active":"2023-12-08T08:19:21.477049+0000","last_peered":"2023-12-08T08:19:21.477049+0000","last_clean":"2023-12-08T08:19:21.477049+0000","last_became_active":"2023-12-08T08:19:20.480897+0000","last_became_peered":"2023-12-08T08:19:20.480897+0000","last_unstale":"2023-12-08T08:19:21.477049+0000","last_undegraded":"2023-12-08T08:19:21.477049+0000","last_fullsized":"2023-12-08T08:19:21.477049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:08:58.309555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458163+0000","last_change":"2023-12-08T08:19:20.479202+0000","last_active":"2023-12-08T08:19:21.458163+0000","last_peered":"2023-12-08T08:19:21.458163+0000","last_clean":"2023-12-08T08:19:21.458163+0000","last_became_active":"2023-12-08T08:19:20.478330+0000","last_became_peered":"2023-12-08T08:19:20.478330+0000","last_unstale":"2023-12-08T08:19:21.458163+0000","last_undegraded":"2023-12-08T08:19:21.458163+0000","last_fullsized":"2023-12-08T08:19:21.458163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:13:25.553181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458087+0000","last_change":"2023-12-08T08:19:20.476314+0000","last_active":"2023-12-08T08:19:21.458087+0000","last_peered":"2023-12-08T08:19:21.458087+0000","last_clean":"2023-12-08T08:19:21.458087+0000","last_became_active":"2023-12-08T08:19:20.476023+0000","last_became_peered":"2023-12-08T08:19:20.476023+0000","last_unstale":"2023-12-08T08:19:21.458087+0000","last_undegraded":"2023-12-08T08:19:21.458087+0000","last_fullsized":"2023-12-08T08:19:21.458087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:40:49.604834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476257+0000","last_change":"2023-12-08T08:19:20.470098+0000","last_active":"2023-12-08T08:19:21.476257+0000","last_peered":"2023-12-08T08:19:21.476257+0000","last_clean":"2023-12-08T08:19:21.476257+0000","last_became_active":"2023-12-08T08:19:20.469770+0000","last_became_peered":"2023-12-08T08:19:20.469770+0000","last_unstale":"2023-12-08T08:19:21.476257+0000","last_undegraded":"2023-12-08T08:19:21.476257+0000","last_fullsized":"2023-12-08T08:19:21.476257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:26.749359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458824+0000","last_change":"2023-12-08T08:19:20.466742+0000","last_active":"2023-12-08T08:19:21.458824+0000","last_peered":"2023-12-08T08:19:21.458824+0000","last_clean":"2023-12-08T08:19:21.458824+0000","last_became_active":"2023-12-08T08:19:20.466434+0000","last_became_peered":"2023-12-08T08:19:20.466434+0000","last_unstale":"2023-12-08T08:19:21.458824+0000","last_undegraded":"2023-12-08T08:19:21.458824+0000","last_fullsized":"2023-12-08T08:19:21.458824+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:35.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476420+0000","last_change":"2023-12-08T08:19:20.478094+0000","last_active":"2023-12-08T08:19:21.476420+0000","last_peered":"2023-12-08T08:19:21.476420+0000","last_clean":"2023-12-08T08:19:21.476420+0000","last_became_active":"2023-12-08T08:19:20.477683+0000","last_became_peered":"2023-12-08T08:19:20.477683+0000","last_unstale":"2023-12-08T08:19:21.476420+0000","last_undegraded":"2023-12-08T08:19:21.476420+0000","last_fullsized":"2023-12-08T08:19:21.476420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:12.141771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476637+0000","last_change":"2023-12-08T08:19:20.479380+0000","last_active":"2023-12-08T08:19:21.476637+0000","last_peered":"2023-12-08T08:19:21.476637+0000","last_clean":"2023-12-08T08:19:21.476637+0000","last_became_active":"2023-12-08T08:19:20.479052+0000","last_became_peered":"2023-12-08T08:19:20.479052+0000","last_unstale":"2023-12-08T08:19:21.476637+0000","last_undegraded":"2023-12-08T08:19:21.476637+0000","last_fullsized":"2023-12-08T08:19:21.476637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:59:26.527157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459788+0000","last_change":"2023-12-08T08:19:20.476764+0000","last_active":"2023-12-08T08:19:21.459788+0000","last_peered":"2023-12-08T08:19:21.459788+0000","last_clean":"2023-12-08T08:19:21.459788+0000","last_became_active":"2023-12-08T08:19:20.476329+0000","last_became_peered":"2023-12-08T08:19:20.476329+0000","last_unstale":"2023-12-08T08:19:21.459788+0000","last_undegraded":"2023-12-08T08:19:21.459788+0000","last_fullsized":"2023-12-08T08:19:21.459788+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:34:34.723715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460285+0000","last_change":"2023-12-08T08:19:20.474414+0000","last_active":"2023-12-08T08:19:21.460285+0000","last_peered":"2023-12-08T08:19:21.460285+0000","last_clean":"2023-12-08T08:19:21.460285+0000","last_became_active":"2023-12-08T08:19:20.474107+0000","last_became_peered":"2023-12-08T08:19:20.474107+0000","last_unstale":"2023-12-08T08:19:21.460285+0000","last_undegraded":"2023-12-08T08:19:21.460285+0000","last_fullsized":"2023-12-08T08:19:21.460285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:44:12.578520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476770+0000","last_change":"2023-12-08T08:19:20.481897+0000","last_active":"2023-12-08T08:19:21.476770+0000","last_peered":"2023-12-08T08:19:21.476770+0000","last_clean":"2023-12-08T08:19:21.476770+0000","last_became_active":"2023-12-08T08:19:20.481628+0000","last_became_peered":"2023-12-08T08:19:20.481628+0000","last_unstale":"2023-12-08T08:19:21.476770+0000","last_undegraded":"2023-12-08T08:19:21.476770+0000","last_fullsized":"2023-12-08T08:19:21.476770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:02.816419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459169+0000","last_change":"2023-12-08T08:19:20.474534+0000","last_active":"2023-12-08T08:19:21.459169+0000","last_peered":"2023-12-08T08:19:21.459169+0000","last_clean":"2023-12-08T08:19:21.459169+0000","last_became_active":"2023-12-08T08:19:20.474196+0000","last_became_peered":"2023-12-08T08:19:20.474196+0000","last_unstale":"2023-12-08T08:19:21.459169+0000","last_undegraded":"2023-12-08T08:19:21.459169+0000","last_fullsized":"2023-12-08T08:19:21.459169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:54:11.990189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476516+0000","last_change":"2023-12-08T08:19:20.478973+0000","last_active":"2023-12-08T08:19:21.476516+0000","last_peered":"2023-12-08T08:19:21.476516+0000","last_clean":"2023-12-08T08:19:21.476516+0000","last_became_active":"2023-12-08T08:19:20.478548+0000","last_became_peered":"2023-12-08T08:19:20.478548+0000","last_unstale":"2023-12-08T08:19:21.476516+0000","last_undegraded":"2023-12-08T08:19:21.476516+0000","last_fullsized":"2023-12-08T08:19:21.476516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:53:50.209369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459128+0000","last_change":"2023-12-08T08:19:20.464519+0000","last_active":"2023-12-08T08:19:21.459128+0000","last_peered":"2023-12-08T08:19:21.459128+0000","last_clean":"2023-12-08T08:19:21.459128+0000","last_became_active":"2023-12-08T08:19:20.464229+0000","last_became_peered":"2023-12-08T08:19:20.464229+0000","last_unstale":"2023-12-08T08:19:21.459128+0000","last_undegraded":"2023-12-08T08:19:21.459128+0000","last_fullsized":"2023-12-08T08:19:21.459128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:00.202918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458855+0000","last_change":"2023-12-08T08:19:20.471509+0000","last_active":"2023-12-08T08:19:21.458855+0000","last_peered":"2023-12-08T08:19:21.458855+0000","last_clean":"2023-12-08T08:19:21.458855+0000","last_became_active":"2023-12-08T08:19:20.471266+0000","last_became_peered":"2023-12-08T08:19:20.471266+0000","last_unstale":"2023-12-08T08:19:21.458855+0000","last_undegraded":"2023-12-08T08:19:21.458855+0000","last_fullsized":"2023-12-08T08:19:21.458855+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:42.253282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460110+0000","last_change":"2023-12-08T08:19:20.472107+0000","last_active":"2023-12-08T08:19:21.460110+0000","last_peered":"2023-12-08T08:19:21.460110+0000","last_clean":"2023-12-08T08:19:21.460110+0000","last_became_active":"2023-12-08T08:19:20.471846+0000","last_became_peered":"2023-12-08T08:19:20.471846+0000","last_unstale":"2023-12-08T08:19:21.460110+0000","last_undegraded":"2023-12-08T08:19:21.460110+0000","last_fullsized":"2023-12-08T08:19:21.460110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:07:46.974601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476848+0000","last_change":"2023-12-08T08:19:20.478459+0000","last_active":"2023-12-08T08:19:21.476848+0000","last_peered":"2023-12-08T08:19:21.476848+0000","last_clean":"2023-12-08T08:19:21.476848+0000","last_became_active":"2023-12-08T08:19:20.478183+0000","last_became_peered":"2023-12-08T08:19:20.478183+0000","last_unstale":"2023-12-08T08:19:21.476848+0000","last_undegraded":"2023-12-08T08:19:21.476848+0000","last_fullsized":"2023-12-08T08:19:21.476848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:27.022654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458253+0000","last_change":"2023-12-08T08:19:20.466734+0000","last_active":"2023-12-08T08:19:21.458253+0000","last_peered":"2023-12-08T08:19:21.458253+0000","last_clean":"2023-12-08T08:19:21.458253+0000","last_became_active":"2023-12-08T08:19:20.466337+0000","last_became_peered":"2023-12-08T08:19:20.466337+0000","last_unstale":"2023-12-08T08:19:21.458253+0000","last_undegraded":"2023-12-08T08:19:21.458253+0000","last_fullsized":"2023-12-08T08:19:21.458253+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:54.864732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476769+0000","last_change":"2023-12-08T08:19:20.478878+0000","last_active":"2023-12-08T08:19:21.476769+0000","last_peered":"2023-12-08T08:19:21.476769+0000","last_clean":"2023-12-08T08:19:21.476769+0000","last_became_active":"2023-12-08T08:19:20.478109+0000","last_became_peered":"2023-12-08T08:19:20.478109+0000","last_unstale":"2023-12-08T08:19:21.476769+0000","last_undegraded":"2023-12-08T08:19:21.476769+0000","last_fullsized":"2023-12-08T08:19:21.476769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:11.283975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459343+0000","last_change":"2023-12-08T08:19:20.477650+0000","last_active":"2023-12-08T08:19:21.459343+0000","last_peered":"2023-12-08T08:19:21.459343+0000","last_clean":"2023-12-08T08:19:21.459343+0000","last_became_active":"2023-12-08T08:19:20.476944+0000","last_became_peered":"2023-12-08T08:19:20.476944+0000","last_unstale":"2023-12-08T08:19:21.459343+0000","last_undegraded":"2023-12-08T08:19:21.459343+0000","last_fullsized":"2023-12-08T08:19:21.459343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:07:46.974601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476972+0000","last_change":"2023-12-08T08:19:20.475461+0000","last_active":"2023-12-08T08:19:21.476972+0000","last_peered":"2023-12-08T08:19:21.476972+0000","last_clean":"2023-12-08T08:19:21.476972+0000","last_became_active":"2023-12-08T08:19:20.475147+0000","last_became_peered":"2023-12-08T08:19:20.475147+0000","last_unstale":"2023-12-08T08:19:21.476972+0000","last_undegraded":"2023-12-08T08:19:21.476972+0000","last_fullsized":"2023-12-08T08:19:21.476972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:09.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459347+0000","last_change":"2023-12-08T08:19:20.465241+0000","last_active":"2023-12-08T08:19:21.459347+0000","last_peered":"2023-12-08T08:19:21.459347+0000","last_clean":"2023-12-08T08:19:21.459347+0000","last_became_active":"2023-12-08T08:19:20.464981+0000","last_became_peered":"2023-12-08T08:19:20.464981+0000","last_unstale":"2023-12-08T08:19:21.459347+0000","last_undegraded":"2023-12-08T08:19:21.459347+0000","last_fullsized":"2023-12-08T08:19:21.459347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:02:18.997136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.457930+0000","last_change":"2023-12-08T08:19:20.463739+0000","last_active":"2023-12-08T08:19:21.457930+0000","last_peered":"2023-12-08T08:19:21.457930+0000","last_clean":"2023-12-08T08:19:21.457930+0000","last_became_active":"2023-12-08T08:19:20.463030+0000","last_became_peered":"2023-12-08T08:19:20.463030+0000","last_unstale":"2023-12-08T08:19:21.457930+0000","last_undegraded":"2023-12-08T08:19:21.457930+0000","last_fullsized":"2023-12-08T08:19:21.457930+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:25:59.264376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476903+0000","last_change":"2023-12-08T08:19:20.474317+0000","last_active":"2023-12-08T08:19:21.476903+0000","last_peered":"2023-12-08T08:19:21.476903+0000","last_clean":"2023-12-08T08:19:21.476903+0000","last_became_active":"2023-12-08T08:19:20.473705+0000","last_became_peered":"2023-12-08T08:19:20.473705+0000","last_unstale":"2023-12-08T08:19:21.476903+0000","last_undegraded":"2023-12-08T08:19:21.476903+0000","last_fullsized":"2023-12-08T08:19:21.476903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:08.792255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476870+0000","last_change":"2023-12-08T08:19:20.467537+0000","last_active":"2023-12-08T08:19:21.476870+0000","last_peered":"2023-12-08T08:19:21.476870+0000","last_clean":"2023-12-08T08:19:21.476870+0000","last_became_active":"2023-12-08T08:19:20.467263+0000","last_became_peered":"2023-12-08T08:19:20.467263+0000","last_unstale":"2023-12-08T08:19:21.476870+0000","last_undegraded":"2023-12-08T08:19:21.476870+0000","last_fullsized":"2023-12-08T08:19:21.476870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:02:18.997136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476850+0000","last_change":"2023-12-08T08:19:20.470878+0000","last_active":"2023-12-08T08:19:21.476850+0000","last_peered":"2023-12-08T08:19:21.476850+0000","last_clean":"2023-12-08T08:19:21.476850+0000","last_became_active":"2023-12-08T08:19:20.470432+0000","last_became_peered":"2023-12-08T08:19:20.470432+0000","last_unstale":"2023-12-08T08:19:21.476850+0000","last_undegraded":"2023-12-08T08:19:21.476850+0000","last_fullsized":"2023-12-08T08:19:21.476850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:09.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459593+0000","last_change":"2023-12-08T08:19:20.474674+0000","last_active":"2023-12-08T08:19:21.459593+0000","last_peered":"2023-12-08T08:19:21.459593+0000","last_clean":"2023-12-08T08:19:21.459593+0000","last_became_active":"2023-12-08T08:19:20.473601+0000","last_became_peered":"2023-12-08T08:19:20.473601+0000","last_unstale":"2023-12-08T08:19:21.459593+0000","last_undegraded":"2023-12-08T08:19:21.459593+0000","last_fullsized":"2023-12-08T08:19:21.459593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:13:34.652255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476647+0000","last_change":"2023-12-08T08:19:20.479050+0000","last_active":"2023-12-08T08:19:21.476647+0000","last_peered":"2023-12-08T08:19:21.476647+0000","last_clean":"2023-12-08T08:19:21.476647+0000","last_became_active":"2023-12-08T08:19:20.478765+0000","last_became_peered":"2023-12-08T08:19:20.478765+0000","last_unstale":"2023-12-08T08:19:21.476647+0000","last_undegraded":"2023-12-08T08:19:21.476647+0000","last_fullsized":"2023-12-08T08:19:21.476647+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:22:16.848990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476575+0000","last_change":"2023-12-08T08:19:20.470232+0000","last_active":"2023-12-08T08:19:21.476575+0000","last_peered":"2023-12-08T08:19:21.476575+0000","last_clean":"2023-12-08T08:19:21.476575+0000","last_became_active":"2023-12-08T08:19:20.469950+0000","last_became_peered":"2023-12-08T08:19:20.469950+0000","last_unstale":"2023-12-08T08:19:21.476575+0000","last_undegraded":"2023-12-08T08:19:21.476575+0000","last_fullsized":"2023-12-08T08:19:21.476575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:53:50.209369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459819+0000","last_change":"2023-12-08T08:19:20.465816+0000","last_active":"2023-12-08T08:19:21.459819+0000","last_peered":"2023-12-08T08:19:21.459819+0000","last_clean":"2023-12-08T08:19:21.459819+0000","last_became_active":"2023-12-08T08:19:20.465564+0000","last_became_peered":"2023-12-08T08:19:20.465564+0000","last_unstale":"2023-12-08T08:19:21.459819+0000","last_undegraded":"2023-12-08T08:19:21.459819+0000","last_fullsized":"2023-12-08T08:19:21.459819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:35.022506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476264+0000","last_change":"2023-12-08T08:19:20.468491+0000","last_active":"2023-12-08T08:19:21.476264+0000","last_peered":"2023-12-08T08:19:21.476264+0000","last_clean":"2023-12-08T08:19:21.476264+0000","last_became_active":"2023-12-08T08:19:20.468221+0000","last_became_peered":"2023-12-08T08:19:20.468221+0000","last_unstale":"2023-12-08T08:19:21.476264+0000","last_undegraded":"2023-12-08T08:19:21.476264+0000","last_fullsized":"2023-12-08T08:19:21.476264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:59:26.527157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459899+0000","last_change":"2023-12-08T08:19:20.470544+0000","last_active":"2023-12-08T08:19:21.459899+0000","last_peered":"2023-12-08T08:19:21.459899+0000","last_clean":"2023-12-08T08:19:21.459899+0000","last_became_active":"2023-12-08T08:19:20.469531+0000","last_became_peered":"2023-12-08T08:19:20.469531+0000","last_unstale":"2023-12-08T08:19:21.459899+0000","last_undegraded":"2023-12-08T08:19:21.459899+0000","last_fullsized":"2023-12-08T08:19:21.459899+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:27:04.510041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.486710+0000","last_change":"2023-12-08T08:19:19.464172+0000","last_active":"2023-12-08T08:19:20.486710+0000","last_peered":"2023-12-08T08:19:20.486710+0000","last_clean":"2023-12-08T08:19:20.486710+0000","last_became_active":"2023-12-08T08:19:19.463923+0000","last_became_peered":"2023-12-08T08:19:19.463923+0000","last_unstale":"2023-12-08T08:19:20.486710+0000","last_undegraded":"2023-12-08T08:19:20.486710+0000","last_fullsized":"2023-12-08T08:19:20.486710+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:02.773526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476752+0000","last_change":"2023-12-08T08:19:20.481990+0000","last_active":"2023-12-08T08:19:21.476752+0000","last_peered":"2023-12-08T08:19:21.476752+0000","last_clean":"2023-12-08T08:19:21.476752+0000","last_became_active":"2023-12-08T08:19:20.481699+0000","last_became_peered":"2023-12-08T08:19:20.481699+0000","last_unstale":"2023-12-08T08:19:21.476752+0000","last_undegraded":"2023-12-08T08:19:21.476752+0000","last_fullsized":"2023-12-08T08:19:21.476752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:08:58.309555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489520+0000","last_change":"2023-12-08T08:19:19.462048+0000","last_active":"2023-12-08T08:19:20.489520+0000","last_peered":"2023-12-08T08:19:20.489520+0000","last_clean":"2023-12-08T08:19:20.489520+0000","last_became_active":"2023-12-08T08:19:19.461734+0000","last_became_peered":"2023-12-08T08:19:19.461734+0000","last_unstale":"2023-12-08T08:19:20.489520+0000","last_undegraded":"2023-12-08T08:19:20.489520+0000","last_fullsized":"2023-12-08T08:19:20.489520+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:47.242591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477202+0000","last_change":"2023-12-08T08:19:20.480720+0000","last_active":"2023-12-08T08:19:21.477202+0000","last_peered":"2023-12-08T08:19:21.477202+0000","last_clean":"2023-12-08T08:19:21.477202+0000","last_became_active":"2023-12-08T08:19:20.480447+0000","last_became_peered":"2023-12-08T08:19:20.480447+0000","last_unstale":"2023-12-08T08:19:21.477202+0000","last_undegraded":"2023-12-08T08:19:21.477202+0000","last_fullsized":"2023-12-08T08:19:21.477202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:42:52.838362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489827+0000","last_change":"2023-12-08T08:19:19.462511+0000","last_active":"2023-12-08T08:19:20.489827+0000","last_peered":"2023-12-08T08:19:20.489827+0000","last_clean":"2023-12-08T08:19:20.489827+0000","last_became_active":"2023-12-08T08:19:19.462203+0000","last_became_peered":"2023-12-08T08:19:19.462203+0000","last_unstale":"2023-12-08T08:19:20.489827+0000","last_undegraded":"2023-12-08T08:19:20.489827+0000","last_fullsized":"2023-12-08T08:19:20.489827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:42:51.834229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477443+0000","last_change":"2023-12-08T08:19:20.472688+0000","last_active":"2023-12-08T08:19:21.477443+0000","last_peered":"2023-12-08T08:19:21.477443+0000","last_clean":"2023-12-08T08:19:21.477443+0000","last_became_active":"2023-12-08T08:19:20.472398+0000","last_became_peered":"2023-12-08T08:19:20.472398+0000","last_unstale":"2023-12-08T08:19:21.477443+0000","last_undegraded":"2023-12-08T08:19:21.477443+0000","last_fullsized":"2023-12-08T08:19:21.477443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:50:27.684098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489812+0000","last_change":"2023-12-08T08:19:19.463189+0000","last_active":"2023-12-08T08:19:20.489812+0000","last_peered":"2023-12-08T08:19:20.489812+0000","last_clean":"2023-12-08T08:19:20.489812+0000","last_became_active":"2023-12-08T08:19:19.462959+0000","last_became_peered":"2023-12-08T08:19:19.462959+0000","last_unstale":"2023-12-08T08:19:20.489812+0000","last_undegraded":"2023-12-08T08:19:20.489812+0000","last_fullsized":"2023-12-08T08:19:20.489812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:02.610212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477005+0000","last_change":"2023-12-08T08:19:20.484298+0000","last_active":"2023-12-08T08:19:21.477005+0000","last_peered":"2023-12-08T08:19:21.477005+0000","last_clean":"2023-12-08T08:19:21.477005+0000","last_became_active":"2023-12-08T08:19:20.484044+0000","last_became_peered":"2023-12-08T08:19:20.484044+0000","last_unstale":"2023-12-08T08:19:21.477005+0000","last_undegraded":"2023-12-08T08:19:21.477005+0000","last_fullsized":"2023-12-08T08:19:21.477005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:42.253282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.488256+0000","last_change":"2023-12-08T08:19:19.465277+0000","last_active":"2023-12-08T08:19:20.488256+0000","last_peered":"2023-12-08T08:19:20.488256+0000","last_clean":"2023-12-08T08:19:20.488256+0000","last_became_active":"2023-12-08T08:19:19.465010+0000","last_became_peered":"2023-12-08T08:19:19.465010+0000","last_unstale":"2023-12-08T08:19:20.488256+0000","last_undegraded":"2023-12-08T08:19:20.488256+0000","last_fullsized":"2023-12-08T08:19:20.488256+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:13.331905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458990+0000","last_change":"2023-12-08T08:19:20.467722+0000","last_active":"2023-12-08T08:19:21.458990+0000","last_peered":"2023-12-08T08:19:21.458990+0000","last_clean":"2023-12-08T08:19:21.458990+0000","last_became_active":"2023-12-08T08:19:20.467450+0000","last_became_peered":"2023-12-08T08:19:20.467450+0000","last_unstale":"2023-12-08T08:19:21.458990+0000","last_undegraded":"2023-12-08T08:19:21.458990+0000","last_fullsized":"2023-12-08T08:19:21.458990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:27:04.510041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.487504+0000","last_change":"2023-12-08T08:19:19.454482+0000","last_active":"2023-12-08T08:19:20.487504+0000","last_peered":"2023-12-08T08:19:20.487504+0000","last_clean":"2023-12-08T08:19:20.487504+0000","last_became_active":"2023-12-08T08:19:19.453976+0000","last_became_peered":"2023-12-08T08:19:19.453976+0000","last_unstale":"2023-12-08T08:19:20.487504+0000","last_undegraded":"2023-12-08T08:19:20.487504+0000","last_fullsized":"2023-12-08T08:19:20.487504+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:02.773526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476652+0000","last_change":"2023-12-08T08:19:20.478425+0000","last_active":"2023-12-08T08:19:21.476652+0000","last_peered":"2023-12-08T08:19:21.476652+0000","last_clean":"2023-12-08T08:19:21.476652+0000","last_became_active":"2023-12-08T08:19:20.478171+0000","last_became_peered":"2023-12-08T08:19:20.478171+0000","last_unstale":"2023-12-08T08:19:21.476652+0000","last_undegraded":"2023-12-08T08:19:21.476652+0000","last_fullsized":"2023-12-08T08:19:21.476652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:53:11.283975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.460420+0000","last_change":"2023-12-08T08:19:19.464566+0000","last_active":"2023-12-08T08:19:20.460420+0000","last_peered":"2023-12-08T08:19:20.460420+0000","last_clean":"2023-12-08T08:19:20.460420+0000","last_became_active":"2023-12-08T08:19:19.464219+0000","last_became_peered":"2023-12-08T08:19:19.464219+0000","last_unstale":"2023-12-08T08:19:20.460420+0000","last_undegraded":"2023-12-08T08:19:20.460420+0000","last_fullsized":"2023-12-08T08:19:20.460420+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:03:47.242591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476958+0000","last_change":"2023-12-08T08:19:20.476008+0000","last_active":"2023-12-08T08:19:21.476958+0000","last_peered":"2023-12-08T08:19:21.476958+0000","last_clean":"2023-12-08T08:19:21.476958+0000","last_became_active":"2023-12-08T08:19:20.475702+0000","last_became_peered":"2023-12-08T08:19:20.475702+0000","last_unstale":"2023-12-08T08:19:21.476958+0000","last_undegraded":"2023-12-08T08:19:21.476958+0000","last_fullsized":"2023-12-08T08:19:21.476958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:41:14.545285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.466844+0000","last_change":"2023-12-08T08:19:19.461968+0000","last_active":"2023-12-08T08:19:20.466844+0000","last_peered":"2023-12-08T08:19:20.466844+0000","last_clean":"2023-12-08T08:19:20.466844+0000","last_became_active":"2023-12-08T08:19:19.461593+0000","last_became_peered":"2023-12-08T08:19:19.461593+0000","last_unstale":"2023-12-08T08:19:20.466844+0000","last_undegraded":"2023-12-08T08:19:20.466844+0000","last_fullsized":"2023-12-08T08:19:20.466844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:56.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458205+0000","last_change":"2023-12-08T08:19:20.476947+0000","last_active":"2023-12-08T08:19:21.458205+0000","last_peered":"2023-12-08T08:19:21.458205+0000","last_clean":"2023-12-08T08:19:21.458205+0000","last_became_active":"2023-12-08T08:19:20.476619+0000","last_became_peered":"2023-12-08T08:19:20.476619+0000","last_unstale":"2023-12-08T08:19:21.458205+0000","last_undegraded":"2023-12-08T08:19:21.458205+0000","last_fullsized":"2023-12-08T08:19:21.458205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:44:03.777659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.462949+0000","last_change":"2023-12-08T08:19:19.460962+0000","last_active":"2023-12-08T08:19:20.462949+0000","last_peered":"2023-12-08T08:19:20.462949+0000","last_clean":"2023-12-08T08:19:20.462949+0000","last_became_active":"2023-12-08T08:19:19.460633+0000","last_became_peered":"2023-12-08T08:19:19.460633+0000","last_unstale":"2023-12-08T08:19:20.462949+0000","last_undegraded":"2023-12-08T08:19:20.462949+0000","last_fullsized":"2023-12-08T08:19:20.462949+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:13:33.648121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460076+0000","last_change":"2023-12-08T08:19:20.474759+0000","last_active":"2023-12-08T08:19:21.460076+0000","last_peered":"2023-12-08T08:19:21.460076+0000","last_clean":"2023-12-08T08:19:21.460076+0000","last_became_active":"2023-12-08T08:19:20.474520+0000","last_became_peered":"2023-12-08T08:19:20.474520+0000","last_unstale":"2023-12-08T08:19:21.460076+0000","last_undegraded":"2023-12-08T08:19:21.460076+0000","last_fullsized":"2023-12-08T08:19:21.460076+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:54:11.990189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.460549+0000","last_change":"2023-12-08T08:19:19.466716+0000","last_active":"2023-12-08T08:19:20.460549+0000","last_peered":"2023-12-08T08:19:20.460549+0000","last_clean":"2023-12-08T08:19:20.460549+0000","last_became_active":"2023-12-08T08:19:19.466423+0000","last_became_peered":"2023-12-08T08:19:19.466423+0000","last_unstale":"2023-12-08T08:19:20.460549+0000","last_undegraded":"2023-12-08T08:19:20.460549+0000","last_fullsized":"2023-12-08T08:19:20.460549+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:01.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476676+0000","last_change":"2023-12-08T08:19:20.477408+0000","last_active":"2023-12-08T08:19:21.476676+0000","last_peered":"2023-12-08T08:19:21.476676+0000","last_clean":"2023-12-08T08:19:21.476676+0000","last_became_active":"2023-12-08T08:19:20.477018+0000","last_became_peered":"2023-12-08T08:19:20.477018+0000","last_unstale":"2023-12-08T08:19:21.476676+0000","last_undegraded":"2023-12-08T08:19:21.476676+0000","last_fullsized":"2023-12-08T08:19:21.476676+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:09:26.749359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.488546+0000","last_change":"2023-12-08T08:19:19.460730+0000","last_active":"2023-12-08T08:19:20.488546+0000","last_peered":"2023-12-08T08:19:20.488546+0000","last_clean":"2023-12-08T08:19:20.488546+0000","last_became_active":"2023-12-08T08:19:19.460417+0000","last_became_peered":"2023-12-08T08:19:19.460417+0000","last_unstale":"2023-12-08T08:19:20.488546+0000","last_undegraded":"2023-12-08T08:19:20.488546+0000","last_fullsized":"2023-12-08T08:19:20.488546+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:02:17.993003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477152+0000","last_change":"2023-12-08T08:19:20.482492+0000","last_active":"2023-12-08T08:19:21.477152+0000","last_peered":"2023-12-08T08:19:21.477152+0000","last_clean":"2023-12-08T08:19:21.477152+0000","last_became_active":"2023-12-08T08:19:20.482176+0000","last_became_peered":"2023-12-08T08:19:20.482176+0000","last_unstale":"2023-12-08T08:19:21.477152+0000","last_undegraded":"2023-12-08T08:19:21.477152+0000","last_fullsized":"2023-12-08T08:19:21.477152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:08.792255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.490554+0000","last_change":"2023-12-08T08:19:19.465202+0000","last_active":"2023-12-08T08:19:20.490554+0000","last_peered":"2023-12-08T08:19:20.490554+0000","last_clean":"2023-12-08T08:19:20.490554+0000","last_became_active":"2023-12-08T08:19:19.464942+0000","last_became_peered":"2023-12-08T08:19:19.464942+0000","last_unstale":"2023-12-08T08:19:20.490554+0000","last_undegraded":"2023-12-08T08:19:20.490554+0000","last_fullsized":"2023-12-08T08:19:20.490554+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:07:45.970467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477136+0000","last_change":"2023-12-08T08:19:20.480611+0000","last_active":"2023-12-08T08:19:21.477136+0000","last_peered":"2023-12-08T08:19:21.477136+0000","last_clean":"2023-12-08T08:19:21.477136+0000","last_became_active":"2023-12-08T08:19:20.480143+0000","last_became_peered":"2023-12-08T08:19:20.480143+0000","last_unstale":"2023-12-08T08:19:21.477136+0000","last_undegraded":"2023-12-08T08:19:21.477136+0000","last_fullsized":"2023-12-08T08:19:21.477136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:02:18.997136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.488195+0000","last_change":"2023-12-08T08:19:19.468566+0000","last_active":"2023-12-08T08:19:20.488195+0000","last_peered":"2023-12-08T08:19:20.488195+0000","last_clean":"2023-12-08T08:19:20.488195+0000","last_became_active":"2023-12-08T08:19:19.468266+0000","last_became_peered":"2023-12-08T08:19:19.468266+0000","last_unstale":"2023-12-08T08:19:20.488195+0000","last_undegraded":"2023-12-08T08:19:20.488195+0000","last_fullsized":"2023-12-08T08:19:20.488195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:54:10.986056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477180+0000","last_change":"2023-12-08T08:19:20.473371+0000","last_active":"2023-12-08T08:19:21.477180+0000","last_peered":"2023-12-08T08:19:21.477180+0000","last_clean":"2023-12-08T08:19:21.477180+0000","last_became_active":"2023-12-08T08:19:20.473051+0000","last_became_peered":"2023-12-08T08:19:20.473051+0000","last_unstale":"2023-12-08T08:19:21.477180+0000","last_undegraded":"2023-12-08T08:19:21.477180+0000","last_fullsized":"2023-12-08T08:19:21.477180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:58.880159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.460920+0000","last_change":"2023-12-08T08:19:19.466026+0000","last_active":"2023-12-08T08:19:20.460920+0000","last_peered":"2023-12-08T08:19:20.460920+0000","last_clean":"2023-12-08T08:19:20.460920+0000","last_became_active":"2023-12-08T08:19:19.465721+0000","last_became_peered":"2023-12-08T08:19:19.465721+0000","last_unstale":"2023-12-08T08:19:20.460920+0000","last_undegraded":"2023-12-08T08:19:20.460920+0000","last_fullsized":"2023-12-08T08:19:20.460920+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:22:15.844857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460009+0000","last_change":"2023-12-08T08:19:20.467487+0000","last_active":"2023-12-08T08:19:21.460009+0000","last_peered":"2023-12-08T08:19:21.460009+0000","last_clean":"2023-12-08T08:19:21.460009+0000","last_became_active":"2023-12-08T08:19:20.467220+0000","last_became_peered":"2023-12-08T08:19:20.467220+0000","last_unstale":"2023-12-08T08:19:21.460009+0000","last_undegraded":"2023-12-08T08:19:21.460009+0000","last_fullsized":"2023-12-08T08:19:21.460009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:47:00.202918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.464627+0000","last_change":"2023-12-08T08:19:19.463283+0000","last_active":"2023-12-08T08:19:20.464627+0000","last_peered":"2023-12-08T08:19:20.464627+0000","last_clean":"2023-12-08T08:19:20.464627+0000","last_became_active":"2023-12-08T08:19:19.463032+0000","last_became_peered":"2023-12-08T08:19:19.463032+0000","last_unstale":"2023-12-08T08:19:20.464627+0000","last_undegraded":"2023-12-08T08:19:20.464627+0000","last_fullsized":"2023-12-08T08:19:20.464627+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:53.860599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476959+0000","last_change":"2023-12-08T08:19:20.473696+0000","last_active":"2023-12-08T08:19:21.476959+0000","last_peered":"2023-12-08T08:19:21.476959+0000","last_clean":"2023-12-08T08:19:21.476959+0000","last_became_active":"2023-12-08T08:19:20.473229+0000","last_became_peered":"2023-12-08T08:19:20.473229+0000","last_unstale":"2023-12-08T08:19:21.476959+0000","last_undegraded":"2023-12-08T08:19:21.476959+0000","last_fullsized":"2023-12-08T08:19:21.476959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:42.303819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489658+0000","last_change":"2023-12-08T08:19:19.463045+0000","last_active":"2023-12-08T08:19:20.489658+0000","last_peered":"2023-12-08T08:19:20.489658+0000","last_clean":"2023-12-08T08:19:20.489658+0000","last_became_active":"2023-12-08T08:19:19.462783+0000","last_became_peered":"2023-12-08T08:19:19.462783+0000","last_unstale":"2023-12-08T08:19:20.489658+0000","last_undegraded":"2023-12-08T08:19:20.489658+0000","last_fullsized":"2023-12-08T08:19:20.489658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:22:15.844857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476632+0000","last_change":"2023-12-08T08:19:20.474144+0000","last_active":"2023-12-08T08:19:21.476632+0000","last_peered":"2023-12-08T08:19:21.476632+0000","last_clean":"2023-12-08T08:19:21.476632+0000","last_became_active":"2023-12-08T08:19:20.473622+0000","last_became_peered":"2023-12-08T08:19:20.473622+0000","last_unstale":"2023-12-08T08:19:21.476632+0000","last_undegraded":"2023-12-08T08:19:21.476632+0000","last_fullsized":"2023-12-08T08:19:21.476632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:44:12.578520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.486679+0000","last_change":"2023-12-08T08:19:19.464937+0000","last_active":"2023-12-08T08:19:20.486679+0000","last_peered":"2023-12-08T08:19:20.486679+0000","last_clean":"2023-12-08T08:19:20.486679+0000","last_became_active":"2023-12-08T08:19:19.464684+0000","last_became_peered":"2023-12-08T08:19:19.464684+0000","last_unstale":"2023-12-08T08:19:20.486679+0000","last_undegraded":"2023-12-08T08:19:20.486679+0000","last_fullsized":"2023-12-08T08:19:20.486679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:42:51.834229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460310+0000","last_change":"2023-12-08T08:19:20.468002+0000","last_active":"2023-12-08T08:19:21.460310+0000","last_peered":"2023-12-08T08:19:21.460310+0000","last_clean":"2023-12-08T08:19:21.460310+0000","last_became_active":"2023-12-08T08:19:20.467139+0000","last_became_peered":"2023-12-08T08:19:20.467139+0000","last_unstale":"2023-12-08T08:19:21.460310+0000","last_undegraded":"2023-12-08T08:19:21.460310+0000","last_fullsized":"2023-12-08T08:19:21.460310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:41:14.545285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489600+0000","last_change":"2023-12-08T08:19:19.462344+0000","last_active":"2023-12-08T08:19:20.489600+0000","last_peered":"2023-12-08T08:19:20.489600+0000","last_clean":"2023-12-08T08:19:20.489600+0000","last_became_active":"2023-12-08T08:19:19.462082+0000","last_became_peered":"2023-12-08T08:19:19.462082+0000","last_unstale":"2023-12-08T08:19:20.489600+0000","last_undegraded":"2023-12-08T08:19:20.489600+0000","last_fullsized":"2023-12-08T08:19:20.489600+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:53.860599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477142+0000","last_change":"2023-12-08T08:19:20.483322+0000","last_active":"2023-12-08T08:19:21.477142+0000","last_peered":"2023-12-08T08:19:21.477142+0000","last_clean":"2023-12-08T08:19:21.477142+0000","last_became_active":"2023-12-08T08:19:20.483049+0000","last_became_peered":"2023-12-08T08:19:20.483049+0000","last_unstale":"2023-12-08T08:19:21.477142+0000","last_undegraded":"2023-12-08T08:19:21.477142+0000","last_fullsized":"2023-12-08T08:19:21.477142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:27.022654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.489542+0000","last_change":"2023-12-08T08:19:19.456106+0000","last_active":"2023-12-08T08:19:20.489542+0000","last_peered":"2023-12-08T08:19:20.489542+0000","last_clean":"2023-12-08T08:19:20.489542+0000","last_became_active":"2023-12-08T08:19:19.455798+0000","last_became_peered":"2023-12-08T08:19:19.455798+0000","last_unstale":"2023-12-08T08:19:20.489542+0000","last_undegraded":"2023-12-08T08:19:20.489542+0000","last_fullsized":"2023-12-08T08:19:20.489542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:46:06.187766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458299+0000","last_change":"2023-12-08T08:19:20.464542+0000","last_active":"2023-12-08T08:19:21.458299+0000","last_peered":"2023-12-08T08:19:21.458299+0000","last_clean":"2023-12-08T08:19:21.458299+0000","last_became_active":"2023-12-08T08:19:20.464212+0000","last_became_peered":"2023-12-08T08:19:20.464212+0000","last_unstale":"2023-12-08T08:19:21.458299+0000","last_undegraded":"2023-12-08T08:19:21.458299+0000","last_fullsized":"2023-12-08T08:19:21.458299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:03.614345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.461514+0000","last_change":"2023-12-08T08:19:19.463139+0000","last_active":"2023-12-08T08:19:20.461514+0000","last_peered":"2023-12-08T08:19:20.461514+0000","last_clean":"2023-12-08T08:19:20.461514+0000","last_became_active":"2023-12-08T08:19:19.462834+0000","last_became_peered":"2023-12-08T08:19:19.462834+0000","last_unstale":"2023-12-08T08:19:20.461514+0000","last_undegraded":"2023-12-08T08:19:20.461514+0000","last_fullsized":"2023-12-08T08:19:20.461514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:26.018521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458963+0000","last_change":"2023-12-08T08:19:20.470369+0000","last_active":"2023-12-08T08:19:21.458963+0000","last_peered":"2023-12-08T08:19:21.458963+0000","last_clean":"2023-12-08T08:19:21.458963+0000","last_became_active":"2023-12-08T08:19:20.470009+0000","last_became_peered":"2023-12-08T08:19:20.470009+0000","last_unstale":"2023-12-08T08:19:21.458963+0000","last_undegraded":"2023-12-08T08:19:21.458963+0000","last_fullsized":"2023-12-08T08:19:21.458963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:08:58.309555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.488609+0000","last_change":"2023-12-08T08:19:19.464867+0000","last_active":"2023-12-08T08:19:20.488609+0000","last_peered":"2023-12-08T08:19:20.488609+0000","last_clean":"2023-12-08T08:19:20.488609+0000","last_became_active":"2023-12-08T08:19:19.464559+0000","last_became_peered":"2023-12-08T08:19:19.464559+0000","last_unstale":"2023-12-08T08:19:20.488609+0000","last_undegraded":"2023-12-08T08:19:20.488609+0000","last_fullsized":"2023-12-08T08:19:20.488609+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:00:00.903212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476528+0000","last_change":"2023-12-08T08:19:20.477563+0000","last_active":"2023-12-08T08:19:21.476528+0000","last_peered":"2023-12-08T08:19:21.476528+0000","last_clean":"2023-12-08T08:19:21.476528+0000","last_became_active":"2023-12-08T08:19:20.477289+0000","last_became_peered":"2023-12-08T08:19:20.477289+0000","last_unstale":"2023-12-08T08:19:21.476528+0000","last_undegraded":"2023-12-08T08:19:21.476528+0000","last_fullsized":"2023-12-08T08:19:21.476528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:42:52.838362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.456911+0000","last_change":"2023-12-08T08:19:19.457129+0000","last_active":"2023-12-08T08:19:20.456911+0000","last_peered":"2023-12-08T08:19:20.456911+0000","last_clean":"2023-12-08T08:19:20.456911+0000","last_became_active":"2023-12-08T08:19:19.456841+0000","last_became_peered":"2023-12-08T08:19:19.456841+0000","last_unstale":"2023-12-08T08:19:20.456911+0000","last_undegraded":"2023-12-08T08:19:20.456911+0000","last_fullsized":"2023-12-08T08:19:20.456911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:55.151623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459800+0000","last_change":"2023-12-08T08:19:20.471075+0000","last_active":"2023-12-08T08:19:21.459800+0000","last_peered":"2023-12-08T08:19:21.459800+0000","last_clean":"2023-12-08T08:19:21.459800+0000","last_became_active":"2023-12-08T08:19:20.470783+0000","last_became_peered":"2023-12-08T08:19:20.470783+0000","last_unstale":"2023-12-08T08:19:21.459800+0000","last_undegraded":"2023-12-08T08:19:21.459800+0000","last_fullsized":"2023-12-08T08:19:21.459800+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:12.141771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.459683+0000","last_change":"2023-12-08T08:19:19.459100+0000","last_active":"2023-12-08T08:19:20.459683+0000","last_peered":"2023-12-08T08:19:20.459683+0000","last_clean":"2023-12-08T08:19:20.459683+0000","last_became_active":"2023-12-08T08:19:19.458783+0000","last_became_peered":"2023-12-08T08:19:19.458783+0000","last_unstale":"2023-12-08T08:19:20.459683+0000","last_undegraded":"2023-12-08T08:19:20.459683+0000","last_fullsized":"2023-12-08T08:19:20.459683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:35:07.788122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477107+0000","last_change":"2023-12-08T08:19:20.475187+0000","last_active":"2023-12-08T08:19:21.477107+0000","last_peered":"2023-12-08T08:19:21.477107+0000","last_clean":"2023-12-08T08:19:21.477107+0000","last_became_active":"2023-12-08T08:19:20.474906+0000","last_became_peered":"2023-12-08T08:19:20.474906+0000","last_unstale":"2023-12-08T08:19:21.477107+0000","last_undegraded":"2023-12-08T08:19:21.477107+0000","last_fullsized":"2023-12-08T08:19:21.477107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:38:18.688895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.456732+0000","last_change":"2023-12-08T08:19:19.460538+0000","last_active":"2023-12-08T08:19:20.456732+0000","last_peered":"2023-12-08T08:19:20.456732+0000","last_clean":"2023-12-08T08:19:20.456732+0000","last_became_active":"2023-12-08T08:19:19.460171+0000","last_became_peered":"2023-12-08T08:19:19.460171+0000","last_unstale":"2023-12-08T08:19:20.456732+0000","last_undegraded":"2023-12-08T08:19:20.456732+0000","last_fullsized":"2023-12-08T08:19:20.456732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:20:50.521409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476486+0000","last_change":"2023-12-08T08:19:20.466753+0000","last_active":"2023-12-08T08:19:21.476486+0000","last_peered":"2023-12-08T08:19:21.476486+0000","last_clean":"2023-12-08T08:19:21.476486+0000","last_became_active":"2023-12-08T08:19:20.466483+0000","last_became_peered":"2023-12-08T08:19:20.466483+0000","last_unstale":"2023-12-08T08:19:21.476486+0000","last_undegraded":"2023-12-08T08:19:21.476486+0000","last_fullsized":"2023-12-08T08:19:21.476486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:02.816419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.487917+0000","last_change":"2023-12-08T08:19:19.460442+0000","last_active":"2023-12-08T08:19:20.487917+0000","last_peered":"2023-12-08T08:19:20.487917+0000","last_clean":"2023-12-08T08:19:20.487917+0000","last_became_active":"2023-12-08T08:19:19.460163+0000","last_became_peered":"2023-12-08T08:19:19.460163+0000","last_unstale":"2023-12-08T08:19:20.487917+0000","last_undegraded":"2023-12-08T08:19:20.487917+0000","last_fullsized":"2023-12-08T08:19:20.487917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:22:26.018521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.460233+0000","last_change":"2023-12-08T08:19:20.474162+0000","last_active":"2023-12-08T08:19:21.460233+0000","last_peered":"2023-12-08T08:19:21.460233+0000","last_clean":"2023-12-08T08:19:21.460233+0000","last_became_active":"2023-12-08T08:19:20.473900+0000","last_became_peered":"2023-12-08T08:19:20.473900+0000","last_unstale":"2023-12-08T08:19:21.460233+0000","last_undegraded":"2023-12-08T08:19:21.460233+0000","last_fullsized":"2023-12-08T08:19:21.460233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:38:51.566456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.458213+0000","last_change":"2023-12-08T08:19:19.461171+0000","last_active":"2023-12-08T08:19:21.458213+0000","last_peered":"2023-12-08T08:19:21.458213+0000","last_clean":"2023-12-08T08:19:21.458213+0000","last_became_active":"2023-12-08T08:19:19.460904+0000","last_became_peered":"2023-12-08T08:19:19.460904+0000","last_unstale":"2023-12-08T08:19:21.458213+0000","last_undegraded":"2023-12-08T08:19:21.458213+0000","last_fullsized":"2023-12-08T08:19:21.458213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:49:56.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477402+0000","last_change":"2023-12-08T08:19:20.481252+0000","last_active":"2023-12-08T08:19:21.477402+0000","last_peered":"2023-12-08T08:19:21.477402+0000","last_clean":"2023-12-08T08:19:21.477402+0000","last_became_active":"2023-12-08T08:19:20.480952+0000","last_became_peered":"2023-12-08T08:19:20.480952+0000","last_unstale":"2023-12-08T08:19:21.477402+0000","last_undegraded":"2023-12-08T08:19:21.477402+0000","last_fullsized":"2023-12-08T08:19:21.477402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:16:02.860455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.467110+0000","last_change":"2023-12-08T08:19:19.461362+0000","last_active":"2023-12-08T08:19:20.467110+0000","last_peered":"2023-12-08T08:19:20.467110+0000","last_clean":"2023-12-08T08:19:20.467110+0000","last_became_active":"2023-12-08T08:19:19.461087+0000","last_became_peered":"2023-12-08T08:19:19.461087+0000","last_unstale":"2023-12-08T08:19:20.467110+0000","last_undegraded":"2023-12-08T08:19:20.467110+0000","last_fullsized":"2023-12-08T08:19:20.467110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:08.721130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.477258+0000","last_change":"2023-12-08T08:19:20.480425+0000","last_active":"2023-12-08T08:19:21.477258+0000","last_peered":"2023-12-08T08:19:21.477258+0000","last_clean":"2023-12-08T08:19:21.477258+0000","last_became_active":"2023-12-08T08:19:20.479767+0000","last_became_peered":"2023-12-08T08:19:20.479767+0000","last_unstale":"2023-12-08T08:19:21.477258+0000","last_undegraded":"2023-12-08T08:19:21.477258+0000","last_fullsized":"2023-12-08T08:19:21.477258+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:14.336038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.466456+0000","last_change":"2023-12-08T08:19:19.462325+0000","last_active":"2023-12-08T08:19:20.466456+0000","last_peered":"2023-12-08T08:19:20.466456+0000","last_clean":"2023-12-08T08:19:20.466456+0000","last_became_active":"2023-12-08T08:19:19.462011+0000","last_became_peered":"2023-12-08T08:19:19.462011+0000","last_unstale":"2023-12-08T08:19:20.466456+0000","last_undegraded":"2023-12-08T08:19:20.466456+0000","last_fullsized":"2023-12-08T08:19:20.466456+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:02.610212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476595+0000","last_change":"2023-12-08T08:19:20.475627+0000","last_active":"2023-12-08T08:19:21.476595+0000","last_peered":"2023-12-08T08:19:21.476595+0000","last_clean":"2023-12-08T08:19:21.476595+0000","last_became_active":"2023-12-08T08:19:20.475322+0000","last_became_peered":"2023-12-08T08:19:20.475322+0000","last_unstale":"2023-12-08T08:19:21.476595+0000","last_undegraded":"2023-12-08T08:19:21.476595+0000","last_fullsized":"2023-12-08T08:19:21.476595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:37:42.253282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.464876+0000","last_change":"2023-12-08T08:19:19.465944+0000","last_active":"2023-12-08T08:19:20.464876+0000","last_peered":"2023-12-08T08:19:20.464876+0000","last_clean":"2023-12-08T08:19:20.464876+0000","last_became_active":"2023-12-08T08:19:19.465649+0000","last_became_peered":"2023-12-08T08:19:19.465649+0000","last_unstale":"2023-12-08T08:19:20.464876+0000","last_undegraded":"2023-12-08T08:19:20.464876+0000","last_fullsized":"2023-12-08T08:19:20.464876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:57:02.610212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.476579+0000","last_change":"2023-12-08T08:19:20.481780+0000","last_active":"2023-12-08T08:19:21.476579+0000","last_peered":"2023-12-08T08:19:21.476579+0000","last_clean":"2023-12-08T08:19:21.476579+0000","last_became_active":"2023-12-08T08:19:20.481456+0000","last_became_peered":"2023-12-08T08:19:20.481456+0000","last_unstale":"2023-12-08T08:19:21.476579+0000","last_undegraded":"2023-12-08T08:19:21.476579+0000","last_fullsized":"2023-12-08T08:19:21.476579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:22:16.848990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.467320+0000","last_change":"2023-12-08T08:19:19.454420+0000","last_active":"2023-12-08T08:19:20.467320+0000","last_peered":"2023-12-08T08:19:20.467320+0000","last_clean":"2023-12-08T08:19:20.467320+0000","last_became_active":"2023-12-08T08:19:19.454157+0000","last_became_peered":"2023-12-08T08:19:19.454157+0000","last_unstale":"2023-12-08T08:19:20.467320+0000","last_undegraded":"2023-12-08T08:19:20.467320+0000","last_fullsized":"2023-12-08T08:19:20.467320+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:13:24.549047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459720+0000","last_change":"2023-12-08T08:19:20.474218+0000","last_active":"2023-12-08T08:19:21.459720+0000","last_peered":"2023-12-08T08:19:21.459720+0000","last_clean":"2023-12-08T08:19:21.459720+0000","last_became_active":"2023-12-08T08:19:20.473994+0000","last_became_peered":"2023-12-08T08:19:20.473994+0000","last_unstale":"2023-12-08T08:19:21.459720+0000","last_undegraded":"2023-12-08T08:19:21.459720+0000","last_fullsized":"2023-12-08T08:19:21.459720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:39:14.336038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.460369+0000","last_change":"2023-12-08T08:19:19.464170+0000","last_active":"2023-12-08T08:19:20.460369+0000","last_peered":"2023-12-08T08:19:20.460369+0000","last_clean":"2023-12-08T08:19:20.460369+0000","last_became_active":"2023-12-08T08:19:19.463922+0000","last_became_peered":"2023-12-08T08:19:19.463922+0000","last_unstale":"2023-12-08T08:19:20.460369+0000","last_undegraded":"2023-12-08T08:19:20.460369+0000","last_fullsized":"2023-12-08T08:19:20.460369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:01.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-08T08:19:21.459438+0000","last_change":"2023-12-08T08:19:20.473359+0000","last_active":"2023-12-08T08:19:21.459438+0000","last_peered":"2023-12-08T08:19:21.459438+0000","last_clean":"2023-12-08T08:19:21.459438+0000","last_became_active":"2023-12-08T08:19:20.472161+0000","last_became_peered":"2023-12-08T08:19:20.472161+0000","last_unstale":"2023-12-08T08:19:21.459438+0000","last_undegraded":"2023-12-08T08:19:21.459438+0000","last_fullsized":"2023-12-08T08:19:21.459438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:19.442785+0000","last_clean_scrub_stamp":"2023-12-08T08:19:19.442785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:38:51.566456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.460288+0000","last_change":"2023-12-08T08:19:19.456284+0000","last_active":"2023-12-08T08:19:20.460288+0000","last_peered":"2023-12-08T08:19:20.460288+0000","last_clean":"2023-12-08T08:19:20.460288+0000","last_became_active":"2023-12-08T08:19:19.456035+0000","last_became_peered":"2023-12-08T08:19:19.456035+0000","last_unstale":"2023-12-08T08:19:20.460288+0000","last_undegraded":"2023-12-08T08:19:20.460288+0000","last_fullsized":"2023-12-08T08:19:20.460288+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:19:18.438652+0000","last_clean_scrub_stamp":"2023-12-08T08:19:18.438652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:35:01.812286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-08T08:19:20.459631+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:19:20.459631+0000","last_peered":"2023-12-08T08:19:20.459631+0000","last_clean":"2023-12-08T08:19:20.459631+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:19:20.459631+0000","last_undegraded":"2023-12-08T08:19:20.459631+0000","last_fullsized":"2023-12-08T08:19:20.459631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":780688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.623},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":189220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.5}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.30099999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.433}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.45200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":188750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.436},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.498}]},{"osd":6,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.378},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.41899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":446464,"data_stored":189242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.502}]},{"osd":2,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":454656,"data_stored":190284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.438}]},{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.34399999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.45900000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.48199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":188708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.439},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61399999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:18:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":442368,"data_stored":188728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.307}]},{"osd":4,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47499999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.497}]},{"osd":7,"last update":"Fri Dec 8 08:18:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1032192,"data_stored":778021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.308},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.378}]},{"osd":2,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.32400000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.8100000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.745}]},{"osd":6,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:19:28.238 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:19:28.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:19:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.384+0000 7ff0382ad640 1 Processor -- start 2023-12-08T08:19:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.384+0000 7ff0382ad640 1 -- start start 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff0382ad640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 0x7ff0300cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff0382ad640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300d0900 con 0x7ff0300b2030 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff0382ad640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300cfcf0 con 0x7ff03015d7b0 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff0382ad640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300b2780 con 0x7ff03015d3d0 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035848640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff0300b2030 0x7ff03006b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45656/0 (socket says 172.21.15.50:45656) 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035848640 1 -- 172.21.15.50:0/752823473 learned_addr learned my addr 172.21.15.50:0/752823473 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff036049640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 0x7ff0300cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712589478 0 0) 0x7ff0300d0900 con 0x7ff0300b2030 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff01c003520 con 0x7ff0300b2030 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760481391 0 0) 0x7ff0300cfcf0 con 0x7ff03015d7b0 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0300d0900 con 0x7ff03015d7b0 2023-12-08T08:19:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581693561 0 0) 0x7ff01c003520 con 0x7ff0300b2030 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 msgr2=0x7ff0300cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 0x7ff0300cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 >> v1:172.21.15.170:6789/0 conn(0x7ff03015d7b0 legacy=0x7ff03006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300cffd0 con 0x7ff0300b2030 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7ff020001670 con 0x7ff0300b2030 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 >> v1:172.21.15.50:6789/0 conn(0x7ff0300b2030 legacy=0x7ff03006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.385+0000 7ff035047640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff01c003b30 0x7ff01c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff035047640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 0x7ff01c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff035047640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c004d00 0x7ff01c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c00ba30 con 0x7ff01c003b30 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c00bb70 con 0x7ff01c004d00 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c00bce0 con 0x7ff03015d3d0 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff036049640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff01c003b30 0x7ff01c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff035848640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 0x7ff01c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff03684a640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c004d00 0x7ff01c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff036049640 1 -- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 msgr2=0x7ff01c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff036049640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff03015d3d0 0x7ff01c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff036049640 1 -- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c004d00 msgr2=0x7ff01c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff036049640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c004d00 0x7ff01c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.386+0000 7ff036049640 1 -- 172.21.15.50:0/752823473 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c003520 con 0x7ff01c003b30 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff036049640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff01c003b30 0x7ff01c003f30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009ac0 tx=0x7ff01c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466f06fc2cac47b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c02c6b0 con 0x7ff01c003b30 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c02c810 con 0x7ff01c003b30 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff035047640 1 -- 172.21.15.50:0/752823473 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c02cba0 con 0x7ff01c003b30 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff0382ad640 1 -- 172.21.15.50:0/752823473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff01c003b30 msgr2=0x7ff01c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff0382ad640 1 --2- 172.21.15.50:0/752823473 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff01c003b30 0x7ff01c003f30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009ac0 tx=0x7ff01c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff03684a640 1 -- 172.21.15.50:0/752823473 reap_dead start 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff0382ad640 1 -- 172.21.15.50:0/752823473 shutdown_connections 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.387+0000 7ff0382ad640 1 -- 172.21.15.50:0/752823473 >> 172.21.15.50:0/752823473 conn(0x7ff0300d0de0 msgr2=0x7ff0300d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.388+0000 7ff0382ad640 1 -- 172.21.15.50:0/752823473 shutdown_connections 2023-12-08T08:19:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.388+0000 7ff0382ad640 1 -- 172.21.15.50:0/752823473 wait complete. 2023-12-08T08:19:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.389+0000 7ff0382ad640 1 Processor -- start 2023-12-08T08:19:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.389+0000 7ff0382ad640 1 -- start start 2023-12-08T08:19:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c003b30 0x7ff0301572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0300c5a70 0x7ff0300c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0301e55e0 0x7ff0301e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0301e5fa0 con 0x7ff0301e55e0 2023-12-08T08:19:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c6510 con 0x7ff01c003b30 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c67f0 con 0x7ff0300c5a70 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0301e55e0 0x7ff0301e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0301e55e0 0x7ff0301e5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37802/0 (socket says 172.21.15.50:37802) 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 -- 172.21.15.50:0/775109003 learned_addr learned my addr 172.21.15.50:0/775109003 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff035848640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0300c5a70 0x7ff0300c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff036049640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c003b30 0x7ff0301572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 -- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0300c5a70 msgr2=0x7ff0300c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0300c5a70 0x7ff0300c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 -- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c003b30 msgr2=0x7ff0301572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c003b30 0x7ff0301572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 -- 172.21.15.50:0/775109003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300c6ad0 con 0x7ff0301e55e0 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff036049640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c003b30 0x7ff0301572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff03684a640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0301e55e0 0x7ff0301e5a60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff030067280 tx=0x7ff02800fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff026ffd640 1 -- 172.21.15.50:0/775109003 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028006e20 con 0x7ff0301e55e0 2023-12-08T08:19:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff026ffd640 1 -- 172.21.15.50:0/775109003 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028003970 con 0x7ff0301e55e0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0300c6db0 con 0x7ff0301e55e0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff026ffd640 1 -- 172.21.15.50:0/775109003 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028003d20 con 0x7ff0301e55e0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.390+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0301e7bb0 con 0x7ff0301e55e0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.391+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0300c72d0 con 0x7ff0301e55e0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.392+0000 7ff026ffd640 1 -- 172.21.15.50:0/775109003 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0280050d0 con 0x7ff0301e55e0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.392+0000 7ff026ffd640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff01406ae40 0x7ff01406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.392+0000 7ff026ffd640 1 -- 172.21.15.50:0/775109003 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff028088af0 con 0x7ff0301e55e0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.392+0000 7ff036049640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff01406ae40 0x7ff01406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.393+0000 7ff036049640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff01406ae40 0x7ff01406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff02c036000 tx=0x7ff02c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.396+0000 7ff026ffd640 1 -- 172.21.15.50:0/775109003 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0300c72d0 con 0x7ff0301e55e0 2023-12-08T08:19:28.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.642+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff0300c72d0 con 0x7ff0301e55e0 2023-12-08T08:19:28.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.644+0000 7ff026ffd640 1 -- 172.21.15.50:0/775109003 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff0300c72d0 con 0x7ff0301e55e0 2023-12-08T08:19:28.647 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:19:28.647 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:19:28.647 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-12-08T08:19:28.647 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:19:28.647 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:19:28.647 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:19:28.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff01406ae40 msgr2=0x7ff01406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff01406ae40 0x7ff01406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff02c036000 tx=0x7ff02c030000 comp rx=0 tx=0).stop 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0301e55e0 msgr2=0x7ff0301e5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0301e55e0 0x7ff0301e5a60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff030067280 tx=0x7ff02800fd60 comp rx=0 tx=0).stop 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 shutdown_connections 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff01406ae40 0x7ff01406d300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0301e55e0 0x7ff0301e5a60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0300c5a70 0x7ff0300c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 --2- 172.21.15.50:0/775109003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff01c003b30 0x7ff0301572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 >> 172.21.15.50:0/775109003 conn(0x7ff0300d0de0 msgr2=0x7ff0300cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 shutdown_connections 2023-12-08T08:19:28.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.646+0000 7ff0382ad640 1 -- 172.21.15.50:0/775109003 wait complete. 2023-12-08T08:19:28.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:28.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.763+0000 7fd57d7e5640 1 Processor -- start 2023-12-08T08:19:28.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.763+0000 7fd57d7e5640 1 -- start start 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd57d7e5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5780cd240 0x7fd5780cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd57d7e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd57815f4e0 0x7fd57815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd57d7e5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5780cfb90 con 0x7fd5780cf730 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd57d7e5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5780cd620 con 0x7fd5780cd240 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd57d7e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57815c150 con 0x7fd57815f4e0 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd576ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5780cd240 0x7fd5780cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd576ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd5780cd240 0x7fd5780cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37816/0 (socket says 172.21.15.50:37816) 2023-12-08T08:19:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.764+0000 7fd576ffd640 1 -- 172.21.15.50:0/2350333556 learned_addr learned my addr 172.21.15.50:0/2350333556 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.765+0000 7fd576ffd640 1 -- 172.21.15.50:0/2350333556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd57815f4e0 msgr2=0x7fd57815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.765+0000 7fd576ffd640 1 --2- 172.21.15.50:0/2350333556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd57815f4e0 0x7fd57815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.765+0000 7fd576ffd640 1 -- 172.21.15.50:0/2350333556 >> v1:172.21.15.170:6789/0 conn(0x7fd5780cf730 legacy=0x7fd57815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:28.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.765+0000 7fd576ffd640 1 -- 172.21.15.50:0/2350333556 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57815fb00 con 0x7fd5780cd240 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.765+0000 7fd576ffd640 1 --2- 172.21.15.50:0/2350333556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5780cd240 0x7fd5780cf1f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd568009e50 tx=0x7fd56802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afa36ee9670ede2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.765+0000 7fd575ffb640 1 -- 172.21.15.50:0/2350333556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56802ca70 con 0x7fd5780cd240 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd575ffb640 1 -- 172.21.15.50:0/2350333556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56802cbd0 con 0x7fd5780cd240 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd575ffb640 1 -- 172.21.15.50:0/2350333556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680343f0 con 0x7fd5780cd240 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 -- 172.21.15.50:0/2350333556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5780cd240 msgr2=0x7fd5780cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/2350333556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5780cd240 0x7fd5780cf1f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd568009e50 tx=0x7fd56802bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 -- 172.21.15.50:0/2350333556 shutdown_connections 2023-12-08T08:19:28.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/2350333556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd57815f4e0 0x7fd57815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/2350333556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd5780cd240 0x7fd5780cf1f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 -- 172.21.15.50:0/2350333556 >> 172.21.15.50:0/2350333556 conn(0x7fd578099a10 msgr2=0x7fd578099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 -- 172.21.15.50:0/2350333556 shutdown_connections 2023-12-08T08:19:28.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.766+0000 7fd57d7e5640 1 -- 172.21.15.50:0/2350333556 wait complete. 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.767+0000 7fd57d7e5640 1 Processor -- start 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd57d7e5640 1 -- start start 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd57d7e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5780cd240 0x7fd5780b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd57d7e5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5780cf730 0x7fd5780b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd57d7e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57815f4e0 0x7fd578159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd57d7e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780b19a0 con 0x7fd57815f4e0 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd57d7e5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780b2520 con 0x7fd5780cf730 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd57d7e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780b1bf0 con 0x7fd5780cd240 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd5777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57815f4e0 0x7fd578159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd5777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57815f4e0 0x7fd578159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37822/0 (socket says 172.21.15.50:37822) 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.768+0000 7fd5777fe640 1 -- 172.21.15.50:0/1150019651 learned_addr learned my addr 172.21.15.50:0/1150019651 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd576ffd640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5780cd240 0x7fd5780b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd5767fc640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5780cf730 0x7fd5780b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd5777fe640 1 -- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5780cd240 msgr2=0x7fd5780b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd5777fe640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5780cd240 0x7fd5780b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd5777fe640 1 -- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5780cf730 msgr2=0x7fd5780b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd5777fe640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5780cf730 0x7fd5780b63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd5777fe640 1 -- 172.21.15.50:0/1150019651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568009b30 con 0x7fd57815f4e0 2023-12-08T08:19:28.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd5777fe640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57815f4e0 0x7fd578159330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd57000b440 tx=0x7fd57000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd56f7fe640 1 -- 172.21.15.50:0/1150019651 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011830 con 0x7fd57815f4e0 2023-12-08T08:19:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd56f7fe640 1 -- 172.21.15.50:0/1150019651 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570011990 con 0x7fd57815f4e0 2023-12-08T08:19:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5780b1ed0 con 0x7fd57815f4e0 2023-12-08T08:19:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd56f7fe640 1 -- 172.21.15.50:0/1150019651 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011d40 con 0x7fd57815f4e0 2023-12-08T08:19:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.769+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5780b6930 con 0x7fd57815f4e0 2023-12-08T08:19:28.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.770+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57815c5c0 con 0x7fd57815f4e0 2023-12-08T08:19:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.771+0000 7fd56f7fe640 1 -- 172.21.15.50:0/1150019651 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd57001a400 con 0x7fd57815f4e0 2023-12-08T08:19:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.771+0000 7fd56f7fe640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd55806ae70 0x7fd55806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.771+0000 7fd56f7fe640 1 -- 172.21.15.50:0/1150019651 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd570089840 con 0x7fd57815f4e0 2023-12-08T08:19:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.771+0000 7fd576ffd640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd55806ae70 0x7fd55806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:28.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.772+0000 7fd576ffd640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd55806ae70 0x7fd55806d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd568035000 tx=0x7fd568030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:28.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.776+0000 7fd56f7fe640 1 -- 172.21.15.50:0/1150019651 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd57815c5c0 con 0x7fd57815f4e0 2023-12-08T08:19:28.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.989+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd57815c5c0 con 0x7fd57815f4e0 2023-12-08T08:19:28.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.990+0000 7fd56f7fe640 1 -- 172.21.15.50:0/1150019651 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fd57815c5c0 con 0x7fd57815f4e0 2023-12-08T08:19:28.992 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:28.992 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:19.820822+0000","modified":"2023-12-08T08:19:21.813122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/209897774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":209897774},{"type":"v1","addr":"172.21.15.50:6835","nonce":209897774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:19:28.992 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 16 2023-12-08T08:19:28.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.991+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd55806ae70 msgr2=0x7fd55806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd55806ae70 0x7fd55806d330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd568035000 tx=0x7fd568030000 comp rx=0 tx=0).stop 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57815f4e0 msgr2=0x7fd578159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57815f4e0 0x7fd578159330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd57000b440 tx=0x7fd57000b900 comp rx=0 tx=0).stop 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 shutdown_connections 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd55806ae70 0x7fd55806d330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd57815f4e0 0x7fd578159330 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5780cf730 0x7fd5780b63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 --2- 172.21.15.50:0/1150019651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5780cd240 0x7fd5780b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 >> 172.21.15.50:0/1150019651 conn(0x7fd578099a10 msgr2=0x7fd57815e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 shutdown_connections 2023-12-08T08:19:28.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:28.992+0000 7fd57d7e5640 1 -- 172.21.15.50:0/1150019651 wait complete. 2023-12-08T08:19:29.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:19:19.820822+0000', 'modified': '2023-12-08T08:19:21.813122+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5260': {'gid': 5260, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/209897774', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 209897774}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 209897774}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:19:29.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:19:29.408 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-08T08:19:29.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.523+0000 7f7958168640 1 Processor -- start 2023-12-08T08:19:29.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.524+0000 7f7958168640 1 -- start start 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.524+0000 7f7958168640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79500ccd70 0x7f79500ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.524+0000 7f7958168640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f79500cf1e0 0x7f795006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.524+0000 7f7958168640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795006c8f0 con 0x7f795006c480 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.524+0000 7f7958168640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500d0a60 con 0x7f79500ccd70 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.524+0000 7f7958168640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500ce7b0 con 0x7f79500cf1e0 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7955f04640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f79500ccd70 0x7f79500ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7956705640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f795006c480 0x7f795015ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:45664/0 (socket says 172.21.15.50:45664) 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7956705640 1 -- 172.21.15.50:0/3442766990 learned_addr learned my addr 172.21.15.50:0/3442766990 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7955f04640 1 -- 172.21.15.50:0/3442766990 >> v2:172.21.15.170:3300/0 conn(0x7f79500cf1e0 msgr2=0x7f795006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7955703640 1 --2- 172.21.15.50:0/3442766990 >> v2:172.21.15.170:3300/0 conn(0x7f79500cf1e0 0x7f795006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7955f04640 1 --2- 172.21.15.50:0/3442766990 >> v2:172.21.15.170:3300/0 conn(0x7f79500cf1e0 0x7f795006bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7955f04640 1 -- 172.21.15.50:0/3442766990 >> v1:172.21.15.50:6789/0 conn(0x7f795006c480 legacy=0x7f795015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7954f02640 1 -- 172.21.15.50:0/3442766990 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604484197 0 0) 0x7f7948001490 con 0x7f795006c480 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7955f04640 1 -- 172.21.15.50:0/3442766990 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500cf9c0 con 0x7f79500ccd70 2023-12-08T08:19:29.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.525+0000 7f7955703640 1 --2- 172.21.15.50:0/3442766990 >> v2:172.21.15.170:3300/0 conn(0x7f79500cf1e0 0x7f795006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7955f04640 1 --2- 172.21.15.50:0/3442766990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79500ccd70 0x7f79500ce270 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7950071310 tx=0x7f794c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925360f876bb92f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7954f02640 1 -- 172.21.15.50:0/3442766990 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c031830 con 0x7f79500ccd70 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7954f02640 1 -- 172.21.15.50:0/3442766990 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c031990 con 0x7f79500ccd70 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7954f02640 1 -- 172.21.15.50:0/3442766990 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c031d20 con 0x7f79500ccd70 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7958168640 1 -- 172.21.15.50:0/3442766990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79500ccd70 msgr2=0x7f79500ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7958168640 1 --2- 172.21.15.50:0/3442766990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79500ccd70 0x7f79500ce270 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7950071310 tx=0x7f794c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7958168640 1 -- 172.21.15.50:0/3442766990 shutdown_connections 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7958168640 1 --2- 172.21.15.50:0/3442766990 >> v2:172.21.15.170:3300/0 conn(0x7f79500cf1e0 0x7f795006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7958168640 1 --2- 172.21.15.50:0/3442766990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79500ccd70 0x7f79500ce270 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.526+0000 7f7958168640 1 -- 172.21.15.50:0/3442766990 >> 172.21.15.50:0/3442766990 conn(0x7f79500d0de0 msgr2=0x7f79500d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.527+0000 7f7958168640 1 -- 172.21.15.50:0/3442766990 shutdown_connections 2023-12-08T08:19:29.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.527+0000 7f7958168640 1 -- 172.21.15.50:0/3442766990 wait complete. 2023-12-08T08:19:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.528+0000 7f7958168640 1 Processor -- start 2023-12-08T08:19:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.528+0000 7f7958168640 1 -- start start 2023-12-08T08:19:29.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.528+0000 7f7958168640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795006c480 0x7f79501f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.528+0000 7f7958168640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79500ccd70 0x7f79500c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.528+0000 7f7958168640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79500cf1e0 0x7f795015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7958168640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c7730 con 0x7f795006c480 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7958168640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c8a90 con 0x7f79500cf1e0 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7958168640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c6120 con 0x7f79500ccd70 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795006c480 0x7f79501f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795006c480 0x7f79501f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37840/0 (socket says 172.21.15.50:37840) 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 -- 172.21.15.50:0/3027342485 learned_addr learned my addr 172.21.15.50:0/3027342485 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7956705640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79500cf1e0 0x7f795015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955703640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79500ccd70 0x7f79500c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 -- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79500ccd70 msgr2=0x7f79500c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79500ccd70 0x7f79500c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 -- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79500cf1e0 msgr2=0x7f795015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79500cf1e0 0x7f795015e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 -- 172.21.15.50:0/3027342485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009400 con 0x7f795006c480 2023-12-08T08:19:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7955f04640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795006c480 0x7f79501f2760 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f794c009890 tx=0x7f794c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f79467fc640 1 -- 172.21.15.50:0/3027342485 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c03ba70 con 0x7f795006c480 2023-12-08T08:19:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f79467fc640 1 -- 172.21.15.50:0/3027342485 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c03bbf0 con 0x7f795006c480 2023-12-08T08:19:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500c6400 con 0x7f795006c480 2023-12-08T08:19:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f79467fc640 1 -- 172.21.15.50:0/3027342485 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c045400 con 0x7f795006c480 2023-12-08T08:19:29.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.529+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500c7140 con 0x7f795006c480 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.531+0000 7f79467fc640 1 -- 172.21.15.50:0/3027342485 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f794c04e440 con 0x7f795006c480 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.531+0000 7f79467fc640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f793406ae70 0x7f793406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.532+0000 7f79467fc640 1 -- 172.21.15.50:0/3027342485 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f794c0abb30 con 0x7f795006c480 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.532+0000 7f7955703640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f793406ae70 0x7f793406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.532+0000 7f7955703640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f793406ae70 0x7f793406d330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f79501f6220 tx=0x7f7940008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 Processor -- start 2023-12-08T08:19:29.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 -- start start 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f7050ac50 0x555f704ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050b030 0x555f7050d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f704de130 0x555f7050df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f7049e980 con 0x555f704de130 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f70450b90 con 0x555f7050b030 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.533+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f7044e280 con 0x555f7050ac50 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f704de130 0x555f7050df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.538 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7955f04640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f7050ac50 0x555f704ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f704de130 0x555f7050df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37856/0 (socket says 172.21.15.50:37856) 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 -- 172.21.15.50:0/3595617030 learned_addr learned my addr 172.21.15.50:0/3595617030 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7955703640 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050b030 0x555f7050d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 -- 172.21.15.50:0/3595617030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f7050ac50 msgr2=0x555f704ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f7050ac50 0x555f704ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 -- 172.21.15.50:0/3595617030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050b030 msgr2=0x555f7050d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050b030 0x555f7050d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 -- 172.21.15.50:0/3595617030 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f7040f500 con 0x555f704de130 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f7956705640 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f704de130 0x555f7050df20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f79480019a0 tx=0x7f7948001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74e761c032130e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f79337fe640 1 -- 172.21.15.50:0/3595617030 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007630 con 0x555f704de130 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f79337fe640 1 -- 172.21.15.50:0/3595617030 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79480077b0 con 0x555f704de130 2023-12-08T08:19:29.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.534+0000 7f79337fe640 1 -- 172.21.15.50:0/3595617030 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948014480 con 0x555f704de130 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 -- 172.21.15.50:0/3595617030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f704de130 msgr2=0x555f7050df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f704de130 0x555f7050df20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f79480019a0 tx=0x7f7948001e60 comp rx=0 tx=0).stop 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 -- 172.21.15.50:0/3595617030 shutdown_connections 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f704de130 0x555f7050df20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050b030 0x555f7050d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 --2- 172.21.15.50:0/3595617030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f7050ac50 0x555f704ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 -- 172.21.15.50:0/3595617030 >> 172.21.15.50:0/3595617030 conn(0x555f704dfe60 msgr2=0x555f705289e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 -- 172.21.15.50:0/3595617030 shutdown_connections 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.535+0000 7f795add6740 1 -- 172.21.15.50:0/3595617030 wait complete. 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.536+0000 7f795add6740 1 -- start start 2023-12-08T08:19:29.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.536+0000 7f795add6740 1 Processor -- start 2023-12-08T08:19:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7050b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f795add6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f705036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f795add6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f70449b70 con 0x555f7050b030 2023-12-08T08:19:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f70403e00 con 0x555f7050ac50 2023-12-08T08:19:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f70403aa0 con 0x555f70503060 2023-12-08T08:19:29.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f795add6740 10 client.0 _ll_register_callbacks cb 0x555f7015bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f705036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f705036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37862/0 (socket says 172.21.15.50:37862) 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 -- 172.21.15.50:0/2526047416 learned_addr learned my addr 172.21.15.50:0/2526047416 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955f04640 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7050b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7956705640 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 -- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 msgr2=0x555f70503be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 -- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 msgr2=0x555f7050b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7050b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 -- 172.21.15.50:0/2526047416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794800f040 con 0x555f7050b030 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7955703640 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f705036a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7940013730 tx=0x7f79400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7411e04132ee16bd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.537+0000 7f7930ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f7930ff9640 1 -- 172.21.15.50:0/2526047416 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940014940 con 0x555f7050b030 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f7930ff9640 1 -- 172.21.15.50:0/2526047416 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7940014aa0 con 0x555f7050b030 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f70442b50 con 0x555f7050b030 2023-12-08T08:19:29.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f7930ff9640 1 -- 172.21.15.50:0/2526047416 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7940014c60 con 0x555f7050b030 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 10 client.5724 fetch_fsmap learned FSMap version 16 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x555f704481f0 con 0x555f7050b030 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f7930ff9640 1 -- 172.21.15.50:0/2526047416 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f70442b50 con 0x555f7050b030 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f7930ff9640 1 -- 172.21.15.50:0/2526047416 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7940011070 con 0x555f7050b030 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 10 client.5724 fetch_fsmap finished waiting for FSMap version 16 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 10 client.5724 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 20 client.5724 populate_metadata read hostname 'smithi050' 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f704f1f20 0x555f704f2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 4 client.5724 mds_command: new command op to 5260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 --> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f70442870 con 0x555f704f1f20 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.538+0000 7f7955f04640 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f704f1f20 0x555f704f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f7955f04640 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f704f1f20 0x555f704f2300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0f23f2f7c5f4b1b server_cookie=5832ed950e4d4d23 in_seq=0 out_seq=0 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f7930ff9640 10 client.5724 ms_handle_connect on v2:172.21.15.50:6832/209897774 2023-12-08T08:19:29.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f7930ff9640 1 -- 172.21.15.50:0/2526047416 <== mds.0 v2:172.21.15.50:6832/209897774 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555f70442870 con 0x555f704f1f20 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f7930ff9640 10 client.5724 handle_command_reply: tid=0 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 client.5724 shutdown 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 msgr2=0x555f705036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f705036a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7940013730 tx=0x7f79400046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 shutdown_connections 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f704f1f20 0x555f704f2300 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f705036a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f7930ff9640 0 client.5724 ms_handle_reset on v2:172.21.15.50:6832/209897774 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 --2- 172.21.15.50:0/2526047416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7050b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 >> 172.21.15.50:0/2526047416 conn(0x555f704de130 msgr2=0x555f704e1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.539+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 shutdown_connections 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.540+0000 7f795add6740 1 -- 172.21.15.50:0/2526047416 wait complete. 2023-12-08T08:19:29.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.540+0000 7f795add6740 20 client.5724 trim_cache size 0 max 16384 2023-12-08T08:19:29.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.555+0000 7f795add6740 1 Processor -- start 2023-12-08T08:19:29.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.555+0000 7f795add6740 1 -- start start 2023-12-08T08:19:29.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f704e19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f795add6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f795add6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f703c9270 con 0x555f7050b030 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f7041c2d0 con 0x555f7050ac50 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f70504150 con 0x555f70503060 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f7956705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f7956705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37874/0 (socket says 172.21.15.50:37874) 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.556+0000 7f7956705640 1 -- 172.21.15.50:0/2150193218 learned_addr learned my addr 172.21.15.50:0/2150193218 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7955703640 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f704e19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7955f04640 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7956705640 1 -- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 msgr2=0x555f70503550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7956705640 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7956705640 1 -- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 msgr2=0x555f704e19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7956705640 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f704e19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7956705640 1 -- 172.21.15.50:0/2150193218 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f703e5d00 con 0x555f7050b030 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7955703640 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f704e19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7956705640 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dceb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7948001970 tx=0x7f794800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833f5e74dda93d58 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7933fff640 1 -- 172.21.15.50:0/2150193218 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007630 con 0x555f7050b030 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7933fff640 1 -- 172.21.15.50:0/2150193218 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948007920 con 0x555f7050b030 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f7933fff640 1 -- 172.21.15.50:0/2150193218 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480146a0 con 0x555f7050b030 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f795add6740 1 -- 172.21.15.50:0/2150193218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 msgr2=0x555f704dceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f795add6740 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dceb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7948001970 tx=0x7f794800c000 comp rx=0 tx=0).stop 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f795add6740 1 -- 172.21.15.50:0/2150193218 shutdown_connections 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f795add6740 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dceb0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f795add6740 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f704e19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f795add6740 1 --2- 172.21.15.50:0/2150193218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f70503550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.557+0000 7f795add6740 1 -- 172.21.15.50:0/2150193218 >> 172.21.15.50:0/2150193218 conn(0x555f704de130 msgr2=0x555f7050dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.558+0000 7f795add6740 1 -- 172.21.15.50:0/2150193218 shutdown_connections 2023-12-08T08:19:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.558+0000 7f795add6740 1 -- 172.21.15.50:0/2150193218 wait complete. 2023-12-08T08:19:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.558+0000 7f795add6740 1 -- start start 2023-12-08T08:19:29.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.558+0000 7f795add6740 1 Processor -- start 2023-12-08T08:19:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f705791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f795add6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7053a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f795add6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f795add6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f705026a0 con 0x555f7050b030 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f705284f0 con 0x555f7050ac50 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f795add6740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f7053b3a0 con 0x555f70503060 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f795add6740 10 client.0 _ll_register_callbacks cb 0x7f7948005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f7956705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f7956705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37888/0 (socket says 172.21.15.50:37888) 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f7956705640 1 -- 172.21.15.50:0/2853081837 learned_addr learned my addr 172.21.15.50:0/2853081837 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f7955703640 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7053a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f7955f04640 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f705791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f7956705640 1 -- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 msgr2=0x555f705791f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.559+0000 7f7956705640 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f705791f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7956705640 1 -- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 msgr2=0x555f7053a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7956705640 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7053a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7956705640 1 -- 172.21.15.50:0/2853081837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f7040f500 con 0x555f7050b030 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7956705640 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dcc80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7948007420 tx=0x7f7948001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647a8dcbc1fdcea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7930ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:19:29.568 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7930ff9640 1 -- 172.21.15.50:0/2853081837 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007630 con 0x555f7050b030 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7930ff9640 1 -- 172.21.15.50:0/2853081837 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7948015a80 con 0x555f7050b030 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79480077b0 con 0x555f7050b030 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7930ff9640 1 -- 172.21.15.50:0/2853081837 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7948015c40 con 0x555f7050b030 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 10 client.5730 fetch_fsmap learned FSMap version 16 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x555f7040b4f0 con 0x555f7050b030 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7930ff9640 1 -- 172.21.15.50:0/2853081837 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79480077b0 con 0x555f7050b030 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7930ff9640 1 -- 172.21.15.50:0/2853081837 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7948031470 con 0x555f7050b030 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 10 client.5730 fetch_fsmap finished waiting for FSMap version 16 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 10 client.5730 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 20 client.5730 populate_metadata read hostname 'smithi050' 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f70510c90 0x555f70511070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 4 client.5730 mds_command: new command op to 5260 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 --> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f7014a6c0 con 0x555f70510c90 2023-12-08T08:19:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.560+0000 7f7955f04640 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f70510c90 0x555f70511070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f7930ff9640 10 client.5730 ms_handle_connect on v2:172.21.15.50:6832/209897774 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f7955f04640 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f70510c90 0x555f70511070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f938d1161d78012 server_cookie=f4629b1319df594e in_seq=0 out_seq=0 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f7930ff9640 1 -- 172.21.15.50:0/2853081837 <== mds.0 v2:172.21.15.50:6832/209897774 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555f7014a6c0 con 0x555f70510c90 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f7930ff9640 10 client.5730 handle_command_reply: tid=0 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 client.5730 shutdown 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 msgr2=0x555f704dcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dcc80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7948007420 tx=0x7f7948001250 comp rx=0 tx=0).stop 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 shutdown_connections 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:6832/209897774,v1:172.21.15.50:6835/209897774] conn(0x555f70510c90 0x555f70511070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555f7050b030 0x555f704dcc80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555f7050ac50 0x555f7053a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f7930ff9640 0 client.5730 ms_handle_reset on v2:172.21.15.50:6832/209897774 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 --2- 172.21.15.50:0/2853081837 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555f70503060 0x555f705791f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.570 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 >> 172.21.15.50:0/2853081837 conn(0x555f704de130 msgr2=0x555f704f1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 shutdown_connections 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 1 -- 172.21.15.50:0/2853081837 wait complete. 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.561+0000 7f795add6740 20 client.5730 trim_cache size 0 max 16384 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "e65cfade-ffb6-4f9a-b644-0a4f3f758761", 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5260, 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-08T08:19:29.571 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 9.0938966299999997, 2023-12-08T08:19:29.572 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 16, 2023-12-08T08:19:29.572 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 38, 2023-12-08T08:19:29.572 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 38, 2023-12-08T08:19:29.572 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 15.975533138999999 2023-12-08T08:19:29.572 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:19:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f793406ae70 msgr2=0x7f793406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f793406ae70 0x7f793406d330 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f79501f6220 tx=0x7f7940008040 comp rx=0 tx=0).stop 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795006c480 msgr2=0x7f79501f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795006c480 0x7f79501f2760 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f794c009890 tx=0x7f794c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 shutdown_connections 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f793406ae70 0x7f793406d330 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79500cf1e0 0x7f795015e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79500ccd70 0x7f79500c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 --2- 172.21.15.50:0/3027342485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f795006c480 0x7f79501f2760 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 >> 172.21.15.50:0/3027342485 conn(0x7f79500d0de0 msgr2=0x7f79500b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 shutdown_connections 2023-12-08T08:19:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.562+0000 7f7958168640 1 -- 172.21.15.50:0/3027342485 wait complete. 2023-12-08T08:19:29.575 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.678+0000 7f223bd89640 1 Processor -- start 2023-12-08T08:19:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.679+0000 7f223bd89640 1 -- start start 2023-12-08T08:19:29.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.679+0000 7f223bd89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22341608a0 0x7f22340d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.679+0000 7f223bd89640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22340b1d70 0x7f22340d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.679+0000 7f223bd89640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22340d20b0 con 0x7f22340afce0 2023-12-08T08:19:29.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.679+0000 7f223bd89640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22340d0620 con 0x7f22340b1d70 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.679+0000 7f223bd89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22340d1dd0 con 0x7f22341608a0 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239324640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22340b1d70 0x7f22340d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239324640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22340b1d70 0x7f22340d1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:37900/0 (socket says 172.21.15.50:37900) 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239324640 1 -- 172.21.15.50:0/131001227 learned_addr learned my addr 172.21.15.50:0/131001227 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239b25640 1 --2- 172.21.15.50:0/131001227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22341608a0 0x7f22340d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239324640 1 -- 172.21.15.50:0/131001227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22341608a0 msgr2=0x7f22340d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239324640 1 --2- 172.21.15.50:0/131001227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22341608a0 0x7f22340d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239324640 1 -- 172.21.15.50:0/131001227 >> v1:172.21.15.170:6789/0 conn(0x7f22340afce0 legacy=0x7f22340b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.680+0000 7f2239324640 1 -- 172.21.15.50:0/131001227 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340cff60 con 0x7f22340b1d70 2023-12-08T08:19:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f2239324640 1 --2- 172.21.15.50:0/131001227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340b1d70 0x7f22340d1470 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2228009870 tx=0x7f222802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26064330326679d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f2238b23640 1 -- 172.21.15.50:0/131001227 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228031640 con 0x7f22340b1d70 2023-12-08T08:19:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f2238b23640 1 -- 172.21.15.50:0/131001227 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22280317a0 con 0x7f22340b1d70 2023-12-08T08:19:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f2238b23640 1 -- 172.21.15.50:0/131001227 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228031b30 con 0x7f22340b1d70 2023-12-08T08:19:29.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f223bd89640 1 -- 172.21.15.50:0/131001227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340b1d70 msgr2=0x7f22340d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f223bd89640 1 --2- 172.21.15.50:0/131001227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340b1d70 0x7f22340d1470 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2228009870 tx=0x7f222802b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f223bd89640 1 -- 172.21.15.50:0/131001227 shutdown_connections 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f223bd89640 1 --2- 172.21.15.50:0/131001227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22340b1d70 0x7f22340d1470 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f223bd89640 1 --2- 172.21.15.50:0/131001227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22341608a0 0x7f22340d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f223bd89640 1 -- 172.21.15.50:0/131001227 >> 172.21.15.50:0/131001227 conn(0x7f22340d3030 msgr2=0x7f22340d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.681+0000 7f223bd89640 1 -- 172.21.15.50:0/131001227 shutdown_connections 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.682+0000 7f223bd89640 1 -- 172.21.15.50:0/131001227 wait complete. 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 Processor -- start 2023-12-08T08:19:29.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 -- start start 2023-12-08T08:19:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22340afce0 0x7f22341f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22340b1d70 0x7f223415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22341608a0 0x7f22341f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22341f3dc0 con 0x7f22341608a0 2023-12-08T08:19:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223415d090 con 0x7f22340b1d70 2023-12-08T08:19:29.688 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.683+0000 7f223bd89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22341f3520 con 0x7f22340afce0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22341608a0 0x7f22341f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22341608a0 0x7f22341f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42714/0 (socket says 172.21.15.50:42714) 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 -- 172.21.15.50:0/1673376099 learned_addr learned my addr 172.21.15.50:0/1673376099 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f2239b25640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22340afce0 0x7f22341f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f2239324640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22340b1d70 0x7f223415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 -- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22340afce0 msgr2=0x7f22341f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22340afce0 0x7f22341f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 -- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22340b1d70 msgr2=0x7f223415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22340b1d70 0x7f223415cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 -- 172.21.15.50:0/1673376099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280094d0 con 0x7f22341608a0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f2239324640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22340b1d70 0x7f223415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223a326640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22341608a0 0x7f22341f0250 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c3c0 tx=0x7f222c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f22327fc640 1 -- 172.21.15.50:0/1673376099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c0052d0 con 0x7f22341608a0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f22327fc640 1 -- 172.21.15.50:0/1673376099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c005430 con 0x7f22341608a0 2023-12-08T08:19:29.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22341f3800 con 0x7f22341608a0 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f22327fc640 1 -- 172.21.15.50:0/1673376099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c003810 con 0x7f22341608a0 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.684+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223415aeb0 con 0x7f22341608a0 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.685+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223415b0d0 con 0x7f22341608a0 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.686+0000 7f22327fc640 1 -- 172.21.15.50:0/1673376099 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f222c003970 con 0x7f22341608a0 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.686+0000 7f22327fc640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f222006ae40 0x7f222006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.686+0000 7f22327fc640 1 -- 172.21.15.50:0/1673376099 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f222c099b00 con 0x7f22341608a0 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.686+0000 7f2239b25640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f222006ae40 0x7f222006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:29.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.687+0000 7f2239b25640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f222006ae40 0x7f222006d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f22340cd190 tx=0x7f2224009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:29.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.690+0000 7f22327fc640 1 -- 172.21.15.50:0/1673376099 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f222c064bb0 con 0x7f22341608a0 2023-12-08T08:19:29.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.903+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2234067430 con 0x7f22341608a0 2023-12-08T08:19:29.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.903+0000 7f22327fc640 1 -- 172.21.15.50:0/1673376099 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f222c028070 con 0x7f22341608a0 2023-12-08T08:19:29.906 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f222006ae40 msgr2=0x7f222006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f222006ae40 0x7f222006d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f22340cd190 tx=0x7f2224009830 comp rx=0 tx=0).stop 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22341608a0 msgr2=0x7f22341f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22341608a0 0x7f22341f0250 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c3c0 tx=0x7f222c00c880 comp rx=0 tx=0).stop 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 shutdown_connections 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f222006ae40 0x7f222006d300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22341608a0 0x7f22341f0250 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22340b1d70 0x7f223415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 --2- 172.21.15.50:0/1673376099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22340afce0 0x7f22341f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 >> 172.21.15.50:0/1673376099 conn(0x7f22340d3030 msgr2=0x7f22340ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 shutdown_connections 2023-12-08T08:19:29.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:29.905+0000 7f223bd89640 1 -- 172.21.15.50:0/1673376099 wait complete. 2023-12-08T08:19:29.918 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:19:29.918 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:29.919 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:19:29.919 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:19:29.919 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:29.919 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:19:29.919 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:19:29.919 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:19:29.919 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:29.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:29.919 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:19:29.935 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:29.935 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:29.935 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:29.935 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:29.935 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:19:29.936 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42404sec preferred_lft 42404sec 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c008:83ff:fe50:e6c0/64 scope link 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:29.937 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:29.938 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::403f:3fff:fee6:f2fc/64 scope link 2023-12-08T08:19:29.938 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:29.938 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:29.938 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:29.938 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::2880:6dff:fe2e:b579/64 scope link 2023-12-08T08:19:29.938 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:29.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:29.938 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:30.004 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:19:30.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.006 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:19:30.062 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:19:30.062 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:30.062 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:19:30.062 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:19:30.063 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:30.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.063 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:19:30.063 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:19:30.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:19:30.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:19:30.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:19:30.063 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:19:30.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.169 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:19:30.184 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-08T08:19:30.184 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:19:30.184 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:30.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:19:30.256 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-08T08:19:30.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:30.257 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:30.311 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:30.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:30.312 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:30.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:19:30.438 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:19:30.494 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:19:30.494 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:19:30.494 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:19:30.494 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:19:30.494 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:19:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:30.496 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:30.497 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:30.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.497 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:19:30.549 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:19:30.549 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T08:19:30.592 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:19:30.622 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:19:30.678 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:19:30.678 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:19:30.678 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:19:30.678 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:19:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:19:30.680 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:19:30.681 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:19:30.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:19:30.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:30.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:30.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:30.681 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:30.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.682 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:19:30.684 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-12-08T08:19:30.682+0000 7f280020b480 -1 init, newargv = 0x55c2accef460 newargc=15 2023-12-08T08:19:30.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[105560]: starting ceph client 2023-12-08T08:19:30.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[105560]: starting fuse 2023-12-08T08:19:30.701 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:19:30.701 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:19:30.701 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:19:30.702 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:19:30.703 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:19:30.703 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:30.703 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-12-08T08:19:30.703 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:19:30.826 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.105560.asok 2023-12-08T08:19:30.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:19:30.836 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.105560.asok 2023-12-08T08:19:30.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.836 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.105560.asok status 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "105560", 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:30.979 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5745, 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 5745 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3917722970 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:19:30.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3917722970 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.5745 192.168.0.1:0/3917722970", 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/3917722970", 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 16, 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 38, 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:19:30.981 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:19:30.982 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:19:30.982 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:19:30.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:30.987 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:19:30.987 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:31.003 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:19:31.003 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:31.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:31.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:31.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-12-08T08:19:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.223+0000 7f3615c31640 1 Processor -- start 2023-12-08T08:19:31.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.223+0000 7f3615c31640 1 -- start start 2023-12-08T08:19:31.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f3615c31640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f361015e7c0 0x7f36100b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f3615c31640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f36100b1a70 0x7f361015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f3615c31640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361015fd70 con 0x7f361015f3c0 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f3615c31640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100d1cc0 con 0x7f361015e7c0 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f3615c31640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100b1720 con 0x7f36100b1a70 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f360f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f361015e7c0 0x7f36100b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f360f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f361015e7c0 0x7f36100b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42718/0 (socket says 172.21.15.50:42718) 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.224+0000 7f360f7fe640 1 -- 172.21.15.50:0/4029424876 learned_addr learned my addr 172.21.15.50:0/4029424876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.225+0000 7f360effd640 1 --2- 172.21.15.50:0/4029424876 >> v2:172.21.15.170:3300/0 conn(0x7f36100b1a70 0x7f361015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.225+0000 7f360f7fe640 1 -- 172.21.15.50:0/4029424876 >> v2:172.21.15.170:3300/0 conn(0x7f36100b1a70 msgr2=0x7f361015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.225+0000 7f360f7fe640 1 --2- 172.21.15.50:0/4029424876 >> v2:172.21.15.170:3300/0 conn(0x7f36100b1a70 0x7f361015ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.225+0000 7f360f7fe640 1 -- 172.21.15.50:0/4029424876 >> v1:172.21.15.170:6789/0 conn(0x7f361015f3c0 legacy=0x7f36100b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.225+0000 7f360f7fe640 1 -- 172.21.15.50:0/4029424876 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100d19e0 con 0x7f361015e7c0 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.225+0000 7f360f7fe640 1 --2- 172.21.15.50:0/4029424876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100b2260 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f36100ce2f0 tx=0x7f360002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece2a59974452ffe server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.225+0000 7f360e7fc640 1 -- 172.21.15.50:0/4029424876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000317e0 con 0x7f361015e7c0 2023-12-08T08:19:31.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f360e7fc640 1 -- 172.21.15.50:0/4029424876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3600031940 con 0x7f361015e7c0 2023-12-08T08:19:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f360e7fc640 1 -- 172.21.15.50:0/4029424876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600031cd0 con 0x7f361015e7c0 2023-12-08T08:19:31.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 -- 172.21.15.50:0/4029424876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 msgr2=0x7f36100b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 --2- 172.21.15.50:0/4029424876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100b2260 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f36100ce2f0 tx=0x7f360002b880 comp rx=0 tx=0).stop 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 -- 172.21.15.50:0/4029424876 shutdown_connections 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 --2- 172.21.15.50:0/4029424876 >> v2:172.21.15.170:3300/0 conn(0x7f36100b1a70 0x7f361015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 --2- 172.21.15.50:0/4029424876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100b2260 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 -- 172.21.15.50:0/4029424876 >> 172.21.15.50:0/4029424876 conn(0x7f36100d0d90 msgr2=0x7f36100d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 -- 172.21.15.50:0/4029424876 shutdown_connections 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.226+0000 7f3615c31640 1 -- 172.21.15.50:0/4029424876 wait complete. 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.227+0000 7f3615c31640 1 Processor -- start 2023-12-08T08:19:31.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f3615c31640 1 -- start start 2023-12-08T08:19:31.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f3615c31640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36100b1a70 0x7f3610157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f3615c31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f3615c31640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f361015f3c0 0x7f361006cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f3615c31640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361006bf50 con 0x7f361015e7c0 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f3615c31640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361006c230 con 0x7f36100b1a70 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f3615c31640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361006c510 con 0x7f361015f3c0 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f360effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f360effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42732/0 (socket says 172.21.15.50:42732) 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.228+0000 7f360effd640 1 -- 172.21.15.50:0/3009536314 learned_addr learned my addr 172.21.15.50:0/3009536314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360f7fe640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36100b1a70 0x7f3610157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360ffff640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f361015f3c0 0x7f361006cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360effd640 1 -- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f361015f3c0 msgr2=0x7f361006cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360effd640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f361015f3c0 0x7f361006cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360effd640 1 -- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36100b1a70 msgr2=0x7f3610157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360effd640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36100b1a70 0x7f3610157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360effd640 1 -- 172.21.15.50:0/3009536314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36000094d0 con 0x7f361015e7c0 2023-12-08T08:19:31.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360f7fe640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36100b1a70 0x7f3610157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f360effd640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100c5ac0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f360400d5d0 tx=0x7f360400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f35f7fff640 1 -- 172.21.15.50:0/3009536314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604004240 con 0x7f361015e7c0 2023-12-08T08:19:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f35f7fff640 1 -- 172.21.15.50:0/3009536314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36040043a0 con 0x7f361015e7c0 2023-12-08T08:19:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361006c7f0 con 0x7f361015e7c0 2023-12-08T08:19:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f35f7fff640 1 -- 172.21.15.50:0/3009536314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604003830 con 0x7f361015e7c0 2023-12-08T08:19:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.229+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36100c6000 con 0x7f361015e7c0 2023-12-08T08:19:31.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.230+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3610067540 con 0x7f361015e7c0 2023-12-08T08:19:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.231+0000 7f35f7fff640 1 -- 172.21.15.50:0/3009536314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3604003990 con 0x7f361015e7c0 2023-12-08T08:19:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.231+0000 7f35f7fff640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35fc06ae40 0x7f35fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.231+0000 7f35f7fff640 1 -- 172.21.15.50:0/3009536314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f36040897c0 con 0x7f361015e7c0 2023-12-08T08:19:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.231+0000 7f360f7fe640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35fc06ae40 0x7f35fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.232+0000 7f360f7fe640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35fc06ae40 0x7f35fc06d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3600036000 tx=0x7f360003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.235+0000 7f35f7fff640 1 -- 172.21.15.50:0/3009536314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36040547c0 con 0x7f361015e7c0 2023-12-08T08:19:31.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.410+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7f3610072520 con 0x7f361015e7c0 2023-12-08T08:19:31.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.839+0000 7f35f7fff640 1 -- 172.21.15.50:0/3009536314 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v39) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3604057de0 con 0x7f361015e7c0 2023-12-08T08:19:31.841 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'data_new' created 2023-12-08T08:19:31.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.842+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35fc06ae40 msgr2=0x7f35fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.842+0000 7f3615c31640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35fc06ae40 0x7f35fc06d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3600036000 tx=0x7f360003d040 comp rx=0 tx=0).stop 2023-12-08T08:19:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.842+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 msgr2=0x7f36100c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.842+0000 7f3615c31640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100c5ac0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f360400d5d0 tx=0x7f360400da90 comp rx=0 tx=0).stop 2023-12-08T08:19:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.843+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 shutdown_connections 2023-12-08T08:19:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.843+0000 7f3615c31640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f35fc06ae40 0x7f35fc06d300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.843+0000 7f3615c31640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f361015e7c0 0x7f36100c5ac0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.843+0000 7f3615c31640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f361015f3c0 0x7f361006cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.843+0000 7f3615c31640 1 --2- 172.21.15.50:0/3009536314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36100b1a70 0x7f3610157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.843+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 >> 172.21.15.50:0/3009536314 conn(0x7f36100d0d90 msgr2=0x7f36100cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.843+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 shutdown_connections 2023-12-08T08:19:31.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.844+0000 7f3615c31640 1 -- 172.21.15.50:0/3009536314 wait complete. 2023-12-08T08:19:31.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-12-08T08:19:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.969+0000 7f3a7ec9b640 1 Processor -- start 2023-12-08T08:19:31.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.969+0000 7f3a7ec9b640 1 -- start start 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7ec9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a7815d120 0x7f3a780ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7ec9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3a780ad290 0x7f3a7806ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7ec9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7815d500 con 0x7f3a7806b4e0 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7ec9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a780ad7c0 con 0x7f3a7815d120 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7ec9b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a780b2f80 con 0x7f3a780ad290 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7ca37640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a7815d120 0x7f3a780ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7d238640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3a7806b4e0 0x7f3a780b3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60400/0 (socket says 172.21.15.50:60400) 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7d238640 1 -- 172.21.15.50:0/2677603695 learned_addr learned my addr 172.21.15.50:0/2677603695 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:31.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.970+0000 7f3a7ca37640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a7815d120 0x7f3a780ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42740/0 (socket says 172.21.15.50:42740) 2023-12-08T08:19:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.971+0000 7f3a7ca37640 1 -- 172.21.15.50:0/2677603695 >> v2:172.21.15.170:3300/0 conn(0x7f3a780ad290 msgr2=0x7f3a7806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.971+0000 7f3a7ca37640 1 --2- 172.21.15.50:0/2677603695 >> v2:172.21.15.170:3300/0 conn(0x7f3a780ad290 0x7f3a7806ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.971+0000 7f3a7ca37640 1 -- 172.21.15.50:0/2677603695 >> v1:172.21.15.50:6789/0 conn(0x7f3a7806b4e0 legacy=0x7f3a780b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.971+0000 7f3a777fe640 1 -- 172.21.15.50:0/2677603695 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424441744 0 0) 0x7f3a7815d500 con 0x7f3a7806b4e0 2023-12-08T08:19:31.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.971+0000 7f3a7ca37640 1 -- 172.21.15.50:0/2677603695 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780b3260 con 0x7f3a7815d120 2023-12-08T08:19:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.971+0000 7f3a7ca37640 1 --2- 172.21.15.50:0/2677603695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a780ac880 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009d90 tx=0x7f3a7002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84c14d034a78001 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a777fe640 1 -- 172.21.15.50:0/2677603695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7002cc60 con 0x7f3a7815d120 2023-12-08T08:19:31.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a777fe640 1 -- 172.21.15.50:0/2677603695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7002cdc0 con 0x7f3a7815d120 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a777fe640 1 -- 172.21.15.50:0/2677603695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70034660 con 0x7f3a7815d120 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2677603695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 msgr2=0x7f3a780ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2677603695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a780ac880 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009d90 tx=0x7f3a7002beb0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2677603695 shutdown_connections 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2677603695 >> v2:172.21.15.170:3300/0 conn(0x7f3a780ad290 0x7f3a7806ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2677603695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a780ac880 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2677603695 >> 172.21.15.50:0/2677603695 conn(0x7f3a78070960 msgr2=0x7f3a78070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2677603695 shutdown_connections 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.972+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2677603695 wait complete. 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.973+0000 7f3a7ec9b640 1 Processor -- start 2023-12-08T08:19:31.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.973+0000 7f3a7ec9b640 1 -- start start 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7ec9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a7806b4e0 0x7f3a78145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7ec9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a780ad290 0x7f3a781524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7ec9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a781509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7ec9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a781520a0 con 0x7f3a7815d120 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7ec9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78146510 con 0x7f3a7806b4e0 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7ec9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78151420 con 0x7f3a780ad290 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7d238640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a781509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7d238640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a781509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42742/0 (socket says 172.21.15.50:42742) 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.974+0000 7f3a7d238640 1 -- 172.21.15.50:0/2871199926 learned_addr learned my addr 172.21.15.50:0/2871199926 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7d238640 1 -- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a780ad290 msgr2=0x7f3a781524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7d238640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a780ad290 0x7f3a781524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7d238640 1 -- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a7806b4e0 msgr2=0x7f3a78145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7d238640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a7806b4e0 0x7f3a78145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7d238640 1 -- 172.21.15.50:0/2871199926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a70009a70 con 0x7f3a7815d120 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7d238640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a781509a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c450 tx=0x7f3a6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a757fa640 1 -- 172.21.15.50:0/2871199926 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a680074e0 con 0x7f3a7815d120 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a757fa640 1 -- 172.21.15.50:0/2871199926 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68007660 con 0x7f3a7815d120 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a78151700 con 0x7f3a7815d120 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a757fa640 1 -- 172.21.15.50:0/2871199926 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68004a20 con 0x7f3a7815d120 2023-12-08T08:19:31.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.975+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a78151cc0 con 0x7f3a7815d120 2023-12-08T08:19:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.976+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a78067430 con 0x7f3a7815d120 2023-12-08T08:19:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.977+0000 7f3a757fa640 1 -- 172.21.15.50:0/2871199926 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a68004b80 con 0x7f3a7815d120 2023-12-08T08:19:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.977+0000 7f3a757fa640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a6406ae40 0x7f3a6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.977+0000 7f3a757fa640 1 -- 172.21.15.50:0/2871199926 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6392+0+0 (secure 0 0 0) 0x7f3a68088d60 con 0x7f3a7815d120 2023-12-08T08:19:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.978+0000 7f3a7ca37640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a6406ae40 0x7f3a6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:31.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.978+0000 7f3a7ca37640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a6406ae40 0x7f3a6406d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a70036000 tx=0x7f3a7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:31.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:31.982+0000 7f3a757fa640 1 -- 172.21.15.50:0/2871199926 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a68053b60 con 0x7f3a7815d120 2023-12-08T08:19:32.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.198+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f3a781521e0 con 0x7f3a7815d120 2023-12-08T08:19:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.840+0000 7f3a757fa640 1 -- 172.21.15.50:0/2871199926 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v17) v1 ==== 131+0+0 (secure 0 0 0) 0x7f3a781521e0 con 0x7f3a7815d120 2023-12-08T08:19:32.843 INFO:teuthology.orchestra.run.smithi050.stderr:added data pool 7 to fsmap 2023-12-08T08:19:32.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a6406ae40 msgr2=0x7f3a6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:32.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a6406ae40 0x7f3a6406d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a70036000 tx=0x7f3a7002e000 comp rx=0 tx=0).stop 2023-12-08T08:19:32.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 msgr2=0x7f3a781509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:32.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a781509a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c450 tx=0x7f3a6800c910 comp rx=0 tx=0).stop 2023-12-08T08:19:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 shutdown_connections 2023-12-08T08:19:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a6406ae40 0x7f3a6406d300 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a7815d120 0x7f3a781509a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a780ad290 0x7f3a781524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 --2- 172.21.15.50:0/2871199926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a7806b4e0 0x7f3a78145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.845+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 >> 172.21.15.50:0/2871199926 conn(0x7f3a78070960 msgr2=0x7f3a7806ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:32.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.846+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 shutdown_connections 2023-12-08T08:19:32.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.846+0000 7f3a7ec9b640 1 -- 172.21.15.50:0/2871199926 wait complete. 2023-12-08T08:19:32.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:19:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.980+0000 7f82fd778640 1 Processor -- start 2023-12-08T08:19:32.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.980+0000 7f82fd778640 1 -- start start 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82fd778640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 0x7f82f80d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82fd778640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f82f80b3bf0 0x7f82f80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82fd778640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f80cdc20 con 0x7f82f80b3340 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82fd778640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80d11d0 con 0x7f82f80b3bf0 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82fd778640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80d3a60 con 0x7f82f80d1d00 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82f6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f82f80b3340 0x7f82f80d15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60412/0 (socket says 172.21.15.50:60412) 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82f6ffd640 1 -- 172.21.15.50:0/3543543257 learned_addr learned my addr 172.21.15.50:0/3543543257 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82f67fc640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 0x7f82f80d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82f77fe640 1 --2- 172.21.15.50:0/3543543257 >> v2:172.21.15.170:3300/0 conn(0x7f82f80b3bf0 0x7f82f80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890918733 0 0) 0x7f82f80cdc20 con 0x7f82f80b3340 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.981+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e4003520 con 0x7f82f80b3340 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805309404 0 0) 0x7f82e4003520 con 0x7f82f80b3340 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 msgr2=0x7f82f80d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:32.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 0x7f82f80d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 >> v2:172.21.15.170:3300/0 conn(0x7f82f80b3bf0 msgr2=0x7f82f80b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 --2- 172.21.15.50:0/3543543257 >> v2:172.21.15.170:3300/0 conn(0x7f82f80b3bf0 0x7f82f80b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80d3d40 con 0x7f82f80b3340 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f82f0001670 con 0x7f82f80b3340 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 >> v1:172.21.15.50:6789/0 conn(0x7f82f80b3340 legacy=0x7f82f80d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4003970 0x7f82e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 0x7f82e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4004d00 0x7f82e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80d11d0 con 0x7f82e4003970 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80d3a60 con 0x7f82e4004d00 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e400b9b0 con 0x7f82f80d1d00 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f6ffd640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4003970 0x7f82e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f77fe640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4004d00 0x7f82e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f67fc640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 0x7f82e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f6ffd640 1 -- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 msgr2=0x7f82e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f6ffd640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f80d1d00 0x7f82e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f6ffd640 1 -- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4004d00 msgr2=0x7f82e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f6ffd640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4004d00 0x7f82e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.982+0000 7f82f6ffd640 1 -- 172.21.15.50:0/3543543257 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4003520 con 0x7f82e4003970 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.983+0000 7f82f6ffd640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4003970 0x7f82e4003d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f82f000c240 tx=0x7f82e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c469db7af1ecbc84 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.983+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f002cb00 con 0x7f82e4003970 2023-12-08T08:19:32.989 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.983+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f002cc60 con 0x7f82e4003970 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.983+0000 7f82f5ffb640 1 -- 172.21.15.50:0/3543543257 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0005af0 con 0x7f82e4003970 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.984+0000 7f82fd778640 1 -- 172.21.15.50:0/3543543257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4003970 msgr2=0x7f82e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.984+0000 7f82fd778640 1 --2- 172.21.15.50:0/3543543257 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4003970 0x7f82e4003d90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f82f000c240 tx=0x7f82e40057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.984+0000 7f82f77fe640 1 -- 172.21.15.50:0/3543543257 reap_dead start 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.984+0000 7f82fd778640 1 -- 172.21.15.50:0/3543543257 shutdown_connections 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.984+0000 7f82fd778640 1 -- 172.21.15.50:0/3543543257 >> 172.21.15.50:0/3543543257 conn(0x7f82f809c2f0 msgr2=0x7f82f80d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.984+0000 7f82fd778640 1 -- 172.21.15.50:0/3543543257 shutdown_connections 2023-12-08T08:19:32.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.984+0000 7f82fd778640 1 -- 172.21.15.50:0/3543543257 wait complete. 2023-12-08T08:19:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.985+0000 7f82fd778640 1 Processor -- start 2023-12-08T08:19:32.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.985+0000 7f82fd778640 1 -- start start 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82fd778640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4003970 0x7f82f80c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82fd778640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f81f3210 0x7f82f81f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82fd778640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f81508b0 0x7f82f8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82fd778640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f815f710 con 0x7f82f81f3210 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82fd778640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80c9d90 con 0x7f82e4003970 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82fd778640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81512a0 con 0x7f82f81508b0 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f81f3210 0x7f82f81f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f81f3210 0x7f82f81f3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42756/0 (socket says 172.21.15.50:42756) 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 -- 172.21.15.50:0/2947807540 learned_addr learned my addr 172.21.15.50:0/2947807540 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f6ffd640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4003970 0x7f82f80c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f77fe640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f81508b0 0x7f82f8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 -- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f81508b0 msgr2=0x7f82f8150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:32.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f81508b0 0x7f82f8150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 -- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4003970 msgr2=0x7f82f80c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4003970 0x7f82f80c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 -- 172.21.15.50:0/2947807540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f814f810 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f77fe640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f81508b0 0x7f82f8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82f67fc640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f81f3210 0x7f82f81f3670 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f82e00119a0 tx=0x7f82e0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82ef7fe640 1 -- 172.21.15.50:0/2947807540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000faf0 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.986+0000 7f82ef7fe640 1 -- 172.21.15.50:0/2947807540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000fc50 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.987+0000 7f82ef7fe640 1 -- 172.21.15.50:0/2947807540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0014440 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.987+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f814faf0 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.987+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f81500b0 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.987+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f8067430 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.988+0000 7f82ef7fe640 1 -- 172.21.15.50:0/2947807540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82e00145a0 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.988+0000 7f82ef7fe640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f82d806ae40 0x7f82d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.988+0000 7f82ef7fe640 1 -- 172.21.15.50:0/2947807540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f82e008a260 con 0x7f82f81f3210 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.989+0000 7f82f6ffd640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f82d806ae40 0x7f82d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:32.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.989+0000 7f82f6ffd640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f82d806ae40 0x7f82d806d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f82f0034000 tx=0x7f82f0007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:32.996 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:32.993+0000 7f82ef7fe640 1 -- 172.21.15.50:0/2947807540 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82e0054fa0 con 0x7f82f81f3210 2023-12-08T08:19:33.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.206+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82f80b2e30 con 0x7f82f81f3210 2023-12-08T08:19:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.206+0000 7f82ef7fe640 1 -- 172.21.15.50:0/2947807540 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f82e00585c0 con 0x7f82f81f3210 2023-12-08T08:19:33.209 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:33.209 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:19.820822+0000","modified":"2023-12-08T08:19:32.200005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/209897774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":209897774},{"type":"v1","addr":"172.21.15.50:6835","nonce":209897774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:19:33.209 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f82d806ae40 msgr2=0x7f82d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f82d806ae40 0x7f82d806d300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f82f0034000 tx=0x7f82f0007000 comp rx=0 tx=0).stop 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f81f3210 msgr2=0x7f82f81f3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f81f3210 0x7f82f81f3670 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f82e00119a0 tx=0x7f82e0011e60 comp rx=0 tx=0).stop 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 shutdown_connections 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f82d806ae40 0x7f82d806d300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82f81f3210 0x7f82f81f3670 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82f81508b0 0x7f82f8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 --2- 172.21.15.50:0/2947807540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82e4003970 0x7f82f80c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 >> 172.21.15.50:0/2947807540 conn(0x7f82f809c2f0 msgr2=0x7f82f80b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:33.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 shutdown_connections 2023-12-08T08:19:33.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.208+0000 7f82fd778640 1 -- 172.21.15.50:0/2947807540 wait complete. 2023-12-08T08:19:33.221 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:33.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.325+0000 7f012ae75640 1 Processor -- start 2023-12-08T08:19:33.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.325+0000 7f012ae75640 1 -- start start 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f012ae75640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0124159a10 0x7f01240b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f012ae75640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0124071dc0 0x7f01240b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f012ae75640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01240b1cf0 0x7f012406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f012ae75640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012406dae0 con 0x7f01240b1cf0 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f012ae75640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01240b3fa0 con 0x7f0124159a10 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f012ae75640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01240ae2e0 con 0x7f0124071dc0 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f0129412640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01240b1cf0 0x7f012406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f0129412640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f01240b1cf0 0x7f012406c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42758/0 (socket says 172.21.15.50:42758) 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f0129412640 1 -- 172.21.15.50:0/619700128 learned_addr learned my addr 172.21.15.50:0/619700128 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f0128c11640 1 --2- 172.21.15.50:0/619700128 >> v2:172.21.15.170:3300/0 conn(0x7f0124159a10 0x7f01240b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.326+0000 7f0123fff640 1 --2- 172.21.15.50:0/619700128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0124071dc0 0x7f01240b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.327+0000 7f0129412640 1 -- 172.21.15.50:0/619700128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0124071dc0 msgr2=0x7f01240b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.327+0000 7f0129412640 1 --2- 172.21.15.50:0/619700128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0124071dc0 0x7f01240b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.327+0000 7f0129412640 1 -- 172.21.15.50:0/619700128 >> v2:172.21.15.170:3300/0 conn(0x7f0124159a10 msgr2=0x7f01240b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.327+0000 7f0129412640 1 --2- 172.21.15.50:0/619700128 >> v2:172.21.15.170:3300/0 conn(0x7f0124159a10 0x7f01240b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.327+0000 7f0129412640 1 -- 172.21.15.50:0/619700128 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012406dd30 con 0x7f01240b1cf0 2023-12-08T08:19:33.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.327+0000 7f0123fff640 1 --2- 172.21.15.50:0/619700128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0124071dc0 0x7f01240b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:33.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.327+0000 7f0129412640 1 --2- 172.21.15.50:0/619700128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01240b1cf0 0x7f012406c0c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0124066b10 tx=0x7f010c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e735bac35703e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f01237fe640 1 -- 172.21.15.50:0/619700128 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c031750 con 0x7f01240b1cf0 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f01237fe640 1 -- 172.21.15.50:0/619700128 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c0318b0 con 0x7f01240b1cf0 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f01237fe640 1 -- 172.21.15.50:0/619700128 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c031c40 con 0x7f01240b1cf0 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 -- 172.21.15.50:0/619700128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01240b1cf0 msgr2=0x7f012406c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 --2- 172.21.15.50:0/619700128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01240b1cf0 0x7f012406c0c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0124066b10 tx=0x7f010c02b7f0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 -- 172.21.15.50:0/619700128 shutdown_connections 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 --2- 172.21.15.50:0/619700128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f01240b1cf0 0x7f012406c0c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 --2- 172.21.15.50:0/619700128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0124071dc0 0x7f01240b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 --2- 172.21.15.50:0/619700128 >> v2:172.21.15.170:3300/0 conn(0x7f0124159a10 0x7f01240b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 -- 172.21.15.50:0/619700128 >> 172.21.15.50:0/619700128 conn(0x7f01240b09f0 msgr2=0x7f01240b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 -- 172.21.15.50:0/619700128 shutdown_connections 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.328+0000 7f012ae75640 1 -- 172.21.15.50:0/619700128 wait complete. 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.329+0000 7f012ae75640 1 Processor -- start 2023-12-08T08:19:33.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.329+0000 7f012ae75640 1 -- start start 2023-12-08T08:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f012ae75640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0124071dc0 0x7f01240c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f012ae75640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01240b1cf0 0x7f012414f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f012ae75640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0124159a10 0x7f012414fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f012ae75640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012415b760 con 0x7f0124071dc0 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f012ae75640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0124150040 con 0x7f0124159a10 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f012ae75640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012415aae0 con 0x7f01240b1cf0 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f0128c11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0124071dc0 0x7f01240c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f0128c11640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0124071dc0 0x7f01240c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42772/0 (socket says 172.21.15.50:42772) 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f0128c11640 1 -- 172.21.15.50:0/1191190863 learned_addr learned my addr 172.21.15.50:0/1191190863 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f0129412640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0124159a10 0x7f012414fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.330+0000 7f0123fff640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01240b1cf0 0x7f012414f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f0128c11640 1 -- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01240b1cf0 msgr2=0x7f012414f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f0128c11640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01240b1cf0 0x7f012414f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f0128c11640 1 -- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0124159a10 msgr2=0x7f012414fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f0128c11640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0124159a10 0x7f012414fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f0128c11640 1 -- 172.21.15.50:0/1191190863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0094d0 con 0x7f0124071dc0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f0128c11640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0124071dc0 0x7f01240c96c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f011c007d80 tx=0x7f011c00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f01217fa640 1 -- 172.21.15.50:0/1191190863 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00f040 con 0x7f0124071dc0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f01217fa640 1 -- 172.21.15.50:0/1191190863 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c00dda0 con 0x7f0124071dc0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012415adc0 con 0x7f0124071dc0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f01217fa640 1 -- 172.21.15.50:0/1191190863 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c008680 con 0x7f0124071dc0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.331+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012415b380 con 0x7f0124071dc0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.332+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0124067430 con 0x7f0124071dc0 2023-12-08T08:19:33.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.332+0000 7f01217fa640 1 -- 172.21.15.50:0/1191190863 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f011c0087e0 con 0x7f0124071dc0 2023-12-08T08:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.333+0000 7f01217fa640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f010406ae40 0x7f010406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.333+0000 7f01217fa640 1 -- 172.21.15.50:0/1191190863 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f011c089c40 con 0x7f0124071dc0 2023-12-08T08:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.333+0000 7f0123fff640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f010406ae40 0x7f010406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.334+0000 7f0123fff640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f010406ae40 0x7f010406d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f01240c93a0 tx=0x7f0114008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.337+0000 7f01217fa640 1 -- 172.21.15.50:0/1191190863 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f011c054ad0 con 0x7f0124071dc0 2023-12-08T08:19:33.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.512+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f012415b9d0 con 0x7f0124071dc0 2023-12-08T08:19:33.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.514+0000 7f01217fa640 1 -- 172.21.15.50:0/1191190863 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18566 (secure 0 0 0) 0x7f011c0580f0 con 0x7f0124071dc0 2023-12-08T08:19:33.516 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:33.517 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":40,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:32.199776+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f010406ae40 msgr2=0x7f010406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f010406ae40 0x7f010406d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f01240c93a0 tx=0x7f0114008040 comp rx=0 tx=0).stop 2023-12-08T08:19:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0124071dc0 msgr2=0x7f01240c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0124071dc0 0x7f01240c96c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f011c007d80 tx=0x7f011c00d490 comp rx=0 tx=0).stop 2023-12-08T08:19:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 shutdown_connections 2023-12-08T08:19:33.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f010406ae40 0x7f010406d300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0124159a10 0x7f012414fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01240b1cf0 0x7f012414f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 --2- 172.21.15.50:0/1191190863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0124071dc0 0x7f01240c96c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 >> 172.21.15.50:0/1191190863 conn(0x7f01240b09f0 msgr2=0x7f01240b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 shutdown_connections 2023-12-08T08:19:33.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.516+0000 7f012ae75640 1 -- 172.21.15.50:0/1191190863 wait complete. 2023-12-08T08:19:33.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:33.530 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-12-08T08:19:33.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:33.551 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-12-08T08:19:33.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-12-08T08:19:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.766+0000 7f5cb73d7640 1 Processor -- start 2023-12-08T08:19:33.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.767+0000 7f5cb73d7640 1 -- start start 2023-12-08T08:19:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.767+0000 7f5cb73d7640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cb01608a0 0x7f5cb00d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.767+0000 7f5cb73d7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5cb00d1c90 0x7f5cb00c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.767+0000 7f5cb73d7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00c6af0 con 0x7f5cb0160c80 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.767+0000 7f5cb73d7640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb00d12c0 con 0x7f5cb01608a0 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.767+0000 7f5cb73d7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb00d0500 con 0x7f5cb00d1c90 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.768+0000 7f5cb5173640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cb01608a0 0x7f5cb00d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.768+0000 7f5cb5173640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cb01608a0 0x7f5cb00d0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42788/0 (socket says 172.21.15.50:42788) 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.768+0000 7f5cb5173640 1 -- 172.21.15.50:0/1547674784 learned_addr learned my addr 172.21.15.50:0/1547674784 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.768+0000 7f5cb5173640 1 -- 172.21.15.50:0/1547674784 >> v2:172.21.15.170:3300/0 conn(0x7f5cb00d1c90 msgr2=0x7f5cb00c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.768+0000 7f5cb5173640 1 --2- 172.21.15.50:0/1547674784 >> v2:172.21.15.170:3300/0 conn(0x7f5cb00d1c90 0x7f5cb00c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.768+0000 7f5cb5173640 1 -- 172.21.15.50:0/1547674784 >> v1:172.21.15.170:6789/0 conn(0x7f5cb0160c80 legacy=0x7f5cb00d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:33.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.768+0000 7f5cb5173640 1 -- 172.21.15.50:0/1547674784 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00d07e0 con 0x7f5cb01608a0 2023-12-08T08:19:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb5173640 1 --2- 172.21.15.50:0/1547674784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb00d0d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00b9020 tx=0x7f5cac02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ccb2c662a8aedf server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5ca7fff640 1 -- 172.21.15.50:0/1547674784 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac031750 con 0x7f5cb01608a0 2023-12-08T08:19:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5ca7fff640 1 -- 172.21.15.50:0/1547674784 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac0318b0 con 0x7f5cb01608a0 2023-12-08T08:19:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5ca7fff640 1 -- 172.21.15.50:0/1547674784 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac031c40 con 0x7f5cb01608a0 2023-12-08T08:19:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1547674784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 msgr2=0x7f5cb00d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1547674784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb00d0d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00b9020 tx=0x7f5cac02b7f0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1547674784 shutdown_connections 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1547674784 >> v2:172.21.15.170:3300/0 conn(0x7f5cb00d1c90 0x7f5cb00c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1547674784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb00d0d80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1547674784 >> 172.21.15.50:0/1547674784 conn(0x7f5cb00d2fa0 msgr2=0x7f5cb00d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1547674784 shutdown_connections 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.769+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1547674784 wait complete. 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 Processor -- start 2023-12-08T08:19:33.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 -- start start 2023-12-08T08:19:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb00d1c90 0x7f5cb01574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb0159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0160c80 0x7f5cb0153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb01f65b0 con 0x7f5cb01608a0 2023-12-08T08:19:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb01f6800 con 0x7f5cb0160c80 2023-12-08T08:19:33.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb73d7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb01f6ae0 con 0x7f5cb00d1c90 2023-12-08T08:19:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb4972640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb0159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb4972640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb0159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42800/0 (socket says 172.21.15.50:42800) 2023-12-08T08:19:33.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.771+0000 7f5cb4972640 1 -- 172.21.15.50:0/1134324917 learned_addr learned my addr 172.21.15.50:0/1134324917 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:33.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb5173640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb00d1c90 0x7f5cb01574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb5974640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0160c80 0x7f5cb0153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb4972640 1 -- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb00d1c90 msgr2=0x7f5cb01574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb4972640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb00d1c90 0x7f5cb01574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb4972640 1 -- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0160c80 msgr2=0x7f5cb0153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb4972640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0160c80 0x7f5cb0153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb4972640 1 -- 172.21.15.50:0/1134324917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0094d0 con 0x7f5cb01608a0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb5173640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb00d1c90 0x7f5cb01574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb5974640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0160c80 0x7f5cb0153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb4972640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb0159200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000c410 tx=0x7f5ca000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5ca5ffb640 1 -- 172.21.15.50:0/1134324917 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00035f0 con 0x7f5cb01608a0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5ca5ffb640 1 -- 172.21.15.50:0/1134324917 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca0003750 con 0x7f5cb01608a0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb01f6dc0 con 0x7f5cb01608a0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5ca5ffb640 1 -- 172.21.15.50:0/1134324917 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0003b40 con 0x7f5cb01608a0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.772+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb01f7380 con 0x7f5cb01608a0 2023-12-08T08:19:33.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.773+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb0067430 con 0x7f5cb01608a0 2023-12-08T08:19:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.774+0000 7f5ca5ffb640 1 -- 172.21.15.50:0/1134324917 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ca0003ca0 con 0x7f5cb01608a0 2023-12-08T08:19:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.774+0000 7f5ca5ffb640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9406ae70 0x7f5c9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.774+0000 7f5ca5ffb640 1 -- 172.21.15.50:0/1134324917 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f5ca0088a40 con 0x7f5cb01608a0 2023-12-08T08:19:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.774+0000 7f5cb5173640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9406ae70 0x7f5c9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:33.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.775+0000 7f5cb5173640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9406ae70 0x7f5c9406d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5cac035000 tx=0x7f5cac008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:33.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:33.778+0000 7f5ca5ffb640 1 -- 172.21.15.50:0/1134324917 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ca008ae60 con 0x7f5cb01608a0 2023-12-08T08:19:34.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.029+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f5cb00d2b50 con 0x7f5cb01608a0 2023-12-08T08:19:34.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.030+0000 7f5ca5ffb640 1 -- 172.21.15.50:0/1134324917 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) v1 ==== 210+0+167 (secure 0 0 0) 0x7f5ca00170c0 con 0x7f5cb01608a0 2023-12-08T08:19:34.033 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:19:34.033 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:19:34.033 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow rw" 2023-12-08T08:19:34.033 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:19:34.033 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-12-08T08:19:34.033 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:19:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9406ae70 msgr2=0x7f5c9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9406ae70 0x7f5c9406d330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5cac035000 tx=0x7f5cac008030 comp rx=0 tx=0).stop 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 msgr2=0x7f5cb0159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb0159200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000c410 tx=0x7f5ca000c8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 shutdown_connections 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9406ae70 0x7f5c9406d330 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01608a0 0x7f5cb0159200 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb0160c80 0x7f5cb0153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 --2- 172.21.15.50:0/1134324917 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb00d1c90 0x7f5cb01574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 >> 172.21.15.50:0/1134324917 conn(0x7f5cb00d2fa0 msgr2=0x7f5cb015e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 shutdown_connections 2023-12-08T08:19:34.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.033+0000 7f5cb73d7640 1 -- 172.21.15.50:0/1134324917 wait complete. 2023-12-08T08:19:34.046 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:19:34.046 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:34.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:34.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.209+0000 7f524e656640 1 Processor -- start 2023-12-08T08:19:34.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.209+0000 7f524e656640 1 -- start start 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524e656640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f524806d940 0x7f52480b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524e656640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52480b3d30 0x7f524815d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524e656640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5248161d90 con 0x7f5248160f30 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524e656640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524806c690 con 0x7f52480b3d30 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524e656640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524806c8a0 con 0x7f524806d940 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524cbf3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52480b3d30 0x7f524815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524cbf3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f52480b3d30 0x7f524815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42816/0 (socket says 172.21.15.50:42816) 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524cbf3640 1 -- 172.21.15.50:0/433582665 learned_addr learned my addr 172.21.15.50:0/433582665 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f52477fe640 1 --2- 172.21.15.50:0/433582665 >> v2:172.21.15.170:3300/0 conn(0x7f524806d940 0x7f52480b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524cbf3640 1 -- 172.21.15.50:0/433582665 >> v2:172.21.15.170:3300/0 conn(0x7f524806d940 msgr2=0x7f52480b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524cbf3640 1 --2- 172.21.15.50:0/433582665 >> v2:172.21.15.170:3300/0 conn(0x7f524806d940 0x7f52480b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524cbf3640 1 -- 172.21.15.50:0/433582665 >> v1:172.21.15.170:6789/0 conn(0x7f5248160f30 legacy=0x7f5248161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f524cbf3640 1 -- 172.21.15.50:0/433582665 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524806cb80 con 0x7f52480b3d30 2023-12-08T08:19:34.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.210+0000 7f52477fe640 1 --2- 172.21.15.50:0/433582665 >> v2:172.21.15.170:3300/0 conn(0x7f524806d940 0x7f52480b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.211+0000 7f524cbf3640 1 --2- 172.21.15.50:0/433582665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f524815d570 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5248072f50 tx=0x7f524002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51442ff0623f46fa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.211+0000 7f5246ffd640 1 -- 172.21.15.50:0/433582665 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524002cb10 con 0x7f52480b3d30 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.211+0000 7f5246ffd640 1 -- 172.21.15.50:0/433582665 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524002cc70 con 0x7f52480b3d30 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.211+0000 7f5246ffd640 1 -- 172.21.15.50:0/433582665 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400343f0 con 0x7f52480b3d30 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 -- 172.21.15.50:0/433582665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 msgr2=0x7f524815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 --2- 172.21.15.50:0/433582665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f524815d570 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5248072f50 tx=0x7f524002bf70 comp rx=0 tx=0).stop 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 -- 172.21.15.50:0/433582665 shutdown_connections 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 --2- 172.21.15.50:0/433582665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f524815d570 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 --2- 172.21.15.50:0/433582665 >> v2:172.21.15.170:3300/0 conn(0x7f524806d940 0x7f52480b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 -- 172.21.15.50:0/433582665 >> 172.21.15.50:0/433582665 conn(0x7f52480b09f0 msgr2=0x7f52480b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 -- 172.21.15.50:0/433582665 shutdown_connections 2023-12-08T08:19:34.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.212+0000 7f524e656640 1 -- 172.21.15.50:0/433582665 wait complete. 2023-12-08T08:19:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.213+0000 7f524e656640 1 Processor -- start 2023-12-08T08:19:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.213+0000 7f524e656640 1 -- start start 2023-12-08T08:19:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f524e656640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f524806d940 0x7f5248153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f524e656640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f52480aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f524e656640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5248160f30 0x7f52480af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f524e656640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52481544f0 con 0x7f52480b3d30 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f524e656640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52481547d0 con 0x7f524806d940 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f524e656640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5248154ab0 con 0x7f5248160f30 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f52480aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f52480aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42832/0 (socket says 172.21.15.50:42832) 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 -- 172.21.15.50:0/3810270609 learned_addr learned my addr 172.21.15.50:0/3810270609 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f5247fff640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f524806d940 0x7f5248153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f524cbf3640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5248160f30 0x7f52480af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 -- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5248160f30 msgr2=0x7f52480af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5248160f30 0x7f52480af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 -- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f524806d940 msgr2=0x7f5248153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f524806d940 0x7f5248153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 -- 172.21.15.50:0/3810270609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5240009b30 con 0x7f52480b3d30 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.214+0000 7f52477fe640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f52480aed80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f523800e7e0 tx=0x7f523800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.215+0000 7f5244ff9640 1 -- 172.21.15.50:0/3810270609 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238004030 con 0x7f52480b3d30 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.215+0000 7f5244ff9640 1 -- 172.21.15.50:0/3810270609 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238004190 con 0x7f52480b3d30 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.215+0000 7f5244ff9640 1 -- 172.21.15.50:0/3810270609 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238004520 con 0x7f52480b3d30 2023-12-08T08:19:34.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.215+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5248154d90 con 0x7f52480b3d30 2023-12-08T08:19:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.215+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524809bf70 con 0x7f52480b3d30 2023-12-08T08:19:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.216+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5248067430 con 0x7f52480b3d30 2023-12-08T08:19:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.216+0000 7f5244ff9640 1 -- 172.21.15.50:0/3810270609 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f523800c6d0 con 0x7f52480b3d30 2023-12-08T08:19:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.217+0000 7f5244ff9640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f523406ae70 0x7f523406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.217+0000 7f5244ff9640 1 -- 172.21.15.50:0/3810270609 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f5238089610 con 0x7f52480b3d30 2023-12-08T08:19:34.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.217+0000 7f5247fff640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f523406ae70 0x7f523406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.218+0000 7f5247fff640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f523406ae70 0x7f523406d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f523c000f60 tx=0x7f523c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.221+0000 7f5244ff9640 1 -- 172.21.15.50:0/3810270609 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5238054350 con 0x7f52480b3d30 2023-12-08T08:19:34.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.397+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52480704d0 con 0x7f52480b3d30 2023-12-08T08:19:34.401 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.399+0000 7f5244ff9640 1 -- 172.21.15.50:0/3810270609 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18553 (secure 0 0 0) 0x7f5238057970 con 0x7f52480b3d30 2023-12-08T08:19:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:34.401 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:33.852363+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.400+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f523406ae70 msgr2=0x7f523406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.400+0000 7f524e656640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f523406ae70 0x7f523406d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f523c000f60 tx=0x7f523c009040 comp rx=0 tx=0).stop 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.400+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 msgr2=0x7f52480aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.400+0000 7f524e656640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f52480aed80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f523800e7e0 tx=0x7f523800eca0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 shutdown_connections 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f523406ae70 0x7f523406d330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f52480b3d30 0x7f52480aed80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5248160f30 0x7f52480af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 --2- 172.21.15.50:0/3810270609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f524806d940 0x7f5248153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 >> 172.21.15.50:0/3810270609 conn(0x7f52480b09f0 msgr2=0x7f5248160710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 shutdown_connections 2023-12-08T08:19:34.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.401+0000 7f524e656640 1 -- 172.21.15.50:0/3810270609 wait complete. 2023-12-08T08:19:34.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:19:18.367216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:19:18.792176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-08T08:19:31.441584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:34.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.522+0000 7fe6703be640 1 Processor -- start 2023-12-08T08:19:34.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.522+0000 7fe6703be640 1 -- start start 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.523+0000 7fe6703be640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 0x7fe6680b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.523+0000 7fe6703be640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680c6be0 con 0x7fe6680cfe10 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.523+0000 7fe6703be640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6680d3ff0 con 0x7fe6680cfa30 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.523+0000 7fe6703be640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680b4860 con 0x7fe6680b4150 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.523+0000 7fe66e95b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe6680cfe10 0x7fe6680cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60426/0 (socket says 172.21.15.50:60426) 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66e95b640 1 -- 172.21.15.50:0/1569620021 learned_addr learned my addr 172.21.15.50:0/1569620021 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466942453 0 0) 0x7fe6680c6be0 con 0x7fe6680cfe10 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d959640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 0x7fe6680b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe654003520 con 0x7fe6680cfe10 2023-12-08T08:19:34.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3260678029 0 0) 0x7fe654003520 con 0x7fe6680cfe10 2023-12-08T08:19:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 msgr2=0x7fe6680b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 0x7fe6680b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 >> v1:172.21.15.170:6789/0 conn(0x7fe6680cfa30 legacy=0x7fe6680b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680d3d50 con 0x7fe6680cfe10 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fe6600019f0 con 0x7fe6680cfe10 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 >> v1:172.21.15.50:6789/0 conn(0x7fe6680cfe10 legacy=0x7fe6680cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe654003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 0x7fe6540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe654004d00 0x7fe654005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680b4860 con 0x7fe6540039a0 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65400bb40 con 0x7fe654004d00 2023-12-08T08:19:34.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65400bd00 con 0x7fe6680b4150 2023-12-08T08:19:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66e15a640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe654003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66d959640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 0x7fe6540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.524+0000 7fe66e95b640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe654004d00 0x7fe654005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66e15a640 1 -- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 msgr2=0x7fe6540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66e15a640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6680b4150 0x7fe6540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66e15a640 1 -- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe654004d00 msgr2=0x7fe654005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66e15a640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe654004d00 0x7fe654005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66e15a640 1 -- 172.21.15.50:0/1569620021 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654003520 con 0x7fe6540039a0 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66e15a640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe654003dc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe664001750 tx=0x7fe6540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84f6ee94cbb8e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640052d0 con 0x7fe6540039a0 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66402e050 con 0x7fe6540039a0 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.525+0000 7fe66d158640 1 -- 172.21.15.50:0/1569620021 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640035f0 con 0x7fe6540039a0 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.526+0000 7fe6703be640 1 -- 172.21.15.50:0/1569620021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 msgr2=0x7fe654003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.526+0000 7fe6703be640 1 --2- 172.21.15.50:0/1569620021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe654003dc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe664001750 tx=0x7fe6540057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.526+0000 7fe66e95b640 1 -- 172.21.15.50:0/1569620021 reap_dead start 2023-12-08T08:19:34.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.526+0000 7fe6703be640 1 -- 172.21.15.50:0/1569620021 shutdown_connections 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.526+0000 7fe6703be640 1 -- 172.21.15.50:0/1569620021 >> 172.21.15.50:0/1569620021 conn(0x7fe6680d3090 msgr2=0x7fe6680d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.526+0000 7fe6703be640 1 -- 172.21.15.50:0/1569620021 shutdown_connections 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.526+0000 7fe6703be640 1 -- 172.21.15.50:0/1569620021 wait complete. 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.527+0000 7fe6703be640 1 Processor -- start 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.527+0000 7fe6703be640 1 -- start start 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe6703be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe6680cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe6703be640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe668153770 0x7fe668155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe6703be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe668150b70 0x7fe668150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe6703be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe668154280 con 0x7fe6540039a0 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe6703be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe668153fa0 con 0x7fe668150b70 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe6703be640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6680ca200 con 0x7fe668153770 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe6680cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe6680cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42848/0 (socket says 172.21.15.50:42848) 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 -- 172.21.15.50:0/863809341 learned_addr learned my addr 172.21.15.50:0/863809341 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 -- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe668153770 msgr2=0x7fe668155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66d959640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe668153770 0x7fe668155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e95b640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe668150b70 0x7fe668150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe668153770 0x7fe668155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 -- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe668150b70 msgr2=0x7fe668150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe668150b70 0x7fe668150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66e15a640 1 -- 172.21.15.50:0/863809341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680ca4e0 con 0x7fe6540039a0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.528+0000 7fe66d959640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe668153770 0x7fe668155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.529+0000 7fe66e95b640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe668150b70 0x7fe668150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.529+0000 7fe66e15a640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe6680cccf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe664008fd0 tx=0x7fe664001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.529+0000 7fe65effd640 1 -- 172.21.15.50:0/863809341 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640076c0 con 0x7fe6540039a0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.529+0000 7fe65effd640 1 -- 172.21.15.50:0/863809341 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664007a30 con 0x7fe6540039a0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.529+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe668154280 con 0x7fe6540039a0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.529+0000 7fe65effd640 1 -- 172.21.15.50:0/863809341 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664006c00 con 0x7fe6540039a0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.529+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe668153bf0 con 0x7fe6540039a0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.530+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe668152b60 con 0x7fe6540039a0 2023-12-08T08:19:34.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.530+0000 7fe65effd640 1 -- 172.21.15.50:0/863809341 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe6640035f0 con 0x7fe6540039a0 2023-12-08T08:19:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.531+0000 7fe65effd640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe64c06ae40 0x7fe64c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.531+0000 7fe65effd640 1 -- 172.21.15.50:0/863809341 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fe6640ab940 con 0x7fe6540039a0 2023-12-08T08:19:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.531+0000 7fe66d959640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe64c06ae40 0x7fe64c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.531+0000 7fe66d959640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe64c06ae40 0x7fe64c06d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe6680cd260 tx=0x7fe658008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.537 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.535+0000 7fe65effd640 1 -- 172.21.15.50:0/863809341 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe664076720 con 0x7fe6540039a0 2023-12-08T08:19:34.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.713+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe668067430 con 0x7fe6540039a0 2023-12-08T08:19:34.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.713+0000 7fe65effd640 1 -- 172.21.15.50:0/863809341 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe664079d40 con 0x7fe6540039a0 2023-12-08T08:19:34.716 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:34.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe64c06ae40 msgr2=0x7fe64c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe64c06ae40 0x7fe64c06d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe6680cd260 tx=0x7fe658008040 comp rx=0 tx=0).stop 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 msgr2=0x7fe6680cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe6680cccf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe664008fd0 tx=0x7fe664001120 comp rx=0 tx=0).stop 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 shutdown_connections 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe64c06ae40 0x7fe64c06d300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe668150b70 0x7fe668150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe668153770 0x7fe668155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 --2- 172.21.15.50:0/863809341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6540039a0 0x7fe6680cccf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 >> 172.21.15.50:0/863809341 conn(0x7fe6680d3090 msgr2=0x7fe6680b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 shutdown_connections 2023-12-08T08:19:34.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.715+0000 7fe6703be640 1 -- 172.21.15.50:0/863809341 wait complete. 2023-12-08T08:19:34.728 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:34.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.835+0000 7f474c068640 1 Processor -- start 2023-12-08T08:19:34.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.835+0000 7f474c068640 1 -- start start 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474c068640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4744145d80 0x7f4744071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474c068640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f474406a4d0 0x7f474406a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474c068640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474406ae60 con 0x7f47440b4920 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474c068640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440b4e00 con 0x7f4744145d80 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474c068640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440b50e0 con 0x7f474406a4d0 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474a605640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f474406a4d0 0x7f474406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474a605640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f474406a4d0 0x7f474406a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:39326/0 (socket says 172.21.15.50:39326) 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474a605640 1 -- 172.21.15.50:0/1353017312 learned_addr learned my addr 172.21.15.50:0/1353017312 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f4749e04640 1 --2- 172.21.15.50:0/1353017312 >> v2:172.21.15.170:3300/0 conn(0x7f4744145d80 0x7f4744071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f4748e02640 1 -- 172.21.15.50:0/1353017312 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199021460 0 0) 0x7f4734001110 con 0x7f47440b4920 2023-12-08T08:19:34.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f4748e02640 1 -- 172.21.15.50:0/1353017312 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4730003520 con 0x7f47440b4920 2023-12-08T08:19:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474a605640 1 -- 172.21.15.50:0/1353017312 >> v2:172.21.15.170:3300/0 conn(0x7f4744145d80 msgr2=0x7f4744071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474a605640 1 --2- 172.21.15.50:0/1353017312 >> v2:172.21.15.170:3300/0 conn(0x7f4744145d80 0x7f4744071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474a605640 1 -- 172.21.15.50:0/1353017312 >> v1:172.21.15.50:6789/0 conn(0x7f47440b4920 legacy=0x7f47440acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.836+0000 7f474a605640 1 -- 172.21.15.50:0/1353017312 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474406cfb0 con 0x7f474406a4d0 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.837+0000 7f474a605640 1 --2- 172.21.15.50:0/1353017312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f474406a4d0 0x7f474406a920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f473c009e50 tx=0x7f473c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ff8afac9feb1ed server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f4748e02640 1 -- 172.21.15.50:0/1353017312 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c02cb00 con 0x7f474406a4d0 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f4748e02640 1 -- 172.21.15.50:0/1353017312 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c02cc60 con 0x7f474406a4d0 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f4748e02640 1 -- 172.21.15.50:0/1353017312 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c0343f0 con 0x7f474406a4d0 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 -- 172.21.15.50:0/1353017312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f474406a4d0 msgr2=0x7f474406a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 --2- 172.21.15.50:0/1353017312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f474406a4d0 0x7f474406a920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f473c009e50 tx=0x7f473c02bf60 comp rx=0 tx=0).stop 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 -- 172.21.15.50:0/1353017312 shutdown_connections 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 --2- 172.21.15.50:0/1353017312 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f474406a4d0 0x7f474406a920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 --2- 172.21.15.50:0/1353017312 >> v2:172.21.15.170:3300/0 conn(0x7f4744145d80 0x7f4744071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 -- 172.21.15.50:0/1353017312 >> 172.21.15.50:0/1353017312 conn(0x7f474406b7c0 msgr2=0x7f474406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 -- 172.21.15.50:0/1353017312 shutdown_connections 2023-12-08T08:19:34.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.838+0000 7f474c068640 1 -- 172.21.15.50:0/1353017312 wait complete. 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.839+0000 7f474c068640 1 Processor -- start 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f474c068640 1 -- start start 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f474c068640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406a4d0 0x7f474415e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f474c068640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47440b4920 0x7f47440b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f474c068640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4744145d80 0x7f47441f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f474c068640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440b1720 con 0x7f47440b4920 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f474c068640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474415ee40 con 0x7f474406a4d0 2023-12-08T08:19:34.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f474c068640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474415f120 con 0x7f4744145d80 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f4749603640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47440b4920 0x7f47440b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f4749603640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47440b4920 0x7f47440b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42856/0 (socket says 172.21.15.50:42856) 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.840+0000 7f4749603640 1 -- 172.21.15.50:0/983562872 learned_addr learned my addr 172.21.15.50:0/983562872 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f4749e04640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406a4d0 0x7f474415e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f474a605640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4744145d80 0x7f47441f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f4749603640 1 -- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4744145d80 msgr2=0x7f47441f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f4749603640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4744145d80 0x7f47441f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f4749603640 1 -- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406a4d0 msgr2=0x7f474415e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f4749603640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406a4d0 0x7f474415e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f4749603640 1 -- 172.21.15.50:0/983562872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c009b30 con 0x7f47440b4920 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f474a605640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4744145d80 0x7f47441f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f4749603640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47440b4920 0x7f47440b11e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f473400c700 tx=0x7f473400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f473a7fc640 1 -- 172.21.15.50:0/983562872 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47340050d0 con 0x7f47440b4920 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f473a7fc640 1 -- 172.21.15.50:0/983562872 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734005230 con 0x7f47440b4920 2023-12-08T08:19:34.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474415f400 con 0x7f47440b4920 2023-12-08T08:19:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f473a7fc640 1 -- 172.21.15.50:0/983562872 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473400a640 con 0x7f47440b4920 2023-12-08T08:19:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.841+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474415f9c0 con 0x7f47440b4920 2023-12-08T08:19:34.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.842+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744071460 con 0x7f47440b4920 2023-12-08T08:19:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.843+0000 7f473a7fc640 1 -- 172.21.15.50:0/983562872 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f473400a7a0 con 0x7f47440b4920 2023-12-08T08:19:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.843+0000 7f473a7fc640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f472806ae40 0x7f472806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.843+0000 7f473a7fc640 1 -- 172.21.15.50:0/983562872 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f4734089150 con 0x7f47440b4920 2023-12-08T08:19:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.843+0000 7f4749e04640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f472806ae40 0x7f472806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:34.847 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.844+0000 7f4749e04640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f472806ae40 0x7f472806d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4740009aa0 tx=0x7f4740009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:34.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:34.847+0000 7f473a7fc640 1 -- 172.21.15.50:0/983562872 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4734053fc0 con 0x7f47440b4920 2023-12-08T08:19:35.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.024+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f474406ae60 con 0x7f47440b4920 2023-12-08T08:19:35.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.024+0000 7f473a7fc640 1 -- 172.21.15.50:0/983562872 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f474406ae60 con 0x7f47440b4920 2023-12-08T08:19:35.027 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f472806ae40 msgr2=0x7f472806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f472806ae40 0x7f472806d300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4740009aa0 tx=0x7f4740009190 comp rx=0 tx=0).stop 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47440b4920 msgr2=0x7f47440b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47440b4920 0x7f47440b11e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f473400c700 tx=0x7f473400cbc0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 shutdown_connections 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f472806ae40 0x7f472806d300 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f47440b4920 0x7f47440b11e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4744145d80 0x7f47441f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 --2- 172.21.15.50:0/983562872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406a4d0 0x7f474415e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 >> 172.21.15.50:0/983562872 conn(0x7f474406b7c0 msgr2=0x7f47440b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 shutdown_connections 2023-12-08T08:19:35.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.026+0000 7f474c068640 1 -- 172.21.15.50:0/983562872 wait complete. 2023-12-08T08:19:35.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.146+0000 7f1926b68640 1 Processor -- start 2023-12-08T08:19:35.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.146+0000 7f1926b68640 1 -- start start 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1926b68640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19200cfa30 0x7f19200b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1926b68640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200b4150 0x7f19200b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1926b68640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19200c6be0 con 0x7f19200cfe10 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1926b68640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19200d3ff0 con 0x7f19200cfa30 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1926b68640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19200b4860 con 0x7f19200b4150 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1924904640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19200cfa30 0x7f19200b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1924904640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f19200cfa30 0x7f19200b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42858/0 (socket says 172.21.15.50:42858) 2023-12-08T08:19:35.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.147+0000 7f1924904640 1 -- 172.21.15.50:0/1920877817 learned_addr learned my addr 172.21.15.50:0/1920877817 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:35.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.148+0000 7f1917fff640 1 --2- 172.21.15.50:0/1920877817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200b4150 0x7f19200b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.148+0000 7f1924904640 1 -- 172.21.15.50:0/1920877817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200b4150 msgr2=0x7f19200b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:35.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.148+0000 7f1924904640 1 --2- 172.21.15.50:0/1920877817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200b4150 0x7f19200b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.148+0000 7f1924904640 1 -- 172.21.15.50:0/1920877817 >> v1:172.21.15.170:6789/0 conn(0x7f19200cfe10 legacy=0x7f1920161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:35.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.148+0000 7f1924904640 1 -- 172.21.15.50:0/1920877817 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200d3d50 con 0x7f19200cfa30 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.148+0000 7f1924904640 1 --2- 172.21.15.50:0/1920877817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19200b2f20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f191c009870 tx=0x7f191c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb774c8e3cafb2f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f19177fe640 1 -- 172.21.15.50:0/1920877817 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c031640 con 0x7f19200cfa30 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f19177fe640 1 -- 172.21.15.50:0/1920877817 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c0317a0 con 0x7f19200cfa30 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f19177fe640 1 -- 172.21.15.50:0/1920877817 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c031b30 con 0x7f19200cfa30 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 -- 172.21.15.50:0/1920877817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 msgr2=0x7f19200b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 --2- 172.21.15.50:0/1920877817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19200b2f20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f191c009870 tx=0x7f191c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 -- 172.21.15.50:0/1920877817 shutdown_connections 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 --2- 172.21.15.50:0/1920877817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200b4150 0x7f19200b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 --2- 172.21.15.50:0/1920877817 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19200b2f20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 -- 172.21.15.50:0/1920877817 >> 172.21.15.50:0/1920877817 conn(0x7f19200d3090 msgr2=0x7f19200d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 -- 172.21.15.50:0/1920877817 shutdown_connections 2023-12-08T08:19:35.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.149+0000 7f1926b68640 1 -- 172.21.15.50:0/1920877817 wait complete. 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.150+0000 7f1926b68640 1 Processor -- start 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.151+0000 7f1926b68640 1 -- start start 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.151+0000 7f1926b68640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19200b4150 0x7f19201525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.151+0000 7f1926b68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19201f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.151+0000 7f1926b68640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200cfe10 0x7f192006c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.151+0000 7f1926b68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19200ccef0 con 0x7f19200cfa30 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.151+0000 7f1926b68640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1920152af0 con 0x7f19200b4150 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.151+0000 7f1926b68640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19201f7670 con 0x7f19200cfe10 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19201f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19201f7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42872/0 (socket says 172.21.15.50:42872) 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 -- 172.21.15.50:0/645032004 learned_addr learned my addr 172.21.15.50:0/645032004 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:35.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1924904640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19200b4150 0x7f19201525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1925105640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200cfe10 0x7f192006c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 -- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200cfe10 msgr2=0x7f192006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200cfe10 0x7f192006c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 -- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19200b4150 msgr2=0x7f19201525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19200b4150 0x7f19201525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 -- 172.21.15.50:0/645032004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0094d0 con 0x7f19200cfa30 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1917fff640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19201f7130 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f191000d620 tx=0x7f191000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f19157fa640 1 -- 172.21.15.50:0/645032004 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000b620 con 0x7f19200cfa30 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f19157fa640 1 -- 172.21.15.50:0/645032004 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191000b780 con 0x7f19200cfa30 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f19157fa640 1 -- 172.21.15.50:0/645032004 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191000bb30 con 0x7f19200cfa30 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19200cc2e0 con 0x7f19200cfa30 2023-12-08T08:19:35.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.152+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19200cc8a0 con 0x7f19200cfa30 2023-12-08T08:19:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.153+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19200cd060 con 0x7f19200cfa30 2023-12-08T08:19:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.154+0000 7f19157fa640 1 -- 172.21.15.50:0/645032004 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f191000bc90 con 0x7f19200cfa30 2023-12-08T08:19:35.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.154+0000 7f19157fa640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f190c06ae40 0x7f190c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.154+0000 7f19157fa640 1 -- 172.21.15.50:0/645032004 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f1910089df0 con 0x7f19200cfa30 2023-12-08T08:19:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.154+0000 7f1924904640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f190c06ae40 0x7f190c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.158 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.155+0000 7f1924904640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f190c06ae40 0x7f190c06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f191c036000 tx=0x7f191c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.158+0000 7f19157fa640 1 -- 172.21.15.50:0/645032004 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1910054bd0 con 0x7f19200cfa30 2023-12-08T08:19:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.333+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1920067430 con 0x7f19200cfa30 2023-12-08T08:19:35.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.334+0000 7f19157fa640 1 -- 172.21.15.50:0/645032004 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19100581f0 con 0x7f19200cfa30 2023-12-08T08:19:35.336 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:35.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f190c06ae40 msgr2=0x7f190c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.338 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f190c06ae40 0x7f190c06d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f191c036000 tx=0x7f191c03c040 comp rx=0 tx=0).stop 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 msgr2=0x7f19201f7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19201f7130 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f191000d620 tx=0x7f191000dae0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 shutdown_connections 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f190c06ae40 0x7f190c06d300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19200cfa30 0x7f19201f7130 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19200cfe10 0x7f192006c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 --2- 172.21.15.50:0/645032004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19200b4150 0x7f19201525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 >> 172.21.15.50:0/645032004 conn(0x7f19200d3090 msgr2=0x7f192015c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 shutdown_connections 2023-12-08T08:19:35.339 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.336+0000 7f1926b68640 1 -- 172.21.15.50:0/645032004 wait complete. 2023-12-08T08:19:35.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-08T08:19:35.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.457+0000 7ffaefb68640 1 Processor -- start 2023-12-08T08:19:35.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.457+0000 7ffaefb68640 1 -- start start 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.458+0000 7ffaefb68640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffae80b4150 0x7ffae80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.458+0000 7ffaefb68640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae80c6be0 con 0x7ffae80cfe10 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.458+0000 7ffaefb68640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae80d3ff0 con 0x7ffae80cfa30 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.458+0000 7ffaefb68640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae80b4860 con 0x7ffae80b4150 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.458+0000 7ffaee105640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffae80cfe10 0x7ffae80cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60450/0 (socket says 172.21.15.50:60450) 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.458+0000 7ffaee105640 1 -- 172.21.15.50:0/402660975 learned_addr learned my addr 172.21.15.50:0/402660975 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.458+0000 7ffaed103640 1 --2- 172.21.15.50:0/402660975 >> v2:172.21.15.170:3300/0 conn(0x7ffae80b4150 0x7ffae80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.459+0000 7ffaec902640 1 -- 172.21.15.50:0/402660975 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207268344 0 0) 0x7ffae80c6be0 con 0x7ffae80cfe10 2023-12-08T08:19:35.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.459+0000 7ffaec902640 1 -- 172.21.15.50:0/402660975 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad0003520 con 0x7ffae80cfe10 2023-12-08T08:19:35.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.459+0000 7ffaed103640 1 -- 172.21.15.50:0/402660975 >> v1:172.21.15.170:6789/0 conn(0x7ffae80cfa30 legacy=0x7ffae80b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.459+0000 7ffaed103640 1 -- 172.21.15.50:0/402660975 >> v1:172.21.15.50:6789/0 conn(0x7ffae80cfe10 legacy=0x7ffae80cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.459+0000 7ffaed103640 1 -- 172.21.15.50:0/402660975 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae80d3d50 con 0x7ffae80b4150 2023-12-08T08:19:35.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.460+0000 7ffaed103640 1 --2- 172.21.15.50:0/402660975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80b4150 0x7ffae80b3630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0097a0 tx=0x7ffadc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b26b2246e58501ba server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.460+0000 7ffaec902640 1 -- 172.21.15.50:0/402660975 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc031830 con 0x7ffae80b4150 2023-12-08T08:19:35.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.460+0000 7ffaec902640 1 -- 172.21.15.50:0/402660975 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc031990 con 0x7ffae80b4150 2023-12-08T08:19:35.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.460+0000 7ffaec902640 1 -- 172.21.15.50:0/402660975 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc031d20 con 0x7ffae80b4150 2023-12-08T08:19:35.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.461+0000 7ffaefb68640 1 -- 172.21.15.50:0/402660975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80b4150 msgr2=0x7ffae80b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.461+0000 7ffaefb68640 1 --2- 172.21.15.50:0/402660975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80b4150 0x7ffae80b3630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0097a0 tx=0x7ffadc02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.461+0000 7ffaefb68640 1 -- 172.21.15.50:0/402660975 shutdown_connections 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.461+0000 7ffaefb68640 1 --2- 172.21.15.50:0/402660975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80b4150 0x7ffae80b3630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.461+0000 7ffaefb68640 1 -- 172.21.15.50:0/402660975 >> 172.21.15.50:0/402660975 conn(0x7ffae80d3090 msgr2=0x7ffae80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.461+0000 7ffaefb68640 1 -- 172.21.15.50:0/402660975 shutdown_connections 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.461+0000 7ffaefb68640 1 -- 172.21.15.50:0/402660975 wait complete. 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.462+0000 7ffaefb68640 1 Processor -- start 2023-12-08T08:19:35.464 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.462+0000 7ffaefb68640 1 -- start start 2023-12-08T08:19:35.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaefb68640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80b4150 0x7ffae8158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaefb68640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cfa30 0x7ffae815e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaefb68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae80cfe10 0x7ffae81f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaefb68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81f2e30 con 0x7ffae80cfe10 2023-12-08T08:19:35.466 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaefb68640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8158b60 con 0x7ffae80cfa30 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaefb68640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80cb350 con 0x7ffae80b4150 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae80cfe10 0x7ffae81f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae80cfe10 0x7ffae81f28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42884/0 (socket says 172.21.15.50:42884) 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 -- 172.21.15.50:0/2516349848 learned_addr learned my addr 172.21.15.50:0/2516349848 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaed103640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cfa30 0x7ffae815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaed904640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80b4150 0x7ffae8158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 -- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80b4150 msgr2=0x7ffae8158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80b4150 0x7ffae8158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 -- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cfa30 msgr2=0x7ffae815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cfa30 0x7ffae815e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.463+0000 7ffaee105640 1 -- 172.21.15.50:0/2516349848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc009400 con 0x7ffae80cfe10 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.464+0000 7ffaee105640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae80cfe10 0x7ffae81f28f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffad800cb40 tx=0x7ffad800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.464+0000 7ffae67fc640 1 -- 172.21.15.50:0/2516349848 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad800aca0 con 0x7ffae80cfe10 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.464+0000 7ffae67fc640 1 -- 172.21.15.50:0/2516349848 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad800ae00 con 0x7ffae80cfe10 2023-12-08T08:19:35.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.464+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae80cb630 con 0x7ffae80cfe10 2023-12-08T08:19:35.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.464+0000 7ffae67fc640 1 -- 172.21.15.50:0/2516349848 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8012620 con 0x7ffae80cfe10 2023-12-08T08:19:35.468 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.464+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81551f0 con 0x7ffae80cfe10 2023-12-08T08:19:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.465+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae80cb1b0 con 0x7ffae80cfe10 2023-12-08T08:19:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.465+0000 7ffae67fc640 1 -- 172.21.15.50:0/2516349848 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffad8007070 con 0x7ffae80cfe10 2023-12-08T08:19:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.466+0000 7ffae67fc640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffad406ae40 0x7ffad406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.466+0000 7ffae67fc640 1 -- 172.21.15.50:0/2516349848 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ffad8089810 con 0x7ffae80cfe10 2023-12-08T08:19:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.466+0000 7ffaed904640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffad406ae40 0x7ffad406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.466+0000 7ffaed904640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffad406ae40 0x7ffad406d300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffae80cf670 tx=0x7ffae0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.470+0000 7ffae67fc640 1 -- 172.21.15.50:0/2516349848 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffae80cb1b0 con 0x7ffae80cfe10 2023-12-08T08:19:35.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.644+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7ffae80cbb50 con 0x7ffae80cfe10 2023-12-08T08:19:35.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.644+0000 7ffae67fc640 1 -- 172.21.15.50:0/2516349848 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v41) v1 ==== 97+0+11 (secure 0 0 0) 0x7ffae80cbb50 con 0x7ffae80cfe10 2023-12-08T08:19:35.647 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:35.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffad406ae40 msgr2=0x7ffad406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffad406ae40 0x7ffad406d300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffae80cf670 tx=0x7ffae0009040 comp rx=0 tx=0).stop 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae80cfe10 msgr2=0x7ffae81f28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae80cfe10 0x7ffae81f28f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffad800cb40 tx=0x7ffad800a060 comp rx=0 tx=0).stop 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 shutdown_connections 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffad406ae40 0x7ffad406d300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffae80cfe10 0x7ffae81f28f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffae80cfa30 0x7ffae815e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 --2- 172.21.15.50:0/2516349848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffae80b4150 0x7ffae8158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 >> 172.21.15.50:0/2516349848 conn(0x7ffae80d3090 msgr2=0x7ffae80d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 shutdown_connections 2023-12-08T08:19:35.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.646+0000 7ffaefb68640 1 -- 172.21.15.50:0/2516349848 wait complete. 2023-12-08T08:19:35.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.764+0000 7efe0338a640 1 Processor -- start 2023-12-08T08:19:35.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.764+0000 7efe0338a640 1 -- start start 2023-12-08T08:19:35.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe0338a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc0b0cf0 0x7efdfc0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe0338a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efdfc0b1d70 0x7efdfc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe0338a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0d20b0 con 0x7efdfc1608a0 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe0338a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0d0620 con 0x7efdfc0b1d70 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe0338a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0d1b80 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe01927640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efdfc0b1d70 0x7efdfc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe00925640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc0b0cf0 0x7efdfc0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe01126640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7efdfc1608a0 0x7efdfc0d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:48978/0 (socket says 172.21.15.50:48978) 2023-12-08T08:19:35.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.765+0000 7efe01126640 1 -- 172.21.15.50:0/171764029 learned_addr learned my addr 172.21.15.50:0/171764029 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.766+0000 7efdf3fff640 1 -- 172.21.15.50:0/171764029 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128370902 0 0) 0x7efdfc0d20b0 con 0x7efdfc1608a0 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.766+0000 7efe00925640 1 -- 172.21.15.50:0/171764029 >> v2:172.21.15.170:3300/0 conn(0x7efdfc0b1d70 msgr2=0x7efdfc0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.766+0000 7efe00925640 1 --2- 172.21.15.50:0/171764029 >> v2:172.21.15.170:3300/0 conn(0x7efdfc0b1d70 0x7efdfc0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.766+0000 7efe00925640 1 -- 172.21.15.50:0/171764029 >> v1:172.21.15.170:6789/0 conn(0x7efdfc1608a0 legacy=0x7efdfc0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.766+0000 7efe00925640 1 -- 172.21.15.50:0/171764029 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0d1dd0 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.766+0000 7efe01927640 1 --2- 172.21.15.50:0/171764029 >> v2:172.21.15.170:3300/0 conn(0x7efdfc0b1d70 0x7efdfc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe00925640 1 --2- 172.21.15.50:0/171764029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc0b0cf0 0x7efdfc0d1640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097a0 tx=0x7efdec02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae211fb549045cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efdf3fff640 1 -- 172.21.15.50:0/171764029 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec02e070 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efdf3fff640 1 -- 172.21.15.50:0/171764029 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec0315a0 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efdf3fff640 1 -- 172.21.15.50:0/171764029 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec031930 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 -- 172.21.15.50:0/171764029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc0b0cf0 msgr2=0x7efdfc0d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 --2- 172.21.15.50:0/171764029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc0b0cf0 0x7efdfc0d1640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097a0 tx=0x7efdec02b840 comp rx=0 tx=0).stop 2023-12-08T08:19:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 -- 172.21.15.50:0/171764029 shutdown_connections 2023-12-08T08:19:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 --2- 172.21.15.50:0/171764029 >> v2:172.21.15.170:3300/0 conn(0x7efdfc0b1d70 0x7efdfc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 --2- 172.21.15.50:0/171764029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc0b0cf0 0x7efdfc0d1640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 -- 172.21.15.50:0/171764029 >> 172.21.15.50:0/171764029 conn(0x7efdfc0d3030 msgr2=0x7efdfc0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 -- 172.21.15.50:0/171764029 shutdown_connections 2023-12-08T08:19:35.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.767+0000 7efe0338a640 1 -- 172.21.15.50:0/171764029 wait complete. 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 Processor -- start 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 -- start start 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0b0cf0 0x7efdfc0b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdfc0b1d70 0x7efdfc152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc1608a0 0x7efdfc0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0b5fa0 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc1540f0 con 0x7efdfc0b1d70 2023-12-08T08:19:35.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe0338a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0c75a0 con 0x7efdfc1608a0 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe01126640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0b0cf0 0x7efdfc0b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe01126640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0b0cf0 0x7efdfc0b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42888/0 (socket says 172.21.15.50:42888) 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.769+0000 7efe01126640 1 -- 172.21.15.50:0/1923259560 learned_addr learned my addr 172.21.15.50:0/1923259560 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01927640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc1608a0 0x7efdfc0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe00925640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdfc0b1d70 0x7efdfc152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01126640 1 -- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc1608a0 msgr2=0x7efdfc0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01126640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc1608a0 0x7efdfc0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01126640 1 -- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdfc0b1d70 msgr2=0x7efdfc152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01126640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdfc0b1d70 0x7efdfc152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01126640 1 -- 172.21.15.50:0/1923259560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009a70 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01927640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc1608a0 0x7efdfc0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe00925640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdfc0b1d70 0x7efdfc152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:35.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe01126640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0b0cf0 0x7efdfc0b6b40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c430 tx=0x7efdf800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efdf1ffb640 1 -- 172.21.15.50:0/1923259560 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80074e0 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efdf1ffb640 1 -- 172.21.15.50:0/1923259560 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8007660 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efdf1ffb640 1 -- 172.21.15.50:0/1923259560 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8004a20 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec009400 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.770+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc1537c0 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.771+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc067430 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.772+0000 7efdf1ffb640 1 -- 172.21.15.50:0/1923259560 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdf8004b80 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.772+0000 7efdf1ffb640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efde006ae40 0x7efde006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.772+0000 7efdf1ffb640 1 -- 172.21.15.50:0/1923259560 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7efdf80896c0 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.772+0000 7efe00925640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efde006ae40 0x7efde006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:35.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.773+0000 7efe00925640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efde006ae40 0x7efde006d300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdec036000 tx=0x7efdec03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:35.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.776+0000 7efdf1ffb640 1 -- 172.21.15.50:0/1923259560 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdf8054530 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.966+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efdfc0d3da0 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.966+0000 7efdf1ffb640 1 -- 172.21.15.50:0/1923259560 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7efdf8057b50 con 0x7efdfc0b0cf0 2023-12-08T08:19:35.968 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efde006ae40 msgr2=0x7efde006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efde006ae40 0x7efde006d300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdec036000 tx=0x7efdec03d040 comp rx=0 tx=0).stop 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0b0cf0 msgr2=0x7efdfc0b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0b0cf0 0x7efdfc0b6b40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdf800c430 tx=0x7efdf800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 shutdown_connections 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efde006ae40 0x7efde006d300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdfc1608a0 0x7efdfc0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efdfc0b1d70 0x7efdfc152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 --2- 172.21.15.50:0/1923259560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efdfc0b0cf0 0x7efdfc0b6b40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:35.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 >> 172.21.15.50:0/1923259560 conn(0x7efdfc0d3030 msgr2=0x7efdfc06c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 shutdown_connections 2023-12-08T08:19:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:35.968+0000 7efe0338a640 1 -- 172.21.15.50:0/1923259560 wait complete. 2023-12-08T08:19:35.981 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:19:35.981 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:35.997 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:36.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.141+0000 7f2d08abb640 1 Processor -- start 2023-12-08T08:19:36.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.141+0000 7f2d08abb640 1 -- start start 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d08abb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d0415d580 0x7f2d040d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d08abb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d040d3ad0 0x7f2d0415f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d08abb640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0415ee90 con 0x7f2d0415f6c0 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d08abb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d040d0fe0 con 0x7f2d0415d580 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d08abb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040d1280 con 0x7f2d040d3ad0 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d0259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d0415d580 0x7f2d040d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d0259c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d0415d580 0x7f2d040d1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42894/0 (socket says 172.21.15.50:42894) 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d0259c640 1 -- 172.21.15.50:0/2671053324 learned_addr learned my addr 172.21.15.50:0/2671053324 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2cfbfff640 1 --2- 172.21.15.50:0/2671053324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d040d3ad0 0x7f2d0415f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d0259c640 1 -- 172.21.15.50:0/2671053324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d040d3ad0 msgr2=0x7f2d0415f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d0259c640 1 --2- 172.21.15.50:0/2671053324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d040d3ad0 0x7f2d0415f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.142+0000 7f2d0259c640 1 -- 172.21.15.50:0/2671053324 >> v1:172.21.15.170:6789/0 conn(0x7f2d0415f6c0 legacy=0x7f2d040b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.143+0000 7f2d0259c640 1 -- 172.21.15.50:0/2671053324 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d040d1560 con 0x7f2d0415d580 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.143+0000 7f2d0259c640 1 --2- 172.21.15.50:0/2671053324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0415d580 0x7f2d040d1d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f170feb21d027f3f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.143+0000 7f2d01d9b640 1 -- 172.21.15.50:0/2671053324 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4031640 con 0x7f2d0415d580 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.143+0000 7f2d01d9b640 1 -- 172.21.15.50:0/2671053324 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf40317a0 con 0x7f2d0415d580 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.143+0000 7f2d01d9b640 1 -- 172.21.15.50:0/2671053324 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4031b30 con 0x7f2d0415d580 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 -- 172.21.15.50:0/2671053324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0415d580 msgr2=0x7f2d040d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2671053324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0415d580 0x7f2d040d1d60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 -- 172.21.15.50:0/2671053324 shutdown_connections 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2671053324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d040d3ad0 0x7f2d0415f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2671053324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d0415d580 0x7f2d040d1d60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 -- 172.21.15.50:0/2671053324 >> 172.21.15.50:0/2671053324 conn(0x7f2d040d2fb0 msgr2=0x7f2d040d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 -- 172.21.15.50:0/2671053324 shutdown_connections 2023-12-08T08:19:36.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.144+0000 7f2d08abb640 1 -- 172.21.15.50:0/2671053324 wait complete. 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.145+0000 7f2d08abb640 1 Processor -- start 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.145+0000 7f2d08abb640 1 -- start start 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d08abb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d040d3ad0 0x7f2d0414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d08abb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d0415d580 0x7f2d040c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d08abb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d0415f6c0 0x7f2d040b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d08abb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040c8f50 con 0x7f2d040d3ad0 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d08abb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0414e940 con 0x7f2d0415f6c0 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d08abb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040c98b0 con 0x7f2d0415d580 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d0259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d040d3ad0 0x7f2d0414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d0259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d040d3ad0 0x7f2d0414e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42896/0 (socket says 172.21.15.50:42896) 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d0259c640 1 -- 172.21.15.50:0/2511430445 learned_addr learned my addr 172.21.15.50:0/2511430445 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:36.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d0259c640 1 -- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d0415d580 msgr2=0x7f2d040c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d0259c640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d0415d580 0x7f2d040c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2d0259c640 1 -- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d0415f6c0 msgr2=0x7f2d040b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.146+0000 7f2d02d9d640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d0415f6c0 0x7f2d040b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2d0259c640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d0415f6c0 0x7f2d040b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2d0259c640 1 -- 172.21.15.50:0/2511430445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40094d0 con 0x7f2d040d3ad0 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2d02d9d640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d0415f6c0 0x7f2d040b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2d0259c640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d040d3ad0 0x7f2d0414e400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2cfaffd640 1 -- 172.21.15.50:0/2511430445 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf403ac60 con 0x7f2d040d3ad0 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2cfaffd640 1 -- 172.21.15.50:0/2511430445 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf403adc0 con 0x7f2d040d3ad0 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2cfaffd640 1 -- 172.21.15.50:0/2511430445 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4044630 con 0x7f2d040d3ad0 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d040c82d0 con 0x7f2d040d3ad0 2023-12-08T08:19:36.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.147+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d040c8890 con 0x7f2d040d3ad0 2023-12-08T08:19:36.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.148+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d040d09d0 con 0x7f2d040d3ad0 2023-12-08T08:19:36.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.148+0000 7f2cfaffd640 1 -- 172.21.15.50:0/2511430445 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cf402f050 con 0x7f2d040d3ad0 2023-12-08T08:19:36.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.149+0000 7f2cfaffd640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.149+0000 7f2cfaffd640 1 -- 172.21.15.50:0/2511430445 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f2cf40ab810 con 0x7f2d040d3ad0 2023-12-08T08:19:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.149+0000 7f2cfbfff640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.150+0000 7f2cfbfff640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ce406ae40 0x7f2ce406d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d04151dd0 tx=0x7f2cec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.153+0000 7f2cfaffd640 1 -- 172.21.15.50:0/2511430445 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2cf40765f0 con 0x7f2d040d3ad0 2023-12-08T08:19:36.330 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.328+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d04067430 con 0x7f2d040d3ad0 2023-12-08T08:19:36.331 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.329+0000 7f2cfaffd640 1 -- 172.21.15.50:0/2511430445 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18553 (secure 0 0 0) 0x7f2cf4079c10 con 0x7f2d040d3ad0 2023-12-08T08:19:36.332 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:36.332 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":41,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:33.852363+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ce406ae40 msgr2=0x7f2ce406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ce406ae40 0x7f2ce406d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d04151dd0 tx=0x7f2cec008040 comp rx=0 tx=0).stop 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d040d3ad0 msgr2=0x7f2d0414e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d040d3ad0 0x7f2d0414e400 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf40046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 shutdown_connections 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2ce406ae40 0x7f2ce406d300 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d0415f6c0 0x7f2d040b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d0415d580 0x7f2d040c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 --2- 172.21.15.50:0/2511430445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d040d3ad0 0x7f2d0414e400 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 >> 172.21.15.50:0/2511430445 conn(0x7f2d040d2fb0 msgr2=0x7f2d0406b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 shutdown_connections 2023-12-08T08:19:36.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.331+0000 7f2d08abb640 1 -- 172.21.15.50:0/2511430445 wait complete. 2023-12-08T08:19:36.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:19:18.367216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:19:18.792176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-08T08:19:31.441584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:36.345 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:36.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.451+0000 7fdcc0bbe640 1 Processor -- start 2023-12-08T08:19:36.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.451+0000 7fdcc0bbe640 1 -- start start 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.452+0000 7fdcc0bbe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcbc0cfe10 0x7fdcbc0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.452+0000 7fdcc0bbe640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc0c6be0 con 0x7fdcbc0b4150 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.452+0000 7fdcc0bbe640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc0d3ff0 con 0x7fdcbc0cfa30 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.452+0000 7fdcc0bbe640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc0b4860 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.452+0000 7fdcbad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdcbc0cfe10 0x7fdcbc0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.452+0000 7fdcb9d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdcbc0b4150 0x7fdcbc0cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60466/0 (socket says 172.21.15.50:60466) 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.452+0000 7fdcb9d9b640 1 -- 172.21.15.50:0/109485537 learned_addr learned my addr 172.21.15.50:0/109485537 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.453+0000 7fdcbad9d640 1 -- 172.21.15.50:0/109485537 >> v1:172.21.15.170:6789/0 conn(0x7fdcbc0cfa30 legacy=0x7fdcbc0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:36.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.453+0000 7fdcbad9d640 1 -- 172.21.15.50:0/109485537 >> v1:172.21.15.50:6789/0 conn(0x7fdcbc0b4150 legacy=0x7fdcbc0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.453+0000 7fdcbad9d640 1 -- 172.21.15.50:0/109485537 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0d3d50 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.453+0000 7fdcbad9d640 1 --2- 172.21.15.50:0/109485537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0b3630 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009d90 tx=0x7fdcac02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53623de6e01475e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcb959a640 1 -- 172.21.15.50:0/109485537 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac02cbd0 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcb959a640 1 -- 172.21.15.50:0/109485537 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac02cd30 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcb959a640 1 -- 172.21.15.50:0/109485537 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac02cea0 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/109485537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 msgr2=0x7fdcbc0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/109485537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0b3630 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009d90 tx=0x7fdcac02be20 comp rx=0 tx=0).stop 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/109485537 shutdown_connections 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/109485537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0b3630 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/109485537 >> 172.21.15.50:0/109485537 conn(0x7fdcbc0d3090 msgr2=0x7fdcbc0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/109485537 shutdown_connections 2023-12-08T08:19:36.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.454+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/109485537 wait complete. 2023-12-08T08:19:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 Processor -- start 2023-12-08T08:19:36.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 -- start start 2023-12-08T08:19:36.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcbc0b4150 0x7fdcbc15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcbc0cfa30 0x7fdcbc15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0ca160 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0ca3b0 con 0x7fdcbc0cfa30 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.456+0000 7fdcc0bbe640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0ca690 con 0x7fdcbc0b4150 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42906/0 (socket says 172.21.15.50:42906) 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 -- 172.21.15.50:0/1369476190 learned_addr learned my addr 172.21.15.50:0/1369476190 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcba59c640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcbc0b4150 0x7fdcbc15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 -- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcbc0b4150 msgr2=0x7fdcbc15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcbc0b4150 0x7fdcbc15eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcb9d9b640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcbc0cfa30 0x7fdcbc15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 -- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcbc0cfa30 msgr2=0x7fdcbc15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcbc0cfa30 0x7fdcbc15fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 -- 172.21.15.50:0/1369476190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac009a70 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcba59c640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcbc0b4150 0x7fdcbc15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcbad9d640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0cb450 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009d90 tx=0x7fdcac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcb2ffd640 1 -- 172.21.15.50:0/1369476190 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac02cea0 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcb2ffd640 1 -- 172.21.15.50:0/1369476190 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac040450 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc0ca970 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcb2ffd640 1 -- 172.21.15.50:0/1369476190 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0407e0 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.462 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.457+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc0caf30 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.458+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc067430 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.459+0000 7fdcb2ffd640 1 -- 172.21.15.50:0/1369476190 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcac040940 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.459+0000 7fdcb2ffd640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdc9c06ae40 0x7fdc9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.459+0000 7fdcb2ffd640 1 -- 172.21.15.50:0/1369476190 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fdcac0ac340 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.459+0000 7fdcba59c640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdc9c06ae40 0x7fdc9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.463 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.460+0000 7fdcba59c640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdc9c06ae40 0x7fdc9c06d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc06b760 tx=0x7fdcb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.465 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.463+0000 7fdcb2ffd640 1 -- 172.21.15.50:0/1369476190 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdcac077260 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.644+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcbc0743e0 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.646 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.644+0000 7fdcb2ffd640 1 -- 172.21.15.50:0/1369476190 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcac07a880 con 0x7fdcbc0cfe10 2023-12-08T08:19:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdc9c06ae40 msgr2=0x7fdc9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdc9c06ae40 0x7fdc9c06d300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc06b760 tx=0x7fdcb4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 msgr2=0x7fdcbc0cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0cb450 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009d90 tx=0x7fdcac004a40 comp rx=0 tx=0).stop 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 shutdown_connections 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdc9c06ae40 0x7fdc9c06d300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdcbc0cfe10 0x7fdcbc0cb450 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcbc0cfa30 0x7fdcbc15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 --2- 172.21.15.50:0/1369476190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcbc0b4150 0x7fdcbc15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 >> 172.21.15.50:0/1369476190 conn(0x7fdcbc0d3090 msgr2=0x7fdcbc15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 shutdown_connections 2023-12-08T08:19:36.650 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.646+0000 7fdcc0bbe640 1 -- 172.21.15.50:0/1369476190 wait complete. 2023-12-08T08:19:36.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:36.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.766+0000 7fea6b9a9640 1 Processor -- start 2023-12-08T08:19:36.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.766+0000 7fea6b9a9640 1 -- start start 2023-12-08T08:19:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea6b9a9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fea640b4920 0x7fea640acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea6b9a9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea640ad290 0x7fea6406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea6b9a9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea640721f0 con 0x7fea64145d80 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea6b9a9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea640b4e00 con 0x7fea640ad290 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea6b9a9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea640b50e0 con 0x7fea640b4920 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69f46640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea640ad290 0x7fea6406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69745640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fea64145d80 0x7fea64071ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60480/0 (socket says 172.21.15.50:60480) 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69f46640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fea640ad290 0x7fea6406a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42912/0 (socket says 172.21.15.50:42912) 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69745640 1 -- 172.21.15.50:0/1034993217 learned_addr learned my addr 172.21.15.50:0/1034993217 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea68f44640 1 --2- 172.21.15.50:0/1034993217 >> v2:172.21.15.170:3300/0 conn(0x7fea640b4920 0x7fea640acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69f46640 1 -- 172.21.15.50:0/1034993217 >> v2:172.21.15.170:3300/0 conn(0x7fea640b4920 msgr2=0x7fea640acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69f46640 1 --2- 172.21.15.50:0/1034993217 >> v2:172.21.15.170:3300/0 conn(0x7fea640b4920 0x7fea640acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69f46640 1 -- 172.21.15.50:0/1034993217 >> v1:172.21.15.50:6789/0 conn(0x7fea64145d80 legacy=0x7fea64071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea69f46640 1 -- 172.21.15.50:0/1034993217 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6406cfb0 con 0x7fea640ad290 2023-12-08T08:19:36.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.767+0000 7fea5bfff640 1 -- 172.21.15.50:0/1034993217 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046248104 0 0) 0x7fea640721f0 con 0x7fea64145d80 2023-12-08T08:19:36.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.768+0000 7fea69f46640 1 --2- 172.21.15.50:0/1034993217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea6406a4d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fea6406f2a0 tx=0x7fea5c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcaa173a5311193f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.768+0000 7fea5bfff640 1 -- 172.21.15.50:0/1034993217 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c02cc80 con 0x7fea640ad290 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.768+0000 7fea5bfff640 1 -- 172.21.15.50:0/1034993217 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c02cde0 con 0x7fea640ad290 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.768+0000 7fea5bfff640 1 -- 172.21.15.50:0/1034993217 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c034660 con 0x7fea640ad290 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 -- 172.21.15.50:0/1034993217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 msgr2=0x7fea6406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/1034993217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea6406a4d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fea6406f2a0 tx=0x7fea5c02bed0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 -- 172.21.15.50:0/1034993217 shutdown_connections 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/1034993217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea6406a4d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/1034993217 >> v2:172.21.15.170:3300/0 conn(0x7fea640b4920 0x7fea640acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 -- 172.21.15.50:0/1034993217 >> 172.21.15.50:0/1034993217 conn(0x7fea6406b7c0 msgr2=0x7fea6406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 -- 172.21.15.50:0/1034993217 shutdown_connections 2023-12-08T08:19:36.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.769+0000 7fea6b9a9640 1 -- 172.21.15.50:0/1034993217 wait complete. 2023-12-08T08:19:36.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.770+0000 7fea6b9a9640 1 Processor -- start 2023-12-08T08:19:36.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.770+0000 7fea6b9a9640 1 -- start start 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea6b9a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea64140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea6b9a9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea640b4920 0x7fea640ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea6b9a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea64145d80 0x7fea64141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea6b9a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64141060 con 0x7fea640ad290 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea6b9a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6415d120 con 0x7fea64145d80 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea6b9a9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea64140080 con 0x7fea640b4920 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea64140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea64140b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42922/0 (socket says 172.21.15.50:42922) 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 -- 172.21.15.50:0/4105391070 learned_addr learned my addr 172.21.15.50:0/4105391070 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea68f44640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea640b4920 0x7fea640ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69f46640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea64145d80 0x7fea64141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 -- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea640b4920 msgr2=0x7fea640ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea640b4920 0x7fea640ae930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 -- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea64145d80 msgr2=0x7fea64141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea64145d80 0x7fea64141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 -- 172.21.15.50:0/4105391070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c009a70 con 0x7fea640ad290 2023-12-08T08:19:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea69745640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea64140b20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c430 tx=0x7fea6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea59ffb640 1 -- 172.21.15.50:0/4105391070 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600074e0 con 0x7fea640ad290 2023-12-08T08:19:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea59ffb640 1 -- 172.21.15.50:0/4105391070 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60007660 con 0x7fea640ad290 2023-12-08T08:19:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea59ffb640 1 -- 172.21.15.50:0/4105391070 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60004a20 con 0x7fea640ad290 2023-12-08T08:19:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.771+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea64141ff0 con 0x7fea640ad290 2023-12-08T08:19:36.776 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.772+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea64140340 con 0x7fea640ad290 2023-12-08T08:19:36.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.773+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea64071460 con 0x7fea640ad290 2023-12-08T08:19:36.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.773+0000 7fea59ffb640 1 -- 172.21.15.50:0/4105391070 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea60004b80 con 0x7fea640ad290 2023-12-08T08:19:36.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.773+0000 7fea59ffb640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea4806ae40 0x7fea4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:36.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.773+0000 7fea59ffb640 1 -- 172.21.15.50:0/4105391070 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fea60089710 con 0x7fea640ad290 2023-12-08T08:19:36.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.774+0000 7fea68f44640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea4806ae40 0x7fea4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:36.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.774+0000 7fea68f44640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea4806ae40 0x7fea4806d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea640b3f60 tx=0x7fea54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:36.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.778+0000 7fea59ffb640 1 -- 172.21.15.50:0/4105391070 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea600544f0 con 0x7fea640ad290 2023-12-08T08:19:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.952+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea6406f110 con 0x7fea640ad290 2023-12-08T08:19:36.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.953+0000 7fea59ffb640 1 -- 172.21.15.50:0/4105391070 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea60057b10 con 0x7fea640ad290 2023-12-08T08:19:36.955 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea4806ae40 msgr2=0x7fea4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea4806ae40 0x7fea4806d300 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea640b3f60 tx=0x7fea54008040 comp rx=0 tx=0).stop 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 msgr2=0x7fea64140b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea64140b20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c430 tx=0x7fea6000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 shutdown_connections 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea4806ae40 0x7fea4806d300 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea64145d80 0x7fea64141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.954+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea640b4920 0x7fea640ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.955+0000 7fea6b9a9640 1 --2- 172.21.15.50:0/4105391070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea640ad290 0x7fea64140b20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.955+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 >> 172.21.15.50:0/4105391070 conn(0x7fea6406b7c0 msgr2=0x7fea64143090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.955+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 shutdown_connections 2023-12-08T08:19:36.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:36.955+0000 7fea6b9a9640 1 -- 172.21.15.50:0/4105391070 wait complete. 2023-12-08T08:19:36.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.075+0000 7fd98d301640 1 Processor -- start 2023-12-08T08:19:37.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.075+0000 7fd98d301640 1 -- start start 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd98d301640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd988145d80 0x7fd988071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd98d301640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd9880b4920 0x7fd9880acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd98d301640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9880ad290 0x7fd98806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd98d301640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9880b4e00 con 0x7fd988145d80 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd98d301640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9880b50e0 con 0x7fd9880b4920 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd98d301640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98806cfb0 con 0x7fd9880ad290 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd988145d80 0x7fd988071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd988145d80 0x7fd988071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42934/0 (socket says 172.21.15.50:42934) 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 -- 172.21.15.50:0/1136155232 learned_addr learned my addr 172.21.15.50:0/1136155232 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd9877fe640 1 --2- 172.21.15.50:0/1136155232 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9880ad290 0x7fd98806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 -- 172.21.15.50:0/1136155232 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9880ad290 msgr2=0x7fd98806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd97ffff640 1 --2- 172.21.15.50:0/1136155232 >> v2:172.21.15.170:3300/0 conn(0x7fd9880b4920 0x7fd9880acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 --2- 172.21.15.50:0/1136155232 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9880ad290 0x7fd98806a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 -- 172.21.15.50:0/1136155232 >> v2:172.21.15.170:3300/0 conn(0x7fd9880b4920 msgr2=0x7fd9880acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 --2- 172.21.15.50:0/1136155232 >> v2:172.21.15.170:3300/0 conn(0x7fd9880b4920 0x7fd9880acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.076+0000 7fd986ffd640 1 -- 172.21.15.50:0/1136155232 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98806d290 con 0x7fd988145d80 2023-12-08T08:19:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.077+0000 7fd986ffd640 1 --2- 172.21.15.50:0/1136155232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd988145d80 0x7fd988071ae0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd98806f2a0 tx=0x7fd97802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28422bfdffa45e04 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.077+0000 7fd9867fc640 1 -- 172.21.15.50:0/1136155232 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978031870 con 0x7fd988145d80 2023-12-08T08:19:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.077+0000 7fd9867fc640 1 -- 172.21.15.50:0/1136155232 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9780319d0 con 0x7fd988145d80 2023-12-08T08:19:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.077+0000 7fd9867fc640 1 -- 172.21.15.50:0/1136155232 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978031d60 con 0x7fd988145d80 2023-12-08T08:19:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 -- 172.21.15.50:0/1136155232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd988145d80 msgr2=0x7fd988071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 --2- 172.21.15.50:0/1136155232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd988145d80 0x7fd988071ae0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd98806f2a0 tx=0x7fd97802b910 comp rx=0 tx=0).stop 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 -- 172.21.15.50:0/1136155232 shutdown_connections 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 --2- 172.21.15.50:0/1136155232 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd9880ad290 0x7fd98806a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 --2- 172.21.15.50:0/1136155232 >> v2:172.21.15.170:3300/0 conn(0x7fd9880b4920 0x7fd9880acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 --2- 172.21.15.50:0/1136155232 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd988145d80 0x7fd988071ae0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 -- 172.21.15.50:0/1136155232 >> 172.21.15.50:0/1136155232 conn(0x7fd98806b7c0 msgr2=0x7fd98806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 -- 172.21.15.50:0/1136155232 shutdown_connections 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.078+0000 7fd98d301640 1 -- 172.21.15.50:0/1136155232 wait complete. 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.079+0000 7fd98d301640 1 Processor -- start 2023-12-08T08:19:37.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.079+0000 7fd98d301640 1 -- start start 2023-12-08T08:19:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd98d301640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880ad290 0x7fd988140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd98d301640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9880b4920 0x7fd9880cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd98d301640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd988145d80 0x7fd98813e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd98d301640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880cde20 con 0x7fd9880ad290 2023-12-08T08:19:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd98d301640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880cd210 con 0x7fd9880b4920 2023-12-08T08:19:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd98d301640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880cd4f0 con 0x7fd988145d80 2023-12-08T08:19:37.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880ad290 0x7fd988140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880ad290 0x7fd988140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42948/0 (socket says 172.21.15.50:42948) 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 -- 172.21.15.50:0/2874374290 learned_addr learned my addr 172.21.15.50:0/2874374290 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd97ffff640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9880b4920 0x7fd9880cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd9877fe640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd988145d80 0x7fd98813e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 -- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd988145d80 msgr2=0x7fd98813e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd988145d80 0x7fd98813e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 -- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9880b4920 msgr2=0x7fd9880cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9880b4920 0x7fd9880cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 -- 172.21.15.50:0/2874374290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9780094d0 con 0x7fd9880ad290 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.080+0000 7fd986ffd640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880ad290 0x7fd988140ce0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd97802b950 tx=0x7fd9780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.081+0000 7fd97f7fe640 1 -- 172.21.15.50:0/2874374290 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978031860 con 0x7fd9880ad290 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.081+0000 7fd97f7fe640 1 -- 172.21.15.50:0/2874374290 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9780443f0 con 0x7fd9880ad290 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.081+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9880cd7d0 con 0x7fd9880ad290 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.081+0000 7fd97f7fe640 1 -- 172.21.15.50:0/2874374290 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9780447a0 con 0x7fd9880ad290 2023-12-08T08:19:37.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.081+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9880ccf00 con 0x7fd9880ad290 2023-12-08T08:19:37.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.082+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd988071460 con 0x7fd9880ad290 2023-12-08T08:19:37.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.082+0000 7fd97f7fe640 1 -- 172.21.15.50:0/2874374290 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd97804d450 con 0x7fd9880ad290 2023-12-08T08:19:37.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.083+0000 7fd97f7fe640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd96806ae70 0x7fd96806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.083+0000 7fd97f7fe640 1 -- 172.21.15.50:0/2874374290 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd97802d040 con 0x7fd9880ad290 2023-12-08T08:19:37.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.083+0000 7fd97ffff640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd96806ae70 0x7fd96806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.084+0000 7fd97ffff640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd96806ae70 0x7fd96806d330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd9881e9210 tx=0x7fd970008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.087+0000 7fd97f7fe640 1 -- 172.21.15.50:0/2874374290 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd978076dd0 con 0x7fd9880ad290 2023-12-08T08:19:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.262+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd9880cc5d0 con 0x7fd9880ad290 2023-12-08T08:19:37.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.263+0000 7fd97f7fe640 1 -- 172.21.15.50:0/2874374290 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd978035070 con 0x7fd9880ad290 2023-12-08T08:19:37.265 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd96806ae70 msgr2=0x7fd96806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd96806ae70 0x7fd96806d330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd9881e9210 tx=0x7fd970008040 comp rx=0 tx=0).stop 2023-12-08T08:19:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880ad290 msgr2=0x7fd988140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880ad290 0x7fd988140ce0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd97802b950 tx=0x7fd9780046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 shutdown_connections 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd96806ae70 0x7fd96806d330 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd988145d80 0x7fd98813e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9880b4920 0x7fd9880cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 --2- 172.21.15.50:0/2874374290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd9880ad290 0x7fd988140ce0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 >> 172.21.15.50:0/2874374290 conn(0x7fd98806b7c0 msgr2=0x7fd988143a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 shutdown_connections 2023-12-08T08:19:37.268 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.265+0000 7fd98d301640 1 -- 172.21.15.50:0/2874374290 wait complete. 2023-12-08T08:19:37.278 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-08T08:19:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.384+0000 7ff55609b640 1 Processor -- start 2023-12-08T08:19:37.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.384+0000 7ff55609b640 1 -- start start 2023-12-08T08:19:37.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.385+0000 7ff55609b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff5500b4150 0x7ff5500b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.385+0000 7ff55609b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff5500cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.385+0000 7ff55609b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5500c6be0 con 0x7ff5500cfa30 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.385+0000 7ff55609b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5500d3ff0 con 0x7ff5500b4150 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.385+0000 7ff55609b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500b4860 con 0x7ff5500cfe10 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.385+0000 7ff54f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff5500cfa30 0x7ff5500b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60492/0 (socket says 172.21.15.50:60492) 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.385+0000 7ff54f7fe640 1 -- 172.21.15.50:0/761702293 learned_addr learned my addr 172.21.15.50:0/761702293 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529176605 0 0) 0x7ff5500c6be0 con 0x7ff5500cfa30 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff538003520 con 0x7ff5500cfa30 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54effd640 1 --2- 172.21.15.50:0/761702293 >> v2:172.21.15.170:3300/0 conn(0x7ff5500b4150 0x7ff5500b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54ffff640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff5500cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 228999718 0 0) 0x7ff538003520 con 0x7ff5500cfa30 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 msgr2=0x7ff5500cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff5500cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 >> v2:172.21.15.170:3300/0 conn(0x7ff5500b4150 msgr2=0x7ff5500b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 --2- 172.21.15.50:0/761702293 >> v2:172.21.15.170:3300/0 conn(0x7ff5500b4150 0x7ff5500b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500d3d50 con 0x7ff5500cfa30 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7ff540001690 con 0x7ff5500cfa30 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54ffff640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff5500cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 >> v1:172.21.15.50:6789/0 conn(0x7ff5500cfa30 legacy=0x7ff5500b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff538003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5380047c0 0x7ff538004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff538005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500d3ff0 con 0x7ff538003970 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5500b4860 con 0x7ff5380047c0 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53800ba80 con 0x7ff5500cfe10 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54f7fe640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff538003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54effd640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5380047c0 0x7ff538004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54ffff640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff538005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.392 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54f7fe640 1 -- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 msgr2=0x7ff538005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54f7fe640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff538005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54f7fe640 1 -- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5380047c0 msgr2=0x7ff538004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54f7fe640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5380047c0 0x7ff538004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54f7fe640 1 -- 172.21.15.50:0/761702293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538003520 con 0x7ff538003970 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.386+0000 7ff54ffff640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5500cfe10 0x7ff538005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.387+0000 7ff54f7fe640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff538003d90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff55008b280 tx=0x7ff5380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07fd5402f16cadb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.387+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540005ad0 con 0x7ff538003970 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.387+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff540005c50 con 0x7ff538003970 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.387+0000 7ff54e7fc640 1 -- 172.21.15.50:0/761702293 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54002c890 con 0x7ff538003970 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.388+0000 7ff55609b640 1 -- 172.21.15.50:0/761702293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 msgr2=0x7ff538003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.388+0000 7ff55609b640 1 --2- 172.21.15.50:0/761702293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff538003d90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff55008b280 tx=0x7ff5380057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.388+0000 7ff54ffff640 1 -- 172.21.15.50:0/761702293 reap_dead start 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.388+0000 7ff55609b640 1 -- 172.21.15.50:0/761702293 shutdown_connections 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.388+0000 7ff55609b640 1 -- 172.21.15.50:0/761702293 >> 172.21.15.50:0/761702293 conn(0x7ff5500d3090 msgr2=0x7ff5500d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.393 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.388+0000 7ff55609b640 1 -- 172.21.15.50:0/761702293 shutdown_connections 2023-12-08T08:19:37.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.388+0000 7ff55609b640 1 -- 172.21.15.50:0/761702293 wait complete. 2023-12-08T08:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.389+0000 7ff55609b640 1 Processor -- start 2023-12-08T08:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.389+0000 7ff55609b640 1 -- start start 2023-12-08T08:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff55609b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff550155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff55609b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5501f3aa0 0x7ff550145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff55609b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff550145840 0x7ff550145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff55609b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550160820 con 0x7ff538003970 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff55609b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550155ee0 con 0x7ff550145840 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff55609b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501561c0 con 0x7ff5501f3aa0 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff550155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff550155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42960/0 (socket says 172.21.15.50:42960) 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 -- 172.21.15.50:0/2115977211 learned_addr learned my addr 172.21.15.50:0/2115977211 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54effd640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5501f3aa0 0x7ff550145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54ffff640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff550145840 0x7ff550145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 -- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5501f3aa0 msgr2=0x7ff550145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5501f3aa0 0x7ff550145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 -- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff550145840 msgr2=0x7ff550145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff550145840 0x7ff550145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.397 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54f7fe640 1 -- 172.21.15.50:0/2115977211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5501564a0 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.390+0000 7ff54ffff640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff550145840 0x7ff550145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.391+0000 7ff54f7fe640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff550155860 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c350 tx=0x7ff55015dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.391+0000 7ff537fff640 1 -- 172.21.15.50:0/2115977211 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540039070 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.391+0000 7ff537fff640 1 -- 172.21.15.50:0/2115977211 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54002cca0 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.391+0000 7ff537fff640 1 -- 172.21.15.50:0/2115977211 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540007270 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.391+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff550156780 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.391+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5501f3f00 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.392+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550067430 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.392+0000 7ff537fff640 1 -- 172.21.15.50:0/2115977211 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff540032070 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.393+0000 7ff537fff640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff53c06ae40 0x7ff53c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.393+0000 7ff537fff640 1 -- 172.21.15.50:0/2115977211 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ff54003c040 con 0x7ff538003970 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.393+0000 7ff54effd640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff53c06ae40 0x7ff53c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.394+0000 7ff54effd640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff53c06ae40 0x7ff53c06d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff544009b60 tx=0x7ff544009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.399 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.397+0000 7ff537fff640 1 -- 172.21.15.50:0/2115977211 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff540075a20 con 0x7ff538003970 2023-12-08T08:19:37.575 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.573+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7ff5500743e0 con 0x7ff538003970 2023-12-08T08:19:37.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.573+0000 7ff537fff640 1 -- 172.21.15.50:0/2115977211 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v41) v1 ==== 97+0+11 (secure 0 0 0) 0x7ff5400aa070 con 0x7ff538003970 2023-12-08T08:19:37.576 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:37.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff53c06ae40 msgr2=0x7ff53c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff53c06ae40 0x7ff53c06d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff544009b60 tx=0x7ff544009190 comp rx=0 tx=0).stop 2023-12-08T08:19:37.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 msgr2=0x7ff550155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff550155860 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff54000c350 tx=0x7ff55015dcf0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 shutdown_connections 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff53c06ae40 0x7ff53c06d300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff550145840 0x7ff550145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5501f3aa0 0x7ff550145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 --2- 172.21.15.50:0/2115977211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff538003970 0x7ff550155860 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 >> 172.21.15.50:0/2115977211 conn(0x7ff5500d3090 msgr2=0x7ff5500b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 shutdown_connections 2023-12-08T08:19:37.579 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.575+0000 7ff55609b640 1 -- 172.21.15.50:0/2115977211 wait complete. 2023-12-08T08:19:37.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.693+0000 7f7420031640 1 Processor -- start 2023-12-08T08:19:37.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.693+0000 7f7420031640 1 -- start start 2023-12-08T08:19:37.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f7420031640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f74180b6ac0 0x7f74180cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f7420031640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180ce1c0 0x7f74180cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f7420031640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180d0070 con 0x7f74180cd660 2023-12-08T08:19:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f7420031640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7418160cb0 con 0x7f74180b6ac0 2023-12-08T08:19:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f7420031640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180d02b0 con 0x7f74180ce1c0 2023-12-08T08:19:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f741e5ce640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180ce1c0 0x7f74180cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f741ddcd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f74180b6ac0 0x7f74180cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f741d5cc640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f74180cd660 0x7f74180cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49008/0 (socket says 172.21.15.50:49008) 2023-12-08T08:19:37.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.694+0000 7f741d5cc640 1 -- 172.21.15.50:0/583702716 learned_addr learned my addr 172.21.15.50:0/583702716 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.695+0000 7f741ddcd640 1 -- 172.21.15.50:0/583702716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180ce1c0 msgr2=0x7f74180cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.695+0000 7f741ddcd640 1 --2- 172.21.15.50:0/583702716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180ce1c0 0x7f74180cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.695+0000 7f741ddcd640 1 -- 172.21.15.50:0/583702716 >> v1:172.21.15.170:6789/0 conn(0x7f74180cd660 legacy=0x7f74180cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.695+0000 7f741ddcd640 1 -- 172.21.15.50:0/583702716 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180cb430 con 0x7f74180b6ac0 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f741ddcd640 1 --2- 172.21.15.50:0/583702716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180b6ac0 0x7f74180cfb30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f74140097a0 tx=0x7f741402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae0ff7de7c77418d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f741cdcb640 1 -- 172.21.15.50:0/583702716 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741402f050 con 0x7f74180b6ac0 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f741cdcb640 1 -- 172.21.15.50:0/583702716 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414031700 con 0x7f74180b6ac0 2023-12-08T08:19:37.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f741cdcb640 1 -- 172.21.15.50:0/583702716 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414031a90 con 0x7f74180b6ac0 2023-12-08T08:19:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 -- 172.21.15.50:0/583702716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180b6ac0 msgr2=0x7f74180cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 --2- 172.21.15.50:0/583702716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180b6ac0 0x7f74180cfb30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f74140097a0 tx=0x7f741402b7a0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 -- 172.21.15.50:0/583702716 shutdown_connections 2023-12-08T08:19:37.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 --2- 172.21.15.50:0/583702716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180ce1c0 0x7f74180cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 --2- 172.21.15.50:0/583702716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180b6ac0 0x7f74180cfb30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 -- 172.21.15.50:0/583702716 >> 172.21.15.50:0/583702716 conn(0x7f74180d0de0 msgr2=0x7f74180d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 -- 172.21.15.50:0/583702716 shutdown_connections 2023-12-08T08:19:37.700 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.696+0000 7f7420031640 1 -- 172.21.15.50:0/583702716 wait complete. 2023-12-08T08:19:37.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 Processor -- start 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 -- start start 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180b6ac0 0x7f74181e7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74180cd660 0x7f74181e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180ce1c0 0x7f741815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741815d3f0 con 0x7f74180cd660 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180c88c0 con 0x7f74180ce1c0 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.698+0000 7f7420031640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180c98b0 con 0x7f74180b6ac0 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74180cd660 0x7f74181e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74180cd660 0x7f74181e80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:42966/0 (socket says 172.21.15.50:42966) 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 -- 172.21.15.50:0/2744667352 learned_addr learned my addr 172.21.15.50:0/2744667352 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741ddcd640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180b6ac0 0x7f74181e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741e5ce640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180ce1c0 0x7f741815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 -- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180b6ac0 msgr2=0x7f74181e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180b6ac0 0x7f74181e7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 -- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180ce1c0 msgr2=0x7f741815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180ce1c0 0x7f741815c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 -- 172.21.15.50:0/2744667352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009400 con 0x7f74180cd660 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f741d5cc640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74180cd660 0x7f74181e80a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f740800c400 tx=0x7f740800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f740e7fc640 1 -- 172.21.15.50:0/2744667352 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408005ce0 con 0x7f74180cd660 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f740e7fc640 1 -- 172.21.15.50:0/2744667352 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408005e40 con 0x7f74180cd660 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180c8af0 con 0x7f74180cd660 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f740e7fc640 1 -- 172.21.15.50:0/2744667352 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408007310 con 0x7f74180cd660 2023-12-08T08:19:37.703 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.699+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74180c90b0 con 0x7f74180cd660 2023-12-08T08:19:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.700+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7418067430 con 0x7f74180cd660 2023-12-08T08:19:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.701+0000 7f740e7fc640 1 -- 172.21.15.50:0/2744667352 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7408007470 con 0x7f74180cd660 2023-12-08T08:19:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.701+0000 7f740e7fc640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f73fc06ae40 0x7f73fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.701+0000 7f740e7fc640 1 -- 172.21.15.50:0/2744667352 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f7408088c30 con 0x7f74180cd660 2023-12-08T08:19:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.701+0000 7f741ddcd640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f73fc06ae40 0x7f73fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:37.704 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.702+0000 7f741ddcd640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f73fc06ae40 0x7f73fc06d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7414035000 tx=0x7f7414008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:37.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.705+0000 7f740e7fc640 1 -- 172.21.15.50:0/2744667352 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7408053ac0 con 0x7f74180cd660 2023-12-08T08:19:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.895+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74180d0070 con 0x7f74180cd660 2023-12-08T08:19:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.895+0000 7f740e7fc640 1 -- 172.21.15.50:0/2744667352 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74180d0070 con 0x7f74180cd660 2023-12-08T08:19:37.898 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f73fc06ae40 msgr2=0x7f73fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f73fc06ae40 0x7f73fc06d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7414035000 tx=0x7f7414008030 comp rx=0 tx=0).stop 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74180cd660 msgr2=0x7f74181e80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74180cd660 0x7f74181e80a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f740800c400 tx=0x7f740800c8c0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 shutdown_connections 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f73fc06ae40 0x7f73fc06d300 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74180cd660 0x7f74181e80a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74180ce1c0 0x7f741815c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 --2- 172.21.15.50:0/2744667352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74180b6ac0 0x7f74181e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 >> 172.21.15.50:0/2744667352 conn(0x7f74180d0de0 msgr2=0x7f741806e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 shutdown_connections 2023-12-08T08:19:37.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:37.897+0000 7f7420031640 1 -- 172.21.15.50:0/2744667352 wait complete. 2023-12-08T08:19:37.910 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:19:37.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:37.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:37.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[105560]: fuse finished with error 0 and tester_r 0 2023-12-08T08:19:37.941 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:44.043 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:19:44.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:44.043 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:19:44.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.217+0000 7f9ae670f640 1 Processor -- start 2023-12-08T08:19:44.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.217+0000 7f9ae670f640 1 -- start start 2023-12-08T08:19:44.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.218+0000 7f9ae670f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 0x7f9ae00d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.218+0000 7f9ae670f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00d20b0 con 0x7f9ae00b0cf0 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.218+0000 7f9ae670f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00d1b80 con 0x7f9ae01608a0 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.218+0000 7f9ae670f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00d0620 con 0x7f9ae00b1d70 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.218+0000 7f9adf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ae00b0cf0 0x7f9ae00cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50732/0 (socket says 172.21.15.50:50732) 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.218+0000 7f9adf7fe640 1 -- 172.21.15.50:0/3753211725 learned_addr learned my addr 172.21.15.50:0/3753211725 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9ae4cac640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 0x7f9ae00d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419202847 0 0) 0x7f9ae00d20b0 con 0x7f9ae00b0cf0 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac8003520 con 0x7f9ae00b0cf0 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945005979 0 0) 0x7f9ac8003520 con 0x7f9ae00b0cf0 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 msgr2=0x7f9ae00d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 0x7f9ae00d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 >> v1:172.21.15.170:6789/0 conn(0x7f9ae01608a0 legacy=0x7f9ae00d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00d1dd0 con 0x7f9ae00b0cf0 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f9ad4001670 con 0x7f9ae00b0cf0 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 >> v1:172.21.15.50:6789/0 conn(0x7f9ae00b0cf0 legacy=0x7f9ae00cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ac80039a0 0x7f9ac8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 0x7f9ac80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ac8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00d0620 con 0x7f9ac8004d00 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac800ba60 con 0x7f9ac80039a0 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac800bc20 con 0x7f9ae00b1d70 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9ae4cac640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ac8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adffff640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ac80039a0 0x7f9ac8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.219+0000 7f9adf7fe640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 0x7f9ac80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.220+0000 7f9ae4cac640 1 -- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 msgr2=0x7f9ac80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.220+0000 7f9ae4cac640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae00b1d70 0x7f9ac80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.220+0000 7f9ae4cac640 1 -- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ac80039a0 msgr2=0x7f9ac8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.220+0000 7f9ae4cac640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ac80039a0 0x7f9ac8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.220+0000 7f9ae4cac640 1 -- 172.21.15.50:0/3753211725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8003520 con 0x7f9ac8004d00 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.220+0000 7f9ae4cac640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ac8005180 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009fc0 tx=0x7f9ac80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b30a048be4a298 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad802cc20 con 0x7f9ac8004d00 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad800f040 con 0x7f9ac8004d00 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9adeffd640 1 -- 172.21.15.50:0/3753211725 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8034440 con 0x7f9ac8004d00 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9ae670f640 1 -- 172.21.15.50:0/3753211725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 msgr2=0x7f9ac8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9ae670f640 1 --2- 172.21.15.50:0/3753211725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ac8005180 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009fc0 tx=0x7f9ac80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9ae4cac640 1 -- 172.21.15.50:0/3753211725 reap_dead start 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9ae670f640 1 -- 172.21.15.50:0/3753211725 shutdown_connections 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9ae670f640 1 -- 172.21.15.50:0/3753211725 >> 172.21.15.50:0/3753211725 conn(0x7f9ae00d3030 msgr2=0x7f9ae00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9ae670f640 1 -- 172.21.15.50:0/3753211725 shutdown_connections 2023-12-08T08:19:44.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.221+0000 7f9ae670f640 1 -- 172.21.15.50:0/3753211725 wait complete. 2023-12-08T08:19:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.222+0000 7f9ae670f640 1 Processor -- start 2023-12-08T08:19:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9ae670f640 1 -- start start 2023-12-08T08:19:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9ae670f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ae00cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9ae670f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ae0152e70 0x7f9ae00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9ae670f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae01522c0 0x7f9ae0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9ae670f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00ccf20 con 0x7f9ac8004d00 2023-12-08T08:19:44.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9ae670f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00c7ae0 con 0x7f9ae0152e70 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9ae670f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0152c60 con 0x7f9ae01522c0 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9adffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ae00cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9adffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ae00cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58778/0 (socket says 172.21.15.50:58778) 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.223+0000 7f9adffff640 1 -- 172.21.15.50:0/3008026767 learned_addr learned my addr 172.21.15.50:0/3008026767 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9ae4cac640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae01522c0 0x7f9ae0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adf7fe640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ae0152e70 0x7f9ae00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adffff640 1 -- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae01522c0 msgr2=0x7f9ae0152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adffff640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae01522c0 0x7f9ae0152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adffff640 1 -- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ae0152e70 msgr2=0x7f9ae00c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adffff640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ae0152e70 0x7f9ae00c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adffff640 1 -- 172.21.15.50:0/3008026767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae01f3120 con 0x7f9ac8004d00 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adffff640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ae00cc9e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000f8b0 tx=0x7f9ad000fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adcff9640 1 -- 172.21.15.50:0/3008026767 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0001550 con 0x7f9ac8004d00 2023-12-08T08:19:44.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adcff9640 1 -- 172.21.15.50:0/3008026767 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad00052e0 con 0x7f9ac8004d00 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae00c7520 con 0x7f9ac8004d00 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9adcff9640 1 -- 172.21.15.50:0/3008026767 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000d970 con 0x7f9ac8004d00 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.224+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00cad00 con 0x7f9ac8004d00 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.225+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae0067430 con 0x7f9ac8004d00 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.226+0000 7f9adcff9640 1 -- 172.21.15.50:0/3008026767 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ad000dad0 con 0x7f9ac8004d00 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.226+0000 7f9adcff9640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9acc06ae40 0x7f9acc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.226+0000 7f9adcff9640 1 -- 172.21.15.50:0/3008026767 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f9ad00899a0 con 0x7f9ac8004d00 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.226+0000 7f9adf7fe640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9acc06ae40 0x7f9acc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:44.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.227+0000 7f9adf7fe640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9acc06ae40 0x7f9acc06d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ae01f65f0 tx=0x7f9ad4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:44.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.231+0000 7f9adcff9640 1 -- 172.21.15.50:0/3008026767 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ad00547f0 con 0x7f9ac8004d00 2023-12-08T08:19:44.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.443+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9ae006c630 con 0x7f9ac8004d00 2023-12-08T08:19:44.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.443+0000 7f9adcff9640 1 -- 172.21.15.50:0/3008026767 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+82 (secure 0 0 0) 0x7f9ad0057e10 con 0x7f9ac8004d00 2023-12-08T08:19:44.446 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-12-08T08:19:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9acc06ae40 msgr2=0x7f9acc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.447 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9acc06ae40 0x7f9acc06d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ae01f65f0 tx=0x7f9ad4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 msgr2=0x7f9ae00cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ae00cc9e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000f8b0 tx=0x7f9ad000fd70 comp rx=0 tx=0).stop 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 shutdown_connections 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9acc06ae40 0x7f9acc06d300 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ae01522c0 0x7f9ae0152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ae0152e70 0x7f9ae00c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 --2- 172.21.15.50:0/3008026767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ac8004d00 0x7f9ae00cc9e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 >> 172.21.15.50:0/3008026767 conn(0x7f9ae00d3030 msgr2=0x7f9ae015fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 shutdown_connections 2023-12-08T08:19:44.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:44.445+0000 7f9ae670f640 1 -- 172.21.15.50:0/3008026767 wait complete. 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:19:44.458 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:44.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:44.459 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:19:44.475 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:44.475 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:44.476 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c008:83ff:fe50:e6c0/64 scope link 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::403f:3fff:fee6:f2fc/64 scope link 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::2880:6dff:fe2e:b579/64 scope link 2023-12-08T08:19:44.477 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:44.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:44.478 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:44.545 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:19:44.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:44.546 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:19:44.602 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:19:44.602 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:44.602 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:19:44.602 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:19:44.602 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:44.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:44.603 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:19:44.603 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:19:44.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:19:44.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:19:44.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:19:44.603 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:19:44.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:44.708 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:19:44.724 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-08T08:19:44.724 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:19:44.724 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:44.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:44.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:19:44.795 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-08T08:19:44.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:44.795 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:44.851 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:44.851 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:44.851 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:44.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:19:44.978 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:19:45.034 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:19:45.035 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:19:45.036 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:19:45.037 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:19:45.038 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:19:45.038 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:45.038 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:45.038 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:45.038 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:45.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.038 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:19:45.090 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:19:45.090 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T08:19:45.132 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:19:45.163 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:19:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:19:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:19:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:19:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:19:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:19:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:19:45.219 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:19:45.220 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:45.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.222 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:19:45.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-12-08T08:19:45.224+0000 7f35bce49480 -1 init, newargv = 0x55fd7bdd31d0 newargc=15 2023-12-08T08:19:45.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[106795]: starting ceph client 2023-12-08T08:19:45.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[106795]: starting fuse 2023-12-08T08:19:45.242 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:19:45.242 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:19:45.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:19:45.242 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:19:45.242 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:19:45.242 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:19:45.242 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:19:45.242 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:19:45.243 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:19:45.244 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:19:45.244 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:19:45.244 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:45.244 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-12-08T08:19:45.244 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:19:45.366 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.106795.asok 2023-12-08T08:19:45.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:19:45.378 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.106795.asok 2023-12-08T08:19:45.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.106795.asok status 2023-12-08T08:19:45.520 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "106795", 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5862, 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:19:45.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 5862 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 873808634 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 873808634 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:45.522 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.5862 192.168.0.1:0/873808634", 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/873808634", 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 17, 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 43, 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:19:45.523 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:19:45.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.529 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:19:45.529 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:45.544 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:19:45.545 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:45.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:45.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.616 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-12-08T08:19:45.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:45.672 INFO:teuthology.orchestra.run.smithi050.stderr:setfattr: layoutfile: Permission denied 2023-12-08T08:19:45.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:45.673 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-12-08T08:19:45.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:19:45.729 INFO:teuthology.orchestra.run.smithi050.stderr:setfattr: layoutdir: Permission denied 2023-12-08T08:19:45.730 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:19:45.730 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:45.787 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:45.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.931+0000 7f4be23a0640 1 Processor -- start 2023-12-08T08:19:45.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.931+0000 7f4be23a0640 1 -- start start 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be23a0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bdc0b43e0 0x7f4bdc0d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be23a0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be23a0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4bdc0cfba0 0x7f4bdc160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be23a0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc0d0010 con 0x7f4bdc0b43e0 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be23a0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc0cdb40 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be23a0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc0cdde0 con 0x7f4bdc0d1c30 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bdc0b43e0 0x7f4bdc0d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4bdc0b43e0 0x7f4bdc0d16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58780/0 (socket says 172.21.15.50:58780) 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 -- 172.21.15.50:0/4118539276 learned_addr learned my addr 172.21.15.50:0/4118539276 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:45.935 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be0b9d640 1 --2- 172.21.15.50:0/4118539276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be1b9f640 1 --2- 172.21.15.50:0/4118539276 >> v2:172.21.15.170:3300/0 conn(0x7f4bdc0cfba0 0x7f4bdc160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 -- 172.21.15.50:0/4118539276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 msgr2=0x7f4bdc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:45.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 --2- 172.21.15.50:0/4118539276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 -- 172.21.15.50:0/4118539276 >> v2:172.21.15.170:3300/0 conn(0x7f4bdc0cfba0 msgr2=0x7f4bdc160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:45.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 --2- 172.21.15.50:0/4118539276 >> v2:172.21.15.170:3300/0 conn(0x7f4bdc0cfba0 0x7f4bdc160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.936 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.932+0000 7f4be139e640 1 -- 172.21.15.50:0/4118539276 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0d3cf0 con 0x7f4bdc0b43e0 2023-12-08T08:19:45.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.933+0000 7f4be139e640 1 --2- 172.21.15.50:0/4118539276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0b43e0 0x7f4bdc0d16f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc08c120 tx=0x7f4bd402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b934f3f1a242ddc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.933+0000 7f4bd3fff640 1 -- 172.21.15.50:0/4118539276 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40317e0 con 0x7f4bdc0b43e0 2023-12-08T08:19:45.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.933+0000 7f4bd3fff640 1 -- 172.21.15.50:0/4118539276 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd4031940 con 0x7f4bdc0b43e0 2023-12-08T08:19:45.937 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.933+0000 7f4bd3fff640 1 -- 172.21.15.50:0/4118539276 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4031cd0 con 0x7f4bdc0b43e0 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 -- 172.21.15.50:0/4118539276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0b43e0 msgr2=0x7f4bdc0d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 --2- 172.21.15.50:0/4118539276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0b43e0 0x7f4bdc0d16f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc08c120 tx=0x7f4bd402b880 comp rx=0 tx=0).stop 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 -- 172.21.15.50:0/4118539276 shutdown_connections 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 --2- 172.21.15.50:0/4118539276 >> v2:172.21.15.170:3300/0 conn(0x7f4bdc0cfba0 0x7f4bdc160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 --2- 172.21.15.50:0/4118539276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 --2- 172.21.15.50:0/4118539276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0b43e0 0x7f4bdc0d16f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 -- 172.21.15.50:0/4118539276 >> 172.21.15.50:0/4118539276 conn(0x7f4bdc0d2f30 msgr2=0x7f4bdc0d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 -- 172.21.15.50:0/4118539276 shutdown_connections 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.934+0000 7f4be23a0640 1 -- 172.21.15.50:0/4118539276 wait complete. 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.935+0000 7f4be23a0640 1 Processor -- start 2023-12-08T08:19:45.938 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.935+0000 7f4be23a0640 1 -- start start 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be23a0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bdc0b43e0 0x7f4bdc158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be23a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0cfba0 0x7f4bdc0a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be23a0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be23a0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc0b1090 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be23a0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc15dad0 con 0x7f4bdc0b43e0 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be23a0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc155db0 con 0x7f4bdc0d1c30 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0cfba0 0x7f4bdc0a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.941 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0cfba0 0x7f4bdc0a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58792/0 (socket says 172.21.15.50:58792) 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 -- 172.21.15.50:0/1127844937 learned_addr learned my addr 172.21.15.50:0/1127844937 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be1b9f640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be139e640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bdc0b43e0 0x7f4bdc158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 -- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 msgr2=0x7f4bdc0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 -- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bdc0b43e0 msgr2=0x7f4bdc158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bdc0b43e0 0x7f4bdc158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 -- 172.21.15.50:0/1127844937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd40094d0 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.936+0000 7f4be0b9d640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0cfba0 0x7f4bdc0a0500 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00d800 tx=0x7f4bcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.937+0000 7f4bd1ffb640 1 -- 172.21.15.50:0/1127844937 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00b6c0 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.937+0000 7f4bd1ffb640 1 -- 172.21.15.50:0/1127844937 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc00b820 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.937+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc156050 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.937+0000 7f4bd1ffb640 1 -- 172.21.15.50:0/1127844937 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00bbb0 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.942 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.937+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc156610 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.938+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc0d0950 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.938+0000 7f4bd1ffb640 1 -- 172.21.15.50:0/1127844937 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4bcc00bd10 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.938+0000 7f4bd1ffb640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4bc006ae70 0x7f4bc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:45.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.939+0000 7f4bd1ffb640 1 -- 172.21.15.50:0/1127844937 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f4bcc089dd0 con 0x7f4bdc0cfba0 2023-12-08T08:19:45.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.939+0000 7f4be139e640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4bc006ae70 0x7f4bc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:45.943 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.939+0000 7f4be139e640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4bc006ae70 0x7f4bc006d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4036000 tx=0x7f4bd403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:45.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:45.943+0000 7f4bd1ffb640 1 -- 172.21.15.50:0/1127844937 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4bcc054c20 con 0x7f4bdc0cfba0 2023-12-08T08:19:46.124 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.122+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bdc0673c0 con 0x7f4bdc0cfba0 2023-12-08T08:19:46.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.123+0000 7f4bd1ffb640 1 -- 172.21.15.50:0/1127844937 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18546 (secure 0 0 0) 0x7f4bcc08b090 con 0x7f4bdc0cfba0 2023-12-08T08:19:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:46.127 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:38.869408+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4bc006ae70 msgr2=0x7f4bc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4bc006ae70 0x7f4bc006d330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4036000 tx=0x7f4bd403d040 comp rx=0 tx=0).stop 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0cfba0 msgr2=0x7f4bdc0a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0cfba0 0x7f4bdc0a0500 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00d800 tx=0x7f4bcc00dcc0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 shutdown_connections 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4bc006ae70 0x7f4bc006d330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bdc0cfba0 0x7f4bdc0a0500 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bdc0d1c30 0x7f4bdc0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 --2- 172.21.15.50:0/1127844937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bdc0b43e0 0x7f4bdc158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 >> 172.21.15.50:0/1127844937 conn(0x7f4bdc0d2f30 msgr2=0x7f4bdc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 shutdown_connections 2023-12-08T08:19:46.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.126+0000 7f4be23a0640 1 -- 172.21.15.50:0/1127844937 wait complete. 2023-12-08T08:19:46.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:19:18.367216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:19:18.792176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-08T08:19:31.441584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:46.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.248+0000 7f2e93d61640 1 Processor -- start 2023-12-08T08:19:46.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.248+0000 7f2e93d61640 1 -- start start 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e93d61640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 0x7f2e8c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e93d61640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e8c0cfe10 0x7f2e8c0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e93d61640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c0c6be0 con 0x7f2e8c0b4150 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e93d61640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0d3ff0 con 0x7f2e8c0cfe10 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e93d61640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b4860 con 0x7f2e8c0cfa30 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e922fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2e8c0cfe10 0x7f2e8c0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e912fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e8c0b4150 0x7f2e8c0b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50734/0 (socket says 172.21.15.50:50734) 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e912fc640 1 -- 172.21.15.50:0/3098971522 learned_addr learned my addr 172.21.15.50:0/3098971522 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e91afd640 1 --2- 172.21.15.50:0/3098971522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 0x7f2e8c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e90afb640 1 -- 172.21.15.50:0/3098971522 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641076554 0 0) 0x7f2e8c0c6be0 con 0x7f2e8c0b4150 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e90afb640 1 -- 172.21.15.50:0/3098971522 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e78003520 con 0x7f2e8c0b4150 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e922fe640 1 -- 172.21.15.50:0/3098971522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 msgr2=0x7f2e8c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:46.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e922fe640 1 --2- 172.21.15.50:0/3098971522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 0x7f2e8c0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e922fe640 1 -- 172.21.15.50:0/3098971522 >> v1:172.21.15.50:6789/0 conn(0x7f2e8c0b4150 legacy=0x7f2e8c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.253 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.249+0000 7f2e922fe640 1 -- 172.21.15.50:0/3098971522 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c0d3d50 con 0x7f2e8c0cfe10 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.250+0000 7f2e922fe640 1 --2- 172.21.15.50:0/3098971522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c0cdf50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009d90 tx=0x7f2e8402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0ce9250109b325 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.250+0000 7f2e90afb640 1 -- 172.21.15.50:0/3098971522 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8402cbc0 con 0x7f2e8c0cfe10 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.250+0000 7f2e90afb640 1 -- 172.21.15.50:0/3098971522 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8402cd20 con 0x7f2e8c0cfe10 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.250+0000 7f2e90afb640 1 -- 172.21.15.50:0/3098971522 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84034660 con 0x7f2e8c0cfe10 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 -- 172.21.15.50:0/3098971522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0cfe10 msgr2=0x7f2e8c0cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3098971522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c0cdf50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009d90 tx=0x7f2e8402be10 comp rx=0 tx=0).stop 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 -- 172.21.15.50:0/3098971522 shutdown_connections 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3098971522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c0cdf50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3098971522 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 0x7f2e8c0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 -- 172.21.15.50:0/3098971522 >> 172.21.15.50:0/3098971522 conn(0x7f2e8c0d3090 msgr2=0x7f2e8c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 -- 172.21.15.50:0/3098971522 shutdown_connections 2023-12-08T08:19:46.254 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.251+0000 7f2e93d61640 1 -- 172.21.15.50:0/3098971522 wait complete. 2023-12-08T08:19:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.252+0000 7f2e93d61640 1 Processor -- start 2023-12-08T08:19:46.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.252+0000 7f2e93d61640 1 -- start start 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e93d61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0b4150 0x7f2e8c158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e93d61640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 0x7f2e8c0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e93d61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e93d61640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0cb4e0 con 0x7f2e8c0b4150 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e93d61640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b6750 con 0x7f2e8c0cfe10 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e93d61640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b5e20 con 0x7f2e8c0cfa30 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0b4150 0x7f2e8c158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0b4150 0x7f2e8c158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58822/0 (socket says 172.21.15.50:58822) 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 -- 172.21.15.50:0/3284341997 learned_addr learned my addr 172.21.15.50:0/3284341997 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 -- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 msgr2=0x7f2e8c0cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e922fe640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 0x7f2e8c0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 -- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0cfe10 msgr2=0x7f2e8c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 -- 172.21.15.50:0/3284341997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009a70 con 0x7f2e8c0b4150 2023-12-08T08:19:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e922fe640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.253+0000 7f2e91afd640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0b4150 0x7f2e8c158e30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800e870 tx=0x7f2e8800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.254+0000 7f2e827fc640 1 -- 172.21.15.50:0/3284341997 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800c940 con 0x7f2e8c0b4150 2023-12-08T08:19:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.254+0000 7f2e827fc640 1 -- 172.21.15.50:0/3284341997 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800caa0 con 0x7f2e8c0b4150 2023-12-08T08:19:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.254+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c0b6100 con 0x7f2e8c0b4150 2023-12-08T08:19:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.254+0000 7f2e827fc640 1 -- 172.21.15.50:0/3284341997 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800ce50 con 0x7f2e8c0b4150 2023-12-08T08:19:46.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.254+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c159370 con 0x7f2e8c0b4150 2023-12-08T08:19:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.255+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c072730 con 0x7f2e8c0b4150 2023-12-08T08:19:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.255+0000 7f2e827fc640 1 -- 172.21.15.50:0/3284341997 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e88013470 con 0x7f2e8c0b4150 2023-12-08T08:19:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.256+0000 7f2e827fc640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e7006ae40 0x7f2e7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.256+0000 7f2e827fc640 1 -- 172.21.15.50:0/3284341997 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f2e88089a10 con 0x7f2e8c0b4150 2023-12-08T08:19:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.256+0000 7f2e912fc640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e7006ae40 0x7f2e7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.256+0000 7f2e912fc640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e7006ae40 0x7f2e7006d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c1f77e0 tx=0x7f2e7c007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.260+0000 7f2e827fc640 1 -- 172.21.15.50:0/3284341997 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e880547d0 con 0x7f2e8c0b4150 2023-12-08T08:19:46.436 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.434+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e8c067430 con 0x7f2e8c0b4150 2023-12-08T08:19:46.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.434+0000 7f2e827fc640 1 -- 172.21.15.50:0/3284341997 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e880170a0 con 0x7f2e8c0b4150 2023-12-08T08:19:46.437 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e7006ae40 msgr2=0x7f2e7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e7006ae40 0x7f2e7006d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c1f77e0 tx=0x7f2e7c007930 comp rx=0 tx=0).stop 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0b4150 msgr2=0x7f2e8c158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0b4150 0x7f2e8c158e30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800e870 tx=0x7f2e8800ed30 comp rx=0 tx=0).stop 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 shutdown_connections 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e7006ae40 0x7f2e7006d300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e8c0cfe10 0x7f2e8c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e8c0cfa30 0x7f2e8c0cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 --2- 172.21.15.50:0/3284341997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2e8c0b4150 0x7f2e8c158e30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 >> 172.21.15.50:0/3284341997 conn(0x7f2e8c0d3090 msgr2=0x7f2e8c161500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 shutdown_connections 2023-12-08T08:19:46.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.436+0000 7f2e93d61640 1 -- 172.21.15.50:0/3284341997 wait complete. 2023-12-08T08:19:46.449 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.555+0000 7fd11c69b640 1 Processor -- start 2023-12-08T08:19:46.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.556+0000 7fd11c69b640 1 -- start start 2023-12-08T08:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.556+0000 7fd11c69b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1140cfa30 0x7fd1140b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.556+0000 7fd11c69b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140b4150 0x7fd1140b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.556+0000 7fd11c69b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1140c6be0 con 0x7fd1140cfe10 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.556+0000 7fd11c69b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1140d3ff0 con 0x7fd1140cfa30 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.556+0000 7fd11c69b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140b4860 con 0x7fd1140b4150 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11a437640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1140cfa30 0x7fd1140b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11ac38640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd1140cfe10 0x7fd114161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50744/0 (socket says 172.21.15.50:50744) 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11a437640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd1140cfa30 0x7fd1140b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58826/0 (socket says 172.21.15.50:58826) 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11ac38640 1 -- 172.21.15.50:0/133597069 learned_addr learned my addr 172.21.15.50:0/133597069 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd119c36640 1 --2- 172.21.15.50:0/133597069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140b4150 0x7fd1140b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11a437640 1 -- 172.21.15.50:0/133597069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140b4150 msgr2=0x7fd1140b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11a437640 1 --2- 172.21.15.50:0/133597069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140b4150 0x7fd1140b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11a437640 1 -- 172.21.15.50:0/133597069 >> v1:172.21.15.50:6789/0 conn(0x7fd1140cfe10 legacy=0x7fd114161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd119435640 1 -- 172.21.15.50:0/133597069 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445459429 0 0) 0x7fd1140c6be0 con 0x7fd1140cfe10 2023-12-08T08:19:46.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.557+0000 7fd11a437640 1 -- 172.21.15.50:0/133597069 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140d3d50 con 0x7fd1140cfa30 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11a437640 1 --2- 172.21.15.50:0/133597069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b2f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0097a0 tx=0x7fd10c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc3573be61eb057 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd119435640 1 -- 172.21.15.50:0/133597069 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c02e070 con 0x7fd1140cfa30 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd119435640 1 -- 172.21.15.50:0/133597069 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10c0315a0 con 0x7fd1140cfa30 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd119435640 1 -- 172.21.15.50:0/133597069 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10c031930 con 0x7fd1140cfa30 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11c69b640 1 -- 172.21.15.50:0/133597069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 msgr2=0x7fd1140b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11c69b640 1 --2- 172.21.15.50:0/133597069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b2f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd10c0097a0 tx=0x7fd10c02b840 comp rx=0 tx=0).stop 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11c69b640 1 -- 172.21.15.50:0/133597069 shutdown_connections 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11c69b640 1 --2- 172.21.15.50:0/133597069 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140b4150 0x7fd1140b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11c69b640 1 --2- 172.21.15.50:0/133597069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b2f20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11c69b640 1 -- 172.21.15.50:0/133597069 >> 172.21.15.50:0/133597069 conn(0x7fd1140d3090 msgr2=0x7fd1140d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.558+0000 7fd11c69b640 1 -- 172.21.15.50:0/133597069 shutdown_connections 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.559+0000 7fd11c69b640 1 -- 172.21.15.50:0/133597069 wait complete. 2023-12-08T08:19:46.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 Processor -- start 2023-12-08T08:19:46.563 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 -- start start 2023-12-08T08:19:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1140b4150 0x7fd114155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140cfe10 0x7fd1140b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.564 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140cc340 con 0x7fd1140cfa30 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140cbeb0 con 0x7fd1140b4150 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd11c69b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1140cb2e0 con 0x7fd1140cfe10 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd119c36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.560+0000 7fd119c36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58828/0 (socket says 172.21.15.50:58828) 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd119c36640 1 -- 172.21.15.50:0/3983252412 learned_addr learned my addr 172.21.15.50:0/3983252412 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd11a437640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1140b4150 0x7fd114155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd11ac38640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140cfe10 0x7fd1140b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd119c36640 1 -- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140cfe10 msgr2=0x7fd1140b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd119c36640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140cfe10 0x7fd1140b6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd119c36640 1 -- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1140b4150 msgr2=0x7fd114155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd119c36640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1140b4150 0x7fd114155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd119c36640 1 -- 172.21.15.50:0/3983252412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009400 con 0x7fd1140cfa30 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd119c36640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b6a10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd10800d5f0 tx=0x7fd10800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd112ffd640 1 -- 172.21.15.50:0/3983252412 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1080125f0 con 0x7fd1140cfa30 2023-12-08T08:19:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd112ffd640 1 -- 172.21.15.50:0/3983252412 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108012750 con 0x7fd1140cfa30 2023-12-08T08:19:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1140cb580 con 0x7fd1140cfa30 2023-12-08T08:19:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd112ffd640 1 -- 172.21.15.50:0/3983252412 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108012b00 con 0x7fd1140cfa30 2023-12-08T08:19:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.561+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1140cbb40 con 0x7fd1140cfa30 2023-12-08T08:19:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.562+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140b8ec0 con 0x7fd1140cfa30 2023-12-08T08:19:46.566 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.563+0000 7fd112ffd640 1 -- 172.21.15.50:0/3983252412 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd108012c60 con 0x7fd1140cfa30 2023-12-08T08:19:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.563+0000 7fd112ffd640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd10006ae70 0x7fd10006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.563+0000 7fd112ffd640 1 -- 172.21.15.50:0/3983252412 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fd108089d40 con 0x7fd1140cfa30 2023-12-08T08:19:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.563+0000 7fd11a437640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd10006ae70 0x7fd10006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.567 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.564+0000 7fd11a437640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd10006ae70 0x7fd10006d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd10c036000 tx=0x7fd10c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.569 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.567+0000 7fd112ffd640 1 -- 172.21.15.50:0/3983252412 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd108054b90 con 0x7fd1140cfa30 2023-12-08T08:19:46.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.742+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd114161ed0 con 0x7fd1140cfa30 2023-12-08T08:19:46.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.743+0000 7fd112ffd640 1 -- 172.21.15.50:0/3983252412 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1080581b0 con 0x7fd1140cfa30 2023-12-08T08:19:46.748 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:46.748 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd10006ae70 msgr2=0x7fd10006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd10006ae70 0x7fd10006d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd10c036000 tx=0x7fd10c03d040 comp rx=0 tx=0).stop 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 msgr2=0x7fd1140b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b6a10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd10800d5f0 tx=0x7fd10800dab0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 shutdown_connections 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd10006ae70 0x7fd10006d330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1140cfa30 0x7fd1140b6a10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd1140cfe10 0x7fd1140b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 --2- 172.21.15.50:0/3983252412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1140b4150 0x7fd114155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 >> 172.21.15.50:0/3983252412 conn(0x7fd1140d3090 msgr2=0x7fd1140b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 shutdown_connections 2023-12-08T08:19:46.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.745+0000 7fd11c69b640 1 -- 172.21.15.50:0/3983252412 wait complete. 2023-12-08T08:19:46.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:46.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.865+0000 7f06e40e7640 1 Processor -- start 2023-12-08T08:19:46.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.865+0000 7f06e40e7640 1 -- start start 2023-12-08T08:19:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e40e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e40e7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f06dc06bff0 0x7f06dc06c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e40e7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0cff90 con 0x7f06dc15ca80 2023-12-08T08:19:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e40e7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0cf380 con 0x7f06dc06bff0 2023-12-08T08:19:46.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e40e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0cf660 con 0x7f06dc0cce10 2023-12-08T08:19:46.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e1e83640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e1682640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f06dc06bff0 0x7f06dc06c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e2684640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f06dc15ca80 0x7f06dc15cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:56100/0 (socket says 172.21.15.50:56100) 2023-12-08T08:19:46.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e2684640 1 -- 172.21.15.50:0/1892152399 learned_addr learned my addr 172.21.15.50:0/1892152399 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.866+0000 7f06e0e81640 1 -- 172.21.15.50:0/1892152399 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503798151 0 0) 0x7f06dc0cff90 con 0x7f06dc15ca80 2023-12-08T08:19:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.867+0000 7f06e0e81640 1 -- 172.21.15.50:0/1892152399 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c8003520 con 0x7f06dc15ca80 2023-12-08T08:19:46.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.867+0000 7f06e1682640 1 -- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 msgr2=0x7f06dc0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.867+0000 7f06e1682640 1 --2- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.867+0000 7f06e1682640 1 -- 172.21.15.50:0/1892152399 >> v1:172.21.15.170:6789/0 conn(0x7f06dc15ca80 legacy=0x7f06dc15cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.867+0000 7f06e1682640 1 -- 172.21.15.50:0/1892152399 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0cf940 con 0x7f06dc06bff0 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.867+0000 7f06e1e83640 1 --2- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.867+0000 7f06e1682640 1 --2- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 0x7f06dc06c430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0097a0 tx=0x7f06cc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3183d9c8c88f8531 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e0e81640 1 -- 172.21.15.50:0/1892152399 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc031830 con 0x7f06dc06bff0 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e0e81640 1 -- 172.21.15.50:0/1892152399 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc031990 con 0x7f06dc06bff0 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e0e81640 1 -- 172.21.15.50:0/1892152399 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc031d20 con 0x7f06dc06bff0 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 -- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 msgr2=0x7f06dc06c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 0x7f06dc06c430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0097a0 tx=0x7f06cc02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 -- 172.21.15.50:0/1892152399 shutdown_connections 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 0x7f06dc06c430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1892152399 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 -- 172.21.15.50:0/1892152399 >> 172.21.15.50:0/1892152399 conn(0x7f06dc0d0e10 msgr2=0x7f06dc0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:46.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 -- 172.21.15.50:0/1892152399 shutdown_connections 2023-12-08T08:19:46.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.868+0000 7f06e40e7640 1 -- 172.21.15.50:0/1892152399 wait complete. 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.869+0000 7f06e40e7640 1 Processor -- start 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.869+0000 7f06e40e7640 1 -- start start 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e40e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 0x7f06dc14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e40e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e40e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06dc15ca80 0x7f06dc0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e40e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc15e660 con 0x7f06dc15ca80 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e40e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc14f740 con 0x7f06dc06bff0 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e40e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc15da50 con 0x7f06dc0cce10 2023-12-08T08:19:46.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e2684640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06dc15ca80 0x7f06dc0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e2684640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06dc15ca80 0x7f06dc0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58836/0 (socket says 172.21.15.50:58836) 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e2684640 1 -- 172.21.15.50:0/1143420903 learned_addr learned my addr 172.21.15.50:0/1143420903 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e1e83640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 0x7f06dc14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e1682640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.870+0000 7f06e2684640 1 -- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 msgr2=0x7f06dc0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e2684640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e2684640 1 -- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 msgr2=0x7f06dc14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e2684640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 0x7f06dc14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e2684640 1 -- 172.21.15.50:0/1143420903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8009400 con 0x7f06dc15ca80 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e1682640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e2684640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06dc15ca80 0x7f06dc0c8840 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f06d400cb40 tx=0x7f06d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06d27fc640 1 -- 172.21.15.50:0/1143420903 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400aca0 con 0x7f06dc15ca80 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06d27fc640 1 -- 172.21.15.50:0/1143420903 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d400ae00 con 0x7f06dc15ca80 2023-12-08T08:19:46.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06d27fc640 1 -- 172.21.15.50:0/1143420903 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4012620 con 0x7f06dc15ca80 2023-12-08T08:19:46.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc009400 con 0x7f06dc15ca80 2023-12-08T08:19:46.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.871+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc15e010 con 0x7f06dc15ca80 2023-12-08T08:19:46.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.872+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc15e7d0 con 0x7f06dc15ca80 2023-12-08T08:19:46.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.872+0000 7f06d27fc640 1 -- 172.21.15.50:0/1143420903 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06d4007070 con 0x7f06dc15ca80 2023-12-08T08:19:46.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.873+0000 7f06d27fc640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:46.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.873+0000 7f06d27fc640 1 -- 172.21.15.50:0/1143420903 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f06d4089930 con 0x7f06dc15ca80 2023-12-08T08:19:46.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.873+0000 7f06e1e83640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:46.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.874+0000 7f06e1e83640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06c006ae40 0x7f06c006d300 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06dc06ba50 tx=0x7f06d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:46.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:46.877+0000 7f06d27fc640 1 -- 172.21.15.50:0/1143420903 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06d4054700 con 0x7f06dc15ca80 2023-12-08T08:19:47.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.053+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06dc067430 con 0x7f06dc15ca80 2023-12-08T08:19:47.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.054+0000 7f06d27fc640 1 -- 172.21.15.50:0/1143420903 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06d4017020 con 0x7f06dc15ca80 2023-12-08T08:19:47.057 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:47.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06c006ae40 msgr2=0x7f06c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06c006ae40 0x7f06c006d300 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f06dc06ba50 tx=0x7f06d8008040 comp rx=0 tx=0).stop 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06dc15ca80 msgr2=0x7f06dc0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06dc15ca80 0x7f06dc0c8840 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f06d400cb40 tx=0x7f06d400a060 comp rx=0 tx=0).stop 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 shutdown_connections 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06c006ae40 0x7f06c006d300 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06dc15ca80 0x7f06dc0c8840 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06dc0cce10 0x7f06dc0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 --2- 172.21.15.50:0/1143420903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06dc06bff0 0x7f06dc14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 >> 172.21.15.50:0/1143420903 conn(0x7f06dc0d0e10 msgr2=0x7f06dc0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 shutdown_connections 2023-12-08T08:19:47.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.056+0000 7f06e40e7640 1 -- 172.21.15.50:0/1143420903 wait complete. 2023-12-08T08:19:47.069 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-08T08:19:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.175+0000 7f8ec5f33640 1 Processor -- start 2023-12-08T08:19:47.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.175+0000 7f8ec5f33640 1 -- start start 2023-12-08T08:19:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ec5f33640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec00caec0 0x7f8ec015d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ec5f33640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec015dbc0 0x7f8ec006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ec5f33640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec015e600 con 0x7f8ec00caae0 2023-12-08T08:19:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ec5f33640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec0161c20 con 0x7f8ec00caec0 2023-12-08T08:19:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ec5f33640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec015e040 con 0x7f8ec015dbc0 2023-12-08T08:19:47.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ebeffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec00caec0 0x7f8ec015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ebeffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8ec00caec0 0x7f8ec015d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58848/0 (socket says 172.21.15.50:58848) 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ebeffd640 1 -- 172.21.15.50:0/859852124 learned_addr learned my addr 172.21.15.50:0/859852124 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.176+0000 7f8ebffff640 1 --2- 172.21.15.50:0/859852124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec015dbc0 0x7f8ec006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.177+0000 7f8ebeffd640 1 -- 172.21.15.50:0/859852124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec015dbc0 msgr2=0x7f8ec006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.177+0000 7f8ebeffd640 1 --2- 172.21.15.50:0/859852124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec015dbc0 0x7f8ec006a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.177+0000 7f8ebeffd640 1 -- 172.21.15.50:0/859852124 >> v1:172.21.15.170:6789/0 conn(0x7f8ec00caae0 legacy=0x7f8ec0161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.177+0000 7f8ebeffd640 1 -- 172.21.15.50:0/859852124 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec015e320 con 0x7f8ec00caec0 2023-12-08T08:19:47.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.177+0000 7f8ebffff640 1 --2- 172.21.15.50:0/859852124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec015dbc0 0x7f8ec006a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.177+0000 7f8ebeffd640 1 --2- 172.21.15.50:0/859852124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caec0 0x7f8ec015d680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009870 tx=0x7f8eb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f521c94729604 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.177+0000 7f8ebe7fc640 1 -- 172.21.15.50:0/859852124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4031640 con 0x7f8ec00caec0 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ebe7fc640 1 -- 172.21.15.50:0/859852124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb40317a0 con 0x7f8ec00caec0 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ebe7fc640 1 -- 172.21.15.50:0/859852124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4031b30 con 0x7f8ec00caec0 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 -- 172.21.15.50:0/859852124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caec0 msgr2=0x7f8ec015d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/859852124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caec0 0x7f8ec015d680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009870 tx=0x7f8eb402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 -- 172.21.15.50:0/859852124 shutdown_connections 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/859852124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec015dbc0 0x7f8ec006a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/859852124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caec0 0x7f8ec015d680 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 -- 172.21.15.50:0/859852124 >> 172.21.15.50:0/859852124 conn(0x7f8ec00cfcd0 msgr2=0x7f8ec00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 -- 172.21.15.50:0/859852124 shutdown_connections 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.178+0000 7f8ec5f33640 1 -- 172.21.15.50:0/859852124 wait complete. 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.179+0000 7f8ec5f33640 1 Processor -- start 2023-12-08T08:19:47.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.179+0000 7f8ec5f33640 1 -- start start 2023-12-08T08:19:47.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ec5f33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caae0 0x7f8ec0156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ec5f33640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec00caec0 0x7f8ec00c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ec5f33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ec015dbc0 0x7f8ec00c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ec5f33640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c4db0 con 0x7f8ec00caae0 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ec5f33640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c5090 con 0x7f8ec015dbc0 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ec5f33640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00c6ed0 con 0x7f8ec00caec0 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ebf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caae0 0x7f8ec0156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ebf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caae0 0x7f8ec0156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58850/0 (socket says 172.21.15.50:58850) 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.180+0000 7f8ebf7fe640 1 -- 172.21.15.50:0/895666159 learned_addr learned my addr 172.21.15.50:0/895666159 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebffff640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ec015dbc0 0x7f8ec00c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebeffd640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec00caec0 0x7f8ec00c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebf7fe640 1 -- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec00caec0 msgr2=0x7f8ec00c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebf7fe640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec00caec0 0x7f8ec00c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebf7fe640 1 -- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ec015dbc0 msgr2=0x7f8ec00c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.185 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebf7fe640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ec015dbc0 0x7f8ec00c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebf7fe640 1 -- 172.21.15.50:0/895666159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40094d0 con 0x7f8ec00caae0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebffff640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ec015dbc0 0x7f8ec00c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ebf7fe640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caae0 0x7f8ec0156b60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000c430 tx=0x7f8eb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ea7fff640 1 -- 172.21.15.50:0/895666159 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0011790 con 0x7f8ec00caae0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ea7fff640 1 -- 172.21.15.50:0/895666159 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb00118f0 con 0x7f8ec00caae0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec00c71b0 con 0x7f8ec00caae0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ea7fff640 1 -- 172.21.15.50:0/895666159 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0011ce0 con 0x7f8ec00caae0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.181+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec00c5370 con 0x7f8ec00caae0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.182+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec0067ad0 con 0x7f8ec00caae0 2023-12-08T08:19:47.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.183+0000 7f8ea7fff640 1 -- 172.21.15.50:0/895666159 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8eb001c460 con 0x7f8ec00caae0 2023-12-08T08:19:47.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.183+0000 7f8ea7fff640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8eac06ae40 0x7f8eac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.183+0000 7f8ea7fff640 1 -- 172.21.15.50:0/895666159 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f8eb0089830 con 0x7f8ec00caae0 2023-12-08T08:19:47.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.183+0000 7f8ebeffd640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8eac06ae40 0x7f8eac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.184+0000 7f8ebeffd640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8eac06ae40 0x7f8eac06d300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4036000 tx=0x7f8eb403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.187+0000 7f8ea7fff640 1 -- 172.21.15.50:0/895666159 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8eb0054680 con 0x7f8ec00caae0 2023-12-08T08:19:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.362+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f8ec015cbe0 con 0x7f8ec00caae0 2023-12-08T08:19:47.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.363+0000 7f8ea7fff640 1 -- 172.21.15.50:0/895666159 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v43) v1 ==== 97+0+11 (secure 0 0 0) 0x7f8eb0057ca0 con 0x7f8ec00caae0 2023-12-08T08:19:47.365 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:47.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8eac06ae40 msgr2=0x7f8eac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8eac06ae40 0x7f8eac06d300 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4036000 tx=0x7f8eb403c040 comp rx=0 tx=0).stop 2023-12-08T08:19:47.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caae0 msgr2=0x7f8ec0156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caae0 0x7f8ec0156b60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000c430 tx=0x7f8eb000c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 shutdown_connections 2023-12-08T08:19:47.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8eac06ae40 0x7f8eac06d300 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ec015dbc0 0x7f8ec00c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ec00caec0 0x7f8ec00c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 --2- 172.21.15.50:0/895666159 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8ec00caae0 0x7f8ec0156b60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 >> 172.21.15.50:0/895666159 conn(0x7f8ec00cfcd0 msgr2=0x7f8ec00af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 shutdown_connections 2023-12-08T08:19:47.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.365+0000 7f8ec5f33640 1 -- 172.21.15.50:0/895666159 wait complete. 2023-12-08T08:19:47.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.483+0000 7f0b05368640 1 Processor -- start 2023-12-08T08:19:47.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.483+0000 7f0b05368640 1 -- start start 2023-12-08T08:19:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.484+0000 7f0b05368640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0b00157950 0x7f0b0006e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.484+0000 7f0b05368640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0015d700 con 0x7f0b0006a4d0 2023-12-08T08:19:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.484+0000 7f0b05368640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0015d9c0 con 0x7f0b00072630 2023-12-08T08:19:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.484+0000 7f0b05368640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0015dca0 con 0x7f0b00157950 2023-12-08T08:19:47.487 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.484+0000 7f0afe7fc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0b0006a4d0 0x7f0b00071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50748/0 (socket says 172.21.15.50:50748) 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.484+0000 7f0afe7fc640 1 -- 172.21.15.50:0/3847076362 learned_addr learned my addr 172.21.15.50:0/3847076362 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.485+0000 7f0afeffd640 1 --2- 172.21.15.50:0/3847076362 >> v2:172.21.15.170:3300/0 conn(0x7f0b00157950 0x7f0b0006e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.485+0000 7f0afdffb640 1 -- 172.21.15.50:0/3847076362 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421042673 0 0) 0x7f0b0015d700 con 0x7f0b0006a4d0 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.485+0000 7f0afdffb640 1 -- 172.21.15.50:0/3847076362 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aec003520 con 0x7f0b0006a4d0 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.485+0000 7f0afeffd640 1 -- 172.21.15.50:0/3847076362 >> v1:172.21.15.170:6789/0 conn(0x7f0b00072630 legacy=0x7f0b00160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.485+0000 7f0afeffd640 1 -- 172.21.15.50:0/3847076362 >> v1:172.21.15.50:6789/0 conn(0x7f0b0006a4d0 legacy=0x7f0b00071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.485+0000 7f0afdffb640 1 -- 172.21.15.50:0/3847076362 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989847499 0 0) 0x7f0b0015d9c0 con 0x7f0b00072630 2023-12-08T08:19:47.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.485+0000 7f0afeffd640 1 -- 172.21.15.50:0/3847076362 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0015df80 con 0x7f0b00157950 2023-12-08T08:19:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.486+0000 7f0afeffd640 1 --2- 172.21.15.50:0/3847076362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00157950 0x7f0b0006e8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d47c1acaf13d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.486+0000 7f0afdffb640 1 -- 172.21.15.50:0/3847076362 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0001670 con 0x7f0b00157950 2023-12-08T08:19:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.486+0000 7f0afdffb640 1 -- 172.21.15.50:0/3847076362 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae802e050 con 0x7f0b00157950 2023-12-08T08:19:47.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.486+0000 7f0afdffb640 1 -- 172.21.15.50:0/3847076362 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8030710 con 0x7f0b00157950 2023-12-08T08:19:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.486+0000 7f0b05368640 1 -- 172.21.15.50:0/3847076362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00157950 msgr2=0x7f0b0006e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.486+0000 7f0b05368640 1 --2- 172.21.15.50:0/3847076362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00157950 0x7f0b0006e8f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802b620 comp rx=0 tx=0).stop 2023-12-08T08:19:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.487+0000 7f0b05368640 1 -- 172.21.15.50:0/3847076362 shutdown_connections 2023-12-08T08:19:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.487+0000 7f0b05368640 1 --2- 172.21.15.50:0/3847076362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00157950 0x7f0b0006e8f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.487+0000 7f0b05368640 1 -- 172.21.15.50:0/3847076362 >> 172.21.15.50:0/3847076362 conn(0x7f0b000cff90 msgr2=0x7f0b000d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.487+0000 7f0b05368640 1 -- 172.21.15.50:0/3847076362 shutdown_connections 2023-12-08T08:19:47.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.487+0000 7f0b05368640 1 -- 172.21.15.50:0/3847076362 wait complete. 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.488+0000 7f0b05368640 1 Processor -- start 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.488+0000 7f0b05368640 1 -- start start 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0b05368640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0006a4d0 0x7f0b000ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0b05368640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00072630 0x7f0b001f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0b05368640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00157950 0x7f0b000b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0b05368640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001f3e00 con 0x7f0b00157950 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0b05368640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000cee90 con 0x7f0b00072630 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0b05368640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000cf170 con 0x7f0b0006a4d0 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00157950 0x7f0b000b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00157950 0x7f0b000b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58860/0 (socket says 172.21.15.50:58860) 2023-12-08T08:19:47.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 -- 172.21.15.50:0/3664139125 learned_addr learned my addr 172.21.15.50:0/3664139125 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0afe7fc640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00072630 0x7f0b001f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0afeffd640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0006a4d0 0x7f0b000ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 -- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0006a4d0 msgr2=0x7f0b000ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0006a4d0 0x7f0b000ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 -- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00072630 msgr2=0x7f0b001f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00072630 0x7f0b001f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 -- 172.21.15.50:0/3664139125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009400 con 0x7f0b00157950 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0aff7fe640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00157950 0x7f0b000b2f80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c780 tx=0x7f0af800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.489+0000 7f0af77fe640 1 -- 172.21.15.50:0/3664139125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8003b70 con 0x7f0b00157950 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.490+0000 7f0af77fe640 1 -- 172.21.15.50:0/3664139125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8003cd0 con 0x7f0b00157950 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.490+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000cf450 con 0x7f0b00157950 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.490+0000 7f0af77fe640 1 -- 172.21.15.50:0/3664139125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8005270 con 0x7f0b00157950 2023-12-08T08:19:47.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.490+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b001f4310 con 0x7f0b00157950 2023-12-08T08:19:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.491+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b00067ad0 con 0x7f0b00157950 2023-12-08T08:19:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.491+0000 7f0af77fe640 1 -- 172.21.15.50:0/3664139125 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0af80053d0 con 0x7f0b00157950 2023-12-08T08:19:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.491+0000 7f0af77fe640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0ae006ae40 0x7f0ae006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.491+0000 7f0af77fe640 1 -- 172.21.15.50:0/3664139125 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f0af80895c0 con 0x7f0b00157950 2023-12-08T08:19:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.492+0000 7f0afeffd640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0ae006ae40 0x7f0ae006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.492+0000 7f0afeffd640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0ae006ae40 0x7f0ae006d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8034000 tx=0x7f0ae8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.496+0000 7f0af77fe640 1 -- 172.21.15.50:0/3664139125 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0af80543b0 con 0x7f0b00157950 2023-12-08T08:19:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.686+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0b000af9d0 con 0x7f0b00157950 2023-12-08T08:19:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.687+0000 7f0af77fe640 1 -- 172.21.15.50:0/3664139125 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0af80579d0 con 0x7f0b00157950 2023-12-08T08:19:47.689 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:47.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0ae006ae40 msgr2=0x7f0ae006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0ae006ae40 0x7f0ae006d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8034000 tx=0x7f0ae8008030 comp rx=0 tx=0).stop 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00157950 msgr2=0x7f0b000b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00157950 0x7f0b000b2f80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c780 tx=0x7f0af800cb80 comp rx=0 tx=0).stop 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 shutdown_connections 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0ae006ae40 0x7f0ae006d300 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b00157950 0x7f0b000b2f80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b00072630 0x7f0b001f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 --2- 172.21.15.50:0/3664139125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0006a4d0 0x7f0b000ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 >> 172.21.15.50:0/3664139125 conn(0x7f0b000cff90 msgr2=0x7f0b0015d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 shutdown_connections 2023-12-08T08:19:47.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.689+0000 7f0b05368640 1 -- 172.21.15.50:0/3664139125 wait complete. 2023-12-08T08:19:47.702 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:19:47.702 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:47.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:47.865 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.863+0000 7fc6dd13c640 1 Processor -- start 2023-12-08T08:19:47.866 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.863+0000 7fc6dd13c640 1 -- start start 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6dd13c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6d80cbd10 0x7fc6d8070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6dd13c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d80720d0 con 0x7fc6d8158ee0 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6dd13c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d80cc890 con 0x7fc6d815b750 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6dd13c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d80714c0 con 0x7fc6d80cbd10 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6d659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6d80cbd10 0x7fc6d8070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6d6d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc6d8158ee0 0x7fc6d80cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50760/0 (socket says 172.21.15.50:50760) 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6d6d9d640 1 -- 172.21.15.50:0/3934700887 learned_addr learned my addr 172.21.15.50:0/3934700887 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:47.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6d659c640 1 -- 172.21.15.50:0/3934700887 >> v1:172.21.15.170:6789/0 conn(0x7fc6d815b750 legacy=0x7fc6d806c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6d659c640 1 -- 172.21.15.50:0/3934700887 >> v1:172.21.15.50:6789/0 conn(0x7fc6d8158ee0 legacy=0x7fc6d80cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6d659c640 1 -- 172.21.15.50:0/3934700887 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d80717a0 con 0x7fc6d80cbd10 2023-12-08T08:19:47.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.864+0000 7fc6d5d9b640 1 -- 172.21.15.50:0/3934700887 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807120488 0 0) 0x7fc6d80720d0 con 0x7fc6d8158ee0 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.865+0000 7fc6d659c640 1 --2- 172.21.15.50:0/3934700887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80cbd10 0x7fc6d8070e30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00097a0 tx=0x7fc6c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea572bc2589af03c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.865+0000 7fc6d5d9b640 1 -- 172.21.15.50:0/3934700887 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c002e070 con 0x7fc6d80cbd10 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.865+0000 7fc6d5d9b640 1 -- 172.21.15.50:0/3934700887 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c00315a0 con 0x7fc6d80cbd10 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.865+0000 7fc6d5d9b640 1 -- 172.21.15.50:0/3934700887 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0031930 con 0x7fc6d80cbd10 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.866+0000 7fc6dd13c640 1 -- 172.21.15.50:0/3934700887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80cbd10 msgr2=0x7fc6d8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.866+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/3934700887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80cbd10 0x7fc6d8070e30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00097a0 tx=0x7fc6c002b840 comp rx=0 tx=0).stop 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.866+0000 7fc6dd13c640 1 -- 172.21.15.50:0/3934700887 shutdown_connections 2023-12-08T08:19:47.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.866+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/3934700887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d80cbd10 0x7fc6d8070e30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.866+0000 7fc6dd13c640 1 -- 172.21.15.50:0/3934700887 >> 172.21.15.50:0/3934700887 conn(0x7fc6d80b09f0 msgr2=0x7fc6d80b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.866+0000 7fc6dd13c640 1 -- 172.21.15.50:0/3934700887 shutdown_connections 2023-12-08T08:19:47.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.866+0000 7fc6dd13c640 1 -- 172.21.15.50:0/3934700887 wait complete. 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.867+0000 7fc6dd13c640 1 Processor -- start 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.867+0000 7fc6dd13c640 1 -- start start 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6dd13c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6d80cbd10 0x7fc6d80b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6dd13c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6d8158ee0 0x7fc6d81f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6dd13c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d815b750 0x7fc6d81ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6dd13c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d81f41f0 con 0x7fc6d815b750 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6dd13c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80cdf00 con 0x7fc6d80cbd10 2023-12-08T08:19:47.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6dd13c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d81f3ff0 con 0x7fc6d8158ee0 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6d759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d815b750 0x7fc6d81ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6d759e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d815b750 0x7fc6d81ecdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58880/0 (socket says 172.21.15.50:58880) 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.868+0000 7fc6d759e640 1 -- 172.21.15.50:0/324397769 learned_addr learned my addr 172.21.15.50:0/324397769 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d759e640 1 -- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6d8158ee0 msgr2=0x7fc6d81f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d6d9d640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6d80cbd10 0x7fc6d80b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d659c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6d8158ee0 0x7fc6d81f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d759e640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6d8158ee0 0x7fc6d81f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d759e640 1 -- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6d80cbd10 msgr2=0x7fc6d80b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d759e640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6d80cbd10 0x7fc6d80b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d759e640 1 -- 172.21.15.50:0/324397769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009400 con 0x7fc6d815b750 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d6d9d640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6d80cbd10 0x7fc6d80b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d659c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6d8158ee0 0x7fc6d81f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6d759e640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d815b750 0x7fc6d81ecdc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800b970 tx=0x7fc6c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6cf7fe640 1 -- 172.21.15.50:0/324397769 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800cb40 con 0x7fc6d815b750 2023-12-08T08:19:47.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6cf7fe640 1 -- 172.21.15.50:0/324397769 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c800cca0 con 0x7fc6d815b750 2023-12-08T08:19:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d80b23d0 con 0x7fc6d815b750 2023-12-08T08:19:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6cf7fe640 1 -- 172.21.15.50:0/324397769 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8014680 con 0x7fc6d815b750 2023-12-08T08:19:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.869+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d80b2760 con 0x7fc6d815b750 2023-12-08T08:19:47.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.870+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d80b2d90 con 0x7fc6d815b750 2023-12-08T08:19:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.870+0000 7fc6cf7fe640 1 -- 172.21.15.50:0/324397769 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6c801d3b0 con 0x7fc6d815b750 2023-12-08T08:19:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.871+0000 7fc6cf7fe640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc6b806ae40 0x7fc6b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.871+0000 7fc6cf7fe640 1 -- 172.21.15.50:0/324397769 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fc6c8089800 con 0x7fc6d815b750 2023-12-08T08:19:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.871+0000 7fc6d6d9d640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc6b806ae40 0x7fc6b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:47.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.872+0000 7fc6d6d9d640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc6b806ae40 0x7fc6b806d300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000f60 tx=0x7fc6d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:47.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:47.875+0000 7fc6cf7fe640 1 -- 172.21.15.50:0/324397769 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6c8054540 con 0x7fc6d815b750 2023-12-08T08:19:48.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.054+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6d8067430 con 0x7fc6d815b750 2023-12-08T08:19:48.057 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.055+0000 7fc6cf7fe640 1 -- 172.21.15.50:0/324397769 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18546 (secure 0 0 0) 0x7fc6c8087e60 con 0x7fc6d815b750 2023-12-08T08:19:48.058 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:48.058 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:38.869408+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc6b806ae40 msgr2=0x7fc6b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc6b806ae40 0x7fc6b806d300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0000f60 tx=0x7fc6d0009040 comp rx=0 tx=0).stop 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d815b750 msgr2=0x7fc6d81ecdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d815b750 0x7fc6d81ecdc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800b970 tx=0x7fc6c800be30 comp rx=0 tx=0).stop 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 shutdown_connections 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc6b806ae40 0x7fc6b806d300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6d815b750 0x7fc6d81ecdc0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6d8158ee0 0x7fc6d81f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 --2- 172.21.15.50:0/324397769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6d80cbd10 0x7fc6d80b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 >> 172.21.15.50:0/324397769 conn(0x7fc6d80b09f0 msgr2=0x7fc6d806dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 shutdown_connections 2023-12-08T08:19:48.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.057+0000 7fc6dd13c640 1 -- 172.21.15.50:0/324397769 wait complete. 2023-12-08T08:19:48.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:19:18.367216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:19:18.792176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-08T08:19:31.441584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:48.070 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:48.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.177+0000 7f046584f640 1 Processor -- start 2023-12-08T08:19:48.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.177+0000 7f046584f640 1 -- start start 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.178+0000 7f046584f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006ab20 0x7f04600ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.178+0000 7f046584f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f04601518a0 0x7f0460151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.178+0000 7f046584f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046015f860 con 0x7f046006a740 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.178+0000 7f046584f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046015ec50 con 0x7f04601518a0 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.178+0000 7f046584f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046015ef30 con 0x7f046006ab20 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045e7fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006ab20 0x7f04600ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045e7fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006ab20 0x7f04600ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:34310/0 (socket says 172.21.15.50:34310) 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045e7fc640 1 -- 172.21.15.50:0/4074971110 learned_addr learned my addr 172.21.15.50:0/4074971110 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:48.181 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045f7fe640 1 --2- 172.21.15.50:0/4074971110 >> v2:172.21.15.170:3300/0 conn(0x7f04601518a0 0x7f0460151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045e7fc640 1 -- 172.21.15.50:0/4074971110 >> v2:172.21.15.170:3300/0 conn(0x7f04601518a0 msgr2=0x7f0460151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045e7fc640 1 --2- 172.21.15.50:0/4074971110 >> v2:172.21.15.170:3300/0 conn(0x7f04601518a0 0x7f0460151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045e7fc640 1 -- 172.21.15.50:0/4074971110 >> v1:172.21.15.170:6789/0 conn(0x7f046006a740 legacy=0x7f046006f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045dffb640 1 -- 172.21.15.50:0/4074971110 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087389472 0 0) 0x7f046015f860 con 0x7f046006a740 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.179+0000 7f045e7fc640 1 -- 172.21.15.50:0/4074971110 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046015f210 con 0x7f046006ab20 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f045e7fc640 1 --2- 172.21.15.50:0/4074971110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006ab20 0x7f04600ca5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0448009870 tx=0x7f044802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=507a92927c70aeff server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f045dffb640 1 -- 172.21.15.50:0/4074971110 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448030840 con 0x7f046006ab20 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f045dffb640 1 -- 172.21.15.50:0/4074971110 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04480309a0 con 0x7f046006ab20 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f045dffb640 1 -- 172.21.15.50:0/4074971110 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448030d30 con 0x7f046006ab20 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f046584f640 1 -- 172.21.15.50:0/4074971110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006ab20 msgr2=0x7f04600ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.183 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f046584f640 1 --2- 172.21.15.50:0/4074971110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006ab20 0x7f04600ca5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0448009870 tx=0x7f044802b980 comp rx=0 tx=0).stop 2023-12-08T08:19:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f046584f640 1 -- 172.21.15.50:0/4074971110 shutdown_connections 2023-12-08T08:19:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f046584f640 1 --2- 172.21.15.50:0/4074971110 >> v2:172.21.15.170:3300/0 conn(0x7f04601518a0 0x7f0460151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f046584f640 1 --2- 172.21.15.50:0/4074971110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006ab20 0x7f04600ca5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.180+0000 7f046584f640 1 -- 172.21.15.50:0/4074971110 >> 172.21.15.50:0/4074971110 conn(0x7f04600cfcd0 msgr2=0x7f04600d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.181+0000 7f046584f640 1 -- 172.21.15.50:0/4074971110 shutdown_connections 2023-12-08T08:19:48.184 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.181+0000 7f046584f640 1 -- 172.21.15.50:0/4074971110 wait complete. 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.182+0000 7f046584f640 1 Processor -- start 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.182+0000 7f046584f640 1 -- start start 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.182+0000 7f046584f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006a740 0x7f04600c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.182+0000 7f046584f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f046006ab20 0x7f04601f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.182+0000 7f046584f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04601518a0 0x7f04601f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.182+0000 7f046584f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04601f0a20 con 0x7f04601518a0 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.182+0000 7f046584f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04601f4fe0 con 0x7f046006ab20 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f046584f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04601f4a20 con 0x7f046006a740 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04601518a0 0x7f04601f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04601518a0 0x7f04601f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58888/0 (socket says 172.21.15.50:58888) 2023-12-08T08:19:48.186 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 -- 172.21.15.50:0/2600171106 learned_addr learned my addr 172.21.15.50:0/2600171106 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045e7fc640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f046006ab20 0x7f04601f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045effd640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006a740 0x7f04600c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 -- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006a740 msgr2=0x7f04600c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006a740 0x7f04600c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 -- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f046006ab20 msgr2=0x7f04601f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f046006ab20 0x7f04601f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 -- 172.21.15.50:0/2600171106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480094d0 con 0x7f04601518a0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f045f7fe640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04601518a0 0x7f04601f4060 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f045800e930 tx=0x7f045800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f0457fff640 1 -- 172.21.15.50:0/2600171106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458009690 con 0x7f04601518a0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f0457fff640 1 -- 172.21.15.50:0/2600171106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045800c980 con 0x7f04601518a0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04601f4d00 con 0x7f04601518a0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f0457fff640 1 -- 172.21.15.50:0/2600171106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800cd30 con 0x7f04601518a0 2023-12-08T08:19:48.187 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.183+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04601f0ef0 con 0x7f04601518a0 2023-12-08T08:19:48.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.184+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04601f1110 con 0x7f04601518a0 2023-12-08T08:19:48.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.185+0000 7f0457fff640 1 -- 172.21.15.50:0/2600171106 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0458013470 con 0x7f04601518a0 2023-12-08T08:19:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.185+0000 7f0457fff640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f044006ae40 0x7f044006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.185+0000 7f0457fff640 1 -- 172.21.15.50:0/2600171106 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f0458089a60 con 0x7f04601518a0 2023-12-08T08:19:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.186+0000 7f045effd640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f044006ae40 0x7f044006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.189 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.186+0000 7f045effd640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f044006ae40 0x7f044006d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f04500012e0 tx=0x7f0450009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.190+0000 7f0457fff640 1 -- 172.21.15.50:0/2600171106 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0458054990 con 0x7f04601518a0 2023-12-08T08:19:48.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.364+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0460067ad0 con 0x7f04601518a0 2023-12-08T08:19:48.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.364+0000 7f0457fff640 1 -- 172.21.15.50:0/2600171106 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04580170a0 con 0x7f04601518a0 2023-12-08T08:19:48.367 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f044006ae40 msgr2=0x7f044006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f044006ae40 0x7f044006d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f04500012e0 tx=0x7f0450009040 comp rx=0 tx=0).stop 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04601518a0 msgr2=0x7f04601f4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04601518a0 0x7f04601f4060 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f045800e930 tx=0x7f045800edf0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 shutdown_connections 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f044006ae40 0x7f044006d300 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04601518a0 0x7f04601f4060 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f046006ab20 0x7f04601f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 --2- 172.21.15.50:0/2600171106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f046006a740 0x7f04600c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 >> 172.21.15.50:0/2600171106 conn(0x7f04600cfcd0 msgr2=0x7f046006d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 shutdown_connections 2023-12-08T08:19:48.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.366+0000 7f046584f640 1 -- 172.21.15.50:0/2600171106 wait complete. 2023-12-08T08:19:48.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:48.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.486+0000 7f43da46b640 1 Processor -- start 2023-12-08T08:19:48.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.486+0000 7f43da46b640 1 -- start start 2023-12-08T08:19:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43da46b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43d415d030 0x7f43d4071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43da46b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d4070a00 0x7f43d4071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43da46b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d4070e50 con 0x7f43d40ac880 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43da46b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d406be30 con 0x7f43d415d030 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43da46b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415d410 con 0x7f43d4070a00 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43d415d030 0x7f43d4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d3fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f43d415d030 0x7f43d4071940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58902/0 (socket says 172.21.15.50:58902) 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d3fff640 1 -- 172.21.15.50:0/3701472234 learned_addr learned my addr 172.21.15.50:0/3701472234 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d8a08640 1 --2- 172.21.15.50:0/3701472234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d4070a00 0x7f43d4071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d3fff640 1 -- 172.21.15.50:0/3701472234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d4070a00 msgr2=0x7f43d4071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d3fff640 1 --2- 172.21.15.50:0/3701472234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d4070a00 0x7f43d4071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d3fff640 1 -- 172.21.15.50:0/3701472234 >> v1:172.21.15.170:6789/0 conn(0x7f43d40ac880 legacy=0x7f43d40702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.487+0000 7f43d3fff640 1 -- 172.21.15.50:0/3701472234 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4071090 con 0x7f43d415d030 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.488+0000 7f43d3fff640 1 --2- 172.21.15.50:0/3701472234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d415d030 0x7f43d4071940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009870 tx=0x7f43c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d629216a74009473 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.488+0000 7f43d2ffd640 1 -- 172.21.15.50:0/3701472234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8030840 con 0x7f43d415d030 2023-12-08T08:19:48.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.488+0000 7f43d2ffd640 1 -- 172.21.15.50:0/3701472234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80309a0 con 0x7f43d415d030 2023-12-08T08:19:48.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.488+0000 7f43d2ffd640 1 -- 172.21.15.50:0/3701472234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8030d30 con 0x7f43d415d030 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 -- 172.21.15.50:0/3701472234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d415d030 msgr2=0x7f43d4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 --2- 172.21.15.50:0/3701472234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d415d030 0x7f43d4071940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009870 tx=0x7f43c802b980 comp rx=0 tx=0).stop 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 -- 172.21.15.50:0/3701472234 shutdown_connections 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 --2- 172.21.15.50:0/3701472234 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d4070a00 0x7f43d4071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 --2- 172.21.15.50:0/3701472234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d415d030 0x7f43d4071940 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 -- 172.21.15.50:0/3701472234 >> 172.21.15.50:0/3701472234 conn(0x7f43d40b0850 msgr2=0x7f43d40b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 -- 172.21.15.50:0/3701472234 shutdown_connections 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.489+0000 7f43da46b640 1 -- 172.21.15.50:0/3701472234 wait complete. 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.490+0000 7f43da46b640 1 Processor -- start 2023-12-08T08:19:48.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.490+0000 7f43da46b640 1 -- start start 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43da46b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d4070a00 0x7f43d41490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43da46b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d40ac880 0x7f43d4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43da46b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d415d030 0x7f43d414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43da46b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d414a490 con 0x7f43d4070a00 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43da46b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415f810 con 0x7f43d415d030 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43da46b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4153880 con 0x7f43d40ac880 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d4070a00 0x7f43d41490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d4070a00 0x7f43d41490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58914/0 (socket says 172.21.15.50:58914) 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 -- 172.21.15.50:0/1360344117 learned_addr learned my addr 172.21.15.50:0/1360344117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d8a08640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d415d030 0x7f43d414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d37fe640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d40ac880 0x7f43d4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 -- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d40ac880 msgr2=0x7f43d4149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d40ac880 0x7f43d4149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 -- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d415d030 msgr2=0x7f43d414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d415d030 0x7f43d414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d3fff640 1 -- 172.21.15.50:0/1360344117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80094d0 con 0x7f43d4070a00 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.491+0000 7f43d37fe640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d40ac880 0x7f43d4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.492+0000 7f43d3fff640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d4070a00 0x7f43d41490c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f43c8000c00 tx=0x7f43c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.492+0000 7f43d0ff9640 1 -- 172.21.15.50:0/1360344117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8039a90 con 0x7f43d4070a00 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.492+0000 7f43d0ff9640 1 -- 172.21.15.50:0/1360344117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c8039bf0 con 0x7f43d4070a00 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.492+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d414a6c0 con 0x7f43d4070a00 2023-12-08T08:19:48.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.492+0000 7f43d0ff9640 1 -- 172.21.15.50:0/1360344117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8043410 con 0x7f43d4070a00 2023-12-08T08:19:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.492+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4153dd0 con 0x7f43d4070a00 2023-12-08T08:19:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.493+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4067430 con 0x7f43d4070a00 2023-12-08T08:19:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.493+0000 7f43d0ff9640 1 -- 172.21.15.50:0/1360344117 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43c804c3b0 con 0x7f43d4070a00 2023-12-08T08:19:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.494+0000 7f43d0ff9640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f43c006ae70 0x7f43c006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.494+0000 7f43d0ff9640 1 -- 172.21.15.50:0/1360344117 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f43c80abbc0 con 0x7f43d4070a00 2023-12-08T08:19:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.494+0000 7f43d37fe640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f43c006ae70 0x7f43c006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.494+0000 7f43d37fe640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f43c006ae70 0x7f43c006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f43c4007fd0 tx=0x7f43c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.498+0000 7f43d0ff9640 1 -- 172.21.15.50:0/1360344117 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43c80769a0 con 0x7f43d4070a00 2023-12-08T08:19:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.672+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43d406cee0 con 0x7f43d4070a00 2023-12-08T08:19:48.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.673+0000 7f43d0ff9640 1 -- 172.21.15.50:0/1360344117 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43c80480a0 con 0x7f43d4070a00 2023-12-08T08:19:48.675 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:48.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f43c006ae70 msgr2=0x7f43c006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f43c006ae70 0x7f43c006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f43c4007fd0 tx=0x7f43c4009040 comp rx=0 tx=0).stop 2023-12-08T08:19:48.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d4070a00 msgr2=0x7f43d41490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d4070a00 0x7f43d41490c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f43c8000c00 tx=0x7f43c8004730 comp rx=0 tx=0).stop 2023-12-08T08:19:48.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 shutdown_connections 2023-12-08T08:19:48.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f43c006ae70 0x7f43c006d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43d415d030 0x7f43d414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43d40ac880 0x7f43d4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 --2- 172.21.15.50:0/1360344117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43d4070a00 0x7f43d41490c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.674+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 >> 172.21.15.50:0/1360344117 conn(0x7f43d40b0850 msgr2=0x7f43d40b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.675+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 shutdown_connections 2023-12-08T08:19:48.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.675+0000 7f43da46b640 1 -- 172.21.15.50:0/1360344117 wait complete. 2023-12-08T08:19:48.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:48.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.795+0000 7f0dc377c640 1 Processor -- start 2023-12-08T08:19:48.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.795+0000 7f0dc377c640 1 -- start start 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc377c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dbc0cb370 0x7f0dbc15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc377c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc06d7d0 0x7f0dbc0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc377c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc157e00 con 0x7f0dbc157a20 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc377c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc06dd20 con 0x7f0dbc0cb370 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc377c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc070cd0 con 0x7f0dbc06d7d0 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc0d17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dbc0cb370 0x7f0dbc15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc1518640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0dbc157a20 0x7f0dbc15d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50764/0 (socket says 172.21.15.50:50764) 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc1518640 1 -- 172.21.15.50:0/730516410 learned_addr learned my addr 172.21.15.50:0/730516410 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc0d17640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0dbc0cb370 0x7f0dbc15e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58928/0 (socket says 172.21.15.50:58928) 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc1d19640 1 --2- 172.21.15.50:0/730516410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc06d7d0 0x7f0dbc0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc0d17640 1 -- 172.21.15.50:0/730516410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc06d7d0 msgr2=0x7f0dbc0b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc0d17640 1 --2- 172.21.15.50:0/730516410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc06d7d0 0x7f0dbc0b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc0d17640 1 -- 172.21.15.50:0/730516410 >> v1:172.21.15.50:6789/0 conn(0x7f0dbc157a20 legacy=0x7f0dbc15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0db3fff640 1 -- 172.21.15.50:0/730516410 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159856086 0 0) 0x7f0dbc157e00 con 0x7f0dbc157a20 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc0d17640 1 -- 172.21.15.50:0/730516410 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc070fb0 con 0x7f0dbc0cb370 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.796+0000 7f0dc1d19640 1 --2- 172.21.15.50:0/730516410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc06d7d0 0x7f0dbc0b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.797+0000 7f0dc0d17640 1 --2- 172.21.15.50:0/730516410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc15e0e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0097a0 tx=0x7f0dac02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04382a4ff61fb48 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.797+0000 7f0db3fff640 1 -- 172.21.15.50:0/730516410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac02d040 con 0x7f0dbc0cb370 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.797+0000 7f0db3fff640 1 -- 172.21.15.50:0/730516410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac031810 con 0x7f0dbc0cb370 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.797+0000 7f0db3fff640 1 -- 172.21.15.50:0/730516410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031ba0 con 0x7f0dbc0cb370 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 -- 172.21.15.50:0/730516410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 msgr2=0x7f0dbc15e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 --2- 172.21.15.50:0/730516410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc15e0e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0097a0 tx=0x7f0dac02b8b0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 -- 172.21.15.50:0/730516410 shutdown_connections 2023-12-08T08:19:48.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 --2- 172.21.15.50:0/730516410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc06d7d0 0x7f0dbc0b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 --2- 172.21.15.50:0/730516410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc15e0e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 -- 172.21.15.50:0/730516410 >> 172.21.15.50:0/730516410 conn(0x7f0dbc0b0850 msgr2=0x7f0dbc0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 -- 172.21.15.50:0/730516410 shutdown_connections 2023-12-08T08:19:48.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.798+0000 7f0dc377c640 1 -- 172.21.15.50:0/730516410 wait complete. 2023-12-08T08:19:48.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.799+0000 7f0dc377c640 1 Processor -- start 2023-12-08T08:19:48.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.799+0000 7f0dc377c640 1 -- start start 2023-12-08T08:19:48.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc377c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dbc06d7d0 0x7f0dbc1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc377c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc14e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc377c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc157a20 0x7f0dbc15c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc377c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc149df0 con 0x7f0dbc0cb370 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc377c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc155f90 con 0x7f0dbc06d7d0 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc377c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc155380 con 0x7f0dbc157a20 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc14e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc14e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58944/0 (socket says 172.21.15.50:58944) 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 -- 172.21.15.50:0/1649985750 learned_addr learned my addr 172.21.15.50:0/1649985750 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc1d19640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc157a20 0x7f0dbc15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc1518640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dbc06d7d0 0x7f0dbc1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 -- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc157a20 msgr2=0x7f0dbc15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc157a20 0x7f0dbc15c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 -- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dbc06d7d0 msgr2=0x7f0dbc1498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dbc06d7d0 0x7f0dbc1498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 -- 172.21.15.50:0/1649985750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009400 con 0x7f0dbc0cb370 2023-12-08T08:19:48.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc1518640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dbc06d7d0 0x7f0dbc1498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc0d17640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc14e790 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0098c0 tx=0x7f0dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0db1ffb640 1 -- 172.21.15.50:0/1649985750 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac03ad60 con 0x7f0dbc0cb370 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0db1ffb640 1 -- 172.21.15.50:0/1649985750 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac044400 con 0x7f0dbc0cb370 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc155660 con 0x7f0dbc0cb370 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.800+0000 7f0db1ffb640 1 -- 172.21.15.50:0/1649985750 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0447b0 con 0x7f0dbc0cb370 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.801+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc155c20 con 0x7f0dbc0cb370 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.802+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc156120 con 0x7f0dbc0cb370 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.802+0000 7f0db1ffb640 1 -- 172.21.15.50:0/1649985750 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dac04d440 con 0x7f0dbc0cb370 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.802+0000 7f0db1ffb640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0da006ae40 0x7f0da006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:48.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.803+0000 7f0db1ffb640 1 -- 172.21.15.50:0/1649985750 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f0dac0abc40 con 0x7f0dbc0cb370 2023-12-08T08:19:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.803+0000 7f0dc1518640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0da006ae40 0x7f0da006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.803+0000 7f0dc1518640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0da006ae40 0x7f0da006d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000f60 tx=0x7f0db8007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:48.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.807+0000 7f0db1ffb640 1 -- 172.21.15.50:0/1649985750 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dac076a90 con 0x7f0dbc0cb370 2023-12-08T08:19:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.985+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0dbc1560d0 con 0x7f0dbc0cb370 2023-12-08T08:19:48.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.985+0000 7f0db1ffb640 1 -- 172.21.15.50:0/1649985750 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dac07a0b0 con 0x7f0dbc0cb370 2023-12-08T08:19:48.988 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0da006ae40 msgr2=0x7f0da006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0da006ae40 0x7f0da006d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000f60 tx=0x7f0db8007ca0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 msgr2=0x7f0dbc14e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc14e790 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0098c0 tx=0x7f0dac0046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 shutdown_connections 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0da006ae40 0x7f0da006d300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0dbc0cb370 0x7f0dbc14e790 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dbc157a20 0x7f0dbc15c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 --2- 172.21.15.50:0/1649985750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dbc06d7d0 0x7f0dbc1498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:48.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 >> 172.21.15.50:0/1649985750 conn(0x7f0dbc0b0850 msgr2=0x7f0dbc0b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:48.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 shutdown_connections 2023-12-08T08:19:48.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:48.987+0000 7f0dc377c640 1 -- 172.21.15.50:0/1649985750 wait complete. 2023-12-08T08:19:49.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-08T08:19:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.106+0000 7f4c23383640 1 Processor -- start 2023-12-08T08:19:49.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.107+0000 7f4c23383640 1 -- start start 2023-12-08T08:19:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.107+0000 7f4c23383640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4c1c0cfa30 0x7f4c1c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.107+0000 7f4c23383640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 0x7f4c1c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.107+0000 7f4c23383640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0c6be0 con 0x7f4c1c0cfe10 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.107+0000 7f4c23383640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0d3ff0 con 0x7f4c1c0cfa30 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.107+0000 7f4c23383640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b4860 con 0x7f4c1c0b4150 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c21920640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4c1c0cfe10 0x7f4c1c161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50778/0 (socket says 172.21.15.50:50778) 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c21920640 1 -- 172.21.15.50:0/2538736120 learned_addr learned my addr 172.21.15.50:0/2538736120 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c2111f640 1 --2- 172.21.15.50:0/2538736120 >> v2:172.21.15.170:3300/0 conn(0x7f4c1c0cfa30 0x7f4c1c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190857835 0 0) 0x7f4c1c0c6be0 con 0x7f4c1c0cfe10 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c2091e640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 0x7f4c1c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c08003520 con 0x7f4c1c0cfe10 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 111811221 0 0) 0x7f4c08003520 con 0x7f4c1c0cfe10 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 msgr2=0x7f4c1c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 0x7f4c1c0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 >> v2:172.21.15.170:3300/0 conn(0x7f4c1c0cfa30 msgr2=0x7f4c1c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 --2- 172.21.15.50:0/2538736120 >> v2:172.21.15.170:3300/0 conn(0x7f4c1c0cfa30 0x7f4c1c0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0d3d50 con 0x7f4c1c0cfe10 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f4c140019f0 con 0x7f4c1c0cfe10 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 >> v1:172.21.15.50:6789/0 conn(0x7f4c1c0cfe10 legacy=0x7f4c1c161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c08003970 0x7f4c08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 0x7f4c080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c08004d00 0x7f4c08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0d3ff0 con 0x7f4c08003970 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b4860 con 0x7f4c08004d00 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0800ba00 con 0x7f4c1c0b4150 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c2111f640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c08003970 0x7f4c08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c2091e640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 0x7f4c080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.108+0000 7f4c21920640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c08004d00 0x7f4c08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c2111f640 1 -- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 msgr2=0x7f4c080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c2111f640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c0b4150 0x7f4c080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c2111f640 1 -- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c08004d00 msgr2=0x7f4c08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c2111f640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c08004d00 0x7f4c08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c2111f640 1 -- 172.21.15.50:0/2538736120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08003520 con 0x7f4c08003970 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c21920640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c08004d00 0x7f4c08005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c2111f640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c08003970 0x7f4c08003d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009ac0 tx=0x7f4c080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610b4b1d54b5392b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.109+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1802c710 con 0x7f4c08003970 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1802c870 con 0x7f4c08003970 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c13fff640 1 -- 172.21.15.50:0/2538736120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1802cc00 con 0x7f4c08003970 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c23383640 1 -- 172.21.15.50:0/2538736120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c08003970 msgr2=0x7f4c08003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c23383640 1 --2- 172.21.15.50:0/2538736120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c08003970 0x7f4c08003d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009ac0 tx=0x7f4c080057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c21920640 1 -- 172.21.15.50:0/2538736120 reap_dead start 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c23383640 1 -- 172.21.15.50:0/2538736120 shutdown_connections 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c23383640 1 -- 172.21.15.50:0/2538736120 >> 172.21.15.50:0/2538736120 conn(0x7f4c1c0d3090 msgr2=0x7f4c1c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c23383640 1 -- 172.21.15.50:0/2538736120 shutdown_connections 2023-12-08T08:19:49.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.110+0000 7f4c23383640 1 -- 172.21.15.50:0/2538736120 wait complete. 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.111+0000 7f4c23383640 1 Processor -- start 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.111+0000 7f4c23383640 1 -- start start 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c23383640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c1554c0 0x7f4c1c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c23383640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c1558a0 0x7f4c1c06b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c23383640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c0b6240 0x7f4c1c0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c23383640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b16b0 con 0x7f4c1c1554c0 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c23383640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b1990 con 0x7f4c1c0b6240 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c23383640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b1c70 con 0x7f4c1c1558a0 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c1554c0 0x7f4c1c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c1554c0 0x7f4c1c06b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58958/0 (socket says 172.21.15.50:58958) 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 -- 172.21.15.50:0/948154122 learned_addr learned my addr 172.21.15.50:0/948154122 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c21920640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c0b6240 0x7f4c1c0b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 -- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c1558a0 msgr2=0x7f4c1c06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2091e640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c1558a0 0x7f4c1c06b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c1558a0 0x7f4c1c06b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 -- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c0b6240 msgr2=0x7f4c1c0b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c0b6240 0x7f4c1c0b66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.112+0000 7f4c2111f640 1 -- 172.21.15.50:0/948154122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0cf0e0 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.113+0000 7f4c2111f640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c1554c0 0x7f4c1c06b480 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000c00 tx=0x7f4c18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.113+0000 7f4c11ffb640 1 -- 172.21.15.50:0/948154122 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18003810 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.113+0000 7f4c11ffb640 1 -- 172.21.15.50:0/948154122 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1802de90 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.113+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0b1f50 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.113+0000 7f4c11ffb640 1 -- 172.21.15.50:0/948154122 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18003bb0 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.113+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0b2230 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.114+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c067430 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.114+0000 7f4c11ffb640 1 -- 172.21.15.50:0/948154122 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c1803b050 con 0x7f4c1c1554c0 2023-12-08T08:19:49.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.115+0000 7f4c11ffb640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4c0006ae40 0x7f4c0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.115+0000 7f4c11ffb640 1 -- 172.21.15.50:0/948154122 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f4c180ab480 con 0x7f4c1c1554c0 2023-12-08T08:19:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.115+0000 7f4c2091e640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4c0006ae40 0x7f4c0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.120 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.116+0000 7f4c2091e640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4c0006ae40 0x7f4c0006d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0cf720 tx=0x7f4c0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.121 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.119+0000 7f4c11ffb640 1 -- 172.21.15.50:0/948154122 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c18076410 con 0x7f4c1c1554c0 2023-12-08T08:19:49.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.294+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f4c1c1620e0 con 0x7f4c1c1554c0 2023-12-08T08:19:49.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.295+0000 7f4c11ffb640 1 -- 172.21.15.50:0/948154122 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v43) v1 ==== 97+0+11 (secure 0 0 0) 0x7f4c18079a30 con 0x7f4c1c1554c0 2023-12-08T08:19:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4c0006ae40 msgr2=0x7f4c0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4c0006ae40 0x7f4c0006d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0cf720 tx=0x7f4c0c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c1554c0 msgr2=0x7f4c1c06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c1554c0 0x7f4c1c06b480 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000c00 tx=0x7f4c18004730 comp rx=0 tx=0).stop 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 shutdown_connections 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4c0006ae40 0x7f4c0006d300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c1c0b6240 0x7f4c1c0b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c1c1558a0 0x7f4c1c06b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 --2- 172.21.15.50:0/948154122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c1c1554c0 0x7f4c1c06b480 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 >> 172.21.15.50:0/948154122 conn(0x7f4c1c0d3090 msgr2=0x7f4c1c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 shutdown_connections 2023-12-08T08:19:49.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.297+0000 7f4c23383640 1 -- 172.21.15.50:0/948154122 wait complete. 2023-12-08T08:19:49.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.414+0000 7fcc576ec640 1 Processor -- start 2023-12-08T08:19:49.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.415+0000 7fcc576ec640 1 -- start start 2023-12-08T08:19:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.415+0000 7fcc576ec640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcc500cf380 0x7fcc5006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.415+0000 7fcc576ec640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc500cf760 0x7fcc50161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.415+0000 7fcc576ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5006b070 con 0x7fcc50071b80 2023-12-08T08:19:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.415+0000 7fcc576ec640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc500d0d00 con 0x7fcc500cf760 2023-12-08T08:19:49.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.415+0000 7fcc576ec640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc50161bd0 con 0x7fcc500cf380 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc54c87640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc500cf760 0x7fcc50161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc54c87640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcc500cf760 0x7fcc50161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58962/0 (socket says 172.21.15.50:58962) 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc54c87640 1 -- 172.21.15.50:0/66731809 learned_addr learned my addr 172.21.15.50:0/66731809 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc55c89640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcc50071b80 0x7fcc500acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:50782/0 (socket says 172.21.15.50:50782) 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc55488640 1 --2- 172.21.15.50:0/66731809 >> v2:172.21.15.170:3300/0 conn(0x7fcc500cf380 0x7fcc5006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc54c87640 1 -- 172.21.15.50:0/66731809 >> v2:172.21.15.170:3300/0 conn(0x7fcc500cf380 msgr2=0x7fcc5006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc54c87640 1 --2- 172.21.15.50:0/66731809 >> v2:172.21.15.170:3300/0 conn(0x7fcc500cf380 0x7fcc5006a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc54c87640 1 -- 172.21.15.50:0/66731809 >> v1:172.21.15.50:6789/0 conn(0x7fcc50071b80 legacy=0x7fcc500acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.416+0000 7fcc54c87640 1 -- 172.21.15.50:0/66731809 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5006aab0 con 0x7fcc500cf760 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc54c87640 1 --2- 172.21.15.50:0/66731809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc50161690 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc500cfd00 tx=0x7fcc4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0e0a5cff5e4f04 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc47fff640 1 -- 172.21.15.50:0/66731809 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40031870 con 0x7fcc500cf760 2023-12-08T08:19:49.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc47fff640 1 -- 172.21.15.50:0/66731809 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc400319d0 con 0x7fcc500cf760 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc47fff640 1 -- 172.21.15.50:0/66731809 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40031d60 con 0x7fcc500cf760 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc576ec640 1 -- 172.21.15.50:0/66731809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 msgr2=0x7fcc50161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc576ec640 1 --2- 172.21.15.50:0/66731809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc50161690 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc500cfd00 tx=0x7fcc4002b910 comp rx=0 tx=0).stop 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc576ec640 1 -- 172.21.15.50:0/66731809 shutdown_connections 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc576ec640 1 --2- 172.21.15.50:0/66731809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc50161690 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc576ec640 1 --2- 172.21.15.50:0/66731809 >> v2:172.21.15.170:3300/0 conn(0x7fcc500cf380 0x7fcc5006a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc576ec640 1 -- 172.21.15.50:0/66731809 >> 172.21.15.50:0/66731809 conn(0x7fcc500cfda0 msgr2=0x7fcc500d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.417+0000 7fcc576ec640 1 -- 172.21.15.50:0/66731809 shutdown_connections 2023-12-08T08:19:49.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.418+0000 7fcc576ec640 1 -- 172.21.15.50:0/66731809 wait complete. 2023-12-08T08:19:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 Processor -- start 2023-12-08T08:19:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 -- start start 2023-12-08T08:19:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc50071b80 0x7fcc5014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc500cf380 0x7fcc5015fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc5015c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5015b7e0 con 0x7fcc500cf760 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5015e7f0 con 0x7fcc50071b80 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc576ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5015ea40 con 0x7fcc500cf380 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc55c89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc5015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc55c89640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc5015c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58970/0 (socket says 172.21.15.50:58970) 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.419+0000 7fcc55c89640 1 -- 172.21.15.50:0/3186971391 learned_addr learned my addr 172.21.15.50:0/3186971391 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc55488640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc50071b80 0x7fcc5014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc54c87640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc500cf380 0x7fcc5015fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc55c89640 1 -- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc500cf380 msgr2=0x7fcc5015fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc55c89640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc500cf380 0x7fcc5015fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc55c89640 1 -- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc50071b80 msgr2=0x7fcc5014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc55c89640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc50071b80 0x7fcc5014fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc55c89640 1 -- 172.21.15.50:0/3186971391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400094d0 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc55c89640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc5015c340 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c780 tx=0x7fcc4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc45ffb640 1 -- 172.21.15.50:0/3186971391 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800ce90 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc45ffb640 1 -- 172.21.15.50:0/3186971391 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4800a640 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc45ffb640 1 -- 172.21.15.50:0/3186971391 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800a9f0 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5015ed20 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.420+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5015f2e0 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.421+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc50067430 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.421+0000 7fcc45ffb640 1 -- 172.21.15.50:0/3186971391 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc4800ab50 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.421+0000 7fcc45ffb640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc3406ae70 0x7fcc3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.421+0000 7fcc45ffb640 1 -- 172.21.15.50:0/3186971391 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fcc48088f60 con 0x7fcc500cf760 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.421+0000 7fcc55488640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc3406ae70 0x7fcc3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:49.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.422+0000 7fcc55488640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc3406ae70 0x7fcc3406d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c006fd0 tx=0x7fcc4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:49.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.425+0000 7fcc45ffb640 1 -- 172.21.15.50:0/3186971391 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc48053e60 con 0x7fcc500cf760 2023-12-08T08:19:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.616+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcc500cc080 con 0x7fcc500cf760 2023-12-08T08:19:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.616+0000 7fcc45ffb640 1 -- 172.21.15.50:0/3186971391 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcc48017020 con 0x7fcc500cf760 2023-12-08T08:19:49.619 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc3406ae70 msgr2=0x7fcc3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc3406ae70 0x7fcc3406d330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c006fd0 tx=0x7fcc4c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:49.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 msgr2=0x7fcc5015c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc5015c340 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c780 tx=0x7fcc4800cc40 comp rx=0 tx=0).stop 2023-12-08T08:19:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 shutdown_connections 2023-12-08T08:19:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc3406ae70 0x7fcc3406d330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcc500cf760 0x7fcc5015c340 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc500cf380 0x7fcc5015fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 --2- 172.21.15.50:0/3186971391 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc50071b80 0x7fcc5014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:49.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 >> 172.21.15.50:0/3186971391 conn(0x7fcc500cfda0 msgr2=0x7fcc50160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:49.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 shutdown_connections 2023-12-08T08:19:49.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:49.618+0000 7fcc576ec640 1 -- 172.21.15.50:0/3186971391 wait complete. 2023-12-08T08:19:49.632 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:19:49.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:49.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:49.661 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[106795]: fuse finished with error 0 and tester_r 0 2023-12-08T08:19:49.663 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:19:54.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:54.789 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:19:55.764 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:19:55.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:55.765 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:19:55.784 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-12-08T08:19:55.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.947+0000 7ff7e3a4f640 1 Processor -- start 2023-12-08T08:19:55.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.947+0000 7ff7e3a4f640 1 -- start start 2023-12-08T08:19:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7e3a4f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff7dc159e30 0x7ff7dc070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7e3a4f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc0ac890 con 0x7ff7dc15d9e0 2023-12-08T08:19:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7e3a4f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc0b1f10 con 0x7ff7dc0cf040 2023-12-08T08:19:55.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7e3a4f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7dc0ac700 con 0x7ff7dc159e30 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7e0fea640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff7dc15d9e0 0x7ff7dc0b3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46036/0 (socket says 172.21.15.50:46036) 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7e0fea640 1 -- 172.21.15.50:0/2330759843 learned_addr learned my addr 172.21.15.50:0/2330759843 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7e17eb640 1 --2- 172.21.15.50:0/2330759843 >> v2:172.21.15.170:3300/0 conn(0x7ff7dc159e30 0x7ff7dc070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860473184 0 0) 0x7ff7dc0ac890 con 0x7ff7dc15d9e0 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.948+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c8003520 con 0x7ff7dc15d9e0 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788414469 0 0) 0x7ff7c8003520 con 0x7ff7dc15d9e0 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 >> v2:172.21.15.170:3300/0 conn(0x7ff7dc159e30 msgr2=0x7ff7dc070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 --2- 172.21.15.50:0/2330759843 >> v2:172.21.15.170:3300/0 conn(0x7ff7dc159e30 0x7ff7dc070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 >> v1:172.21.15.170:6789/0 conn(0x7ff7dc0cf040 legacy=0x7ff7dc0acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc15df50 con 0x7ff7dc15d9e0 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7ff7d8001670 con 0x7ff7dc15d9e0 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 >> v1:172.21.15.50:6789/0 conn(0x7ff7dc15d9e0 legacy=0x7ff7dc0b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c8003970 0x7ff7c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7c8005180 0x7ff7c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0ac700 con 0x7ff7c80047c0 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800c020 con 0x7ff7c8003970 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800c1e0 con 0x7ff7c8005180 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e0fea640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e17eb640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c8003970 0x7ff7c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e1fec640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7c8005180 0x7ff7c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e0fea640 1 -- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7c8005180 msgr2=0x7ff7c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e0fea640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7c8005180 0x7ff7c800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e0fea640 1 -- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c8003970 msgr2=0x7ff7c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e0fea640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7c8003970 0x7ff7c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e0fea640 1 -- 172.21.15.50:0/2330759843 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8003520 con 0x7ff7c80047c0 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e1fec640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7c8005180 0x7ff7c800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.949+0000 7ff7e1fec640 1 -- 172.21.15.50:0/2330759843 reap_dead start 2023-12-08T08:19:55.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.950+0000 7ff7e0fea640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800c210 tx=0x7ff7c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcb7cebd1c14fac server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.950+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8005ad0 con 0x7ff7c80047c0 2023-12-08T08:19:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.950+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d8005c30 con 0x7ff7c80047c0 2023-12-08T08:19:55.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.950+0000 7ff7cffff640 1 -- 172.21.15.50:0/2330759843 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d802cad0 con 0x7ff7c80047c0 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.951+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/2330759843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 msgr2=0x7ff7c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.951+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800c210 tx=0x7ff7c80057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.951+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/2330759843 shutdown_connections 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.951+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/2330759843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7c8004c40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.951+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/2330759843 >> 172.21.15.50:0/2330759843 conn(0x7ff7dc06a8f0 msgr2=0x7ff7dc06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.951+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/2330759843 shutdown_connections 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.951+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/2330759843 wait complete. 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.952+0000 7ff7e3a4f640 1 Processor -- start 2023-12-08T08:19:55.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.952+0000 7ff7e3a4f640 1 -- start start 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e3a4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7dc150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e3a4f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7dc156480 0x7ff7dc1f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e3a4f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7dc1f4630 0x7ff7dc1f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e3a4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc150d70 con 0x7ff7c80047c0 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e3a4f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc1f3080 con 0x7ff7dc156480 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e3a4f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0cd720 con 0x7ff7dc1f4630 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7dc150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7dc150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41158/0 (socket says 172.21.15.50:41158) 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 -- 172.21.15.50:0/1803935239 learned_addr learned my addr 172.21.15.50:0/1803935239 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e0fea640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7dc156480 0x7ff7dc1f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e1fec640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7dc1f4630 0x7ff7dc1f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 -- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7dc1f4630 msgr2=0x7ff7dc1f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7dc1f4630 0x7ff7dc1f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 -- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7dc156480 msgr2=0x7ff7dc1f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:55.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7dc156480 0x7ff7dc1f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.953+0000 7ff7e17eb640 1 -- 172.21.15.50:0/1803935239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc0cda00 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.954+0000 7ff7e17eb640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7dc150830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0011a70 tx=0x7ff7d0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.954+0000 7ff7cdffb640 1 -- 172.21.15.50:0/1803935239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0009680 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.954+0000 7ff7cdffb640 1 -- 172.21.15.50:0/1803935239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d000fb50 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.954+0000 7ff7cdffb640 1 -- 172.21.15.50:0/1803935239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000fee0 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.954+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc1f2d10 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.954+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc156040 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.955+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc1562f0 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.955+0000 7ff7cdffb640 1 -- 172.21.15.50:0/1803935239 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7d0014440 con 0x7ff7c80047c0 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.956+0000 7ff7cdffb640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7c006ae40 0x7ff7c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:55.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.956+0000 7ff7cdffb640 1 -- 172.21.15.50:0/1803935239 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7ff7d008a1e0 con 0x7ff7c80047c0 2023-12-08T08:19:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.956+0000 7ff7e0fea640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7c006ae40 0x7ff7c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:55.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.957+0000 7ff7e0fea640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7c006ae40 0x7ff7c006d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8034000 tx=0x7ff7d8009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:55.962 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:55.960+0000 7ff7cdffb640 1 -- 172.21.15.50:0/1803935239 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7d0055030 con 0x7ff7c80047c0 2023-12-08T08:19:56.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.202+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7ff7dc1f2ea0 con 0x7ff7c80047c0 2023-12-08T08:19:56.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.204+0000 7ff7cdffb640 1 -- 172.21.15.50:0/1803935239 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) v1 ==== 211+0+168 (secure 0 0 0) 0x7ff7d0058650 con 0x7ff7c80047c0 2023-12-08T08:19:56.206 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:19:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:19:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow rwp" 2023-12-08T08:19:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:19:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-12-08T08:19:56.207 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:19:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7c006ae40 msgr2=0x7ff7c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7c006ae40 0x7ff7c006d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8034000 tx=0x7ff7d8009030 comp rx=0 tx=0).stop 2023-12-08T08:19:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 msgr2=0x7ff7dc150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7dc150830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0011a70 tx=0x7ff7d0011f30 comp rx=0 tx=0).stop 2023-12-08T08:19:56.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 shutdown_connections 2023-12-08T08:19:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7c006ae40 0x7ff7c006d300 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7dc1f4630 0x7ff7dc1f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7dc156480 0x7ff7dc1f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 --2- 172.21.15.50:0/1803935239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7c80047c0 0x7ff7dc150830 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 >> 172.21.15.50:0/1803935239 conn(0x7ff7dc06a8f0 msgr2=0x7ff7dc06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 shutdown_connections 2023-12-08T08:19:56.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.206+0000 7ff7e3a4f640 1 -- 172.21.15.50:0/1803935239 wait complete. 2023-12-08T08:19:56.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:19:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.323+0000 7ff3b554c640 1 Processor -- start 2023-12-08T08:19:56.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.323+0000 7ff3b554c640 1 -- start start 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3b554c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3b00ce3e0 0x7ff3b00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3b554c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b0070db0 con 0x7ff3b0071e50 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3b554c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b0071090 con 0x7ff3b0140a10 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3b554c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b0070ba0 con 0x7ff3b00ce3e0 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3ae7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3b00ce3e0 0x7ff3b00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3af7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff3b0071e50 0x7ff3b006c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46038/0 (socket says 172.21.15.50:46038) 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3af7fe640 1 -- 172.21.15.50:0/1369623201 learned_addr learned my addr 172.21.15.50:0/1369623201 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3ae7fc640 1 -- 172.21.15.50:0/1369623201 >> v1:172.21.15.170:6789/0 conn(0x7ff3b0140a10 legacy=0x7ff3b00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3ae7fc640 1 -- 172.21.15.50:0/1369623201 >> v1:172.21.15.50:6789/0 conn(0x7ff3b0071e50 legacy=0x7ff3b006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.324+0000 7ff3ae7fc640 1 -- 172.21.15.50:0/1369623201 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0071370 con 0x7ff3b00ce3e0 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.325+0000 7ff3ae7fc640 1 --2- 172.21.15.50:0/1369623201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b00ce3e0 0x7ff3b00b1f30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff3980097a0 tx=0x7ff39802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e469ed003ae93e6e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.328 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.325+0000 7ff3adffb640 1 -- 172.21.15.50:0/1369623201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398030610 con 0x7ff3b00ce3e0 2023-12-08T08:19:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.325+0000 7ff3adffb640 1 -- 172.21.15.50:0/1369623201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398030770 con 0x7ff3b00ce3e0 2023-12-08T08:19:56.329 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.325+0000 7ff3adffb640 1 -- 172.21.15.50:0/1369623201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398030b00 con 0x7ff3b00ce3e0 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.326+0000 7ff3b554c640 1 -- 172.21.15.50:0/1369623201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b00ce3e0 msgr2=0x7ff3b00b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.326+0000 7ff3b554c640 1 --2- 172.21.15.50:0/1369623201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b00ce3e0 0x7ff3b00b1f30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff3980097a0 tx=0x7ff39802b960 comp rx=0 tx=0).stop 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.326+0000 7ff3b554c640 1 -- 172.21.15.50:0/1369623201 shutdown_connections 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.326+0000 7ff3b554c640 1 --2- 172.21.15.50:0/1369623201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b00ce3e0 0x7ff3b00b1f30 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.326+0000 7ff3b554c640 1 -- 172.21.15.50:0/1369623201 >> 172.21.15.50:0/1369623201 conn(0x7ff3b00b09f0 msgr2=0x7ff3b00b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.326+0000 7ff3b554c640 1 -- 172.21.15.50:0/1369623201 shutdown_connections 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.326+0000 7ff3b554c640 1 -- 172.21.15.50:0/1369623201 wait complete. 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.327+0000 7ff3b554c640 1 Processor -- start 2023-12-08T08:19:56.332 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.327+0000 7ff3b554c640 1 -- start start 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3b554c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0071e50 0x7ff3b0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3b554c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b00ce3e0 0x7ff3b01f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3b554c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b0140a10 0x7ff3b01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3b554c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0157230 con 0x7ff3b0140a10 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3b554c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01f4060 con 0x7ff3b00ce3e0 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3b554c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0141e60 con 0x7ff3b0071e50 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b0140a10 0x7ff3b01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b0140a10 0x7ff3b01574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41178/0 (socket says 172.21.15.50:41178) 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 -- 172.21.15.50:0/237166914 learned_addr learned my addr 172.21.15.50:0/237166914 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 -- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0071e50 msgr2=0x7ff3b0156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.333 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3ae7fc640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b00ce3e0 0x7ff3b01f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3aeffd640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0071e50 0x7ff3b0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0071e50 0x7ff3b0156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 -- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b00ce3e0 msgr2=0x7ff3b01f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b00ce3e0 0x7ff3b01f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.328+0000 7ff3af7fe640 1 -- 172.21.15.50:0/237166914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398009400 con 0x7ff3b0140a10 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.329+0000 7ff3af7fe640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b0140a10 0x7ff3b01574c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000cbc0 tx=0x7ff3a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.329+0000 7ff3a77fe640 1 -- 172.21.15.50:0/237166914 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000ad40 con 0x7ff3b0140a10 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.329+0000 7ff3a77fe640 1 -- 172.21.15.50:0/237166914 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0012400 con 0x7ff3b0140a10 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.329+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b013dcf0 con 0x7ff3b0140a10 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.329+0000 7ff3a77fe640 1 -- 172.21.15.50:0/237166914 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a000aea0 con 0x7ff3b0140a10 2023-12-08T08:19:56.334 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.329+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b0158430 con 0x7ff3b0140a10 2023-12-08T08:19:56.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.330+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b0067430 con 0x7ff3b0140a10 2023-12-08T08:19:56.335 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.330+0000 7ff3a77fe640 1 -- 172.21.15.50:0/237166914 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3a0007070 con 0x7ff3b0140a10 2023-12-08T08:19:56.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.331+0000 7ff3a77fe640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff39006ae40 0x7ff39006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:56.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.331+0000 7ff3a77fe640 1 -- 172.21.15.50:0/237166914 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7ff3a0089720 con 0x7ff3b0140a10 2023-12-08T08:19:56.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.331+0000 7ff3aeffd640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff39006ae40 0x7ff39006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:56.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.332+0000 7ff3aeffd640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff39006ae40 0x7ff39006d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800a750 tx=0x7ff3a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:56.337 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.335+0000 7ff3a77fe640 1 -- 172.21.15.50:0/237166914 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3a0054590 con 0x7ff3b0140a10 2023-12-08T08:19:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.551+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3b0141fa0 con 0x7ff3b0140a10 2023-12-08T08:19:56.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.551+0000 7ff3a77fe640 1 -- 172.21.15.50:0/237166914 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+82 (secure 0 0 0) 0x7ff3a0017070 con 0x7ff3b0140a10 2023-12-08T08:19:56.553 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff39006ae40 msgr2=0x7ff39006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff39006ae40 0x7ff39006d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800a750 tx=0x7ff3a8008040 comp rx=0 tx=0).stop 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b0140a10 msgr2=0x7ff3b01574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b0140a10 0x7ff3b01574c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000cbc0 tx=0x7ff3a000a430 comp rx=0 tx=0).stop 2023-12-08T08:19:56.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 shutdown_connections 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff39006ae40 0x7ff39006d300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3b0140a10 0x7ff3b01574c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b00ce3e0 0x7ff3b01f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 --2- 172.21.15.50:0/237166914 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0071e50 0x7ff3b0156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 >> 172.21.15.50:0/237166914 conn(0x7ff3b00b09f0 msgr2=0x7ff3b00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 shutdown_connections 2023-12-08T08:19:56.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:56.553+0000 7ff3b554c640 1 -- 172.21.15.50:0/237166914 wait complete. 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:19:56.566 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:56.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:56.567 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:19:56.582 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:19:56.582 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:19:56.582 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:19:56.582 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:56.582 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42377sec preferred_lft 42377sec 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:19:56.583 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c008:83ff:fe50:e6c0/64 scope link 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::403f:3fff:fee6:f2fc/64 scope link 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:19:56.584 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:56.585 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::2880:6dff:fe2e:b579/64 scope link 2023-12-08T08:19:56.585 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:19:56.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:56.585 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:19:56.651 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:19:56.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:56.653 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:19:56.709 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:19:56.709 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:19:56.709 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:19:56.709 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:19:56.710 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:19:56.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:56.710 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:19:56.710 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:19:56.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:19:56.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:19:56.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:19:56.710 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:19:56.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:56.815 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:19:56.830 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-08T08:19:56.830 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:19:56.831 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:56.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:56.831 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:19:56.902 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-08T08:19:56.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:56.902 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:56.957 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:19:56.958 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:19:56.958 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:57.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:19:57.084 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:19:57.140 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:19:57.141 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:19:57.142 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:19:57.143 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:57.143 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:57.143 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:57.143 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:57.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:57.143 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:19:57.196 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:19:57.196 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T08:19:57.238 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:19:57.269 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:19:57.325 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:19:57.325 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:19:57.325 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:19:57.325 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:19:57.325 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:19:57.325 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:19:57.325 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:19:57.326 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:57.327 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:19:57.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:57.328 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:19:57.331 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-12-08T08:19:57.328+0000 7fa838ad4480 -1 init, newargv = 0x55f6b59d91b0 newargc=15 2023-12-08T08:19:57.331 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[107877]: starting ceph client 2023-12-08T08:19:57.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[107877]: starting fuse 2023-12-08T08:19:57.346 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:19:57.346 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:19:57.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:19:57.346 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:19:57.346 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:19:57.346 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:19:57.346 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:19:57.346 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:57.346 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:19:57.347 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:19:57.348 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:19:57.348 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:19:57.348 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-12-08T08:19:57.348 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:19:57.470 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.107877.asok 2023-12-08T08:19:57.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:19:57.482 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107877.asok 2023-12-08T08:19:57.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:57.482 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.107877.asok status 2023-12-08T08:19:57.624 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:19:57.624 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:19:57.624 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:19:57.624 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:19:57.624 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "107877", 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 5967, 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 5967 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:19:57.625 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4050092157 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4050092157 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.5967 192.168.0.1:0/4050092157", 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/4050092157", 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:19:57.626 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 17, 2023-12-08T08:19:57.627 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 43, 2023-12-08T08:19:57.627 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:19:57.627 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:19:57.627 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:19:57.627 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:19:57.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:57.633 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:19:57.633 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:57.649 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:19:57.649 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:57.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:57.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:19:57.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:57.720 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-12-08T08:19:57.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:19:57.777 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-12-08T08:19:57.837 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:19:57.837 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:57.893 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.037+0000 7f371dc6b640 1 Processor -- start 2023-12-08T08:19:58.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.037+0000 7f371dc6b640 1 -- start start 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f371dc6b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f37181608a0 0x7f37180d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f371dc6b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37180b1d70 0x7f37180d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f371dc6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f371dc6b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37180d0620 con 0x7f37180b1d70 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f371dc6b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37180d20b0 con 0x7f37181608a0 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f371dc6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180d1dd0 con 0x7f37180afce0 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37180b1d70 0x7f37180d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37180b1d70 0x7f37180d1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41186/0 (socket says 172.21.15.50:41186) 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 -- 172.21.15.50:0/1921337259 learned_addr learned my addr 172.21.15.50:0/1921337259 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3717fff640 1 --2- 172.21.15.50:0/1921337259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f37177fe640 1 --2- 172.21.15.50:0/1921337259 >> v2:172.21.15.170:3300/0 conn(0x7f37181608a0 0x7f37180d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 -- 172.21.15.50:0/1921337259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 msgr2=0x7f37180b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 --2- 172.21.15.50:0/1921337259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 -- 172.21.15.50:0/1921337259 >> v2:172.21.15.170:3300/0 conn(0x7f37181608a0 msgr2=0x7f37180d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 --2- 172.21.15.50:0/1921337259 >> v2:172.21.15.170:3300/0 conn(0x7f37181608a0 0x7f37180d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f3716ffd640 1 -- 172.21.15.50:0/1921337259 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37180cff60 con 0x7f37180b1d70 2023-12-08T08:19:58.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.038+0000 7f37177fe640 1 --2- 172.21.15.50:0/1921337259 >> v2:172.21.15.170:3300/0 conn(0x7f37181608a0 0x7f37180d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:58.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.039+0000 7f3716ffd640 1 --2- 172.21.15.50:0/1921337259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180d1470 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f371808b770 tx=0x7f370802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b2a77ec95d2b2d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.039+0000 7f37167fc640 1 -- 172.21.15.50:0/1921337259 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080317e0 con 0x7f37180b1d70 2023-12-08T08:19:58.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.039+0000 7f37167fc640 1 -- 172.21.15.50:0/1921337259 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708031940 con 0x7f37180b1d70 2023-12-08T08:19:58.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.039+0000 7f37167fc640 1 -- 172.21.15.50:0/1921337259 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708031cd0 con 0x7f37180b1d70 2023-12-08T08:19:58.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 -- 172.21.15.50:0/1921337259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 msgr2=0x7f37180d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1921337259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180d1470 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f371808b770 tx=0x7f370802b880 comp rx=0 tx=0).stop 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 -- 172.21.15.50:0/1921337259 shutdown_connections 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1921337259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1921337259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180d1470 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1921337259 >> v2:172.21.15.170:3300/0 conn(0x7f37181608a0 0x7f37180d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 -- 172.21.15.50:0/1921337259 >> 172.21.15.50:0/1921337259 conn(0x7f37180d3030 msgr2=0x7f37180d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 -- 172.21.15.50:0/1921337259 shutdown_connections 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.040+0000 7f371dc6b640 1 -- 172.21.15.50:0/1921337259 wait complete. 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.041+0000 7f371dc6b640 1 Processor -- start 2023-12-08T08:19:58.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.041+0000 7f371dc6b640 1 -- start start 2023-12-08T08:19:58.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f371dc6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f371dc6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f371dc6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37181608a0 0x7f37180b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f371dc6b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180b8fa0 con 0x7f37180b1d70 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f371dc6b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180cc440 con 0x7f37181608a0 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f371dc6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180cc720 con 0x7f37180afce0 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41202/0 (socket says 172.21.15.50:41202) 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 -- 172.21.15.50:0/1069020727 learned_addr learned my addr 172.21.15.50:0/1069020727 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f37177fe640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3717fff640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37181608a0 0x7f37180b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 -- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 msgr2=0x7f37180cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 -- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37181608a0 msgr2=0x7f37180b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37181608a0 0x7f37180b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 -- 172.21.15.50:0/1069020727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080094d0 con 0x7f37180b1d70 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f37177fe640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:58.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.042+0000 7f3716ffd640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180cbbf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f370802b8c0 tx=0x7f37080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.043+0000 7f36fffff640 1 -- 172.21.15.50:0/1069020727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708032880 con 0x7f37180b1d70 2023-12-08T08:19:58.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.043+0000 7f36fffff640 1 -- 172.21.15.50:0/1069020727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708032a00 con 0x7f37180b1d70 2023-12-08T08:19:58.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.043+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37180cca00 con 0x7f37180b1d70 2023-12-08T08:19:58.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.043+0000 7f36fffff640 1 -- 172.21.15.50:0/1069020727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708032db0 con 0x7f37180b1d70 2023-12-08T08:19:58.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.043+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37180ccfc0 con 0x7f37180b1d70 2023-12-08T08:19:58.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.044+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37180cc860 con 0x7f37180b1d70 2023-12-08T08:19:58.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.044+0000 7f36fffff640 1 -- 172.21.15.50:0/1069020727 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f370804e450 con 0x7f37180b1d70 2023-12-08T08:19:58.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.045+0000 7f36fffff640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f370406ae40 0x7f370406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.045+0000 7f36fffff640 1 -- 172.21.15.50:0/1069020727 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f37080aba00 con 0x7f37180b1d70 2023-12-08T08:19:58.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.045+0000 7f37177fe640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f370406ae40 0x7f370406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.045+0000 7f37177fe640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f370406ae40 0x7f370406d300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f370c006fd0 tx=0x7f370c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.049+0000 7f36fffff640 1 -- 172.21.15.50:0/1069020727 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37180cc860 con 0x7f37180b1d70 2023-12-08T08:19:58.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.228+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37180cc860 con 0x7f37180b1d70 2023-12-08T08:19:58.232 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.230+0000 7f36fffff640 1 -- 172.21.15.50:0/1069020727 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18546 (secure 0 0 0) 0x7f37180cc860 con 0x7f37180b1d70 2023-12-08T08:19:58.232 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:19:58.232 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:38.869408+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:19:58.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f370406ae40 msgr2=0x7f370406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f370406ae40 0x7f370406d300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f370c006fd0 tx=0x7f370c008040 comp rx=0 tx=0).stop 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 msgr2=0x7f37180cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180cbbf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f370802b8c0 tx=0x7f37080046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 shutdown_connections 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f370406ae40 0x7f370406d300 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37180b1d70 0x7f37180cbbf0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37181608a0 0x7f37180b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 --2- 172.21.15.50:0/1069020727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f37180afce0 0x7f37180cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 >> 172.21.15.50:0/1069020727 conn(0x7f37180d3030 msgr2=0x7f371806b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 shutdown_connections 2023-12-08T08:19:58.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.232+0000 7f371dc6b640 1 -- 172.21.15.50:0/1069020727 wait complete. 2023-12-08T08:19:58.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:19:18.367216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:19:18.792176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-08T08:19:31.441584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:19:58.246 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:19:58.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.352+0000 7f1a5a953640 1 Processor -- start 2023-12-08T08:19:58.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.353+0000 7f1a5a953640 1 -- start start 2023-12-08T08:19:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.353+0000 7f1a5a953640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1a540cfa30 0x7f1a540b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.353+0000 7f1a5a953640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfe10 0x7f1a540cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.353+0000 7f1a5a953640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540c6be0 con 0x7f1a540b4150 2023-12-08T08:19:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.353+0000 7f1a5a953640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540d3ff0 con 0x7f1a540cfa30 2023-12-08T08:19:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.353+0000 7f1a5a953640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540b4860 con 0x7f1a540cfe10 2023-12-08T08:19:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a53fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1a540cfa30 0x7f1a540b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a58ef0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfe10 0x7f1a540cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a537fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1a540b4150 0x7f1a540b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:43750/0 (socket says 172.21.15.50:43750) 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a537fe640 1 -- 172.21.15.50:0/3705870059 learned_addr learned my addr 172.21.15.50:0/3705870059 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a53fff640 1 -- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfe10 msgr2=0x7f1a540cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a53fff640 1 --2- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfe10 0x7f1a540cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a53fff640 1 -- 172.21.15.50:0/3705870059 >> v1:172.21.15.170:6789/0 conn(0x7f1a540b4150 legacy=0x7f1a540b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a53fff640 1 -- 172.21.15.50:0/3705870059 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540d3d50 con 0x7f1a540cfa30 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a52ffd640 1 -- 172.21.15.50:0/3705870059 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618909795 0 0) 0x7f1a540c6be0 con 0x7f1a540b4150 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.354+0000 7f1a58ef0640 1 --2- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfe10 0x7f1a540cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.355+0000 7f1a53fff640 1 --2- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfa30 0x7f1a540b2f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097a0 tx=0x7f1a4802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3c24c6c434916fa server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.355+0000 7f1a52ffd640 1 -- 172.21.15.50:0/3705870059 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4802f050 con 0x7f1a540cfa30 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.355+0000 7f1a52ffd640 1 -- 172.21.15.50:0/3705870059 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a48031700 con 0x7f1a540cfa30 2023-12-08T08:19:58.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.355+0000 7f1a52ffd640 1 -- 172.21.15.50:0/3705870059 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48031a90 con 0x7f1a540cfa30 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.355+0000 7f1a5a953640 1 -- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfa30 msgr2=0x7f1a540b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.355+0000 7f1a5a953640 1 --2- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfa30 0x7f1a540b2f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a480097a0 tx=0x7f1a4802b7a0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.356+0000 7f1a5a953640 1 -- 172.21.15.50:0/3705870059 shutdown_connections 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.356+0000 7f1a5a953640 1 --2- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfe10 0x7f1a540cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.356+0000 7f1a5a953640 1 --2- 172.21.15.50:0/3705870059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfa30 0x7f1a540b2f20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.356+0000 7f1a5a953640 1 -- 172.21.15.50:0/3705870059 >> 172.21.15.50:0/3705870059 conn(0x7f1a540d3090 msgr2=0x7f1a540d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.356+0000 7f1a5a953640 1 -- 172.21.15.50:0/3705870059 shutdown_connections 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.356+0000 7f1a5a953640 1 -- 172.21.15.50:0/3705870059 wait complete. 2023-12-08T08:19:58.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.357+0000 7f1a5a953640 1 Processor -- start 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.357+0000 7f1a5a953640 1 -- start start 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a5a953640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a540b4150 0x7f1a541f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a5a953640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfa30 0x7f1a5409d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a5a953640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfe10 0x7f1a5414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a5a953640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540cb960 con 0x7f1a540b4150 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a5a953640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5414dfb0 con 0x7f1a540cfe10 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a5a953640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541f3cf0 con 0x7f1a540cfa30 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a540b4150 0x7f1a541f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a540b4150 0x7f1a541f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41204/0 (socket says 172.21.15.50:41204) 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 -- 172.21.15.50:0/1930113683 learned_addr learned my addr 172.21.15.50:0/1930113683 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a58ef0640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfe10 0x7f1a5414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a537fe640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfa30 0x7f1a5409d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 -- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfa30 msgr2=0x7f1a5409d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfa30 0x7f1a5409d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 -- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfe10 msgr2=0x7f1a5414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfe10 0x7f1a5414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 -- 172.21.15.50:0/1930113683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009a70 con 0x7f1a540b4150 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.358+0000 7f1a53fff640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a540b4150 0x7f1a541f37b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1a48000c00 tx=0x7f1a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.359+0000 7f1a50ff9640 1 -- 172.21.15.50:0/1930113683 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48006e10 con 0x7f1a540b4150 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.359+0000 7f1a50ff9640 1 -- 172.21.15.50:0/1930113683 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a48004030 con 0x7f1a540b4150 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.359+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a48009400 con 0x7f1a540b4150 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.359+0000 7f1a50ff9640 1 -- 172.21.15.50:0/1930113683 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480043c0 con 0x7f1a540b4150 2023-12-08T08:19:58.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.359+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a541505b0 con 0x7f1a540b4150 2023-12-08T08:19:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.360+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a54067430 con 0x7f1a540b4150 2023-12-08T08:19:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.360+0000 7f1a50ff9640 1 -- 172.21.15.50:0/1930113683 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a480339b0 con 0x7f1a540b4150 2023-12-08T08:19:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.361+0000 7f1a50ff9640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1a4006ae40 0x7f1a4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.361+0000 7f1a50ff9640 1 -- 172.21.15.50:0/1930113683 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f1a480ab6e0 con 0x7f1a540b4150 2023-12-08T08:19:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.361+0000 7f1a537fe640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1a4006ae40 0x7f1a4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.361+0000 7f1a537fe640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1a4006ae40 0x7f1a4006d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1a540cd0e0 tx=0x7f1a44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.365+0000 7f1a50ff9640 1 -- 172.21.15.50:0/1930113683 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a48076530 con 0x7f1a540b4150 2023-12-08T08:19:58.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.539+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a540743e0 con 0x7f1a540b4150 2023-12-08T08:19:58.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.539+0000 7f1a50ff9640 1 -- 172.21.15.50:0/1930113683 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a48079b50 con 0x7f1a540b4150 2023-12-08T08:19:58.542 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1a4006ae40 msgr2=0x7f1a4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1a4006ae40 0x7f1a4006d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1a540cd0e0 tx=0x7f1a44009040 comp rx=0 tx=0).stop 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a540b4150 msgr2=0x7f1a541f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a540b4150 0x7f1a541f37b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1a48000c00 tx=0x7f1a480046c0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 shutdown_connections 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1a4006ae40 0x7f1a4006d300 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a540cfe10 0x7f1a5414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a540cfa30 0x7f1a5409d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 --2- 172.21.15.50:0/1930113683 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1a540b4150 0x7f1a541f37b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 >> 172.21.15.50:0/1930113683 conn(0x7f1a540d3090 msgr2=0x7f1a5415f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 shutdown_connections 2023-12-08T08:19:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.541+0000 7f1a5a953640 1 -- 172.21.15.50:0/1930113683 wait complete. 2023-12-08T08:19:58.554 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:19:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.661+0000 7fce909fc640 1 Processor -- start 2023-12-08T08:19:58.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.661+0000 7fce909fc640 1 -- start start 2023-12-08T08:19:58.664 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.662+0000 7fce909fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 0x7fce8c15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.662+0000 7fce909fc640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c157e00 con 0x7fce8c06d7d0 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.662+0000 7fce909fc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c06dd20 con 0x7fce8c157a20 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.662+0000 7fce909fc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c070cd0 con 0x7fce8c0cb370 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.662+0000 7fce8ad9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fce8c06d7d0 0x7fce8c0b1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46044/0 (socket says 172.21.15.50:46044) 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.662+0000 7fce8ad9d640 1 -- 172.21.15.50:0/3798969516 learned_addr learned my addr 172.21.15.50:0/3798969516 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.662+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919747985 0 0) 0x7fce8c157e00 con 0x7fce8c06d7d0 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce89d9b640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 0x7fce8c15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.665 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce78005730 con 0x7fce8c06d7d0 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2486913457 0 0) 0x7fce78005730 con 0x7fce8c06d7d0 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 msgr2=0x7fce8c15e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 0x7fce8c15e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 >> v1:172.21.15.170:6789/0 conn(0x7fce8c157a20 legacy=0x7fce8c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c070fb0 con 0x7fce8c06d7d0 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fce7c0019f0 con 0x7fce8c06d7d0 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 >> v1:172.21.15.50:6789/0 conn(0x7fce8c06d7d0 legacy=0x7fce8c0b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78005bb0 0x7fce78005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78006560 0x7fce78006a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 0x7fce78007290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c070cd0 con 0x7fce78005bb0 2023-12-08T08:19:58.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7800dbc0 con 0x7fce78006560 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7800dd80 con 0x7fce8c0cb370 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8a59c640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78005bb0 0x7fce78005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8ad9d640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 0x7fce78007290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce89d9b640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78006560 0x7fce78006a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8a59c640 1 -- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 msgr2=0x7fce78007290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8a59c640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0cb370 0x7fce78007290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8a59c640 1 -- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78006560 msgr2=0x7fce78006a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8a59c640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78006560 0x7fce78006a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.663+0000 7fce8a59c640 1 -- 172.21.15.50:0/3798969516 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78005730 con 0x7fce78005bb0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.664+0000 7fce8a59c640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78005bb0 0x7fce78005f90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce84001860 tx=0x7fce78007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53a7aea2fd102e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.664+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84033630 con 0x7fce78005bb0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.664+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840337b0 con 0x7fce78005bb0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.664+0000 7fce8959a640 1 -- 172.21.15.50:0/3798969516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84033b60 con 0x7fce78005bb0 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.665+0000 7fce909fc640 1 -- 172.21.15.50:0/3798969516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78005bb0 msgr2=0x7fce78005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.665+0000 7fce909fc640 1 --2- 172.21.15.50:0/3798969516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce78005bb0 0x7fce78005f90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce84001860 tx=0x7fce78007a00 comp rx=0 tx=0).stop 2023-12-08T08:19:58.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.665+0000 7fce8ad9d640 1 -- 172.21.15.50:0/3798969516 reap_dead start 2023-12-08T08:19:58.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.665+0000 7fce909fc640 1 -- 172.21.15.50:0/3798969516 shutdown_connections 2023-12-08T08:19:58.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.665+0000 7fce909fc640 1 -- 172.21.15.50:0/3798969516 >> 172.21.15.50:0/3798969516 conn(0x7fce8c0b0850 msgr2=0x7fce8c0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.665+0000 7fce909fc640 1 -- 172.21.15.50:0/3798969516 shutdown_connections 2023-12-08T08:19:58.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.665+0000 7fce909fc640 1 -- 172.21.15.50:0/3798969516 wait complete. 2023-12-08T08:19:58.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.666+0000 7fce909fc640 1 Processor -- start 2023-12-08T08:19:58.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.666+0000 7fce909fc640 1 -- start start 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce909fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78005bb0 0x7fce8c146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce909fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce8c143000 0x7fce8c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce909fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0af950 0x7fce8c0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce909fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c144820 con 0x7fce8c143000 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce909fc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0b0310 con 0x7fce78005bb0 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce909fc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c143810 con 0x7fce8c0af950 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce89d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce8c143000 0x7fce8c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce89d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce8c143000 0x7fce8c1560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41224/0 (socket says 172.21.15.50:41224) 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce89d9b640 1 -- 172.21.15.50:0/4125953142 learned_addr learned my addr 172.21.15.50:0/4125953142 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:58.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce8a59c640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78005bb0 0x7fce8c146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.667+0000 7fce8ad9d640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0af950 0x7fce8c0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce89d9b640 1 -- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0af950 msgr2=0x7fce8c0afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce89d9b640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0af950 0x7fce8c0afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce89d9b640 1 -- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78005bb0 msgr2=0x7fce8c146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce89d9b640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78005bb0 0x7fce8c146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce89d9b640 1 -- 172.21.15.50:0/4125953142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c143af0 con 0x7fce8c143000 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce89d9b640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce8c143000 0x7fce8c1560f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fce740118e0 tx=0x7fce74011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce82ffd640 1 -- 172.21.15.50:0/4125953142 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400faf0 con 0x7fce8c143000 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce82ffd640 1 -- 172.21.15.50:0/4125953142 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7400fc50 con 0x7fce8c143000 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce82ffd640 1 -- 172.21.15.50:0/4125953142 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74014440 con 0x7fce8c143000 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c143dd0 con 0x7fce8c143000 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.668+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c156630 con 0x7fce8c143000 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.669+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c067430 con 0x7fce8c143000 2023-12-08T08:19:58.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.669+0000 7fce82ffd640 1 -- 172.21.15.50:0/4125953142 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce740145a0 con 0x7fce8c143000 2023-12-08T08:19:58.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.670+0000 7fce82ffd640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fce6c06ae70 0x7fce6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.670+0000 7fce82ffd640 1 -- 172.21.15.50:0/4125953142 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fce74089e90 con 0x7fce8c143000 2023-12-08T08:19:58.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.670+0000 7fce8a59c640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fce6c06ae70 0x7fce6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.671+0000 7fce8a59c640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fce6c06ae70 0x7fce6c06d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce84036000 tx=0x7fce84031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.674+0000 7fce82ffd640 1 -- 172.21.15.50:0/4125953142 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce74054d90 con 0x7fce8c143000 2023-12-08T08:19:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.849+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce8c06bfe0 con 0x7fce8c143000 2023-12-08T08:19:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.849+0000 7fce82ffd640 1 -- 172.21.15.50:0/4125953142 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce74022020 con 0x7fce8c143000 2023-12-08T08:19:58.851 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fce6c06ae70 msgr2=0x7fce6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fce6c06ae70 0x7fce6c06d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce84036000 tx=0x7fce84031000 comp rx=0 tx=0).stop 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce8c143000 msgr2=0x7fce8c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce8c143000 0x7fce8c1560f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fce740118e0 tx=0x7fce74011da0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 shutdown_connections 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fce6c06ae70 0x7fce6c06d330 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce8c143000 0x7fce8c1560f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce8c0af950 0x7fce8c0afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 --2- 172.21.15.50:0/4125953142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce78005bb0 0x7fce8c146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 >> 172.21.15.50:0/4125953142 conn(0x7fce8c0b0850 msgr2=0x7fce8c15cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 shutdown_connections 2023-12-08T08:19:58.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.851+0000 7fce909fc640 1 -- 172.21.15.50:0/4125953142 wait complete. 2023-12-08T08:19:58.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:19:58.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.973+0000 7f1ede2e7640 1 Processor -- start 2023-12-08T08:19:58.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.973+0000 7f1ede2e7640 1 -- start start 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ede2e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed80cb370 0x7f1ed815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ede2e7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1ed806d7d0 0x7f1ed80b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ede2e7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed8157e00 con 0x7f1ed8157a20 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ede2e7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed806dd20 con 0x7f1ed806d7d0 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ede2e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8070cd0 con 0x7f1ed80cb370 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1edc884640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1ed806d7d0 0x7f1ed80b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ed77fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed80cb370 0x7f1ed815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ed7fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1ed8157a20 0x7f1ed815d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:43778/0 (socket says 172.21.15.50:43778) 2023-12-08T08:19:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ed7fff640 1 -- 172.21.15.50:0/3516035502 learned_addr learned my addr 172.21.15.50:0/3516035502 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.974+0000 7f1ed77fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed80cb370 0x7f1ed815e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:60074/0 (socket says 172.21.15.50:60074) 2023-12-08T08:19:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.975+0000 7f1edc884640 1 -- 172.21.15.50:0/3516035502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed80cb370 msgr2=0x7f1ed815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.975+0000 7f1edc884640 1 --2- 172.21.15.50:0/3516035502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed80cb370 0x7f1ed815e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.975+0000 7f1edc884640 1 -- 172.21.15.50:0/3516035502 >> v1:172.21.15.170:6789/0 conn(0x7f1ed8157a20 legacy=0x7f1ed815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.975+0000 7f1edc884640 1 -- 172.21.15.50:0/3516035502 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8070fb0 con 0x7f1ed806d7d0 2023-12-08T08:19:58.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.975+0000 7f1ed6ffd640 1 -- 172.21.15.50:0/3516035502 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111040661 0 0) 0x7f1ed8157e00 con 0x7f1ed8157a20 2023-12-08T08:19:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1edc884640 1 --2- 172.21.15.50:0/3516035502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed806d7d0 0x7f1ed80b1b50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000bfa0 tx=0x7f1ed002e0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f40df22a2ef74a9d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ed6ffd640 1 -- 172.21.15.50:0/3516035502 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed002ea40 con 0x7f1ed806d7d0 2023-12-08T08:19:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ed6ffd640 1 -- 172.21.15.50:0/3516035502 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed002eba0 con 0x7f1ed806d7d0 2023-12-08T08:19:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ed6ffd640 1 -- 172.21.15.50:0/3516035502 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0009540 con 0x7f1ed806d7d0 2023-12-08T08:19:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 -- 172.21.15.50:0/3516035502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed806d7d0 msgr2=0x7f1ed80b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/3516035502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed806d7d0 0x7f1ed80b1b50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000bfa0 tx=0x7f1ed002e0a0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 -- 172.21.15.50:0/3516035502 shutdown_connections 2023-12-08T08:19:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/3516035502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed806d7d0 0x7f1ed80b1b50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/3516035502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed80cb370 0x7f1ed815e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 -- 172.21.15.50:0/3516035502 >> 172.21.15.50:0/3516035502 conn(0x7f1ed80b0850 msgr2=0x7f1ed80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 -- 172.21.15.50:0/3516035502 shutdown_connections 2023-12-08T08:19:58.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.976+0000 7f1ede2e7640 1 -- 172.21.15.50:0/3516035502 wait complete. 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.977+0000 7f1ede2e7640 1 Processor -- start 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ede2e7640 1 -- start start 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ede2e7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed806d7d0 0x7f1ed813d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ede2e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed80cb370 0x7f1ed80adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ede2e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed8157a20 0x7f1ed80ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ede2e7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80ae4d0 con 0x7f1ed806d7d0 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ede2e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8140990 con 0x7f1ed80cb370 2023-12-08T08:19:58.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ede2e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed8140ed0 con 0x7f1ed8157a20 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed806d7d0 0x7f1ed813d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed806d7d0 0x7f1ed813d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41230/0 (socket says 172.21.15.50:41230) 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.978+0000 7f1ed7fff640 1 -- 172.21.15.50:0/674908854 learned_addr learned my addr 172.21.15.50:0/674908854 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed77fe640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed80cb370 0x7f1ed80adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1edc884640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed8157a20 0x7f1ed80ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed7fff640 1 -- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed8157a20 msgr2=0x7f1ed80ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed7fff640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed8157a20 0x7f1ed80ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed7fff640 1 -- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed80cb370 msgr2=0x7f1ed80adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed7fff640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed80cb370 0x7f1ed80adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed7fff640 1 -- 172.21.15.50:0/674908854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed000bc80 con 0x7f1ed806d7d0 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed77fe640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed80cb370 0x7f1ed80adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed7fff640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed806d7d0 0x7f1ed813d6f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c430 tx=0x7f1ecc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed4ff9640 1 -- 172.21.15.50:0/674908854 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0074e0 con 0x7f1ed806d7d0 2023-12-08T08:19:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed8140bf0 con 0x7f1ed806d7d0 2023-12-08T08:19:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed4ff9640 1 -- 172.21.15.50:0/674908854 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc007660 con 0x7f1ed806d7d0 2023-12-08T08:19:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ed4ff9640 1 -- 172.21.15.50:0/674908854 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc004a20 con 0x7f1ed806d7d0 2023-12-08T08:19:58.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.979+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed80cc580 con 0x7f1ed806d7d0 2023-12-08T08:19:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.980+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed8067430 con 0x7f1ed806d7d0 2023-12-08T08:19:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.981+0000 7f1ed4ff9640 1 -- 172.21.15.50:0/674908854 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ecc004b80 con 0x7f1ed806d7d0 2023-12-08T08:19:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.981+0000 7f1ed4ff9640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ec406ae40 0x7f1ec406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.981+0000 7f1ed4ff9640 1 -- 172.21.15.50:0/674908854 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f1ecc089840 con 0x7f1ed806d7d0 2023-12-08T08:19:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.981+0000 7f1ed77fe640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ec406ae40 0x7f1ec406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:58.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.982+0000 7f1ed77fe640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ec406ae40 0x7f1ec406d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8159f40 tx=0x7f1ec8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:58.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:58.985+0000 7f1ed4ff9640 1 -- 172.21.15.50:0/674908854 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ecc054580 con 0x7f1ed806d7d0 2023-12-08T08:19:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.162+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ed8159f70 con 0x7f1ed806d7d0 2023-12-08T08:19:59.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.162+0000 7f1ed4ff9640 1 -- 172.21.15.50:0/674908854 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ecc057ba0 con 0x7f1ed806d7d0 2023-12-08T08:19:59.165 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ec406ae40 msgr2=0x7f1ec406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ec406ae40 0x7f1ec406d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8159f40 tx=0x7f1ec8008040 comp rx=0 tx=0).stop 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed806d7d0 msgr2=0x7f1ed813d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed806d7d0 0x7f1ed813d6f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00c430 tx=0x7f1ecc00c8f0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 shutdown_connections 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ec406ae40 0x7f1ec406d300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ed8157a20 0x7f1ed80ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ed80cb370 0x7f1ed80adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 --2- 172.21.15.50:0/674908854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ed806d7d0 0x7f1ed813d6f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 >> 172.21.15.50:0/674908854 conn(0x7f1ed80b0850 msgr2=0x7f1ed806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 shutdown_connections 2023-12-08T08:19:59.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.164+0000 7f1ede2e7640 1 -- 172.21.15.50:0/674908854 wait complete. 2023-12-08T08:19:59.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-08T08:19:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.284+0000 7f0c7841e640 1 Processor -- start 2023-12-08T08:19:59.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.284+0000 7f0c7841e640 1 -- start start 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c7841e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 0x7f0c700ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c7841e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700cce00 con 0x7f0c700cc380 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c7841e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700b0f00 con 0x7f0c7015e790 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c7841e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700ccb20 con 0x7f0c700cde00 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c769bb640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0c700cc380 0x7f0c700b1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46060/0 (socket says 172.21.15.50:46060) 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c769bb640 1 -- 172.21.15.50:0/3575660776 learned_addr learned my addr 172.21.15.50:0/3575660776 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 0x7f0c700ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862104976 0 0) 0x7f0c700cce00 con 0x7f0c700cc380 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5c003520 con 0x7f0c700cc380 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4237047858 0 0) 0x7f0c5c003520 con 0x7f0c700cc380 2023-12-08T08:19:59.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 msgr2=0x7f0c700ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 0x7f0c700ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 >> v1:172.21.15.170:6789/0 conn(0x7f0c7015e790 legacy=0x7f0c700cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700b08b0 con 0x7f0c700cc380 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f0c680019f0 con 0x7f0c700cc380 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 >> v1:172.21.15.50:6789/0 conn(0x7f0c700cc380 legacy=0x7f0c700b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c0039a0 0x7f0c5c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 0x7f0c5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700ccb20 con 0x7f0c5c0047c0 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c00ba80 con 0x7f0c5c0039a0 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.285+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c00bc40 con 0x7f0c700cde00 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c769bb640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 0x7f0c5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c761ba640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c0039a0 0x7f0c5c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c759b9640 1 -- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 msgr2=0x7f0c5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 0x7f0c5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c759b9640 1 -- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c0039a0 msgr2=0x7f0c5c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5c0039a0 0x7f0c5c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c759b9640 1 -- 172.21.15.50:0/3575660776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c003520 con 0x7f0c5c0047c0 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.286+0000 7f0c769bb640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700cde00 0x7f0c5c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c5c004c40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009ac0 tx=0x7f0c5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f649b0b0e6c15ae server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6002c6b0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6002c810 con 0x7f0c5c0047c0 2023-12-08T08:19:59.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c751b8640 1 -- 172.21.15.50:0/3575660776 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6002cba0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c7841e640 1 -- 172.21.15.50:0/3575660776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 msgr2=0x7f0c5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c7841e640 1 --2- 172.21.15.50:0/3575660776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c5c004c40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0c60009ac0 tx=0x7f0c5c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c769bb640 1 -- 172.21.15.50:0/3575660776 reap_dead start 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c7841e640 1 -- 172.21.15.50:0/3575660776 shutdown_connections 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c7841e640 1 -- 172.21.15.50:0/3575660776 >> 172.21.15.50:0/3575660776 conn(0x7f0c700d0e00 msgr2=0x7f0c700d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c7841e640 1 -- 172.21.15.50:0/3575660776 shutdown_connections 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.287+0000 7f0c7841e640 1 -- 172.21.15.50:0/3575660776 wait complete. 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 Processor -- start 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 -- start start 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c700b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700c9930 0x7f0c7014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c700c9db0 0x7f0c7015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70148d80 con 0x7f0c5c0047c0 2023-12-08T08:19:59.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70158950 con 0x7f0c700c9db0 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c7841e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70149360 con 0x7f0c700c9930 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c761ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c700b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c761ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c700b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41240/0 (socket says 172.21.15.50:41240) 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.289+0000 7f0c761ba640 1 -- 172.21.15.50:0/3050254161 learned_addr learned my addr 172.21.15.50:0/3050254161 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700c9930 0x7f0c7014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c769bb640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c700c9db0 0x7f0c7015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c761ba640 1 -- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700c9930 msgr2=0x7f0c7014c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c761ba640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700c9930 0x7f0c7014c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c761ba640 1 -- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c700c9db0 msgr2=0x7f0c7015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c761ba640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c700c9db0 0x7f0c7015d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c761ba640 1 -- 172.21.15.50:0/3050254161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70149640 con 0x7f0c5c0047c0 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c761ba640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c700b5e90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00f7c0 tx=0x7f0c6c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c66ffd640 1 -- 172.21.15.50:0/3050254161 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00fed0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c66ffd640 1 -- 172.21.15.50:0/3050254161 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c0052e0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c70149920 con 0x7f0c5c0047c0 2023-12-08T08:19:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c66ffd640 1 -- 172.21.15.50:0/3050254161 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00d970 con 0x7f0c5c0047c0 2023-12-08T08:19:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.290+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c70149ee0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.291+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c70067430 con 0x7f0c5c0047c0 2023-12-08T08:19:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.292+0000 7f0c66ffd640 1 -- 172.21.15.50:0/3050254161 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c6c00dad0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.292+0000 7f0c66ffd640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0c5406ae40 0x7f0c5406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.292+0000 7f0c66ffd640 1 -- 172.21.15.50:0/3050254161 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f0c6c089a70 con 0x7f0c5c0047c0 2023-12-08T08:19:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.292+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0c5406ae40 0x7f0c5406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.293+0000 7f0c759b9640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0c5406ae40 0x7f0c5406d300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0c60036000 tx=0x7f0c60030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.296+0000 7f0c66ffd640 1 -- 172.21.15.50:0/3050254161 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c6c0547a0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.472+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f0c7006f980 con 0x7f0c5c0047c0 2023-12-08T08:19:59.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.472+0000 7f0c66ffd640 1 -- 172.21.15.50:0/3050254161 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v43) v1 ==== 97+0+11 (secure 0 0 0) 0x7f0c6c057dc0 con 0x7f0c5c0047c0 2023-12-08T08:19:59.475 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0c5406ae40 msgr2=0x7f0c5406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0c5406ae40 0x7f0c5406d300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0c60036000 tx=0x7f0c60030000 comp rx=0 tx=0).stop 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 msgr2=0x7f0c700b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c700b5e90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00f7c0 tx=0x7f0c6c00fc80 comp rx=0 tx=0).stop 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 shutdown_connections 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0c5406ae40 0x7f0c5406d300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c700c9db0 0x7f0c7015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c700c9930 0x7f0c7014c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 --2- 172.21.15.50:0/3050254161 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c5c0047c0 0x7f0c700b5e90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.474+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 >> 172.21.15.50:0/3050254161 conn(0x7f0c700d0e00 msgr2=0x7f0c700adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.475+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 shutdown_connections 2023-12-08T08:19:59.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.475+0000 7f0c7841e640 1 -- 172.21.15.50:0/3050254161 wait complete. 2023-12-08T08:19:59.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:19:59.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.592+0000 7f8517325640 1 Processor -- start 2023-12-08T08:19:59.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.592+0000 7f8517325640 1 -- start start 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.593+0000 7f8517325640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85100ce270 0x7f851006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.593+0000 7f8517325640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100ce6f0 con 0x7f85100ccd70 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.593+0000 7f8517325640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85100cf9c0 con 0x7f851006c480 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.593+0000 7f8517325640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85100d0a60 con 0x7f85100ce270 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.593+0000 7f85148c0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f85100ce270 0x7f851006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.593+0000 7f85150c1640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f85100ccd70 0x7f85100cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:46068/0 (socket says 172.21.15.50:46068) 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.593+0000 7f85150c1640 1 -- 172.21.15.50:0/2467072344 learned_addr learned my addr 172.21.15.50:0/2467072344 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.594+0000 7f85148c0640 1 -- 172.21.15.50:0/2467072344 >> v1:172.21.15.170:6789/0 conn(0x7f851006c480 legacy=0x7f851015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.594+0000 7f85148c0640 1 -- 172.21.15.50:0/2467072344 >> v1:172.21.15.50:6789/0 conn(0x7f85100ccd70 legacy=0x7f85100cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.594+0000 7f850ffff640 1 -- 172.21.15.50:0/2467072344 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838861814 0 0) 0x7f85100ce6f0 con 0x7f85100ccd70 2023-12-08T08:19:59.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.594+0000 7f85148c0640 1 -- 172.21.15.50:0/2467072344 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100cfca0 con 0x7f85100ce270 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.594+0000 7f85148c0640 1 --2- 172.21.15.50:0/2467072344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85100ce270 0x7f851006bf40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f85040097a0 tx=0x7f850402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a224bb47aa89251 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f850ffff640 1 -- 172.21.15.50:0/2467072344 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504030610 con 0x7f85100ce270 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f850ffff640 1 -- 172.21.15.50:0/2467072344 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8504030770 con 0x7f85100ce270 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f850ffff640 1 -- 172.21.15.50:0/2467072344 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504030b00 con 0x7f85100ce270 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f8517325640 1 -- 172.21.15.50:0/2467072344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85100ce270 msgr2=0x7f851006bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f8517325640 1 --2- 172.21.15.50:0/2467072344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85100ce270 0x7f851006bf40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f85040097a0 tx=0x7f850402b960 comp rx=0 tx=0).stop 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f8517325640 1 -- 172.21.15.50:0/2467072344 shutdown_connections 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f8517325640 1 --2- 172.21.15.50:0/2467072344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85100ce270 0x7f851006bf40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f8517325640 1 -- 172.21.15.50:0/2467072344 >> 172.21.15.50:0/2467072344 conn(0x7f85100d0de0 msgr2=0x7f85100d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f8517325640 1 -- 172.21.15.50:0/2467072344 shutdown_connections 2023-12-08T08:19:59.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.595+0000 7f8517325640 1 -- 172.21.15.50:0/2467072344 wait complete. 2023-12-08T08:19:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.596+0000 7f8517325640 1 Processor -- start 2023-12-08T08:19:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.596+0000 7f8517325640 1 -- start start 2023-12-08T08:19:59.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f8517325640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851006c480 0x7f8510160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f8517325640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85100ccd70 0x7f8510152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f8517325640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85100ce270 0x7f85101f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f8517325640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8510153160 con 0x7f851006c480 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f8517325640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8510160d30 con 0x7f85100ce270 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f8517325640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85101f70d0 con 0x7f85100ccd70 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f85150c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851006c480 0x7f8510160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f85150c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851006c480 0x7f8510160750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:41258/0 (socket says 172.21.15.50:41258) 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.597+0000 7f85150c1640 1 -- 172.21.15.50:0/2455240258 learned_addr learned my addr 172.21.15.50:0/2455240258 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85158c2640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85100ce270 0x7f85101f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85150c1640 1 -- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85100ccd70 msgr2=0x7f8510152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85150c1640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85100ccd70 0x7f8510152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85150c1640 1 -- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85100ce270 msgr2=0x7f85101f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85150c1640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85100ce270 0x7f85101f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85150c1640 1 -- 172.21.15.50:0/2455240258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504009400 con 0x7f851006c480 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85158c2640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85100ce270 0x7f85101f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f85150c1640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851006c480 0x7f8510160750 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f850800c4a0 tx=0x7f850800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f850dffb640 1 -- 172.21.15.50:0/2455240258 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080074e0 con 0x7f851006c480 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f850dffb640 1 -- 172.21.15.50:0/2455240258 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8508007640 con 0x7f851006c480 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8510157860 con 0x7f851006c480 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f850dffb640 1 -- 172.21.15.50:0/2455240258 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508004a00 con 0x7f851006c480 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.598+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8510157e20 con 0x7f851006c480 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.599+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8510157580 con 0x7f851006c480 2023-12-08T08:19:59.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.599+0000 7f850dffb640 1 -- 172.21.15.50:0/2455240258 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8508004b60 con 0x7f851006c480 2023-12-08T08:19:59.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.600+0000 7f850dffb640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f84fc06ae40 0x7f84fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.600+0000 7f850dffb640 1 -- 172.21.15.50:0/2455240258 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f8508088d90 con 0x7f851006c480 2023-12-08T08:19:59.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.600+0000 7f85148c0640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f84fc06ae40 0x7f84fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.600+0000 7f85148c0640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f84fc06ae40 0x7f84fc06d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8504036000 tx=0x7f850403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.604+0000 7f850dffb640 1 -- 172.21.15.50:0/2455240258 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8508053be0 con 0x7f851006c480 2023-12-08T08:19:59.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.791+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8510067430 con 0x7f851006c480 2023-12-08T08:19:59.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.792+0000 7f850dffb640 1 -- 172.21.15.50:0/2455240258 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8508018020 con 0x7f851006c480 2023-12-08T08:19:59.794 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f84fc06ae40 msgr2=0x7f84fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f84fc06ae40 0x7f84fc06d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8504036000 tx=0x7f850403b040 comp rx=0 tx=0).stop 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851006c480 msgr2=0x7f8510160750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851006c480 0x7f8510160750 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f850800c4a0 tx=0x7f850800c960 comp rx=0 tx=0).stop 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 shutdown_connections 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f84fc06ae40 0x7f84fc06d300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85100ce270 0x7f85101f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85100ccd70 0x7f8510152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 --2- 172.21.15.50:0/2455240258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f851006c480 0x7f8510160750 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 >> 172.21.15.50:0/2455240258 conn(0x7f85100d0de0 msgr2=0x7f85100af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.793+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 shutdown_connections 2023-12-08T08:19:59.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.794+0000 7f8517325640 1 -- 172.21.15.50:0/2455240258 wait complete. 2023-12-08T08:19:59.806 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:19:59.807 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:19:59.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:19:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.966+0000 7f5d33694640 1 Processor -- start 2023-12-08T08:19:59.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.966+0000 7f5d33694640 1 -- start start 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.967+0000 7f5d33694640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 0x7f5d2c0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.967+0000 7f5d33694640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5d2c0b1d70 0x7f5d2c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.967+0000 7f5d33694640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c0d20b0 con 0x7f5d2c1608a0 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.967+0000 7f5d33694640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0d0620 con 0x7f5d2c0b1d70 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.967+0000 7f5d33694640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0d1b80 con 0x7f5d2c0b0cf0 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.967+0000 7f5d31430640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5d2c1608a0 0x7f5d2c0d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53298/0 (socket says 172.21.15.50:53298) 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.967+0000 7f5d31430640 1 -- 172.21.15.50:0/1424906971 learned_addr learned my addr 172.21.15.50:0/1424906971 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 0x7f5d2c0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d31c31640 1 --2- 172.21.15.50:0/1424906971 >> v2:172.21.15.170:3300/0 conn(0x7f5d2c0b1d70 0x7f5d2c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834665795 0 0) 0x7f5d2c0d20b0 con 0x7f5d2c1608a0 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d14003520 con 0x7f5d2c1608a0 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 951709346 0 0) 0x7f5d14003520 con 0x7f5d2c1608a0 2023-12-08T08:19:59.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 msgr2=0x7f5d2c0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 0x7f5d2c0d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 >> v2:172.21.15.170:3300/0 conn(0x7f5d2c0b1d70 msgr2=0x7f5d2c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 --2- 172.21.15.50:0/1424906971 >> v2:172.21.15.170:3300/0 conn(0x7f5d2c0b1d70 0x7f5d2c0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0d1dd0 con 0x7f5d2c1608a0 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f5d1c0019f0 con 0x7f5d2c1608a0 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 >> v1:172.21.15.50:6789/0 conn(0x7f5d2c1608a0 legacy=0x7f5d2c0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 0x7f5d14003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d14003ef0 0x7f5d140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d14004d00 0x7f5d14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0d0620 con 0x7f5d14003ef0 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0d1b80 con 0x7f5d14004d00 2023-12-08T08:19:59.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1400b9d0 con 0x7f5d2c0b0cf0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d14003ef0 0x7f5d140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d31c31640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d14004d00 0x7f5d14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d31430640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 0x7f5d14003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d30c2f640 1 -- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 msgr2=0x7f5d14003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d2c0b0cf0 0x7f5d14003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d30c2f640 1 -- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d14004d00 msgr2=0x7f5d14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d14004d00 0x7f5d14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.968+0000 7f5d30c2f640 1 -- 172.21.15.50:0/1424906971 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14003520 con 0x7f5d14003ef0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.969+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d14003ef0 0x7f5d140047c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009af0 tx=0x7f5d140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38766ce6ec2cca8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.969+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2002c6b0 con 0x7f5d14003ef0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.969+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2002c810 con 0x7f5d14003ef0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.969+0000 7f5d2bfff640 1 -- 172.21.15.50:0/1424906971 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2002cba0 con 0x7f5d14003ef0 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.970+0000 7f5d33694640 1 -- 172.21.15.50:0/1424906971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d14003ef0 msgr2=0x7f5d140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.970+0000 7f5d33694640 1 --2- 172.21.15.50:0/1424906971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d14003ef0 0x7f5d140047c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009af0 tx=0x7f5d140057f0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.970+0000 7f5d31c31640 1 -- 172.21.15.50:0/1424906971 reap_dead start 2023-12-08T08:19:59.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.970+0000 7f5d33694640 1 -- 172.21.15.50:0/1424906971 shutdown_connections 2023-12-08T08:19:59.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.970+0000 7f5d33694640 1 -- 172.21.15.50:0/1424906971 >> 172.21.15.50:0/1424906971 conn(0x7f5d2c0d3030 msgr2=0x7f5d2c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:19:59.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.970+0000 7f5d33694640 1 -- 172.21.15.50:0/1424906971 shutdown_connections 2023-12-08T08:19:59.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.970+0000 7f5d33694640 1 -- 172.21.15.50:0/1424906971 wait complete. 2023-12-08T08:19:59.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.971+0000 7f5d33694640 1 Processor -- start 2023-12-08T08:19:59.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.971+0000 7f5d33694640 1 -- start start 2023-12-08T08:19:59.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d33694640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d14003ef0 0x7f5d2c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d33694640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d2c0c83f0 0x7f5d2c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d33694640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d2c15d900 0x7f5d2c15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d33694640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c15e2c0 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d33694640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0c77c0 con 0x7f5d2c15d900 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d33694640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0c6bb0 con 0x7f5d14003ef0 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d2c0c83f0 0x7f5d2c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d2c0c83f0 0x7f5d2c0c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50968/0 (socket says 172.21.15.50:50968) 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 -- 172.21.15.50:0/734287706 learned_addr learned my addr 172.21.15.50:0/734287706 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 -- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d14003ef0 msgr2=0x7f5d2c1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d14003ef0 0x7f5d2c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 -- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d2c15d900 msgr2=0x7f5d2c15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d31c31640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d2c15d900 0x7f5d2c15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d2c15d900 0x7f5d2c15dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.972+0000 7f5d30c2f640 1 -- 172.21.15.50:0/734287706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0c6e90 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.973+0000 7f5d30c2f640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d2c0c83f0 0x7f5d2c0c8850 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5d20037040 tx=0x7f5d20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.973+0000 7f5d29ffb640 1 -- 172.21.15.50:0/734287706 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20003810 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.973+0000 7f5d29ffb640 1 -- 172.21.15.50:0/734287706 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20003970 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.973+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c0c7170 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.973+0000 7f5d29ffb640 1 -- 172.21.15.50:0/734287706 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20003d00 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.973+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c157e00 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.974+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c15f5b0 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.974+0000 7f5d29ffb640 1 -- 172.21.15.50:0/734287706 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d20047450 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.975+0000 7f5d29ffb640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d1806ae40 0x7f5d1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.975+0000 7f5d29ffb640 1 -- 172.21.15.50:0/734287706 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f5d200abb60 con 0x7f5d2c0c83f0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.975+0000 7f5d31430640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d1806ae40 0x7f5d1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:19:59.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.976+0000 7f5d31430640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d1806ae40 0x7f5d1806d300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001f20 tx=0x7f5d1c001eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:19:59.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:19:59.979+0000 7f5d29ffb640 1 -- 172.21.15.50:0/734287706 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d20076940 con 0x7f5d2c0c83f0 2023-12-08T08:20:00.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.157+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d2c067430 con 0x7f5d2c0c83f0 2023-12-08T08:20:00.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.158+0000 7f5d29ffb640 1 -- 172.21.15.50:0/734287706 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18546 (secure 0 0 0) 0x7f5d200044e0 con 0x7f5d2c0c83f0 2023-12-08T08:20:00.161 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:00.161 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:38.869408+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d1806ae40 msgr2=0x7f5d1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d1806ae40 0x7f5d1806d300 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001f20 tx=0x7f5d1c001eb0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d2c0c83f0 msgr2=0x7f5d2c0c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d2c0c83f0 0x7f5d2c0c8850 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5d20037040 tx=0x7f5d20004730 comp rx=0 tx=0).stop 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 shutdown_connections 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5d1806ae40 0x7f5d1806d300 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d2c0c83f0 0x7f5d2c0c8850 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d2c15d900 0x7f5d2c15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 --2- 172.21.15.50:0/734287706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d14003ef0 0x7f5d2c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 >> 172.21.15.50:0/734287706 conn(0x7f5d2c0d3030 msgr2=0x7f5d2c15eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 shutdown_connections 2023-12-08T08:20:00.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.160+0000 7f5d33694640 1 -- 172.21.15.50:0/734287706 wait complete. 2023-12-08T08:20:00.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:19:18.367216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:19:18.792176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-08T08:19:31.441584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:00.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:00.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.281+0000 7f287c689640 1 Processor -- start 2023-12-08T08:20:00.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.281+0000 7f287c689640 1 -- start start 2023-12-08T08:20:00.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.282+0000 7f287c689640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f28740cd3d0 0x7f28740712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.282+0000 7f287c689640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.282+0000 7f287c689640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28740cdcf0 0x7f28740700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.282+0000 7f287c689640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287406d280 con 0x7f28740cdcf0 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.282+0000 7f287c689640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2874071800 con 0x7f28740cd3d0 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.282+0000 7f287c689640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287406c8e0 con 0x7f287406d6a0 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28740cdcf0 0x7f28740700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28740cdcf0 0x7f28740700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50972/0 (socket says 172.21.15.50:50972) 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 -- 172.21.15.50:0/118616554 learned_addr learned my addr 172.21.15.50:0/118616554 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f2879c24640 1 --2- 172.21.15.50:0/118616554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287a425640 1 --2- 172.21.15.50:0/118616554 >> v2:172.21.15.170:3300/0 conn(0x7f28740cd3d0 0x7f28740712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 -- 172.21.15.50:0/118616554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 msgr2=0x7f28740cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 --2- 172.21.15.50:0/118616554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 -- 172.21.15.50:0/118616554 >> v2:172.21.15.170:3300/0 conn(0x7f28740cd3d0 msgr2=0x7f28740712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 --2- 172.21.15.50:0/118616554 >> v2:172.21.15.170:3300/0 conn(0x7f28740cd3d0 0x7f28740712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287ac26640 1 -- 172.21.15.50:0/118616554 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287406cbc0 con 0x7f28740cdcf0 2023-12-08T08:20:00.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.283+0000 7f287a425640 1 --2- 172.21.15.50:0/118616554 >> v2:172.21.15.170:3300/0 conn(0x7f28740cd3d0 0x7f28740712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287ac26640 1 --2- 172.21.15.50:0/118616554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f28740700b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e50 tx=0x7f286c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb4a0d344868e03 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f2879423640 1 -- 172.21.15.50:0/118616554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c02ca70 con 0x7f28740cdcf0 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f2879423640 1 -- 172.21.15.50:0/118616554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c02cbd0 con 0x7f28740cdcf0 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f2879423640 1 -- 172.21.15.50:0/118616554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0343f0 con 0x7f28740cdcf0 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287c689640 1 -- 172.21.15.50:0/118616554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 msgr2=0x7f28740700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287c689640 1 --2- 172.21.15.50:0/118616554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f28740700b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e50 tx=0x7f286c02bed0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287c689640 1 -- 172.21.15.50:0/118616554 shutdown_connections 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287c689640 1 --2- 172.21.15.50:0/118616554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f28740700b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287c689640 1 --2- 172.21.15.50:0/118616554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287c689640 1 --2- 172.21.15.50:0/118616554 >> v2:172.21.15.170:3300/0 conn(0x7f28740cd3d0 0x7f28740712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.284+0000 7f287c689640 1 -- 172.21.15.50:0/118616554 >> 172.21.15.50:0/118616554 conn(0x7f28740b0850 msgr2=0x7f28740b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.285+0000 7f287c689640 1 -- 172.21.15.50:0/118616554 shutdown_connections 2023-12-08T08:20:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.285+0000 7f287c689640 1 -- 172.21.15.50:0/118616554 wait complete. 2023-12-08T08:20:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 Processor -- start 2023-12-08T08:20:00.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 -- start start 2023-12-08T08:20:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28740cd3d0 0x7f28740b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f2874140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b3120 con 0x7f28740cdcf0 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740cba00 con 0x7f28740cd3d0 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.286+0000 7f287c689640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28741f5fb0 con 0x7f287406d6a0 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f2874140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f2874140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:50980/0 (socket says 172.21.15.50:50980) 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 -- 172.21.15.50:0/1508363862 learned_addr learned my addr 172.21.15.50:0/1508363862 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287a425640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f2879c24640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28740cd3d0 0x7f28740b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 -- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 msgr2=0x7f28740cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 -- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28740cd3d0 msgr2=0x7f28740b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28740cd3d0 0x7f28740b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 -- 172.21.15.50:0/1508363862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009b30 con 0x7f28740cdcf0 2023-12-08T08:20:00.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287a425640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f2879c24640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28740cd3d0 0x7f28740b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287ac26640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f2874140930 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e50 tx=0x7f286c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f286affd640 1 -- 172.21.15.50:0/1508363862 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c040670 con 0x7f28740cdcf0 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f286affd640 1 -- 172.21.15.50:0/1508363862 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c0407d0 con 0x7f28740cdcf0 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28740b24a0 con 0x7f28740cdcf0 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f286affd640 1 -- 172.21.15.50:0/1508363862 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c040b80 con 0x7f28740cdcf0 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.287+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28740b2a60 con 0x7f28740cdcf0 2023-12-08T08:20:00.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.288+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2874067430 con 0x7f28740cdcf0 2023-12-08T08:20:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.289+0000 7f286affd640 1 -- 172.21.15.50:0/1508363862 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f286c040ce0 con 0x7f28740cdcf0 2023-12-08T08:20:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.289+0000 7f286affd640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f285806ae40 0x7f285806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.289+0000 7f286affd640 1 -- 172.21.15.50:0/1508363862 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f286c0ac8c0 con 0x7f28740cdcf0 2023-12-08T08:20:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.289+0000 7f287a425640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f285806ae40 0x7f285806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.290+0000 7f287a425640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f285806ae40 0x7f285806d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f287000aa30 tx=0x7f2870008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.293+0000 7f286affd640 1 -- 172.21.15.50:0/1508363862 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f286c077830 con 0x7f28740cdcf0 2023-12-08T08:20:00.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.467+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f287406c6c0 con 0x7f28740cdcf0 2023-12-08T08:20:00.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.468+0000 7f286affd640 1 -- 172.21.15.50:0/1508363862 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f286c009510 con 0x7f28740cdcf0 2023-12-08T08:20:00.470 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:00.472 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f285806ae40 msgr2=0x7f285806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f285806ae40 0x7f285806d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f287000aa30 tx=0x7f2870008040 comp rx=0 tx=0).stop 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 msgr2=0x7f2874140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f2874140930 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f286c009e50 tx=0x7f286c004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 shutdown_connections 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f285806ae40 0x7f285806d300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28740cdcf0 0x7f2874140930 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28740cd3d0 0x7f28740b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 --2- 172.21.15.50:0/1508363862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f287406d6a0 0x7f28740cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 >> 172.21.15.50:0/1508363862 conn(0x7f28740b0850 msgr2=0x7f2874071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 shutdown_connections 2023-12-08T08:20:00.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.470+0000 7f287c689640 1 -- 172.21.15.50:0/1508363862 wait complete. 2023-12-08T08:20:00.484 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:00.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.591+0000 7f7259b0c640 1 Processor -- start 2023-12-08T08:20:00.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.591+0000 7f7259b0c640 1 -- start start 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7259b0c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 0x7f72540ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7259b0c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f72540ad290 0x7f725406ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7259b0c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725415d500 con 0x7f725406b4e0 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7259b0c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72540ad7c0 con 0x7f72540ad290 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7259b0c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72540b2f80 con 0x7f725415d120 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7253fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f725406b4e0 0x7f72540b3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53312/0 (socket says 172.21.15.50:53312) 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7253fff640 1 -- 172.21.15.50:0/4160778816 learned_addr learned my addr 172.21.15.50:0/4160778816 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72537fe640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 0x7f72540ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f7252ffd640 1 --2- 172.21.15.50:0/4160778816 >> v2:172.21.15.170:3300/0 conn(0x7f72540ad290 0x7f725406ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007198288 0 0) 0x7f725415d500 con 0x7f725406b4e0 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f723c003520 con 0x7f725406b4e0 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1510464938 0 0) 0x7f723c003520 con 0x7f725406b4e0 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 msgr2=0x7f72540ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 0x7f72540ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 >> v2:172.21.15.170:3300/0 conn(0x7f72540ad290 msgr2=0x7f725406ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 --2- 172.21.15.50:0/4160778816 >> v2:172.21.15.170:3300/0 conn(0x7f72540ad290 0x7f725406ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540b3260 con 0x7f725406b4e0 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.592+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f724c0019f0 con 0x7f725406b4e0 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 >> v1:172.21.15.50:6789/0 conn(0x7f725406b4e0 legacy=0x7f72540b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72527fc640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 0x7f723c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72527fc640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f723c003ef0 0x7f723c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72527fc640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c004d00 0x7f723c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540ad7c0 con 0x7f723c003ef0 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540b2f80 con 0x7f723c004d00 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c00b980 con 0x7f725415d120 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f7252ffd640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f723c003ef0 0x7f723c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f72537fe640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 0x7f723c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f7253fff640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c004d00 0x7f723c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f7252ffd640 1 -- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 msgr2=0x7f723c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f7252ffd640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f725415d120 0x7f723c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f7252ffd640 1 -- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c004d00 msgr2=0x7f723c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f7252ffd640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c004d00 0x7f723c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.593+0000 7f7252ffd640 1 -- 172.21.15.50:0/4160778816 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c003520 con 0x7f723c003ef0 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f7252ffd640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f723c003ef0 0x7f723c0047c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7248009a90 tx=0x7f723c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a9063a290e880b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724802c6b0 con 0x7f723c003ef0 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724802c810 con 0x7f723c003ef0 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f72527fc640 1 -- 172.21.15.50:0/4160778816 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724802cbc0 con 0x7f723c003ef0 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f7259b0c640 1 -- 172.21.15.50:0/4160778816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f723c003ef0 msgr2=0x7f723c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f7259b0c640 1 --2- 172.21.15.50:0/4160778816 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f723c003ef0 0x7f723c0047c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7248009a90 tx=0x7f723c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f7253fff640 1 -- 172.21.15.50:0/4160778816 reap_dead start 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.594+0000 7f7259b0c640 1 -- 172.21.15.50:0/4160778816 shutdown_connections 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.595+0000 7f7259b0c640 1 -- 172.21.15.50:0/4160778816 >> 172.21.15.50:0/4160778816 conn(0x7f7254070960 msgr2=0x7f7254070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.595+0000 7f7259b0c640 1 -- 172.21.15.50:0/4160778816 shutdown_connections 2023-12-08T08:20:00.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.595+0000 7f7259b0c640 1 -- 172.21.15.50:0/4160778816 wait complete. 2023-12-08T08:20:00.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.596+0000 7f7259b0c640 1 Processor -- start 2023-12-08T08:20:00.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.596+0000 7f7259b0c640 1 -- start start 2023-12-08T08:20:00.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c003ef0 0x7f72540c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72541f3550 0x7f72541efe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7254148750 0x7f725415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725415a3a0 con 0x7f7254148750 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725415a680 con 0x7f723c003ef0 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725415a960 con 0x7f72541f3550 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7254148750 0x7f725415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7254148750 0x7f725415b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51008/0 (socket says 172.21.15.50:51008) 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 -- 172.21.15.50:0/3162661614 learned_addr learned my addr 172.21.15.50:0/3162661614 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f72537fe640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c003ef0 0x7f72540c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7252ffd640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72541f3550 0x7f72541efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 -- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72541f3550 msgr2=0x7f72541efe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72541f3550 0x7f72541efe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 -- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c003ef0 msgr2=0x7f72540c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c003ef0 0x7f72540c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 -- 172.21.15.50:0/3162661614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725415ac40 con 0x7f7254148750 2023-12-08T08:20:00.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7253fff640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7254148750 0x7f725415b440 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f72540705f0 tx=0x7f724c007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f723bfff640 1 -- 172.21.15.50:0/3162661614 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00ab60 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f723bfff640 1 -- 172.21.15.50:0/3162661614 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c00acc0 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725415af20 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f723bfff640 1 -- 172.21.15.50:0/3162661614 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c013630 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.597+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72541f0370 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.598+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7254067430 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.599+0000 7f723bfff640 1 -- 172.21.15.50:0/3162661614 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f724c013790 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.599+0000 7f723bfff640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f724006ae40 0x7f724006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.599+0000 7f723bfff640 1 -- 172.21.15.50:0/3162661614 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f724c089ec0 con 0x7f7254148750 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.600+0000 7f72537fe640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f724006ae40 0x7f724006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.600+0000 7f72537fe640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f724006ae40 0x7f724006d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7244009ae0 tx=0x7f7244009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.606 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.604+0000 7f723bfff640 1 -- 172.21.15.50:0/3162661614 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f724c054c80 con 0x7f7254148750 2023-12-08T08:20:00.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.779+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7254073be0 con 0x7f7254148750 2023-12-08T08:20:00.781 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.779+0000 7f723bfff640 1 -- 172.21.15.50:0/3162661614 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f724c0582a0 con 0x7f7254148750 2023-12-08T08:20:00.782 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f724006ae40 msgr2=0x7f724006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f724006ae40 0x7f724006d300 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7244009ae0 tx=0x7f7244009190 comp rx=0 tx=0).stop 2023-12-08T08:20:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7254148750 msgr2=0x7f725415b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7254148750 0x7f725415b440 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f72540705f0 tx=0x7f724c007b10 comp rx=0 tx=0).stop 2023-12-08T08:20:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 shutdown_connections 2023-12-08T08:20:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f724006ae40 0x7f724006d300 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7254148750 0x7f725415b440 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f72541f3550 0x7f72541efe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 --2- 172.21.15.50:0/3162661614 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f723c003ef0 0x7f72540c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 >> 172.21.15.50:0/3162661614 conn(0x7f7254070960 msgr2=0x7f725406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 shutdown_connections 2023-12-08T08:20:00.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.781+0000 7f7259b0c640 1 -- 172.21.15.50:0/3162661614 wait complete. 2023-12-08T08:20:00.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:00.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.901+0000 7f34ede97640 1 Processor -- start 2023-12-08T08:20:00.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.901+0000 7f34ede97640 1 -- start start 2023-12-08T08:20:00.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.901+0000 7f34ede97640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34e806d6a0 0x7f34e80cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.901+0000 7f34ede97640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f34e80712c0 0x7f34e815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.901+0000 7f34ede97640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e8071770 con 0x7f34e80cd3d0 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.901+0000 7f34ede97640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e806d280 con 0x7f34e806d6a0 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.901+0000 7f34ede97640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80ce400 con 0x7f34e80712c0 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34deffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34e806d6a0 0x7f34e80cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34deffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f34e806d6a0 0x7f34e80cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51010/0 (socket says 172.21.15.50:51010) 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34deffd640 1 -- 172.21.15.50:0/3767966015 learned_addr learned my addr 172.21.15.50:0/3767966015 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34e7fff640 1 --2- 172.21.15.50:0/3767966015 >> v2:172.21.15.170:3300/0 conn(0x7f34e80712c0 0x7f34e815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34deffd640 1 -- 172.21.15.50:0/3767966015 >> v2:172.21.15.170:3300/0 conn(0x7f34e80712c0 msgr2=0x7f34e815b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34deffd640 1 --2- 172.21.15.50:0/3767966015 >> v2:172.21.15.170:3300/0 conn(0x7f34e80712c0 0x7f34e815b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34deffd640 1 -- 172.21.15.50:0/3767966015 >> v1:172.21.15.170:6789/0 conn(0x7f34e80cd3d0 legacy=0x7f34e80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.902+0000 7f34deffd640 1 -- 172.21.15.50:0/3767966015 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e806c8e0 con 0x7f34e806d6a0 2023-12-08T08:20:00.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34deffd640 1 --2- 172.21.15.50:0/3767966015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e806d6a0 0x7f34e80cdec0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f34e806fe70 tx=0x7f34d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d229e93233b2e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34e6ffd640 1 -- 172.21.15.50:0/3767966015 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0030860 con 0x7f34e806d6a0 2023-12-08T08:20:00.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34e6ffd640 1 -- 172.21.15.50:0/3767966015 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d00309c0 con 0x7f34e806d6a0 2023-12-08T08:20:00.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34e6ffd640 1 -- 172.21.15.50:0/3767966015 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0030d50 con 0x7f34e806d6a0 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34ede97640 1 -- 172.21.15.50:0/3767966015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e806d6a0 msgr2=0x7f34e80cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34ede97640 1 --2- 172.21.15.50:0/3767966015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e806d6a0 0x7f34e80cdec0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f34e806fe70 tx=0x7f34d002b9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34ede97640 1 -- 172.21.15.50:0/3767966015 shutdown_connections 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34ede97640 1 --2- 172.21.15.50:0/3767966015 >> v2:172.21.15.170:3300/0 conn(0x7f34e80712c0 0x7f34e815b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34ede97640 1 --2- 172.21.15.50:0/3767966015 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e806d6a0 0x7f34e80cdec0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.903+0000 7f34ede97640 1 -- 172.21.15.50:0/3767966015 >> 172.21.15.50:0/3767966015 conn(0x7f34e80b0850 msgr2=0x7f34e80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.904+0000 7f34ede97640 1 -- 172.21.15.50:0/3767966015 shutdown_connections 2023-12-08T08:20:00.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.904+0000 7f34ede97640 1 -- 172.21.15.50:0/3767966015 wait complete. 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.905+0000 7f34ede97640 1 Processor -- start 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.905+0000 7f34ede97640 1 -- start start 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34ede97640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e806d6a0 0x7f34e80a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34ede97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e80712c0 0x7f34e81394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34ede97640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34e80cd3d0 0x7f34e81f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34ede97640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e81f4b50 con 0x7f34e80712c0 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34ede97640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80a89b0 con 0x7f34e806d6a0 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34ede97640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e81589c0 con 0x7f34e80cd3d0 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e80712c0 0x7f34e81394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e80712c0 0x7f34e81394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51024/0 (socket says 172.21.15.50:51024) 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 -- 172.21.15.50:0/585833020 learned_addr learned my addr 172.21.15.50:0/585833020 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34e77fe640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e806d6a0 0x7f34e80a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34e7fff640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34e80cd3d0 0x7f34e81f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 -- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34e80cd3d0 msgr2=0x7f34e81f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34e80cd3d0 0x7f34e81f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 -- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e806d6a0 msgr2=0x7f34e80a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e806d6a0 0x7f34e80a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 -- 172.21.15.50:0/585833020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00094d0 con 0x7f34e80712c0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34deffd640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e80712c0 0x7f34e81394b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000c00 tx=0x7f34d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34e4ff9640 1 -- 172.21.15.50:0/585833020 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0039c90 con 0x7f34e80712c0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34e4ff9640 1 -- 172.21.15.50:0/585833020 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0039df0 con 0x7f34e80712c0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e8158ca0 con 0x7f34e80712c0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.906+0000 7f34e4ff9640 1 -- 172.21.15.50:0/585833020 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0043640 con 0x7f34e80712c0 2023-12-08T08:20:00.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.907+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e8159260 con 0x7f34e80712c0 2023-12-08T08:20:00.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.907+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e8158b00 con 0x7f34e80712c0 2023-12-08T08:20:00.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.908+0000 7f34e4ff9640 1 -- 172.21.15.50:0/585833020 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34d00437a0 con 0x7f34e80712c0 2023-12-08T08:20:00.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.908+0000 7f34e4ff9640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f34c806ae40 0x7f34c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:00.911 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.908+0000 7f34e4ff9640 1 -- 172.21.15.50:0/585833020 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f34d003e070 con 0x7f34e80712c0 2023-12-08T08:20:00.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.909+0000 7f34e77fe640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f34c806ae40 0x7f34c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:00.912 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.909+0000 7f34e77fe640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f34c806ae40 0x7f34c806d300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34d8000f60 tx=0x7f34d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:00.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:00.912+0000 7f34e4ff9640 1 -- 172.21.15.50:0/585833020 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34e8158b00 con 0x7f34e80712c0 2023-12-08T08:20:01.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.087+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34e8158b00 con 0x7f34e80712c0 2023-12-08T08:20:01.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.088+0000 7f34e4ff9640 1 -- 172.21.15.50:0/585833020 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34e8158b00 con 0x7f34e80712c0 2023-12-08T08:20:01.090 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f34c806ae40 msgr2=0x7f34c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f34c806ae40 0x7f34c806d300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34d8000f60 tx=0x7f34d8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:01.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e80712c0 msgr2=0x7f34e81394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e80712c0 0x7f34e81394b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000c00 tx=0x7f34d0004730 comp rx=0 tx=0).stop 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 shutdown_connections 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f34c806ae40 0x7f34c806d300 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34e80712c0 0x7f34e81394b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34e80cd3d0 0x7f34e81f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 --2- 172.21.15.50:0/585833020 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34e806d6a0 0x7f34e80a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 >> 172.21.15.50:0/585833020 conn(0x7f34e80b0850 msgr2=0x7f34e815b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 shutdown_connections 2023-12-08T08:20:01.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.090+0000 7f34ede97640 1 -- 172.21.15.50:0/585833020 wait complete. 2023-12-08T08:20:01.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-08T08:20:01.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.210+0000 7f61f1733640 1 Processor -- start 2023-12-08T08:20:01.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.210+0000 7f61f1733640 1 -- start start 2023-12-08T08:20:01.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61f1733640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f61ec0ce780 0x7f61ec15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61f1733640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61ec0cf0a0 0x7f61ec0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61f1733640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec0cfcc0 con 0x7f61ec0b48b0 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61f1733640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec0ceb60 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61f1733640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec0cff10 con 0x7f61ec0ce780 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61ea7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f61ec0cf0a0 0x7f61ec0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61eb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f61ec0b48b0 0x7f61ec15b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53314/0 (socket says 172.21.15.50:53314) 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61eb7fe640 1 -- 172.21.15.50:0/3036618078 learned_addr learned my addr 172.21.15.50:0/3036618078 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61ea7fc640 1 --2- 172.21.15.50:0/3036618078 >> v2:172.21.15.50:3300/0 conn(0x7f61ec0cf0a0 0x7f61ec0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51028/0 (socket says 172.21.15.50:51028) 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61ea7fc640 1 -- 172.21.15.50:0/3036618078 >> v2:172.21.15.170:3300/0 conn(0x7f61ec0ce780 msgr2=0x7f61ec15ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61eaffd640 1 --2- 172.21.15.50:0/3036618078 >> v2:172.21.15.170:3300/0 conn(0x7f61ec0ce780 0x7f61ec15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.216 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61ea7fc640 1 --2- 172.21.15.50:0/3036618078 >> v2:172.21.15.170:3300/0 conn(0x7f61ec0ce780 0x7f61ec15ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61ea7fc640 1 -- 172.21.15.50:0/3036618078 >> v1:172.21.15.50:6789/0 conn(0x7f61ec0b48b0 legacy=0x7f61ec15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61ea7fc640 1 -- 172.21.15.50:0/3036618078 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec0d01f0 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.211+0000 7f61e9ffb640 1 -- 172.21.15.50:0/3036618078 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204834153 0 0) 0x7f61ec0cfcc0 con 0x7f61ec0b48b0 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.212+0000 7f61ea7fc640 1 --2- 172.21.15.50:0/3036618078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec0cf550 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0b53f0 tx=0x7f61e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49ed6b57dcbb76d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.212+0000 7f61e9ffb640 1 -- 172.21.15.50:0/3036618078 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0031830 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.212+0000 7f61e9ffb640 1 -- 172.21.15.50:0/3036618078 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0031990 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.212+0000 7f61e9ffb640 1 -- 172.21.15.50:0/3036618078 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0031d20 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 -- 172.21.15.50:0/3036618078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 msgr2=0x7f61ec0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 --2- 172.21.15.50:0/3036618078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec0cf550 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0b53f0 tx=0x7f61e002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 -- 172.21.15.50:0/3036618078 shutdown_connections 2023-12-08T08:20:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 --2- 172.21.15.50:0/3036618078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec0cf550 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 --2- 172.21.15.50:0/3036618078 >> v2:172.21.15.170:3300/0 conn(0x7f61ec0ce780 0x7f61ec15ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 -- 172.21.15.50:0/3036618078 >> 172.21.15.50:0/3036618078 conn(0x7f61ec06b7c0 msgr2=0x7f61ec06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 -- 172.21.15.50:0/3036618078 shutdown_connections 2023-12-08T08:20:01.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.213+0000 7f61f1733640 1 -- 172.21.15.50:0/3036618078 wait complete. 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.214+0000 7f61f1733640 1 Processor -- start 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.214+0000 7f61f1733640 1 -- start start 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61f1733640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61ec0b48b0 0x7f61ec14d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61f1733640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61ec0ce780 0x7f61ec14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61f1733640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61f1733640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec06f060 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61f1733640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec06e330 con 0x7f61ec0b48b0 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61f1733640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec14dae0 con 0x7f61ec0ce780 2023-12-08T08:20:01.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec14e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51040/0 (socket says 172.21.15.50:51040) 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 -- 172.21.15.50:0/1930145418 learned_addr learned my addr 172.21.15.50:0/1930145418 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61ea7fc640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61ec0ce780 0x7f61ec14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eaffd640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61ec0b48b0 0x7f61ec14d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 -- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61ec0ce780 msgr2=0x7f61ec14c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61ec0ce780 0x7f61ec14c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 -- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61ec0b48b0 msgr2=0x7f61ec14d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61ec0b48b0 0x7f61ec14d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.222 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 -- 172.21.15.50:0/1930145418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0009400 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61ea7fc640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61ec0ce780 0x7f61ec14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.215+0000 7f61eb7fe640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec14e4d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c7e0 tx=0x7f61e400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.216+0000 7f61d37fe640 1 -- 172.21.15.50:0/1930145418 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400a640 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.216+0000 7f61d37fe640 1 -- 172.21.15.50:0/1930145418 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e400a7c0 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.216+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec06eaa0 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.216+0000 7f61d37fe640 1 -- 172.21.15.50:0/1930145418 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400ab70 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.216+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec0af240 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.217+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec067430 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.217+0000 7f61d37fe640 1 -- 172.21.15.50:0/1930145418 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61e400acd0 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.218+0000 7f61d37fe640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f61d806ae40 0x7f61d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.218+0000 7f61d37fe640 1 -- 172.21.15.50:0/1930145418 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f61e4088e80 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.218+0000 7f61eaffd640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f61d806ae40 0x7f61d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.219+0000 7f61eaffd640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f61d806ae40 0x7f61d806d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00aac0 tx=0x7f61dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.224 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.222+0000 7f61d37fe640 1 -- 172.21.15.50:0/1930145418 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61e4053c70 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.399+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f61ec0b4470 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.400+0000 7f61d37fe640 1 -- 172.21.15.50:0/1930145418 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v43) v1 ==== 97+0+11 (secure 0 0 0) 0x7f61e40180a0 con 0x7f61ec0cf0a0 2023-12-08T08:20:01.402 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.401+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f61d806ae40 msgr2=0x7f61d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.401+0000 7f61f1733640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f61d806ae40 0x7f61d806d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00aac0 tx=0x7f61dc008040 comp rx=0 tx=0).stop 2023-12-08T08:20:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.401+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 msgr2=0x7f61ec14e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.401+0000 7f61f1733640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec14e4d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c7e0 tx=0x7f61e400cca0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 shutdown_connections 2023-12-08T08:20:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f61d806ae40 0x7f61d806d300 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f61ec0cf0a0 0x7f61ec14e4d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61ec0ce780 0x7f61ec14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 --2- 172.21.15.50:0/1930145418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61ec0b48b0 0x7f61ec14d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 >> 172.21.15.50:0/1930145418 conn(0x7f61ec06b7c0 msgr2=0x7f61ec159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 shutdown_connections 2023-12-08T08:20:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.402+0000 7f61f1733640 1 -- 172.21.15.50:0/1930145418 wait complete. 2023-12-08T08:20:01.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.520+0000 7fa9fe252640 1 Processor -- start 2023-12-08T08:20:01.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.520+0000 7fa9fe252640 1 -- start start 2023-12-08T08:20:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9fe252640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa9f80b6ac0 0x7fa9f80cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9fe252640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 0x7fa9f80cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9fe252640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80d0070 con 0x7fa9f80cd660 2023-12-08T08:20:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9fe252640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f8160cb0 con 0x7fa9f80b6ac0 2023-12-08T08:20:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9fe252640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80d02b0 con 0x7fa9f80ce1c0 2023-12-08T08:20:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f6ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa9f80cd660 0x7fa9f80cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53316/0 (socket says 172.21.15.50:53316) 2023-12-08T08:20:01.526 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f6ffd640 1 -- 172.21.15.50:0/4202881687 learned_addr learned my addr 172.21.15.50:0/4202881687 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f7fff640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 0x7fa9f80cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120114789 0 0) 0x7fa9ec001110 con 0x7fa9f80cd660 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e0003520 con 0x7fa9f80cd660 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/4202881687 >> v2:172.21.15.170:3300/0 conn(0x7fa9f80b6ac0 0x7fa9f80cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1383429375 0 0) 0x7fa9e0003520 con 0x7fa9f80cd660 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 msgr2=0x7fa9f80cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 0x7fa9f80cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 >> v2:172.21.15.170:3300/0 conn(0x7fa9f80b6ac0 msgr2=0x7fa9f80cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 --2- 172.21.15.50:0/4202881687 >> v2:172.21.15.170:3300/0 conn(0x7fa9f80b6ac0 0x7fa9f80cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80cb430 con 0x7fa9f80cd660 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fa9ec001820 con 0x7fa9f80cd660 2023-12-08T08:20:01.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 >> v1:172.21.15.50:6789/0 conn(0x7fa9f80cd660 legacy=0x7fa9f80cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9e00047c0 0x7fa9e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 0x7fa9e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8160cb0 con 0x7fa9e0003970 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80d02b0 con 0x7fa9e00047c0 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.521+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e000ba30 con 0x7fa9f80ce1c0 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f6ffd640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9e00047c0 0x7fa9e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f7fff640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 0x7fa9e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f77fe640 1 -- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 msgr2=0x7fa9e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80ce1c0 0x7fa9e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f77fe640 1 -- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9e00047c0 msgr2=0x7fa9e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9e00047c0 0x7fa9e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.522+0000 7fa9f77fe640 1 -- 172.21.15.50:0/4202881687 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0003520 con 0x7fa9e0003970 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9e0003d90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009ac0 tx=0x7fa9e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97607c5aa188a87a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e802c710 con 0x7fa9e0003970 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e802c870 con 0x7fa9e0003970 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9f67fc640 1 -- 172.21.15.50:0/4202881687 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e802cc00 con 0x7fa9e0003970 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9fe252640 1 -- 172.21.15.50:0/4202881687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 msgr2=0x7fa9e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9fe252640 1 --2- 172.21.15.50:0/4202881687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9e0003d90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009ac0 tx=0x7fa9e00057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9f7fff640 1 -- 172.21.15.50:0/4202881687 reap_dead start 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9fe252640 1 -- 172.21.15.50:0/4202881687 shutdown_connections 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9fe252640 1 -- 172.21.15.50:0/4202881687 >> 172.21.15.50:0/4202881687 conn(0x7fa9f80d0de0 msgr2=0x7fa9f80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9fe252640 1 -- 172.21.15.50:0/4202881687 shutdown_connections 2023-12-08T08:20:01.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.523+0000 7fa9fe252640 1 -- 172.21.15.50:0/4202881687 wait complete. 2023-12-08T08:20:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 Processor -- start 2023-12-08T08:20:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 -- start start 2023-12-08T08:20:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9f81f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9f809e590 0x7fa9f80ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80cc0f0 0x7fa9f80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80adfb0 con 0x7fa9e0003970 2023-12-08T08:20:01.532 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80ccac0 con 0x7fa9f809e590 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.525+0000 7fa9fe252640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f809ea10 con 0x7fa9f80cc0f0 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9f81f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9f81f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51064/0 (socket says 172.21.15.50:51064) 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 -- 172.21.15.50:0/2209570612 learned_addr learned my addr 172.21.15.50:0/2209570612 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f6ffd640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9f809e590 0x7fa9f80ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f7fff640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80cc0f0 0x7fa9f80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 -- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80cc0f0 msgr2=0x7fa9f80cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80cc0f0 0x7fa9f80cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 -- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9f809e590 msgr2=0x7fa9f80ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9f809e590 0x7fa9f80ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 -- 172.21.15.50:0/2209570612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80b0210 con 0x7fa9e0003970 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9f77fe640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9f81f5f80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa9e802c2b0 tx=0x7fa9e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9dffff640 1 -- 172.21.15.50:0/2209570612 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e802c710 con 0x7fa9e0003970 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9dffff640 1 -- 172.21.15.50:0/2209570612 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e802de90 con 0x7fa9e0003970 2023-12-08T08:20:01.533 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9dffff640 1 -- 172.21.15.50:0/2209570612 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8003a10 con 0x7fa9e0003970 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f81f6610 con 0x7fa9e0003970 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.526+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f81f6bd0 con 0x7fa9e0003970 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.527+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f80cdf70 con 0x7fa9e0003970 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.528+0000 7fa9dffff640 1 -- 172.21.15.50:0/2209570612 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9e8003b70 con 0x7fa9e0003970 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.528+0000 7fa9dffff640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa9e406ae40 0x7fa9e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.528+0000 7fa9dffff640 1 -- 172.21.15.50:0/2209570612 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fa9e80ab570 con 0x7fa9e0003970 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.529+0000 7fa9f6ffd640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa9e406ae40 0x7fa9e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.529+0000 7fa9f6ffd640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa9e406ae40 0x7fa9e406d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec007fd0 tx=0x7fa9ec007a70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:01.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.532+0000 7fa9dffff640 1 -- 172.21.15.50:0/2209570612 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9e80763e0 con 0x7fa9e0003970 2023-12-08T08:20:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.720+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa9f8067430 con 0x7fa9e0003970 2023-12-08T08:20:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.721+0000 7fa9dffff640 1 -- 172.21.15.50:0/2209570612 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa9e8079a00 con 0x7fa9e0003970 2023-12-08T08:20:01.723 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:20:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.722+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa9e406ae40 msgr2=0x7fa9e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.722+0000 7fa9fe252640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa9e406ae40 0x7fa9e406d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec007fd0 tx=0x7fa9ec007a70 comp rx=0 tx=0).stop 2023-12-08T08:20:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.722+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 msgr2=0x7fa9f81f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.722+0000 7fa9fe252640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9f81f5f80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa9e802c2b0 tx=0x7fa9e8004730 comp rx=0 tx=0).stop 2023-12-08T08:20:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 shutdown_connections 2023-12-08T08:20:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa9e406ae40 0x7fa9e406d300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9f80cc0f0 0x7fa9f80cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9f809e590 0x7fa9f80ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 --2- 172.21.15.50:0/2209570612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9e0003970 0x7fa9f81f5f80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 >> 172.21.15.50:0/2209570612 conn(0x7fa9f80d0de0 msgr2=0x7fa9f806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 shutdown_connections 2023-12-08T08:20:01.726 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:01.723+0000 7fa9fe252640 1 -- 172.21.15.50:0/2209570612 wait complete. 2023-12-08T08:20:01.735 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:20:01.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:01.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:01.765 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[107877]: fuse finished with error 0 and tester_r 0 2023-12-08T08:20:01.766 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:07.867 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:20:07.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:07.868 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:20:07.891 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-12-08T08:20:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.054+0000 7f6d6d9ce640 1 Processor -- start 2023-12-08T08:20:08.056 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.054+0000 7f6d6d9ce640 1 -- start start 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d6d9ce640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d680cdf00 0x7f6d680cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d6d9ce640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6d680b2380 0x7f6d680cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d6d9ce640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d680d1900 con 0x7f6d6815e930 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d6d9ce640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d680cebc0 con 0x7f6d680b2380 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d6d9ce640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680d1be0 con 0x7f6d680cdf00 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d667fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d680cdf00 0x7f6d680cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d677fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6d680b2380 0x7f6d680cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.058 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d667fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d680cdf00 0x7f6d680cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:54536/0 (socket says 172.21.15.50:54536) 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d667fc640 1 -- 172.21.15.50:0/1425123327 learned_addr learned my addr 172.21.15.50:0/1425123327 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d677fe640 1 --2- 172.21.15.50:0/1425123327 >> v2:172.21.15.170:3300/0 conn(0x7f6d680b2380 0x7f6d680cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:47244/0 (socket says 172.21.15.50:47244) 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d65ffb640 1 -- 172.21.15.50:0/1425123327 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339897338 0 0) 0x7f6d680d1900 con 0x7f6d6815e930 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d65ffb640 1 -- 172.21.15.50:0/1425123327 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d50003520 con 0x7f6d6815e930 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d677fe640 1 -- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d680cdf00 msgr2=0x7f6d680cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d677fe640 1 --2- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d680cdf00 0x7f6d680cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.055+0000 7f6d677fe640 1 -- 172.21.15.50:0/1425123327 >> v1:172.21.15.170:6789/0 conn(0x7f6d6815e930 legacy=0x7f6d680cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.056+0000 7f6d677fe640 1 -- 172.21.15.50:0/1425123327 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6815ed10 con 0x7f6d680b2380 2023-12-08T08:20:08.059 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.056+0000 7f6d667fc640 1 --2- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d680cdf00 0x7f6d680cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.056+0000 7f6d677fe640 1 --2- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 0x7f6d680cc290 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009d90 tx=0x7f6d6002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0ed9f4bdd3704b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d65ffb640 1 -- 172.21.15.50:0/1425123327 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6002cce0 con 0x7f6d680b2380 2023-12-08T08:20:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d65ffb640 1 -- 172.21.15.50:0/1425123327 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6002ce40 con 0x7f6d680b2380 2023-12-08T08:20:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d65ffb640 1 -- 172.21.15.50:0/1425123327 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d60034660 con 0x7f6d680b2380 2023-12-08T08:20:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 msgr2=0x7f6d680cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.060 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 0x7f6d680cc290 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009d90 tx=0x7f6d6002bf30 comp rx=0 tx=0).stop 2023-12-08T08:20:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/1425123327 shutdown_connections 2023-12-08T08:20:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 0x7f6d680cc290 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/1425123327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d680cdf00 0x7f6d680cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/1425123327 >> 172.21.15.50:0/1425123327 conn(0x7f6d680d0de0 msgr2=0x7f6d680d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/1425123327 shutdown_connections 2023-12-08T08:20:08.061 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.057+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/1425123327 wait complete. 2023-12-08T08:20:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.058+0000 7f6d6d9ce640 1 Processor -- start 2023-12-08T08:20:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.059+0000 7f6d6d9ce640 1 -- start start 2023-12-08T08:20:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.059+0000 7f6d6d9ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 0x7f6d680c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.059+0000 7f6d6d9ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d680cdf00 0x7f6d68151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.059+0000 7f6d6d9ce640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6815e930 0x7f6d68152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.063 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.059+0000 7f6d6d9ce640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68152350 con 0x7f6d680cdf00 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.059+0000 7f6d6d9ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d681512d0 con 0x7f6d680b2380 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.059+0000 7f6d6d9ce640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680c6780 con 0x7f6d6815e930 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d680cdf00 0x7f6d68151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d680cdf00 0x7f6d68151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51074/0 (socket says 172.21.15.50:51074) 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 -- 172.21.15.50:0/4233668212 learned_addr learned my addr 172.21.15.50:0/4233668212 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d677fe640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6815e930 0x7f6d68152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d66ffd640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 0x7f6d680c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 -- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6815e930 msgr2=0x7f6d68152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6815e930 0x7f6d68152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 -- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 msgr2=0x7f6d680c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 0x7f6d680c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.064 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 -- 172.21.15.50:0/4233668212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0094d0 con 0x7f6d680cdf00 2023-12-08T08:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d667fc640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d680cdf00 0x7f6d68151540 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e9d0 tx=0x7f6d5c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d4ffff640 1 -- 172.21.15.50:0/4233668212 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c00ca60 con 0x7f6d680cdf00 2023-12-08T08:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d4ffff640 1 -- 172.21.15.50:0/4233668212 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c00cbc0 con 0x7f6d680cdf00 2023-12-08T08:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d60009a70 con 0x7f6d680cdf00 2023-12-08T08:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d4ffff640 1 -- 172.21.15.50:0/4233668212 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c013470 con 0x7f6d680cdf00 2023-12-08T08:20:08.065 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.060+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d680c64a0 con 0x7f6d680cdf00 2023-12-08T08:20:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.062+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d68067430 con 0x7f6d680cdf00 2023-12-08T08:20:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.062+0000 7f6d4ffff640 1 -- 172.21.15.50:0/4233668212 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d5c0135d0 con 0x7f6d680cdf00 2023-12-08T08:20:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.062+0000 7f6d4ffff640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6d5406ae40 0x7f6d5406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.063+0000 7f6d4ffff640 1 -- 172.21.15.50:0/4233668212 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f6d5c089bd0 con 0x7f6d680cdf00 2023-12-08T08:20:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.063+0000 7f6d66ffd640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6d5406ae40 0x7f6d5406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.066 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.063+0000 7f6d66ffd640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6d5406ae40 0x7f6d5406d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d580011e0 tx=0x7f6d58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.067+0000 7f6d4ffff640 1 -- 172.21.15.50:0/4233668212 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d5c054a40 con 0x7f6d680cdf00 2023-12-08T08:20:08.313 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.310+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6d680cf1a0 con 0x7f6d680cdf00 2023-12-08T08:20:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.312+0000 7f6d4ffff640 1 -- 172.21.15.50:0/4233668212 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+141 (secure 0 0 0) 0x7f6d5c0170e0 con 0x7f6d680cdf00 2023-12-08T08:20:08.315 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:20:08.315 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:20:08.315 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-12-08T08:20:08.315 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:20:08.315 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw pool=cephfs_data" 2023-12-08T08:20:08.315 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6d5406ae40 msgr2=0x7f6d5406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6d5406ae40 0x7f6d5406d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d580011e0 tx=0x7f6d58009040 comp rx=0 tx=0).stop 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d680cdf00 msgr2=0x7f6d68151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d680cdf00 0x7f6d68151540 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e9d0 tx=0x7f6d5c00ee90 comp rx=0 tx=0).stop 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 shutdown_connections 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f6d5406ae40 0x7f6d5406d300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6d680cdf00 0x7f6d68151540 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6815e930 0x7f6d68152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 --2- 172.21.15.50:0/4233668212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d680b2380 0x7f6d680c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 >> 172.21.15.50:0/4233668212 conn(0x7f6d680d0de0 msgr2=0x7f6d6815d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:08.317 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 shutdown_connections 2023-12-08T08:20:08.318 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.314+0000 7f6d6d9ce640 1 -- 172.21.15.50:0/4233668212 wait complete. 2023-12-08T08:20:08.327 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:20:08.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:08.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:08.419 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:20:08.419 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:08.419 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:08.435 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2474 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-08T08:20:08.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:20:08.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:08.435 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:20:08.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:08.491 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-08T08:20:08.491 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:20:08.491 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:08.508 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:20:08.508 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:20:08.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:08.509 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:20:08.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:08.566 INFO:teuthology.orchestra.run.smithi170.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-08T08:20:08.567 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:08.567 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:08.582 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2474 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-08T08:20:08.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:20:08.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:08.582 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-08T08:20:08.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:08.637 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-08T08:20:08.637 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:20:08.638 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:08.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:20:08.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:20:08.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:08.655 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-08T08:20:08.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:08.711 INFO:teuthology.orchestra.run.smithi170.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-08T08:20:08.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.815+0000 7f0905b76640 1 Processor -- start 2023-12-08T08:20:08.818 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f0905b76640 1 -- start start 2023-12-08T08:20:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f0905b76640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09001608a0 0x7f09000d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f0905b76640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000d20b0 con 0x7f09000b1d70 2023-12-08T08:20:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f0905b76640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000d1b80 con 0x7f09000b0cf0 2023-12-08T08:20:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f0905b76640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000d0620 con 0x7f09001608a0 2023-12-08T08:20:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f08ff7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f09001608a0 0x7f09000d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f08feffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f09000b1d70 0x7f09000d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53330/0 (socket says 172.21.15.50:53330) 2023-12-08T08:20:08.819 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.816+0000 7f08feffd640 1 -- 172.21.15.50:0/2400865369 learned_addr learned my addr 172.21.15.50:0/2400865369 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.817+0000 7f08ff7fe640 1 -- 172.21.15.50:0/2400865369 >> v1:172.21.15.170:6789/0 conn(0x7f09000b0cf0 legacy=0x7f09000cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.817+0000 7f08ff7fe640 1 -- 172.21.15.50:0/2400865369 >> v1:172.21.15.50:6789/0 conn(0x7f09000b1d70 legacy=0x7f09000d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.817+0000 7f08ff7fe640 1 -- 172.21.15.50:0/2400865369 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000d1dd0 con 0x7f09001608a0 2023-12-08T08:20:08.820 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.817+0000 7f08fe7fc640 1 -- 172.21.15.50:0/2400865369 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663849664 0 0) 0x7f09000d20b0 con 0x7f09000b1d70 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f08ff7fe640 1 --2- 172.21.15.50:0/2400865369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09001608a0 0x7f09000d0f30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f08f00097a0 tx=0x7f08f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8dad8daac6529d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f08fe7fc640 1 -- 172.21.15.50:0/2400865369 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f002e070 con 0x7f09001608a0 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f08fe7fc640 1 -- 172.21.15.50:0/2400865369 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f00315a0 con 0x7f09001608a0 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f08fe7fc640 1 -- 172.21.15.50:0/2400865369 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0031930 con 0x7f09001608a0 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f0905b76640 1 -- 172.21.15.50:0/2400865369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09001608a0 msgr2=0x7f09000d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f0905b76640 1 --2- 172.21.15.50:0/2400865369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09001608a0 0x7f09000d0f30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f08f00097a0 tx=0x7f08f002b840 comp rx=0 tx=0).stop 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f0905b76640 1 -- 172.21.15.50:0/2400865369 shutdown_connections 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f0905b76640 1 --2- 172.21.15.50:0/2400865369 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09001608a0 0x7f09000d0f30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.821 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f0905b76640 1 -- 172.21.15.50:0/2400865369 >> 172.21.15.50:0/2400865369 conn(0x7f09000d3030 msgr2=0x7f09000d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f0905b76640 1 -- 172.21.15.50:0/2400865369 shutdown_connections 2023-12-08T08:20:08.822 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.818+0000 7f0905b76640 1 -- 172.21.15.50:0/2400865369 wait complete. 2023-12-08T08:20:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.819+0000 7f0905b76640 1 Processor -- start 2023-12-08T08:20:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f0905b76640 1 -- start start 2023-12-08T08:20:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f0905b76640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09000b0cf0 0x7f0900153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.824 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f0905b76640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09000b1d70 0x7f09000b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f0905b76640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09001608a0 0x7f090006b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f0905b76640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900153870 con 0x7f09000b1d70 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f0905b76640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09000ccc00 con 0x7f09000b0cf0 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f0905b76640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000ccee0 con 0x7f09001608a0 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f08feffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09000b1d70 0x7f09000b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f08feffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09000b1d70 0x7f09000b8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51094/0 (socket says 172.21.15.50:51094) 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.820+0000 7f08feffd640 1 -- 172.21.15.50:0/2960271421 learned_addr learned my addr 172.21.15.50:0/2960271421 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08ff7fe640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09000b0cf0 0x7f0900153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08feffd640 1 -- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09001608a0 msgr2=0x7f090006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08fffff640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09001608a0 0x7f090006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08feffd640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09001608a0 0x7f090006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08feffd640 1 -- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09000b0cf0 msgr2=0x7f0900153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08feffd640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09000b0cf0 0x7f0900153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08feffd640 1 -- 172.21.15.50:0/2960271421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009400 con 0x7f09000b1d70 2023-12-08T08:20:08.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08ff7fe640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09000b0cf0 0x7f0900153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08fffff640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09001608a0 0x7f090006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08feffd640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09000b1d70 0x7f09000b8430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c4d0 tx=0x7f08f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08e7fff640 1 -- 172.21.15.50:0/2960271421 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40074e0 con 0x7f09000b1d70 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08e7fff640 1 -- 172.21.15.50:0/2960271421 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4007660 con 0x7f09000b1d70 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09000b5dc0 con 0x7f09000b1d70 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f08e7fff640 1 -- 172.21.15.50:0/2960271421 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4004a20 con 0x7f09000b1d70 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.821+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09000b8970 con 0x7f09000b1d70 2023-12-08T08:20:08.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.822+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09000b5c20 con 0x7f09000b1d70 2023-12-08T08:20:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.823+0000 7f08e7fff640 1 -- 172.21.15.50:0/2960271421 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08f4004b80 con 0x7f09000b1d70 2023-12-08T08:20:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.823+0000 7f08e7fff640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ec06ae40 0x7f08ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.823+0000 7f08e7fff640 1 -- 172.21.15.50:0/2960271421 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f08f4088dd0 con 0x7f09000b1d70 2023-12-08T08:20:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.823+0000 7f08ff7fe640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ec06ae40 0x7f08ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:08.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.824+0000 7f08ff7fe640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ec06ae40 0x7f08ec06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f08f0036000 tx=0x7f08f003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:08.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:08.827+0000 7f08e7fff640 1 -- 172.21.15.50:0/2960271421 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09000b5c20 con 0x7f09000b1d70 2023-12-08T08:20:09.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.043+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09000b62e0 con 0x7f09000b1d70 2023-12-08T08:20:09.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.043+0000 7f08e7fff640 1 -- 172.21.15.50:0/2960271421 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f09000b62e0 con 0x7f09000b1d70 2023-12-08T08:20:09.046 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:09.046 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:19.820822+0000","modified":"2023-12-08T08:19:32.200005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/209897774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":209897774},{"type":"v1","addr":"172.21.15.50:6835","nonce":209897774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:20:09.046 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ec06ae40 msgr2=0x7f08ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ec06ae40 0x7f08ec06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f08f0036000 tx=0x7f08f003d040 comp rx=0 tx=0).stop 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09000b1d70 msgr2=0x7f09000b8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09000b1d70 0x7f09000b8430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c4d0 tx=0x7f08f400c990 comp rx=0 tx=0).stop 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 shutdown_connections 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f08ec06ae40 0x7f08ec06d300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09000b1d70 0x7f09000b8430 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09001608a0 0x7f090006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 --2- 172.21.15.50:0/2960271421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09000b0cf0 0x7f0900153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 >> 172.21.15.50:0/2960271421 conn(0x7f09000d3030 msgr2=0x7f09000b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 shutdown_connections 2023-12-08T08:20:09.048 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.045+0000 7f0905b76640 1 -- 172.21.15.50:0/2960271421 wait complete. 2023-12-08T08:20:09.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.162+0000 7fa67bc61640 1 Processor -- start 2023-12-08T08:20:09.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.163+0000 7fa67bc61640 1 -- start start 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.163+0000 7fa67bc61640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa6740cf730 0x7fa6740adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.163+0000 7fa67bc61640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740cfb60 con 0x7fa67415b250 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.163+0000 7fa67bc61640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740ae0b0 con 0x7fa6740d14b0 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.163+0000 7fa67bc61640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740aeee0 con 0x7fa6740cf730 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.163+0000 7fa6799fd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa67415b250 0x7fa6740d0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53342/0 (socket says 172.21.15.50:53342) 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.163+0000 7fa6799fd640 1 -- 172.21.15.50:0/1004975260 learned_addr learned my addr 172.21.15.50:0/1004975260 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970211446 0 0) 0x7fa6740cfb60 con 0x7fa67415b250 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/1004975260 >> v2:172.21.15.170:3300/0 conn(0x7fa6740cf730 0x7fa6740adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c003520 con 0x7fa67415b250 2023-12-08T08:20:09.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1975799444 0 0) 0x7fa65c003520 con 0x7fa67415b250 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 >> v2:172.21.15.170:3300/0 conn(0x7fa6740cf730 msgr2=0x7fa6740adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 --2- 172.21.15.50:0/1004975260 >> v2:172.21.15.170:3300/0 conn(0x7fa6740cf730 0x7fa6740adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 >> v1:172.21.15.170:6789/0 conn(0x7fa6740d14b0 legacy=0x7fa6740af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740ae2f0 con 0x7fa67415b250 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fa66c001670 con 0x7fa67415b250 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 >> v1:172.21.15.50:6789/0 conn(0x7fa67415b250 legacy=0x7fa6740d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c003970 0x7fa65c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65c0047c0 0x7fa65c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c005180 0x7fa65c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740aeee0 con 0x7fa65c005180 2023-12-08T08:20:09.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c00c0d0 con 0x7fa65c003970 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c00c290 con 0x7fa65c0047c0 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c005180 0x7fa65c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6799fd640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c003970 0x7fa65c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.164+0000 7fa6791fc640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65c0047c0 0x7fa65c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa67a1fe640 1 -- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65c0047c0 msgr2=0x7fa65c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa65c0047c0 0x7fa65c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa67a1fe640 1 -- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c003970 msgr2=0x7fa65c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c003970 0x7fa65c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa67a1fe640 1 -- 172.21.15.50:0/1004975260 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c003520 con 0x7fa65c005180 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa67a1fe640 1 -- 172.21.15.50:0/1004975260 reap_dead start 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c005180 0x7fa65c00b980 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa664007360 tx=0x7fa65c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7543f9d92e8245e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66402ccf0 con 0x7fa65c005180 2023-12-08T08:20:09.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66402ce90 con 0x7fa65c005180 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.165+0000 7fa6789fb640 1 -- 172.21.15.50:0/1004975260 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664003bd0 con 0x7fa65c005180 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.166+0000 7fa67bc61640 1 -- 172.21.15.50:0/1004975260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c005180 msgr2=0x7fa65c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.166+0000 7fa67bc61640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c005180 0x7fa65c00b980 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa664007360 tx=0x7fa65c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.166+0000 7fa67bc61640 1 -- 172.21.15.50:0/1004975260 shutdown_connections 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.166+0000 7fa67bc61640 1 --2- 172.21.15.50:0/1004975260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa65c005180 0x7fa65c00b980 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.166+0000 7fa67bc61640 1 -- 172.21.15.50:0/1004975260 >> 172.21.15.50:0/1004975260 conn(0x7fa674099a10 msgr2=0x7fa674099df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.166+0000 7fa67bc61640 1 -- 172.21.15.50:0/1004975260 shutdown_connections 2023-12-08T08:20:09.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.166+0000 7fa67bc61640 1 -- 172.21.15.50:0/1004975260 wait complete. 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.167+0000 7fa67bc61640 1 Processor -- start 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.167+0000 7fa67bc61640 1 -- start start 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67bc61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c005180 0x7fa6740c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67bc61640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740c9ea0 0x7fa6740b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67bc61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6740b1e50 0x7fa6740b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67bc61640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740ca900 con 0x7fa6740b1e50 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67bc61640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740c4c90 con 0x7fa65c005180 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67bc61640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740ca340 con 0x7fa6740c9ea0 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6740b1e50 0x7fa6740b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6740b1e50 0x7fa6740b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51100/0 (socket says 172.21.15.50:51100) 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 -- 172.21.15.50:0/660282722 learned_addr learned my addr 172.21.15.50:0/660282722 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:09.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 -- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740c9ea0 msgr2=0x7fa6740b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740c9ea0 0x7fa6740b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 -- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c005180 msgr2=0x7fa6740c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c005180 0x7fa6740c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.168+0000 7fa67a1fe640 1 -- 172.21.15.50:0/660282722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740ca620 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.169+0000 7fa67a1fe640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6740b1e50 0x7fa6740b3c80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa664007450 tx=0x7fa664004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.169+0000 7fa6727fc640 1 -- 172.21.15.50:0/660282722 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640046a0 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.169+0000 7fa6727fc640 1 -- 172.21.15.50:0/660282722 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664004800 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.169+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6740c4920 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.169+0000 7fa6727fc640 1 -- 172.21.15.50:0/660282722 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664040680 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.169+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6740b41c0 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.170+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6740c4780 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.170+0000 7fa6727fc640 1 -- 172.21.15.50:0/660282722 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa664034440 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.171+0000 7fa6727fc640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa66006ae40 0x7fa66006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.171+0000 7fa6727fc640 1 -- 172.21.15.50:0/660282722 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fa66403b070 con 0x7fa6740b1e50 2023-12-08T08:20:09.176 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.171+0000 7fa6799fd640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa66006ae40 0x7fa66006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.171+0000 7fa6799fd640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa66006ae40 0x7fa66006d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0011e0 tx=0x7fa66c001150 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.175+0000 7fa6727fc640 1 -- 172.21.15.50:0/660282722 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6740c4780 con 0x7fa6740b1e50 2023-12-08T08:20:09.353 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.350+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6740c4780 con 0x7fa6740b1e50 2023-12-08T08:20:09.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.352+0000 7fa6727fc640 1 -- 172.21.15.50:0/660282722 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18546 (secure 0 0 0) 0x7fa6740c4780 con 0x7fa6740b1e50 2023-12-08T08:20:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:09.355 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:38.869408+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:09.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa66006ae40 msgr2=0x7fa66006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa66006ae40 0x7fa66006d300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0011e0 tx=0x7fa66c001150 comp rx=0 tx=0).stop 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6740b1e50 msgr2=0x7fa6740b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6740b1e50 0x7fa6740b3c80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa664007450 tx=0x7fa664004ab0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 shutdown_connections 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa66006ae40 0x7fa66006d300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa6740b1e50 0x7fa6740b3c80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa6740c9ea0 0x7fa6740b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 --2- 172.21.15.50:0/660282722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa65c005180 0x7fa6740c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 >> 172.21.15.50:0/660282722 conn(0x7fa674099a10 msgr2=0x7fa6740d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 shutdown_connections 2023-12-08T08:20:09.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.354+0000 7fa67bc61640 1 -- 172.21.15.50:0/660282722 wait complete. 2023-12-08T08:20:09.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:19:18.367216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:19:18.792176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-08T08:19:31.441584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:09.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:09.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.474+0000 7f0426417640 1 Processor -- start 2023-12-08T08:20:09.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.474+0000 7f0426417640 1 -- start start 2023-12-08T08:20:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f0426417640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f04200cd3d0 0x7f04200712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f0426417640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f042006d6a0 0x7f04200cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f0426417640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04200cdcf0 0x7f04200700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f0426417640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042006d280 con 0x7f04200cdcf0 2023-12-08T08:20:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f0426417640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0420071800 con 0x7f04200cd3d0 2023-12-08T08:20:09.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f0426417640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042006c8e0 con 0x7f042006d6a0 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04200cdcf0 0x7f04200700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f04200cdcf0 0x7f04200700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51112/0 (socket says 172.21.15.50:51112) 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 -- 172.21.15.50:0/2061256149 learned_addr learned my addr 172.21.15.50:0/2061256149 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f041ffff640 1 --2- 172.21.15.50:0/2061256149 >> v2:172.21.15.170:3300/0 conn(0x7f04200cd3d0 0x7f04200712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 -- 172.21.15.50:0/2061256149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f042006d6a0 msgr2=0x7f04200cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f041f7fe640 1 --2- 172.21.15.50:0/2061256149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f042006d6a0 0x7f04200cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 --2- 172.21.15.50:0/2061256149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f042006d6a0 0x7f04200cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 -- 172.21.15.50:0/2061256149 >> v2:172.21.15.170:3300/0 conn(0x7f04200cd3d0 msgr2=0x7f04200712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 --2- 172.21.15.50:0/2061256149 >> v2:172.21.15.170:3300/0 conn(0x7f04200cd3d0 0x7f04200712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f04249b4640 1 -- 172.21.15.50:0/2061256149 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042006cbc0 con 0x7f04200cdcf0 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f041f7fe640 1 --2- 172.21.15.50:0/2061256149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f042006d6a0 0x7f04200cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.475+0000 7f041ffff640 1 --2- 172.21.15.50:0/2061256149 >> v2:172.21.15.170:3300/0 conn(0x7f04200cd3d0 0x7f04200712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:09.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.476+0000 7f04249b4640 1 --2- 172.21.15.50:0/2061256149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04200cdcf0 0x7f04200700b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e50 tx=0x7f041802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983d833d7bf2cffb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.476+0000 7f041effd640 1 -- 172.21.15.50:0/2061256149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041802ca70 con 0x7f04200cdcf0 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.476+0000 7f041effd640 1 -- 172.21.15.50:0/2061256149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041802cbd0 con 0x7f04200cdcf0 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.476+0000 7f041effd640 1 -- 172.21.15.50:0/2061256149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180343f0 con 0x7f04200cdcf0 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 -- 172.21.15.50:0/2061256149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04200cdcf0 msgr2=0x7f04200700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 --2- 172.21.15.50:0/2061256149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04200cdcf0 0x7f04200700b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e50 tx=0x7f041802bed0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 -- 172.21.15.50:0/2061256149 shutdown_connections 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 --2- 172.21.15.50:0/2061256149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f04200cdcf0 0x7f04200700b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 --2- 172.21.15.50:0/2061256149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f042006d6a0 0x7f04200cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 --2- 172.21.15.50:0/2061256149 >> v2:172.21.15.170:3300/0 conn(0x7f04200cd3d0 0x7f04200712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 -- 172.21.15.50:0/2061256149 >> 172.21.15.50:0/2061256149 conn(0x7f04200b0850 msgr2=0x7f04200b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 -- 172.21.15.50:0/2061256149 shutdown_connections 2023-12-08T08:20:09.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.477+0000 7f0426417640 1 -- 172.21.15.50:0/2061256149 wait complete. 2023-12-08T08:20:09.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.478+0000 7f0426417640 1 Processor -- start 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.478+0000 7f0426417640 1 -- start start 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f0426417640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f042006d6a0 0x7f042015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f0426417640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04200cd3d0 0x7f04200b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f0426417640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04200cdcf0 0x7f04200b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f0426417640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200b1c50 con 0x7f042006d6a0 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f0426417640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042015ac00 con 0x7f04200cd3d0 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f0426417640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200b1e60 con 0x7f04200cdcf0 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f042006d6a0 0x7f042015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f042006d6a0 0x7f042015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51118/0 (socket says 172.21.15.50:51118) 2023-12-08T08:20:09.484 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041ffff640 1 -- 172.21.15.50:0/601252199 learned_addr learned my addr 172.21.15.50:0/601252199 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f04249b4640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04200cdcf0 0x7f04200b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041f7fe640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04200cd3d0 0x7f04200b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041ffff640 1 -- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04200cdcf0 msgr2=0x7f04200b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041ffff640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04200cdcf0 0x7f04200b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041ffff640 1 -- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04200cd3d0 msgr2=0x7f04200b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.479+0000 7f041ffff640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04200cd3d0 0x7f04200b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.480+0000 7f041ffff640 1 -- 172.21.15.50:0/601252199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009b30 con 0x7f042006d6a0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.480+0000 7f041ffff640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f042006d6a0 0x7f042015a6c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f040800c7f0 tx=0x7f040800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.480+0000 7f041cff9640 1 -- 172.21.15.50:0/601252199 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080079d0 con 0x7f042006d6a0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.480+0000 7f041cff9640 1 -- 172.21.15.50:0/601252199 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0408007b30 con 0x7f042006d6a0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.480+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04200b2140 con 0x7f042006d6a0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.480+0000 7f041cff9640 1 -- 172.21.15.50:0/601252199 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800ce40 con 0x7f042006d6a0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.480+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04200b2700 con 0x7f042006d6a0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.481+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0420067430 con 0x7f042006d6a0 2023-12-08T08:20:09.485 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.481+0000 7f041cff9640 1 -- 172.21.15.50:0/601252199 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04080113f0 con 0x7f042006d6a0 2023-12-08T08:20:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.482+0000 7f041cff9640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f040006ae40 0x7f040006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.482+0000 7f041cff9640 1 -- 172.21.15.50:0/601252199 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f0408089a00 con 0x7f042006d6a0 2023-12-08T08:20:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.482+0000 7f041f7fe640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f040006ae40 0x7f040006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.483+0000 7f041f7fe640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f040006ae40 0x7f040006d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0420143bf0 tx=0x7f0410008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.486+0000 7f041cff9640 1 -- 172.21.15.50:0/601252199 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0408054880 con 0x7f042006d6a0 2023-12-08T08:20:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.665+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0420144110 con 0x7f042006d6a0 2023-12-08T08:20:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.666+0000 7f041cff9640 1 -- 172.21.15.50:0/601252199 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0408057ea0 con 0x7f042006d6a0 2023-12-08T08:20:09.668 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f040006ae40 msgr2=0x7f040006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f040006ae40 0x7f040006d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0420143bf0 tx=0x7f0410008040 comp rx=0 tx=0).stop 2023-12-08T08:20:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f042006d6a0 msgr2=0x7f042015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f042006d6a0 0x7f042015a6c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f040800c7f0 tx=0x7f040800cbf0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 shutdown_connections 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f040006ae40 0x7f040006d300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04200cdcf0 0x7f04200b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04200cd3d0 0x7f04200b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 --2- 172.21.15.50:0/601252199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f042006d6a0 0x7f042015a6c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 >> 172.21.15.50:0/601252199 conn(0x7f04200b0850 msgr2=0x7f0420071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 shutdown_connections 2023-12-08T08:20:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.668+0000 7f0426417640 1 -- 172.21.15.50:0/601252199 wait complete. 2023-12-08T08:20:09.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.787+0000 7f422bd53640 1 Processor -- start 2023-12-08T08:20:09.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.788+0000 7f422bd53640 1 -- start start 2023-12-08T08:20:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.788+0000 7f422bd53640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfa30 0x7f42240b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.788+0000 7f422bd53640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f42240b4150 0x7f42240b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.788+0000 7f422bd53640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240c6be0 con 0x7f42240cfe10 2023-12-08T08:20:09.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.788+0000 7f422bd53640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42240d3ff0 con 0x7f42240b4150 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.788+0000 7f422bd53640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b4860 con 0x7f42240cfa30 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f4229aef640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfa30 0x7f42240b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f42292ee640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f42240b4150 0x7f42240b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f4229aef640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfa30 0x7f42240b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:39340/0 (socket says 172.21.15.50:39340) 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f4229aef640 1 -- 172.21.15.50:0/3779621174 learned_addr learned my addr 172.21.15.50:0/3779621174 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f4229aef640 1 -- 172.21.15.50:0/3779621174 >> v2:172.21.15.170:3300/0 conn(0x7f42240b4150 msgr2=0x7f42240b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f4229aef640 1 --2- 172.21.15.50:0/3779621174 >> v2:172.21.15.170:3300/0 conn(0x7f42240b4150 0x7f42240b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f4229aef640 1 -- 172.21.15.50:0/3779621174 >> v1:172.21.15.170:6789/0 conn(0x7f42240cfe10 legacy=0x7f4224161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.789+0000 7f4229aef640 1 -- 172.21.15.50:0/3779621174 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240d3d50 con 0x7f42240cfa30 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.790+0000 7f4229aef640 1 --2- 172.21.15.50:0/3779621174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfa30 0x7f42240b2f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4220009870 tx=0x7f422002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e060a8c9d2539f09 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.790+0000 7f4228aed640 1 -- 172.21.15.50:0/3779621174 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220031640 con 0x7f42240cfa30 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.790+0000 7f4228aed640 1 -- 172.21.15.50:0/3779621174 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42200317a0 con 0x7f42240cfa30 2023-12-08T08:20:09.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.790+0000 7f4228aed640 1 -- 172.21.15.50:0/3779621174 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220031b30 con 0x7f42240cfa30 2023-12-08T08:20:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 -- 172.21.15.50:0/3779621174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfa30 msgr2=0x7f42240b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 --2- 172.21.15.50:0/3779621174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfa30 0x7f42240b2f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4220009870 tx=0x7f422002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 -- 172.21.15.50:0/3779621174 shutdown_connections 2023-12-08T08:20:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 --2- 172.21.15.50:0/3779621174 >> v2:172.21.15.170:3300/0 conn(0x7f42240b4150 0x7f42240b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 --2- 172.21.15.50:0/3779621174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfa30 0x7f42240b2f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 -- 172.21.15.50:0/3779621174 >> 172.21.15.50:0/3779621174 conn(0x7f42240d3090 msgr2=0x7f42240d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 -- 172.21.15.50:0/3779621174 shutdown_connections 2023-12-08T08:20:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.791+0000 7f422bd53640 1 -- 172.21.15.50:0/3779621174 wait complete. 2023-12-08T08:20:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.792+0000 7f422bd53640 1 Processor -- start 2023-12-08T08:20:09.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.792+0000 7f422bd53640 1 -- start start 2023-12-08T08:20:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f422bd53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42240b4150 0x7f42240b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f422bd53640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42240cfa30 0x7f4224152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f422bd53640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfe10 0x7f42240ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f422bd53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b06c0 con 0x7f42240b4150 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f422bd53640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b6c10 con 0x7f42240cfa30 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f422bd53640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240b0100 con 0x7f42240cfe10 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42240b4150 0x7f42240b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42240b4150 0x7f42240b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40344/0 (socket says 172.21.15.50:40344) 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 -- 172.21.15.50:0/1859193827 learned_addr learned my addr 172.21.15.50:0/1859193827 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f42292ee640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42240cfa30 0x7f4224152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f422a2f0640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfe10 0x7f42240ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 -- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfe10 msgr2=0x7f42240ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfe10 0x7f42240ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 -- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42240cfa30 msgr2=0x7f4224152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42240cfa30 0x7f4224152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 -- 172.21.15.50:0/1859193827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200094d0 con 0x7f42240b4150 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.793+0000 7f4229aef640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42240b4150 0x7f42240b7030 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f42200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.794+0000 7f421a7fc640 1 -- 172.21.15.50:0/1859193827 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422003a930 con 0x7f42240b4150 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.794+0000 7f421a7fc640 1 -- 172.21.15.50:0/1859193827 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422003aa90 con 0x7f42240b4150 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.794+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42240b03e0 con 0x7f42240b4150 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.794+0000 7f421a7fc640 1 -- 172.21.15.50:0/1859193827 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422003ae40 con 0x7f42240b4150 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.794+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240b7570 con 0x7f42240b4150 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.795+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42240b6690 con 0x7f42240b4150 2023-12-08T08:20:09.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.795+0000 7f421a7fc640 1 -- 172.21.15.50:0/1859193827 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f422002f050 con 0x7f42240b4150 2023-12-08T08:20:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.796+0000 7f421a7fc640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f420806ae40 0x7f420806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.796+0000 7f421a7fc640 1 -- 172.21.15.50:0/1859193827 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f42200ab620 con 0x7f42240b4150 2023-12-08T08:20:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.796+0000 7f42292ee640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f420806ae40 0x7f420806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:09.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.796+0000 7f42292ee640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f420806ae40 0x7f420806d300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f42240b7ad0 tx=0x7f4214008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:09.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.800+0000 7f421a7fc640 1 -- 172.21.15.50:0/1859193827 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42240b6690 con 0x7f42240b4150 2023-12-08T08:20:09.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.975+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42240b6690 con 0x7f42240b4150 2023-12-08T08:20:09.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.975+0000 7f421a7fc640 1 -- 172.21.15.50:0/1859193827 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42240b6690 con 0x7f42240b4150 2023-12-08T08:20:09.978 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f420806ae40 msgr2=0x7f420806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f420806ae40 0x7f420806d300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f42240b7ad0 tx=0x7f4214008040 comp rx=0 tx=0).stop 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42240b4150 msgr2=0x7f42240b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42240b4150 0x7f42240b7030 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f42200046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 shutdown_connections 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f420806ae40 0x7f420806d300 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42240cfe10 0x7f42240ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42240cfa30 0x7f4224152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 --2- 172.21.15.50:0/1859193827 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42240b4150 0x7f42240b7030 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:09.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 >> 172.21.15.50:0/1859193827 conn(0x7f42240d3090 msgr2=0x7f42240b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:09.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 shutdown_connections 2023-12-08T08:20:09.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:09.977+0000 7f422bd53640 1 -- 172.21.15.50:0/1859193827 wait complete. 2023-12-08T08:20:09.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.098+0000 7f1ff4b78640 1 Processor -- start 2023-12-08T08:20:10.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.098+0000 7f1ff4b78640 1 -- start start 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1ff4b78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff015d590 0x7f1ff00ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1ff4b78640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ff00afeb0 0x7f1ff00cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1ff4b78640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff006d650 con 0x7f1ff00cf790 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1ff4b78640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff00adbe0 con 0x7f1ff00afeb0 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1ff4b78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff015d970 con 0x7f1ff015d590 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1fedd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ff00afeb0 0x7f1ff00cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1fedd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1ff00afeb0 0x7f1ff00cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40350/0 (socket says 172.21.15.50:40350) 2023-12-08T08:20:10.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.099+0000 7f1fedd9b640 1 -- 172.21.15.50:0/4149515085 learned_addr learned my addr 172.21.15.50:0/4149515085 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.100+0000 7f1fee59c640 1 --2- 172.21.15.50:0/4149515085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff015d590 0x7f1ff00ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.100+0000 7f1fedd9b640 1 -- 172.21.15.50:0/4149515085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff015d590 msgr2=0x7f1ff00ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.100+0000 7f1fedd9b640 1 --2- 172.21.15.50:0/4149515085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff015d590 0x7f1ff00ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.100+0000 7f1fedd9b640 1 -- 172.21.15.50:0/4149515085 >> v1:172.21.15.170:6789/0 conn(0x7f1ff00cf790 legacy=0x7f1ff0161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.100+0000 7f1fedd9b640 1 -- 172.21.15.50:0/4149515085 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff006c810 con 0x7f1ff00afeb0 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.100+0000 7f1fedd9b640 1 --2- 172.21.15.50:0/4149515085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff00cf250 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009870 tx=0x7f1fd802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61799c5968641be server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1fed59a640 1 -- 172.21.15.50:0/4149515085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8030840 con 0x7f1ff00afeb0 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1fed59a640 1 -- 172.21.15.50:0/4149515085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd80309a0 con 0x7f1ff00afeb0 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1fed59a640 1 -- 172.21.15.50:0/4149515085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8030d30 con 0x7f1ff00afeb0 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 -- 172.21.15.50:0/4149515085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 msgr2=0x7f1ff00cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/4149515085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff00cf250 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009870 tx=0x7f1fd802b980 comp rx=0 tx=0).stop 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 -- 172.21.15.50:0/4149515085 shutdown_connections 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/4149515085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff00cf250 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/4149515085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff015d590 0x7f1ff00ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 -- 172.21.15.50:0/4149515085 >> 172.21.15.50:0/4149515085 conn(0x7f1ff00d0e10 msgr2=0x7f1ff00d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 -- 172.21.15.50:0/4149515085 shutdown_connections 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.101+0000 7f1ff4b78640 1 -- 172.21.15.50:0/4149515085 wait complete. 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 Processor -- start 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 -- start start 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff00cf790 0x7f1ff00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ff015d590 0x7f1ff01f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff014d720 con 0x7f1ff00afeb0 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00c9060 con 0x7f1ff015d590 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1ff4b78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00c9340 con 0x7f1ff00cf790 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1fee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1fee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff014d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40366/0 (socket says 172.21.15.50:40366) 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.103+0000 7f1fee59c640 1 -- 172.21.15.50:0/3671623904 learned_addr learned my addr 172.21.15.50:0/3671623904 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fedd9b640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff00cf790 0x7f1ff00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1feed9d640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ff015d590 0x7f1ff01f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fee59c640 1 -- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff00cf790 msgr2=0x7f1ff00ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fee59c640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff00cf790 0x7f1ff00ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fee59c640 1 -- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ff015d590 msgr2=0x7f1ff01f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fee59c640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ff015d590 0x7f1ff01f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fee59c640 1 -- 172.21.15.50:0/3671623904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80094d0 con 0x7f1ff00afeb0 2023-12-08T08:20:10.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fee59c640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff014d1e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d5f0 tx=0x7f1fe800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fe6ffd640 1 -- 172.21.15.50:0/3671623904 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80125f0 con 0x7f1ff00afeb0 2023-12-08T08:20:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fe6ffd640 1 -- 172.21.15.50:0/3671623904 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8012750 con 0x7f1ff00afeb0 2023-12-08T08:20:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1fe6ffd640 1 -- 172.21.15.50:0/3671623904 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8012b00 con 0x7f1ff00afeb0 2023-12-08T08:20:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff00c9620 con 0x7f1ff00afeb0 2023-12-08T08:20:10.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.104+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff00c9be0 con 0x7f1ff00afeb0 2023-12-08T08:20:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.105+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff00c9d70 con 0x7f1ff00afeb0 2023-12-08T08:20:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.106+0000 7f1fe6ffd640 1 -- 172.21.15.50:0/3671623904 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fe8012c60 con 0x7f1ff00afeb0 2023-12-08T08:20:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.106+0000 7f1fe6ffd640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fd006ae40 0x7f1fd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.106+0000 7f1fe6ffd640 1 -- 172.21.15.50:0/3671623904 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f1fe8089c00 con 0x7f1ff00afeb0 2023-12-08T08:20:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.106+0000 7f1fedd9b640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fd006ae40 0x7f1fd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.110 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.107+0000 7f1fedd9b640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fd006ae40 0x7f1fd006d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8036000 tx=0x7f1fd8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.110+0000 7f1fe6ffd640 1 -- 172.21.15.50:0/3671623904 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1fe8090080 con 0x7f1ff00afeb0 2023-12-08T08:20:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.287+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ff0067430 con 0x7f1ff00afeb0 2023-12-08T08:20:10.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.287+0000 7f1fe6ffd640 1 -- 172.21.15.50:0/3671623904 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fe8054b00 con 0x7f1ff00afeb0 2023-12-08T08:20:10.290 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:10.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fd006ae40 msgr2=0x7f1fd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fd006ae40 0x7f1fd006d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8036000 tx=0x7f1fd8008030 comp rx=0 tx=0).stop 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 msgr2=0x7f1ff014d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff014d1e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d5f0 tx=0x7f1fe800dab0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 shutdown_connections 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fd006ae40 0x7f1fd006d300 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ff015d590 0x7f1ff01f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1ff00cf790 0x7f1ff00ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 --2- 172.21.15.50:0/3671623904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ff00afeb0 0x7f1ff014d1e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 >> 172.21.15.50:0/3671623904 conn(0x7f1ff00d0e10 msgr2=0x7f1ff015b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 shutdown_connections 2023-12-08T08:20:10.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.289+0000 7f1ff4b78640 1 -- 172.21.15.50:0/3671623904 wait complete. 2023-12-08T08:20:10.303 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-08T08:20:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.410+0000 7f606518e640 1 Processor -- start 2023-12-08T08:20:10.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.410+0000 7f606518e640 1 -- start start 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.410+0000 7f606518e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f606015d590 0x7f60600ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.410+0000 7f606518e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600afeb0 0x7f60600cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.410+0000 7f606518e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606006d650 con 0x7f60600cf790 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.410+0000 7f606518e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60600adbe0 con 0x7f606015d590 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.410+0000 7f606518e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606015d970 con 0x7f60600afeb0 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f606015d590 0x7f60600ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605f59e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f60600cf790 0x7f6060161070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60050/0 (socket says 172.21.15.50:60050) 2023-12-08T08:20:10.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f606015d590 0x7f60600ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40378/0 (socket says 172.21.15.50:40378) 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605f59e640 1 -- 172.21.15.50:0/736685443 learned_addr learned my addr 172.21.15.50:0/736685443 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f6057fff640 1 --2- 172.21.15.50:0/736685443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600afeb0 0x7f60600cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605ed9d640 1 -- 172.21.15.50:0/736685443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600afeb0 msgr2=0x7f60600cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605ed9d640 1 --2- 172.21.15.50:0/736685443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600afeb0 0x7f60600cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605ed9d640 1 -- 172.21.15.50:0/736685443 >> v1:172.21.15.50:6789/0 conn(0x7f60600cf790 legacy=0x7f6060161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.411+0000 7f605ed9d640 1 -- 172.21.15.50:0/736685443 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606006c810 con 0x7f606015d590 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f605ed9d640 1 --2- 172.21.15.50:0/736685443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f606015d590 0x7f60600ced10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f60500097a0 tx=0x7f605002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1480670c21d94426 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f605e59c640 1 -- 172.21.15.50:0/736685443 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050031830 con 0x7f606015d590 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f605e59c640 1 -- 172.21.15.50:0/736685443 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050031990 con 0x7f606015d590 2023-12-08T08:20:10.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f605e59c640 1 -- 172.21.15.50:0/736685443 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050031d20 con 0x7f606015d590 2023-12-08T08:20:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 -- 172.21.15.50:0/736685443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f606015d590 msgr2=0x7f60600ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 --2- 172.21.15.50:0/736685443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f606015d590 0x7f60600ced10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f60500097a0 tx=0x7f605002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 -- 172.21.15.50:0/736685443 shutdown_connections 2023-12-08T08:20:10.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 --2- 172.21.15.50:0/736685443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600afeb0 0x7f60600cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 --2- 172.21.15.50:0/736685443 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f606015d590 0x7f60600ced10 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 -- 172.21.15.50:0/736685443 >> 172.21.15.50:0/736685443 conn(0x7f60600d0e10 msgr2=0x7f60600d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 -- 172.21.15.50:0/736685443 shutdown_connections 2023-12-08T08:20:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.412+0000 7f606518e640 1 -- 172.21.15.50:0/736685443 wait complete. 2023-12-08T08:20:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.414+0000 7f606518e640 1 Processor -- start 2023-12-08T08:20:10.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.414+0000 7f606518e640 1 -- start start 2023-12-08T08:20:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60600afeb0 0x7f6060145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600cf790 0x7f60601f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f606015d590 0x7f6060144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060144cb0 con 0x7f60600afeb0 2023-12-08T08:20:10.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060144f90 con 0x7f606015d590 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6060145270 con 0x7f60600cf790 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60600afeb0 0x7f6060145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60600afeb0 0x7f6060145d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40390/0 (socket says 172.21.15.50:40390) 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 -- 172.21.15.50:0/4253679471 learned_addr learned my addr 172.21.15.50:0/4253679471 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f6057fff640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600cf790 0x7f60601f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605f59e640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f606015d590 0x7f6060144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 -- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600cf790 msgr2=0x7f60601f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600cf790 0x7f60601f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 -- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f606015d590 msgr2=0x7f6060144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f606015d590 0x7f6060144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 -- 172.21.15.50:0/4253679471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6050009400 con 0x7f60600afeb0 2023-12-08T08:20:10.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f6057fff640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600cf790 0x7f60601f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f605ed9d640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60600afeb0 0x7f6060145d50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6050034040 tx=0x7f60500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f60577fe640 1 -- 172.21.15.50:0/4253679471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605003aa60 con 0x7f60600afeb0 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f60577fe640 1 -- 172.21.15.50:0/4253679471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605003abe0 con 0x7f60600afeb0 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6060145550 con 0x7f60600afeb0 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f60577fe640 1 -- 172.21.15.50:0/4253679471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050044400 con 0x7f60600afeb0 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.415+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60601f3120 con 0x7f60600afeb0 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.416+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6060145a70 con 0x7f60600afeb0 2023-12-08T08:20:10.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.417+0000 7f60577fe640 1 -- 172.21.15.50:0/4253679471 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f605004d440 con 0x7f60600afeb0 2023-12-08T08:20:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.417+0000 7f60577fe640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f604006ae40 0x7f604006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.417+0000 7f60577fe640 1 -- 172.21.15.50:0/4253679471 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f60500abb70 con 0x7f60600afeb0 2023-12-08T08:20:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.418+0000 7f6057fff640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f604006ae40 0x7f604006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.418+0000 7f6057fff640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f604006ae40 0x7f604006d300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f606006fc20 tx=0x7f6048008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.422+0000 7f60577fe640 1 -- 172.21.15.50:0/4253679471 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6060145a70 con 0x7f60600afeb0 2023-12-08T08:20:10.599 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.597+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f6060145a70 con 0x7f60600afeb0 2023-12-08T08:20:10.600 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.597+0000 7f60577fe640 1 -- 172.21.15.50:0/4253679471 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v43) v1 ==== 97+0+11 (secure 0 0 0) 0x7f6060145a70 con 0x7f60600afeb0 2023-12-08T08:20:10.600 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f604006ae40 msgr2=0x7f604006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f604006ae40 0x7f604006d300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f606006fc20 tx=0x7f6048008040 comp rx=0 tx=0).stop 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60600afeb0 msgr2=0x7f6060145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60600afeb0 0x7f6060145d50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6050034040 tx=0x7f60500046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 shutdown_connections 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f604006ae40 0x7f604006d300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f606015d590 0x7f6060144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60600cf790 0x7f60601f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 --2- 172.21.15.50:0/4253679471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f60600afeb0 0x7f6060145d50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 >> 172.21.15.50:0/4253679471 conn(0x7f60600d0e10 msgr2=0x7f60600b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 shutdown_connections 2023-12-08T08:20:10.603 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.599+0000 7f606518e640 1 -- 172.21.15.50:0/4253679471 wait complete. 2023-12-08T08:20:10.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.718+0000 7fd25655a640 1 Processor -- start 2023-12-08T08:20:10.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.718+0000 7fd25655a640 1 -- start start 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd25655a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd25655a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2500b1d70 0x7fd2500d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd25655a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd2500afce0 0x7fd2500b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd25655a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500d0620 con 0x7fd2500b1d70 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd25655a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2500d20b0 con 0x7fd2500afce0 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd25655a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500d1dd0 con 0x7fd2501608a0 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2500b1d70 0x7fd2500d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd2500b1d70 0x7fd2500d1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40406/0 (socket says 172.21.15.50:40406) 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3729879194 learned_addr learned my addr 172.21.15.50:0/3729879194 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd254af7640 1 --2- 172.21.15.50:0/3729879194 >> v2:172.21.15.170:3300/0 conn(0x7fd2500afce0 0x7fd2500b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24ffff640 1 --2- 172.21.15.50:0/3729879194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3729879194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 msgr2=0x7fd2500d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 --2- 172.21.15.50:0/3729879194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3729879194 >> v2:172.21.15.170:3300/0 conn(0x7fd2500afce0 msgr2=0x7fd2500b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 --2- 172.21.15.50:0/3729879194 >> v2:172.21.15.170:3300/0 conn(0x7fd2500afce0 0x7fd2500b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.719+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3729879194 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500cff60 con 0x7fd2500b1d70 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd24f7fe640 1 --2- 172.21.15.50:0/3729879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500d1470 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd2500b27c0 tx=0x7fd24402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7d41035e7c652 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd24effd640 1 -- 172.21.15.50:0/3729879194 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2440317d0 con 0x7fd2500b1d70 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd24effd640 1 -- 172.21.15.50:0/3729879194 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244031930 con 0x7fd2500b1d70 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd24effd640 1 -- 172.21.15.50:0/3729879194 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244031cc0 con 0x7fd2500b1d70 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd25655a640 1 -- 172.21.15.50:0/3729879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 msgr2=0x7fd2500d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd25655a640 1 --2- 172.21.15.50:0/3729879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500d1470 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd2500b27c0 tx=0x7fd24402b870 comp rx=0 tx=0).stop 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd25655a640 1 -- 172.21.15.50:0/3729879194 shutdown_connections 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.720+0000 7fd25655a640 1 --2- 172.21.15.50:0/3729879194 >> v2:172.21.15.170:3300/0 conn(0x7fd2500afce0 0x7fd2500b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.721+0000 7fd25655a640 1 --2- 172.21.15.50:0/3729879194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500d1470 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.721+0000 7fd25655a640 1 --2- 172.21.15.50:0/3729879194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.721+0000 7fd25655a640 1 -- 172.21.15.50:0/3729879194 >> 172.21.15.50:0/3729879194 conn(0x7fd2500d3030 msgr2=0x7fd2500d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.721+0000 7fd25655a640 1 -- 172.21.15.50:0/3729879194 shutdown_connections 2023-12-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.721+0000 7fd25655a640 1 -- 172.21.15.50:0/3729879194 wait complete. 2023-12-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.722+0000 7fd25655a640 1 Processor -- start 2023-12-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.722+0000 7fd25655a640 1 -- start start 2023-12-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd25655a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2500afce0 0x7fd25015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd25655a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd25655a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd25655a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500c6d40 con 0x7fd2500b1d70 2023-12-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd25655a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500b6ad0 con 0x7fd2500afce0 2023-12-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd25655a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2500b6db0 con 0x7fd2501608a0 2023-12-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500b75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40408/0 (socket says 172.21.15.50:40408) 2023-12-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3906836042 learned_addr learned my addr 172.21.15.50:0/3906836042 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd254af7640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24ffff640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2500afce0 0x7fd25015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 msgr2=0x7fd2500b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2500afce0 msgr2=0x7fd25015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2500afce0 0x7fd25015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 -- 172.21.15.50:0/3906836042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440094d0 con 0x7fd2500b1d70 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24ffff640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2500afce0 0x7fd25015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24f7fe640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500b75e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd24402b8b0 tx=0x7fd2440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24cff9640 1 -- 172.21.15.50:0/3906836042 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244032870 con 0x7fd2500b1d70 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24cff9640 1 -- 172.21.15.50:0/3906836042 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2440329f0 con 0x7fd2500b1d70 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2500b7090 con 0x7fd2500b1d70 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.723+0000 7fd24cff9640 1 -- 172.21.15.50:0/3906836042 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244032da0 con 0x7fd2500b1d70 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.724+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2500b5da0 con 0x7fd2500b1d70 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.724+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2500b72d0 con 0x7fd2500b1d70 2023-12-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.725+0000 7fd24cff9640 1 -- 172.21.15.50:0/3906836042 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd244030070 con 0x7fd2500b1d70 2023-12-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.725+0000 7fd24cff9640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd23c06ae40 0x7fd23c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.726+0000 7fd24cff9640 1 -- 172.21.15.50:0/3906836042 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fd2440ab340 con 0x7fd2500b1d70 2023-12-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.726+0000 7fd24ffff640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd23c06ae40 0x7fd23c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.726+0000 7fd24ffff640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd23c06ae40 0x7fd23c06d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd240006fd0 tx=0x7fd240008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:10.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.730+0000 7fd24cff9640 1 -- 172.21.15.50:0/3906836042 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2500b72d0 con 0x7fd2500b1d70 2023-12-08T08:20:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.946+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2500b6ef0 con 0x7fd2500b1d70 2023-12-08T08:20:10.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.946+0000 7fd24cff9640 1 -- 172.21.15.50:0/3906836042 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7fd2500b6ef0 con 0x7fd2500b1d70 2023-12-08T08:20:10.951 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:10.951 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:19.820822+0000","modified":"2023-12-08T08:19:32.200005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/209897774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":209897774},{"type":"v1","addr":"172.21.15.50:6835","nonce":209897774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:20:10.951 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd23c06ae40 msgr2=0x7fd23c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd23c06ae40 0x7fd23c06d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd240006fd0 tx=0x7fd240008040 comp rx=0 tx=0).stop 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 msgr2=0x7fd2500b75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500b75e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd24402b8b0 tx=0x7fd2440046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 shutdown_connections 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd23c06ae40 0x7fd23c06d300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd2500b1d70 0x7fd2500b75e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2501608a0 0x7fd2500b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 --2- 172.21.15.50:0/3906836042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2500afce0 0x7fd25015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.948+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 >> 172.21.15.50:0/3906836042 conn(0x7fd2500d3030 msgr2=0x7fd2500b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.949+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 shutdown_connections 2023-12-08T08:20:10.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:10.949+0000 7fd25655a640 1 -- 172.21.15.50:0/3906836042 wait complete. 2023-12-08T08:20:10.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:11.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.066+0000 7fec27fd7640 1 Processor -- start 2023-12-08T08:20:11.069 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec27fd7640 1 -- start start 2023-12-08T08:20:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec27fd7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fec200b0cf0 0x7fec200d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec27fd7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 0x7fec200cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec27fd7640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec200d20b0 con 0x7fec201608a0 2023-12-08T08:20:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec27fd7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200d0620 con 0x7fec200b0cf0 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec27fd7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec200d1b80 con 0x7fec200b1d70 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec25d73640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fec201608a0 0x7fec200d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60054/0 (socket says 172.21.15.50:60054) 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.067+0000 7fec25d73640 1 -- 172.21.15.50:0/4229930235 learned_addr learned my addr 172.21.15.50:0/4229930235 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25572640 1 --2- 172.21.15.50:0/4229930235 >> v2:172.21.15.170:3300/0 conn(0x7fec200b0cf0 0x7fec200d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec26574640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 0x7fec200cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095553541 0 0) 0x7fec200d20b0 con 0x7fec201608a0 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec08003520 con 0x7fec201608a0 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1967965911 0 0) 0x7fec08003520 con 0x7fec201608a0 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 msgr2=0x7fec200cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 0x7fec200cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 >> v2:172.21.15.170:3300/0 conn(0x7fec200b0cf0 msgr2=0x7fec200d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 --2- 172.21.15.50:0/4229930235 >> v2:172.21.15.170:3300/0 conn(0x7fec200b0cf0 0x7fec200d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200d1dd0 con 0x7fec201608a0 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fec18001670 con 0x7fec201608a0 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 >> v1:172.21.15.50:6789/0 conn(0x7fec201608a0 legacy=0x7fec200d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec08003970 0x7fec08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec080047c0 0x7fec08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 0x7fec08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200d0620 con 0x7fec08003970 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200d1b80 con 0x7fec080047c0 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0800b9b0 con 0x7fec200b1d70 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25d73640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec08003970 0x7fec08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25572640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec080047c0 0x7fec08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec26574640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 0x7fec08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25d73640 1 -- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 msgr2=0x7fec08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25d73640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 0x7fec08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25d73640 1 -- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec080047c0 msgr2=0x7fec08004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25d73640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec080047c0 0x7fec08004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec25d73640 1 -- 172.21.15.50:0/4229930235 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08003520 con 0x7fec08003970 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.068+0000 7fec26574640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec200b1d70 0x7fec08005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.069+0000 7fec25d73640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec08003970 0x7fec08003d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c240 tx=0x7fec080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d065736a29df69 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.069+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1802cae0 con 0x7fec08003970 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.069+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1802cc40 con 0x7fec08003970 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.069+0000 7fec24d71640 1 -- 172.21.15.50:0/4229930235 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180058d0 con 0x7fec08003970 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.070+0000 7fec27fd7640 1 -- 172.21.15.50:0/4229930235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec08003970 msgr2=0x7fec08003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.070+0000 7fec27fd7640 1 --2- 172.21.15.50:0/4229930235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec08003970 0x7fec08003d90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c240 tx=0x7fec080057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.070+0000 7fec26574640 1 -- 172.21.15.50:0/4229930235 reap_dead start 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.070+0000 7fec27fd7640 1 -- 172.21.15.50:0/4229930235 shutdown_connections 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.070+0000 7fec27fd7640 1 -- 172.21.15.50:0/4229930235 >> 172.21.15.50:0/4229930235 conn(0x7fec200d3030 msgr2=0x7fec200d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.070+0000 7fec27fd7640 1 -- 172.21.15.50:0/4229930235 shutdown_connections 2023-12-08T08:20:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.070+0000 7fec27fd7640 1 -- 172.21.15.50:0/4229930235 wait complete. 2023-12-08T08:20:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.071+0000 7fec27fd7640 1 Processor -- start 2023-12-08T08:20:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.071+0000 7fec27fd7640 1 -- start start 2023-12-08T08:20:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec27fd7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec08003970 0x7fec200b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec27fd7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec2015e050 0x7fec2015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec27fd7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec200cbef0 0x7fec200cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec27fd7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200ca230 con 0x7fec200cbef0 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec27fd7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200ca4d0 con 0x7fec08003970 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec27fd7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec200ca7b0 con 0x7fec2015e050 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec200cbef0 0x7fec200cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec200cbef0 0x7fec200cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40426/0 (socket says 172.21.15.50:40426) 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 -- 172.21.15.50:0/3844962878 learned_addr learned my addr 172.21.15.50:0/3844962878 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec25572640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec2015e050 0x7fec2015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec25d73640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec08003970 0x7fec200b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 -- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec2015e050 msgr2=0x7fec2015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec2015e050 0x7fec2015e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 -- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec08003970 msgr2=0x7fec200b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec08003970 0x7fec200b8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.072+0000 7fec26574640 1 -- 172.21.15.50:0/3844962878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200caa90 con 0x7fec200cbef0 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.073+0000 7fec26574640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec200cbef0 0x7fec200cc370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fec2008b920 tx=0x7fec10009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.073+0000 7fec1e7fc640 1 -- 172.21.15.50:0/3844962878 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1000e050 con 0x7fec200cbef0 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.073+0000 7fec1e7fc640 1 -- 172.21.15.50:0/3844962878 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1000f040 con 0x7fec200cbef0 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.073+0000 7fec1e7fc640 1 -- 172.21.15.50:0/3844962878 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10003bd0 con 0x7fec200cbef0 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.073+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec200cad70 con 0x7fec200cbef0 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.073+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec200cc8b0 con 0x7fec200cbef0 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.074+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec20067430 con 0x7fec200cbef0 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.074+0000 7fec1e7fc640 1 -- 172.21.15.50:0/3844962878 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec10015440 con 0x7fec200cbef0 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.075+0000 7fec1e7fc640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec0c06ae70 0x7fec0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.075+0000 7fec1e7fc640 1 -- 172.21.15.50:0/3844962878 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fec10089e30 con 0x7fec200cbef0 2023-12-08T08:20:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.075+0000 7fec25d73640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec0c06ae70 0x7fec0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.075+0000 7fec25d73640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec0c06ae70 0x7fec0c06d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c210 tx=0x7fec18037040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.079+0000 7fec1e7fc640 1 -- 172.21.15.50:0/3844962878 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec10054c80 con 0x7fec200cbef0 2023-12-08T08:20:11.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.256+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec2006bac0 con 0x7fec200cbef0 2023-12-08T08:20:11.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.258+0000 7fec1e7fc640 1 -- 172.21.15.50:0/3844962878 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18546 (secure 0 0 0) 0x7fec100582a0 con 0x7fec200cbef0 2023-12-08T08:20:11.261 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:11.261 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:38.869408+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:11.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec0c06ae70 msgr2=0x7fec0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec0c06ae70 0x7fec0c06d330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c210 tx=0x7fec18037040 comp rx=0 tx=0).stop 2023-12-08T08:20:11.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec200cbef0 msgr2=0x7fec200cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec200cbef0 0x7fec200cc370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fec2008b920 tx=0x7fec10009f90 comp rx=0 tx=0).stop 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 shutdown_connections 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec0c06ae70 0x7fec0c06d330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec200cbef0 0x7fec200cc370 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fec2015e050 0x7fec2015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 --2- 172.21.15.50:0/3844962878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fec08003970 0x7fec200b8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 >> 172.21.15.50:0/3844962878 conn(0x7fec200d3030 msgr2=0x7fec2006b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 shutdown_connections 2023-12-08T08:20:11.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.260+0000 7fec27fd7640 1 -- 172.21.15.50:0/3844962878 wait complete. 2023-12-08T08:20:11.273 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:20:11.273 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:11.379 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.377+0000 7f25612bb640 1 Processor -- start 2023-12-08T08:20:11.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.377+0000 7f25612bb640 1 -- start start 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f25612bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3340 0x7f255c0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f25612bb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f255c0b3bf0 0x7f255c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f25612bb640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c0cdc20 con 0x7f255c0d15f0 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f25612bb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c0d11d0 con 0x7f255c0b3bf0 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f25612bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0d3a60 con 0x7f255c0b3340 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f255affd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3340 0x7f255c0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f255a7fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f255c0b3bf0 0x7f255c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f255b7fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f255c0d15f0 0x7f255c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:52204/0 (socket says 172.21.15.50:52204) 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.378+0000 7f255b7fe640 1 -- 172.21.15.50:0/2608013058 learned_addr learned my addr 172.21.15.50:0/2608013058 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:11.381 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.379+0000 7f255a7fc640 1 -- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3340 msgr2=0x7f255c0d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.379+0000 7f255a7fc640 1 --2- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3340 0x7f255c0d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.379+0000 7f255a7fc640 1 -- 172.21.15.50:0/2608013058 >> v1:172.21.15.170:6789/0 conn(0x7f255c0d15f0 legacy=0x7f255c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.379+0000 7f255a7fc640 1 -- 172.21.15.50:0/2608013058 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0d3d40 con 0x7f255c0b3bf0 2023-12-08T08:20:11.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.379+0000 7f255affd640 1 --2- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3340 0x7f255c0d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.379+0000 7f255a7fc640 1 --2- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0b3bf0 0x7f255c0b5e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25500097a0 tx=0x7f255002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a3228745d35045a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f2559ffb640 1 -- 172.21.15.50:0/2608013058 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550031780 con 0x7f255c0b3bf0 2023-12-08T08:20:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f2559ffb640 1 -- 172.21.15.50:0/2608013058 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25500318e0 con 0x7f255c0b3bf0 2023-12-08T08:20:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f2559ffb640 1 -- 172.21.15.50:0/2608013058 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550031c70 con 0x7f255c0b3bf0 2023-12-08T08:20:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 -- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0b3bf0 msgr2=0x7f255c0b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 --2- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0b3bf0 0x7f255c0b5e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f25500097a0 tx=0x7f255002b820 comp rx=0 tx=0).stop 2023-12-08T08:20:11.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 -- 172.21.15.50:0/2608013058 shutdown_connections 2023-12-08T08:20:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 --2- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0b3bf0 0x7f255c0b5e40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 --2- 172.21.15.50:0/2608013058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3340 0x7f255c0d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 -- 172.21.15.50:0/2608013058 >> 172.21.15.50:0/2608013058 conn(0x7f255c09c2f0 msgr2=0x7f255c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 -- 172.21.15.50:0/2608013058 shutdown_connections 2023-12-08T08:20:11.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.380+0000 7f25612bb640 1 -- 172.21.15.50:0/2608013058 wait complete. 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 Processor -- start 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 -- start start 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b3340 0x7f255c1f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3bf0 0x7f255c0b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0d15f0 0x7f255c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0cbdc0 con 0x7f255c0b3340 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c1f3680 con 0x7f255c0d15f0 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f25612bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c1f3960 con 0x7f255c0b3bf0 2023-12-08T08:20:11.386 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f255affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b3340 0x7f255c1f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f255affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b3340 0x7f255c1f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40430/0 (socket says 172.21.15.50:40430) 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.382+0000 7f255affd640 1 -- 172.21.15.50:0/1909668582 learned_addr learned my addr 172.21.15.50:0/1909668582 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255b7fe640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0d15f0 0x7f255c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255a7fc640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3bf0 0x7f255c0b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255affd640 1 -- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3bf0 msgr2=0x7f255c0b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255affd640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3bf0 0x7f255c0b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255affd640 1 -- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0d15f0 msgr2=0x7f255c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255affd640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0d15f0 0x7f255c0cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255affd640 1 -- 172.21.15.50:0/1909668582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009400 con 0x7f255c0b3340 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255b7fe640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0d15f0 0x7f255c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f255affd640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b3340 0x7f255c1f2fe0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ebe0 tx=0x7f254c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f25437fe640 1 -- 172.21.15.50:0/1909668582 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c009760 con 0x7f255c0b3340 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f25437fe640 1 -- 172.21.15.50:0/1909668582 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00cc30 con 0x7f255c0b3340 2023-12-08T08:20:11.387 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2550009400 con 0x7f255c0b3340 2023-12-08T08:20:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f25437fe640 1 -- 172.21.15.50:0/1909668582 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00eee0 con 0x7f255c0b3340 2023-12-08T08:20:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.383+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c1f3f20 con 0x7f255c0b3340 2023-12-08T08:20:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.384+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c067430 con 0x7f255c0b3340 2023-12-08T08:20:11.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.385+0000 7f25437fe640 1 -- 172.21.15.50:0/1909668582 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f254c013470 con 0x7f255c0b3340 2023-12-08T08:20:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.385+0000 7f25437fe640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f254806ae40 0x7f254806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.385+0000 7f25437fe640 1 -- 172.21.15.50:0/1909668582 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f254c089c10 con 0x7f255c0b3340 2023-12-08T08:20:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.385+0000 7f255a7fc640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f254806ae40 0x7f254806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.386+0000 7f255a7fc640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f254806ae40 0x7f254806d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2550036000 tx=0x7f255003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.389+0000 7f25437fe640 1 -- 172.21.15.50:0/1909668582 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f254c0549d0 con 0x7f255c0b3340 2023-12-08T08:20:11.601 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.599+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f255c0d13d0 con 0x7f255c0b3340 2023-12-08T08:20:11.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.600+0000 7f25437fe640 1 -- 172.21.15.50:0/1909668582 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f254c017090 con 0x7f255c0b3340 2023-12-08T08:20:11.602 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:11.602 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:19.820822+0000","modified":"2023-12-08T08:19:32.200005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/209897774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":209897774},{"type":"v1","addr":"172.21.15.50:6835","nonce":209897774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:20:11.603 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-08T08:20:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f254806ae40 msgr2=0x7f254806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f254806ae40 0x7f254806d300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2550036000 tx=0x7f255003d040 comp rx=0 tx=0).stop 2023-12-08T08:20:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b3340 msgr2=0x7f255c1f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b3340 0x7f255c1f2fe0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f254c00ebe0 tx=0x7f254c00c520 comp rx=0 tx=0).stop 2023-12-08T08:20:11.604 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 shutdown_connections 2023-12-08T08:20:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f254806ae40 0x7f254806d300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f255c0d15f0 0x7f255c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f255c0b3bf0 0x7f255c0b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 --2- 172.21.15.50:0/1909668582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f255c0b3340 0x7f255c1f2fe0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 >> 172.21.15.50:0/1909668582 conn(0x7f255c09c2f0 msgr2=0x7f255c160500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 shutdown_connections 2023-12-08T08:20:11.605 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.602+0000 7f25612bb640 1 -- 172.21.15.50:0/1909668582 wait complete. 2023-12-08T08:20:11.615 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.721+0000 7f2d80831640 1 Processor -- start 2023-12-08T08:20:11.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.721+0000 7f2d80831640 1 -- start start 2023-12-08T08:20:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d80831640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d7c165ed0 0x7f2d7c1682c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d80831640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c0ce480 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.727 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d80831640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c0cd200 con 0x7f2d7c0b6ac0 2023-12-08T08:20:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d80831640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c160cb0 con 0x7f2d7c165ed0 2023-12-08T08:20:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d7ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d7c165ed0 0x7f2d7c1682c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d79d9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2d7c0cfb30 0x7f2d7c0cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60064/0 (socket says 172.21.15.50:60064) 2023-12-08T08:20:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d79d9b640 1 -- 172.21.15.50:0/1393918640 learned_addr learned my addr 172.21.15.50:0/1393918640 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d7ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d7c165ed0 0x7f2d7c1682c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40438/0 (socket says 172.21.15.50:40438) 2023-12-08T08:20:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d7ad9d640 1 -- 172.21.15.50:0/1393918640 >> v1:172.21.15.170:6789/0 conn(0x7f2d7c0b6ac0 legacy=0x7f2d7c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:11.728 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d7ad9d640 1 -- 172.21.15.50:0/1393918640 >> v1:172.21.15.50:6789/0 conn(0x7f2d7c0cfb30 legacy=0x7f2d7c0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d7ad9d640 1 -- 172.21.15.50:0/1393918640 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c0d02b0 con 0x7f2d7c165ed0 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.722+0000 7f2d7959a640 1 -- 172.21.15.50:0/1393918640 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208132359 0 0) 0x7f2d7c0ce480 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.723+0000 7f2d7ad9d640 1 --2- 172.21.15.50:0/1393918640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c1682c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097a0 tx=0x7f2d7402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f1f31da959aa4b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.723+0000 7f2d7959a640 1 -- 172.21.15.50:0/1393918640 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7402f050 con 0x7f2d7c165ed0 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.723+0000 7f2d7959a640 1 -- 172.21.15.50:0/1393918640 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74031700 con 0x7f2d7c165ed0 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.723+0000 7f2d7959a640 1 -- 172.21.15.50:0/1393918640 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74031a90 con 0x7f2d7c165ed0 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.724+0000 7f2d80831640 1 -- 172.21.15.50:0/1393918640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c165ed0 msgr2=0x7f2d7c1682c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.724+0000 7f2d80831640 1 --2- 172.21.15.50:0/1393918640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c1682c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2d740097a0 tx=0x7f2d7402b7a0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.724+0000 7f2d80831640 1 -- 172.21.15.50:0/1393918640 shutdown_connections 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.724+0000 7f2d80831640 1 --2- 172.21.15.50:0/1393918640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c1682c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.724+0000 7f2d80831640 1 -- 172.21.15.50:0/1393918640 >> 172.21.15.50:0/1393918640 conn(0x7f2d7c0d0de0 msgr2=0x7f2d7c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.729 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.724+0000 7f2d80831640 1 -- 172.21.15.50:0/1393918640 shutdown_connections 2023-12-08T08:20:11.730 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.724+0000 7f2d80831640 1 -- 172.21.15.50:0/1393918640 wait complete. 2023-12-08T08:20:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.725+0000 7f2d80831640 1 Processor -- start 2023-12-08T08:20:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.725+0000 7f2d80831640 1 -- start start 2023-12-08T08:20:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d80831640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d7c0b6ac0 0x7f2d7c15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d80831640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c0cfb30 0x7f2d7c158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d80831640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.732 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d80831640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c09ea60 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d80831640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c160390 con 0x7f2d7c165ed0 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d80831640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c160670 con 0x7f2d7c0b6ac0 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d79d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c0cfb30 0x7f2d7c158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d79d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c0cfb30 0x7f2d7c158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40454/0 (socket says 172.21.15.50:40454) 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d79d9b640 1 -- 172.21.15.50:0/1625178474 learned_addr learned my addr 172.21.15.50:0/1625178474 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d7a59c640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d7c0b6ac0 0x7f2d7c15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.726+0000 7f2d7ad9d640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d79d9b640 1 -- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d7c0b6ac0 msgr2=0x7f2d7c15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d79d9b640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d7c0b6ac0 0x7f2d7c15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d79d9b640 1 -- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d7c165ed0 msgr2=0x7f2d7c159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d79d9b640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d79d9b640 1 -- 172.21.15.50:0/1625178474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009400 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d7a59c640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d7c0b6ac0 0x7f2d7c15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d7ad9d640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:11.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d79d9b640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c0cfb30 0x7f2d7c158ed0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c430 tx=0x7f2d6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d72ffd640 1 -- 172.21.15.50:0/1625178474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d640074e0 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d72ffd640 1 -- 172.21.15.50:0/1625178474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d64007660 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c0c7eb0 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d72ffd640 1 -- 172.21.15.50:0/1625178474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64004a20 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.727+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c15a170 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.728+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c0c83d0 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.728+0000 7f2d72ffd640 1 -- 172.21.15.50:0/1625178474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d64004b80 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.729+0000 7f2d72ffd640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d5c06ae70 0x7f2d5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.729+0000 7f2d72ffd640 1 -- 172.21.15.50:0/1625178474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f2d64089770 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.729+0000 7f2d7a59c640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d5c06ae70 0x7f2d5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:11.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.729+0000 7f2d7a59c640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d5c06ae70 0x7f2d5c06d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009fc0 tx=0x7f2d6c009550 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:11.735 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.733+0000 7f2d72ffd640 1 -- 172.21.15.50:0/1625178474 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d7c0c83d0 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.949+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d7c0c83d0 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.950+0000 7f2d72ffd640 1 -- 172.21.15.50:0/1625178474 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4912 (secure 0 0 0) 0x7f2d7c0c83d0 con 0x7f2d7c0cfb30 2023-12-08T08:20:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:11.953 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:19:19.820822+0000","modified":"2023-12-08T08:19:32.200005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/209897774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":209897774},{"type":"v1","addr":"172.21.15.50:6835","nonce":209897774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-08T08:20:11.953 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 17 2023-12-08T08:20:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d5c06ae70 msgr2=0x7f2d5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d5c06ae70 0x7f2d5c06d330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009fc0 tx=0x7f2d6c009550 comp rx=0 tx=0).stop 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c0cfb30 msgr2=0x7f2d7c158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c0cfb30 0x7f2d7c158ed0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c430 tx=0x7f2d6400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 shutdown_connections 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d5c06ae70 0x7f2d5c06d330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d7c0cfb30 0x7f2d7c158ed0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d7c165ed0 0x7f2d7c159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 --2- 172.21.15.50:0/1625178474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d7c0b6ac0 0x7f2d7c15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 >> 172.21.15.50:0/1625178474 conn(0x7f2d7c0d0de0 msgr2=0x7f2d7c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 shutdown_connections 2023-12-08T08:20:11.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:11.952+0000 7f2d80831640 1 -- 172.21.15.50:0/1625178474 wait complete. 2023-12-08T08:20:11.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:12.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.069+0000 7f0a504da640 1 Processor -- start 2023-12-08T08:20:12.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.069+0000 7f0a504da640 1 -- start start 2023-12-08T08:20:12.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.070+0000 7f0a504da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0a480b0cf0 0x7f0a480d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.074 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.070+0000 7f0a504da640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a480d20b0 con 0x7f0a480b1d70 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.070+0000 7f0a504da640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a480d1b80 con 0x7f0a481608a0 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.070+0000 7f0a504da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a480d0620 con 0x7f0a480b0cf0 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.070+0000 7f0a4ea77640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a480b1d70 0x7f0a480cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60066/0 (socket says 172.21.15.50:60066) 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.070+0000 7f0a4ea77640 1 -- 172.21.15.50:0/1704105250 learned_addr learned my addr 172.21.15.50:0/1704105250 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4da75640 1 --2- 172.21.15.50:0/1704105250 >> v2:172.21.15.170:3300/0 conn(0x7f0a480b0cf0 0x7f0a480d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311192375 0 0) 0x7f0a480d20b0 con 0x7f0a480b1d70 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a34003520 con 0x7f0a480b1d70 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068984897 0 0) 0x7f0a34003520 con 0x7f0a480b1d70 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 >> v2:172.21.15.170:3300/0 conn(0x7f0a480b0cf0 msgr2=0x7f0a480d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 --2- 172.21.15.50:0/1704105250 >> v2:172.21.15.170:3300/0 conn(0x7f0a480b0cf0 0x7f0a480d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 >> v1:172.21.15.170:6789/0 conn(0x7f0a481608a0 legacy=0x7f0a480d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480d1dd0 con 0x7f0a480b1d70 2023-12-08T08:20:12.075 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f0a400019f0 con 0x7f0a480b1d70 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 >> v1:172.21.15.50:6789/0 conn(0x7f0a480b1d70 legacy=0x7f0a480cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a34003970 0x7f0a34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340047c0 0x7f0a34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34005180 0x7f0a3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480d0620 con 0x7f0a34005180 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3400c120 con 0x7f0a34003970 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3400c2e0 con 0x7f0a340047c0 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4ea77640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34005180 0x7f0a3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4e276640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a34003970 0x7f0a34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4da75640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340047c0 0x7f0a34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4ea77640 1 -- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340047c0 msgr2=0x7f0a34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4ea77640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340047c0 0x7f0a34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4ea77640 1 -- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a34003970 msgr2=0x7f0a34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4ea77640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a34003970 0x7f0a34003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.071+0000 7f0a4ea77640 1 -- 172.21.15.50:0/1704105250 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a34003520 con 0x7f0a34005180 2023-12-08T08:20:12.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.072+0000 7f0a4ea77640 1 -- 172.21.15.50:0/1704105250 reap_dead start 2023-12-08T08:20:12.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.072+0000 7f0a4ea77640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34005180 0x7f0a3400b980 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000a820 tx=0x7f0a340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdeb0334a89fdca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.072+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400072d0 con 0x7f0a34005180 2023-12-08T08:20:12.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.072+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4002f070 con 0x7f0a34005180 2023-12-08T08:20:12.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.072+0000 7f0a4d274640 1 -- 172.21.15.50:0/1704105250 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400076b0 con 0x7f0a34005180 2023-12-08T08:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.073+0000 7f0a504da640 1 -- 172.21.15.50:0/1704105250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34005180 msgr2=0x7f0a3400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.073+0000 7f0a504da640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34005180 0x7f0a3400b980 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000a820 tx=0x7f0a340057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.073+0000 7f0a504da640 1 -- 172.21.15.50:0/1704105250 shutdown_connections 2023-12-08T08:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.073+0000 7f0a504da640 1 --2- 172.21.15.50:0/1704105250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a34005180 0x7f0a3400b980 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.073+0000 7f0a504da640 1 -- 172.21.15.50:0/1704105250 >> 172.21.15.50:0/1704105250 conn(0x7f0a480d3030 msgr2=0x7f0a480d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.073+0000 7f0a504da640 1 -- 172.21.15.50:0/1704105250 shutdown_connections 2023-12-08T08:20:12.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.073+0000 7f0a504da640 1 -- 172.21.15.50:0/1704105250 wait complete. 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.074+0000 7f0a504da640 1 Processor -- start 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.074+0000 7f0a504da640 1 -- start start 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a504da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a34005180 0x7f0a480c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a504da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a480c93a0 0x7f0a480c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a504da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a480cb150 0x7f0a480cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a504da640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480c8a40 con 0x7f0a480cb150 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a504da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480c8120 con 0x7f0a480c93a0 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a504da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480c83a0 con 0x7f0a34005180 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a4ea77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a480cb150 0x7f0a480cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a4ea77640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a480cb150 0x7f0a480cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40458/0 (socket says 172.21.15.50:40458) 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a4ea77640 1 -- 172.21.15.50:0/4229011649 learned_addr learned my addr 172.21.15.50:0/4229011649 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a4da75640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a480c93a0 0x7f0a480c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.075+0000 7f0a4e276640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a34005180 0x7f0a480c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a4ea77640 1 -- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a34005180 msgr2=0x7f0a480c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a4ea77640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a34005180 0x7f0a480c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a4ea77640 1 -- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a480c93a0 msgr2=0x7f0a480c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a4ea77640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a480c93a0 0x7f0a480c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a4ea77640 1 -- 172.21.15.50:0/4229011649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480cc890 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a4ea77640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a480cb150 0x7f0a480cb5d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000f80 tx=0x7f0a480b26a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a3effd640 1 -- 172.21.15.50:0/4229011649 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400019b0 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a3effd640 1 -- 172.21.15.50:0/4229011649 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40001250 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a3effd640 1 -- 172.21.15.50:0/4229011649 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40004d60 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a480c8660 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.076+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a480c9d60 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.077+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a480c9f50 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.077+0000 7f0a3effd640 1 -- 172.21.15.50:0/4229011649 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a40031030 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.078+0000 7f0a3effd640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2c06ae40 0x7f0a2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.078+0000 7f0a3effd640 1 -- 172.21.15.50:0/4229011649 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7f0a400ab3a0 con 0x7f0a480cb150 2023-12-08T08:20:12.082 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.078+0000 7f0a4e276640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2c06ae40 0x7f0a2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.083 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.078+0000 7f0a4e276640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2c06ae40 0x7f0a2c06d300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000c00 tx=0x7f0a44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.082+0000 7f0a3effd640 1 -- 172.21.15.50:0/4229011649 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a400761f0 con 0x7f0a480cb150 2023-12-08T08:20:12.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.260+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a480c9f50 con 0x7f0a480cb150 2023-12-08T08:20:12.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.261+0000 7f0a3effd640 1 -- 172.21.15.50:0/4229011649 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18546 (secure 0 0 0) 0x7f0a40079810 con 0x7f0a480cb150 2023-12-08T08:20:12.263 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:12.264 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":43,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:19:38.869408+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:19:18.367216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-08T08:19:18.792176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-08T08:19:31.441584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2c06ae40 msgr2=0x7f0a2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2c06ae40 0x7f0a2c06d300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000c00 tx=0x7f0a44009040 comp rx=0 tx=0).stop 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a480cb150 msgr2=0x7f0a480cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a480cb150 0x7f0a480cb5d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000f80 tx=0x7f0a480b26a0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 shutdown_connections 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f0a2c06ae40 0x7f0a2c06d300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a480cb150 0x7f0a480cb5d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a480c93a0 0x7f0a480c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 --2- 172.21.15.50:0/4229011649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a34005180 0x7f0a480c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 >> 172.21.15.50:0/4229011649 conn(0x7f0a480d3030 msgr2=0x7f0a480b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 shutdown_connections 2023-12-08T08:20:12.267 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.263+0000 7f0a504da640 1 -- 172.21.15.50:0/4229011649 wait complete. 2023-12-08T08:20:12.277 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:20:12.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.382+0000 7fded6a94640 1 Processor -- start 2023-12-08T08:20:12.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.382+0000 7fded6a94640 1 -- start start 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fded6a94640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fded015d580 0x7fded00d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fded6a94640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded015ee90 con 0x7fded00d3ad0 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fded6a94640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded00d0fe0 con 0x7fded015f890 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fded6a94640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded00d1280 con 0x7fded015d580 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fded00d3ad0 0x7fded015f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60076/0 (socket says 172.21.15.50:60076) 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecffff640 1 -- 172.21.15.50:0/2721951706 learned_addr learned my addr 172.21.15.50:0/2721951706 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fded4830640 1 --2- 172.21.15.50:0/2721951706 >> v2:172.21.15.170:3300/0 conn(0x7fded015d580 0x7fded00d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879781264 0 0) 0x7fded015ee90 con 0x7fded00d3ad0 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec0003520 con 0x7fded00d3ad0 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417415887 0 0) 0x7fded00d0fe0 con 0x7fded015f890 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded015ee90 con 0x7fded015f890 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3240228310 0 0) 0x7fdec0003520 con 0x7fded00d3ad0 2023-12-08T08:20:12.388 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 >> v2:172.21.15.170:3300/0 conn(0x7fded015d580 msgr2=0x7fded00d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 --2- 172.21.15.50:0/2721951706 >> v2:172.21.15.170:3300/0 conn(0x7fded015d580 0x7fded00d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 >> v1:172.21.15.170:6789/0 conn(0x7fded015f890 legacy=0x7fded015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00d1560 con 0x7fded00d3ad0 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fdebc001670 con 0x7fded00d3ad0 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 >> v1:172.21.15.50:6789/0 conn(0x7fded00d3ad0 legacy=0x7fded015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0003b00 0x7fdec0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00047c0 0x7fdec0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0005180 0x7fdec000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00d1280 con 0x7fdec0005180 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec000c0b0 con 0x7fdec0003b00 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec000c270 con 0x7fdec00047c0 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.383+0000 7fded4830640 1 --2- 172.21.15.50:0/2721951706 >> v2:172.21.15.170:3300/0 conn(0x7fded015d580 0x7fded00d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:12.389 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded5031640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0005180 0x7fdec000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fdecffff640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00047c0 0x7fdec0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded4830640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0003b00 0x7fdec0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded5031640 1 -- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00047c0 msgr2=0x7fdec0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded5031640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec00047c0 0x7fdec0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded5031640 1 -- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0003b00 msgr2=0x7fdec0003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded5031640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdec0003b00 0x7fdec0003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded5031640 1 -- 172.21.15.50:0/2721951706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0003520 con 0x7fdec0005180 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.384+0000 7fded5031640 1 -- 172.21.15.50:0/2721951706 reap_dead start 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded5031640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0005180 0x7fdec000b980 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdec8001fc0 tx=0x7fdec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb982afc37fec22b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8003b70 con 0x7fdec0005180 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8003cd0 con 0x7fdec0005180 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fdecf7fe640 1 -- 172.21.15.50:0/2721951706 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8005310 con 0x7fdec0005180 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded6a94640 1 -- 172.21.15.50:0/2721951706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0005180 msgr2=0x7fdec000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded6a94640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0005180 0x7fdec000b980 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdec8001fc0 tx=0x7fdec00057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.390 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded6a94640 1 -- 172.21.15.50:0/2721951706 shutdown_connections 2023-12-08T08:20:12.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded6a94640 1 --2- 172.21.15.50:0/2721951706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdec0005180 0x7fdec000b980 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded6a94640 1 -- 172.21.15.50:0/2721951706 >> 172.21.15.50:0/2721951706 conn(0x7fded00d2fb0 msgr2=0x7fded00d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded6a94640 1 -- 172.21.15.50:0/2721951706 shutdown_connections 2023-12-08T08:20:12.391 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.385+0000 7fded6a94640 1 -- 172.21.15.50:0/2721951706 wait complete. 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.386+0000 7fded6a94640 1 Processor -- start 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.386+0000 7fded6a94640 1 -- start start 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fded6a94640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec0005180 0x7fded0160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fded6a94640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded00cc950 0x7fded00cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fded6a94640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded014e490 0x7fded00b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fded6a94640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00ccdd0 con 0x7fded00cc950 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fded6a94640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded00cc4c0 con 0x7fded014e490 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fded6a94640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded00cb610 con 0x7fdec0005180 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fdecffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded00cc950 0x7fded00cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fdecffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded00cc950 0x7fded00cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40470/0 (socket says 172.21.15.50:40470) 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.387+0000 7fdecffff640 1 -- 172.21.15.50:0/1121444098 learned_addr learned my addr 172.21.15.50:0/1121444098 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:12.394 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fded5031640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded014e490 0x7fded00b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fded4830640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec0005180 0x7fded0160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecffff640 1 -- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec0005180 msgr2=0x7fded0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecffff640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec0005180 0x7fded0160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecffff640 1 -- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded014e490 msgr2=0x7fded00b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecffff640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded014e490 0x7fded00b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecffff640 1 -- 172.21.15.50:0/1121444098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00cb8b0 con 0x7fded00cc950 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fded5031640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded014e490 0x7fded00b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecffff640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded00cc950 0x7fded00cb0d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00e760 tx=0x7fdebc00eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecd7fa640 1 -- 172.21.15.50:0/1121444098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00c6c0 con 0x7fded00cc950 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecd7fa640 1 -- 172.21.15.50:0/1121444098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc00c820 con 0x7fded00cc950 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded00cbb90 con 0x7fded00cc950 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fdecd7fa640 1 -- 172.21.15.50:0/1121444098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00cbd0 con 0x7fded00cc950 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.388+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded00cc150 con 0x7fded00cc950 2023-12-08T08:20:12.395 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.389+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded00d09d0 con 0x7fded00cc950 2023-12-08T08:20:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.390+0000 7fdecd7fa640 1 -- 172.21.15.50:0/1121444098 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdebc00cd30 con 0x7fded00cc950 2023-12-08T08:20:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.390+0000 7fdecd7fa640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdeb406ae40 0x7fdeb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.390+0000 7fdecd7fa640 1 -- 172.21.15.50:0/1121444098 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6453+0+0 (secure 0 0 0) 0x7fdebc089850 con 0x7fded00cc950 2023-12-08T08:20:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.390+0000 7fded4830640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdeb406ae40 0x7fdeb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.391+0000 7fded4830640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdeb406ae40 0x7fdeb406d300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009b20 tx=0x7fdec4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.396 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.394+0000 7fdecd7fa640 1 -- 172.21.15.50:0/1121444098 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdebc054610 con 0x7fded00cc950 2023-12-08T08:20:12.610 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.608+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fded00cc2e0 con 0x7fded00cc950 2023-12-08T08:20:12.610 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-08T08:20:12.608+0000 7fd76af52640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:20:12.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.609+0000 7fdecd7fa640 1 -- 172.21.15.50:0/1121444098 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdebc057c30 con 0x7fded00cc950 2023-12-08T08:20:12.612 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdeb406ae40 msgr2=0x7fdeb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdeb406ae40 0x7fdeb406d300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009b20 tx=0x7fdec4008040 comp rx=0 tx=0).stop 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded00cc950 msgr2=0x7fded00cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded00cc950 0x7fded00cb0d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00e760 tx=0x7fdebc00eb60 comp rx=0 tx=0).stop 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 shutdown_connections 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdeb406ae40 0x7fdeb406d300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fded00cc950 0x7fded00cb0d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded014e490 0x7fded00b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 --2- 172.21.15.50:0/1121444098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdec0005180 0x7fded0160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 >> 172.21.15.50:0/1121444098 conn(0x7fded00d2fb0 msgr2=0x7fded015c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 shutdown_connections 2023-12-08T08:20:12.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.612+0000 7fded6a94640 1 -- 172.21.15.50:0/1121444098 wait complete. 2023-12-08T08:20:12.617 INFO:tasks.ceph.mds.a.smithi050.stderr: -3836> 2023-12-08T08:19:25.439+0000 7fb407f3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:20:12.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:20:12.647 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-08T08:20:12.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.734+0000 7fa8bd644640 1 Processor -- start 2023-12-08T08:20:12.736 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.734+0000 7fa8bd644640 1 -- start start 2023-12-08T08:20:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.734+0000 7fa8bd644640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8b815d4f0 0x7fa8b80b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.734+0000 7fa8bd644640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b80b0920 0x7fa8b80b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.737 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.734+0000 7fa8bd644640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b80b2280 con 0x7fa8b80adb50 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.734+0000 7fa8bd644640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b806bb40 con 0x7fa8b815d4f0 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.734+0000 7fa8bd644640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80b2710 con 0x7fa8b80b0920 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8b815d4f0 0x7fa8b80b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa8b80adb50 0x7fa8b80adfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60082/0 (socket says 172.21.15.50:60082) 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b77fe640 1 -- 172.21.15.50:0/1746237316 learned_addr learned my addr 172.21.15.50:0/1746237316 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b6ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa8b815d4f0 0x7fa8b80b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40482/0 (socket says 172.21.15.50:40482) 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b67fc640 1 --2- 172.21.15.50:0/1746237316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b80b0920 0x7fa8b80b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b6ffd640 1 -- 172.21.15.50:0/1746237316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b80b0920 msgr2=0x7fa8b80b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b6ffd640 1 --2- 172.21.15.50:0/1746237316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b80b0920 0x7fa8b80b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b6ffd640 1 -- 172.21.15.50:0/1746237316 >> v1:172.21.15.50:6789/0 conn(0x7fa8b80adb50 legacy=0x7fa8b80adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b6ffd640 1 -- 172.21.15.50:0/1746237316 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80b1690 con 0x7fa8b815d4f0 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b5ffb640 1 -- 172.21.15.50:0/1746237316 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710784027 0 0) 0x7fa8b80b2280 con 0x7fa8b80adb50 2023-12-08T08:20:12.738 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.735+0000 7fa8b67fc640 1 --2- 172.21.15.50:0/1746237316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b80b0920 0x7fa8b80b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.736+0000 7fa8b6ffd640 1 --2- 172.21.15.50:0/1746237316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b815d4f0 0x7fa8b80b03e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009d90 tx=0x7fa8a802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4454f4e33dc2b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.736+0000 7fa8b5ffb640 1 -- 172.21.15.50:0/1746237316 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a802cc50 con 0x7fa8b815d4f0 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.736+0000 7fa8b5ffb640 1 -- 172.21.15.50:0/1746237316 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a802cdb0 con 0x7fa8b815d4f0 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.736+0000 7fa8b5ffb640 1 -- 172.21.15.50:0/1746237316 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8034660 con 0x7fa8b815d4f0 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.736+0000 7fa8bd644640 1 -- 172.21.15.50:0/1746237316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b815d4f0 msgr2=0x7fa8b80b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.736+0000 7fa8bd644640 1 --2- 172.21.15.50:0/1746237316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b815d4f0 0x7fa8b80b03e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009d90 tx=0x7fa8a802bea0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.737+0000 7fa8bd644640 1 -- 172.21.15.50:0/1746237316 shutdown_connections 2023-12-08T08:20:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.737+0000 7fa8bd644640 1 --2- 172.21.15.50:0/1746237316 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b80b0920 0x7fa8b80b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.737+0000 7fa8bd644640 1 --2- 172.21.15.50:0/1746237316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b815d4f0 0x7fa8b80b03e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.737+0000 7fa8bd644640 1 -- 172.21.15.50:0/1746237316 >> 172.21.15.50:0/1746237316 conn(0x7fa8b80d0e00 msgr2=0x7fa8b80d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.737+0000 7fa8bd644640 1 -- 172.21.15.50:0/1746237316 shutdown_connections 2023-12-08T08:20:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.737+0000 7fa8bd644640 1 -- 172.21.15.50:0/1746237316 wait complete. 2023-12-08T08:20:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.738+0000 7fa8bd644640 1 Processor -- start 2023-12-08T08:20:12.741 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.738+0000 7fa8bd644640 1 -- start start 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8bd644640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b80adb50 0x7fa8b80c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8bd644640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b80b0920 0x7fa8b81f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8bd644640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b815d4f0 0x7fa8b81f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8bd644640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80caeb0 con 0x7fa8b80b0920 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8bd644640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80ce370 con 0x7fa8b80adb50 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8bd644640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80c9720 con 0x7fa8b815d4f0 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b80b0920 0x7fa8b81f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.743 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b80b0920 0x7fa8b81f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40486/0 (socket says 172.21.15.50:40486) 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 -- 172.21.15.50:0/2687657652 learned_addr learned my addr 172.21.15.50:0/2687657652 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b6ffd640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b80adb50 0x7fa8b80c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b77fe640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b815d4f0 0x7fa8b81f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 -- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b815d4f0 msgr2=0x7fa8b81f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b815d4f0 0x7fa8b81f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 -- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b80adb50 msgr2=0x7fa8b80c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b80adb50 0x7fa8b80c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 -- 172.21.15.50:0/2687657652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a8009a70 con 0x7fa8b80b0920 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b77fe640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b815d4f0 0x7fa8b81f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8b67fc640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b80b0920 0x7fa8b81f7220 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00e730 tx=0x7fa8ac00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa89f7fe640 1 -- 172.21.15.50:0/2687657652 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac004230 con 0x7fa8b80b0920 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa89f7fe640 1 -- 172.21.15.50:0/2687657652 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac004390 con 0x7fa8b80b0920 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.739+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b80cabd0 con 0x7fa8b80b0920 2023-12-08T08:20:12.744 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.740+0000 7fa89f7fe640 1 -- 172.21.15.50:0/2687657652 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00c8f0 con 0x7fa8b80b0920 2023-12-08T08:20:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.740+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b80cd3e0 con 0x7fa8b80b0920 2023-12-08T08:20:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.740+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b806cf00 con 0x7fa8b80b0920 2023-12-08T08:20:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.741+0000 7fa89f7fe640 1 -- 172.21.15.50:0/2687657652 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8ac00ca50 con 0x7fa8b80b0920 2023-12-08T08:20:12.745 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.741+0000 7fa89f7fe640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa8a406ae40 0x7fa8a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:12.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.741+0000 7fa89f7fe640 1 -- 172.21.15.50:0/2687657652 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6539+0+0 (secure 0 0 0) 0x7fa8ac089550 con 0x7fa8b80b0920 2023-12-08T08:20:12.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.742+0000 7fa8b6ffd640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa8a406ae40 0x7fa8a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:12.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.742+0000 7fa8b6ffd640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa8a406ae40 0x7fa8a406d300 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8036000 tx=0x7fa8a8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:12.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.746+0000 7fa89f7fe640 1 -- 172.21.15.50:0/2687657652 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8ac0542f0 con 0x7fa8b80b0920 2023-12-08T08:20:12.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:12.963+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa8b80ccf60 con 0x7fa8b80b0920 2023-12-08T08:20:13.613 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.611+0000 7fa89f7fe640 1 -- 172.21.15.50:0/2687657652 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8b80ccf60 con 0x7fa8b80b0920 2023-12-08T08:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.613+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa8a406ae40 msgr2=0x7fa8a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.613+0000 7fa8bd644640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa8a406ae40 0x7fa8a406d300 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8036000 tx=0x7fa8a8030000 comp rx=0 tx=0).stop 2023-12-08T08:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.613+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b80b0920 msgr2=0x7fa8b81f7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.613+0000 7fa8bd644640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b80b0920 0x7fa8b81f7220 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00e730 tx=0x7fa8ac00ebf0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.613+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 shutdown_connections 2023-12-08T08:20:13.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.613+0000 7fa8bd644640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa8a406ae40 0x7fa8a406d300 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.614+0000 7fa8bd644640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa8b80b0920 0x7fa8b81f7220 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.614+0000 7fa8bd644640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8b815d4f0 0x7fa8b81f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.614+0000 7fa8bd644640 1 --2- 172.21.15.50:0/2687657652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8b80adb50 0x7fa8b80c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.614+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 >> 172.21.15.50:0/2687657652 conn(0x7fa8b80d0e00 msgr2=0x7fa8b806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.614+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 shutdown_connections 2023-12-08T08:20:13.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.614+0000 7fa8bd644640 1 -- 172.21.15.50:0/2687657652 wait complete. 2023-12-08T08:20:13.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:20:13.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.785+0000 7f62695e5640 1 Processor -- start 2023-12-08T08:20:13.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.785+0000 7f62695e5640 1 -- start start 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62695e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f626415d510 0x7f626415e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62695e5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f626415eaa0 0x7f62640cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62695e5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62640ce540 con 0x7f62640cdc00 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62695e5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62640ce090 con 0x7f626415eaa0 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62695e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626406b950 con 0x7f626415d510 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62637fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f62640cdc00 0x7f6264161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60088/0 (socket says 172.21.15.50:60088) 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62637fe640 1 -- 172.21.15.50:0/910320175 learned_addr learned my addr 172.21.15.50:0/910320175 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f625a7fc640 1 --2- 172.21.15.50:0/910320175 >> v2:172.21.15.170:3300/0 conn(0x7f626415eaa0 0x7f62640cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f6262ffd640 1 --2- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f626415d510 0x7f626415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62627fc640 1 -- 172.21.15.50:0/910320175 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223212185 0 0) 0x7f62640ce540 con 0x7f62640cdc00 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62627fc640 1 -- 172.21.15.50:0/910320175 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6250003520 con 0x7f62640cdc00 2023-12-08T08:20:13.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f625a7fc640 1 -- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f626415d510 msgr2=0x7f626415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f625a7fc640 1 --2- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f626415d510 0x7f626415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f62627fc640 1 -- 172.21.15.50:0/910320175 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3932040023 0 0) 0x7f6250003520 con 0x7f62640cdc00 2023-12-08T08:20:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f625a7fc640 1 -- 172.21.15.50:0/910320175 >> v1:172.21.15.50:6789/0 conn(0x7f62640cdc00 legacy=0x7f6264161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.786+0000 7f625a7fc640 1 -- 172.21.15.50:0/910320175 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626406bc30 con 0x7f626415eaa0 2023-12-08T08:20:13.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.787+0000 7f625a7fc640 1 --2- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 0x7f62640cd6c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f624c0097a0 tx=0x7f624c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a48fbbcf1ece56f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.787+0000 7f62627fc640 1 -- 172.21.15.50:0/910320175 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0019f0 con 0x7f626415eaa0 2023-12-08T08:20:13.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.787+0000 7f62627fc640 1 -- 172.21.15.50:0/910320175 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c02e050 con 0x7f626415eaa0 2023-12-08T08:20:13.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62627fc640 1 -- 172.21.15.50:0/910320175 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c030730 con 0x7f626415eaa0 2023-12-08T08:20:13.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 -- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 msgr2=0x7f62640cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 --2- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 0x7f62640cd6c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f624c0097a0 tx=0x7f624c02b790 comp rx=0 tx=0).stop 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 -- 172.21.15.50:0/910320175 shutdown_connections 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 --2- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 0x7f62640cd6c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 --2- 172.21.15.50:0/910320175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f626415d510 0x7f626415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 -- 172.21.15.50:0/910320175 >> 172.21.15.50:0/910320175 conn(0x7f62640d0d90 msgr2=0x7f62640d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 -- 172.21.15.50:0/910320175 shutdown_connections 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.788+0000 7f62695e5640 1 -- 172.21.15.50:0/910320175 wait complete. 2023-12-08T08:20:13.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.789+0000 7f62695e5640 1 Processor -- start 2023-12-08T08:20:13.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f62695e5640 1 -- start start 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f62695e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62640cdc00 0x7f62640b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f62695e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f626415d510 0x7f6264161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f62695e5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 0x7f626414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f62695e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62640b4b80 con 0x7f626415d510 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f62695e5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626414c560 con 0x7f626415eaa0 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f62695e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62640b3f70 con 0x7f62640cdc00 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f625a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f626415d510 0x7f6264161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f625a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f626415d510 0x7f6264161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40492/0 (socket says 172.21.15.50:40492) 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.790+0000 7f625a7fc640 1 -- 172.21.15.50:0/2570560953 learned_addr learned my addr 172.21.15.50:0/2570560953 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f62637fe640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 0x7f626414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f6262ffd640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62640cdc00 0x7f62640b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625a7fc640 1 -- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62640cdc00 msgr2=0x7f62640b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625a7fc640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62640cdc00 0x7f62640b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625a7fc640 1 -- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 msgr2=0x7f626414c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625a7fc640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 0x7f626414c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625a7fc640 1 -- 172.21.15.50:0/2570560953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c009400 con 0x7f626415d510 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625a7fc640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f626415d510 0x7f6264161220 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f624c035040 tx=0x7f624c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625bfff640 1 -- 172.21.15.50:0/2570560953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c03b810 con 0x7f626415d510 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625bfff640 1 -- 172.21.15.50:0/2570560953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c03b990 con 0x7f626415d510 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640b4250 con 0x7f626415d510 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f625bfff640 1 -- 172.21.15.50:0/2570560953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c03bd40 con 0x7f626415d510 2023-12-08T08:20:13.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.791+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62640b4810 con 0x7f626415d510 2023-12-08T08:20:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.792+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62640ce7b0 con 0x7f626415d510 2023-12-08T08:20:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.793+0000 7f625bfff640 1 -- 172.21.15.50:0/2570560953 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f624c039040 con 0x7f626415d510 2023-12-08T08:20:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.793+0000 7f625bfff640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f624406ae40 0x7f624406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.793+0000 7f625bfff640 1 -- 172.21.15.50:0/2570560953 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6539+0+0 (secure 0 0 0) 0x7f624c0aacc0 con 0x7f626415d510 2023-12-08T08:20:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.793+0000 7f6262ffd640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f624406ae40 0x7f624406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:13.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.794+0000 7f6262ffd640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f624406ae40 0x7f624406d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6254009970 tx=0x7f6254008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:13.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.797+0000 7f625bfff640 1 -- 172.21.15.50:0/2570560953 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f624c075a30 con 0x7f626415d510 2023-12-08T08:20:13.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:13.974+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6264067540 con 0x7f626415d510 2023-12-08T08:20:14.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.952+0000 7f625bfff640 1 -- 172.21.15.50:0/2570560953 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f624c037020 con 0x7f626415d510 2023-12-08T08:20:14.954 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:20:14.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f624406ae40 msgr2=0x7f624406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f624406ae40 0x7f624406d300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6254009970 tx=0x7f6254008040 comp rx=0 tx=0).stop 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f626415d510 msgr2=0x7f6264161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f626415d510 0x7f6264161220 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f624c035040 tx=0x7f624c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 shutdown_connections 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f624406ae40 0x7f624406d300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f626415d510 0x7f6264161220 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f626415eaa0 0x7f626414c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 --2- 172.21.15.50:0/2570560953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62640cdc00 0x7f62640b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 >> 172.21.15.50:0/2570560953 conn(0x7f62640d0d90 msgr2=0x7f62640cb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 shutdown_connections 2023-12-08T08:20:14.959 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:14.956+0000 7f62695e5640 1 -- 172.21.15.50:0/2570560953 wait complete. 2023-12-08T08:20:14.972 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:20:15.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.089+0000 7f6589c90640 1 Processor -- start 2023-12-08T08:20:15.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.089+0000 7f6589c90640 1 -- start start 2023-12-08T08:20:15.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f6589c90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 0x7f65840b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f6589c90640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840ce850 con 0x7f65840d36a0 2023-12-08T08:20:15.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f6589c90640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840ceb30 con 0x7f65840d0090 2023-12-08T08:20:15.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f6589c90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840ce640 con 0x7f6584160920 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f6582ffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f65840d36a0 0x7f65840cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60092/0 (socket says 172.21.15.50:60092) 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f6582ffd640 1 -- 172.21.15.50:0/2399672180 learned_addr learned my addr 172.21.15.50:0/2399672180 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f65837fe640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 0x7f65840b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744055527 0 0) 0x7f65840ce850 con 0x7f65840d36a0 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f656c003520 con 0x7f65840d36a0 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857261620 0 0) 0x7f656c003520 con 0x7f65840d36a0 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 msgr2=0x7f65840b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f65827fc640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 0x7f65840b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.090+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 >> v1:172.21.15.170:6789/0 conn(0x7f65840d0090 legacy=0x7f65840b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840cee10 con 0x7f65840d36a0 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f6578001670 con 0x7f65840d36a0 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 >> v1:172.21.15.50:6789/0 conn(0x7f65840d36a0 legacy=0x7f65840cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f656c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 0x7f656c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f656c004d00 0x7f656c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840ce640 con 0x7f656c0039a0 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c00bab0 con 0x7f656c004d00 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c00bc70 con 0x7f6584160920 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65837fe640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f656c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f6582ffd640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 0x7f656c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f6583fff640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f656c004d00 0x7f656c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65837fe640 1 -- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 msgr2=0x7f656c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65837fe640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 0x7f656c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65837fe640 1 -- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f656c004d00 msgr2=0x7f656c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65837fe640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f656c004d00 0x7f656c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f65837fe640 1 -- 172.21.15.50:0/2399672180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c003520 con 0x7f656c0039a0 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.091+0000 7f6582ffd640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6584160920 0x7f656c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f65837fe640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f656c003dc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6574009ac0 tx=0x7f656c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d2895c13388c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657402c600 con 0x7f656c0039a0 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657402c760 con 0x7f656c0039a0 2023-12-08T08:20:15.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f65827fc640 1 -- 172.21.15.50:0/2399672180 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657402caf0 con 0x7f656c0039a0 2023-12-08T08:20:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f6589c90640 1 -- 172.21.15.50:0/2399672180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 msgr2=0x7f656c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f6589c90640 1 --2- 172.21.15.50:0/2399672180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f656c003dc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6574009ac0 tx=0x7f656c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f6583fff640 1 -- 172.21.15.50:0/2399672180 reap_dead start 2023-12-08T08:20:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f6589c90640 1 -- 172.21.15.50:0/2399672180 shutdown_connections 2023-12-08T08:20:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f6589c90640 1 -- 172.21.15.50:0/2399672180 >> 172.21.15.50:0/2399672180 conn(0x7f658409c340 msgr2=0x7f65840d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f6589c90640 1 -- 172.21.15.50:0/2399672180 shutdown_connections 2023-12-08T08:20:15.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.092+0000 7f6589c90640 1 -- 172.21.15.50:0/2399672180 wait complete. 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.094+0000 7f6589c90640 1 Processor -- start 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.094+0000 7f6589c90640 1 -- start start 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6589c90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f65841f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6589c90640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6584155ec0 0x7f65841551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6589c90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65840cce20 0x7f6584155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6589c90640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584155c60 con 0x7f656c0039a0 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6589c90640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65841f36d0 con 0x7f6584155ec0 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6589c90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65841e6600 con 0x7f65840cce20 2023-12-08T08:20:15.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f65841f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f65841f3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40498/0 (socket says 172.21.15.50:40498) 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 -- 172.21.15.50:0/853147875 learned_addr learned my addr 172.21.15.50:0/853147875 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6583fff640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65840cce20 0x7f6584155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6582ffd640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6584155ec0 0x7f65841551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 -- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65840cce20 msgr2=0x7f6584155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65840cce20 0x7f6584155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 -- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6584155ec0 msgr2=0x7f65841551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6584155ec0 0x7f65841551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 -- 172.21.15.50:0/853147875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65841e68e0 con 0x7f656c0039a0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f65837fe640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f65841f3190 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f657402c1a0 tx=0x7f6574004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f656bfff640 1 -- 172.21.15.50:0/853147875 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6574003810 con 0x7f656c0039a0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f656bfff640 1 -- 172.21.15.50:0/853147875 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6574003970 con 0x7f656c0039a0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65841e6bc0 con 0x7f656c0039a0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.095+0000 7f656bfff640 1 -- 172.21.15.50:0/853147875 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6574003ce0 con 0x7f656c0039a0 2023-12-08T08:20:15.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.096+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65840cd300 con 0x7f656c0039a0 2023-12-08T08:20:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.096+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6584067540 con 0x7f656c0039a0 2023-12-08T08:20:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.097+0000 7f656bfff640 1 -- 172.21.15.50:0/853147875 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6574034440 con 0x7f656c0039a0 2023-12-08T08:20:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.097+0000 7f656bfff640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f657006ae40 0x7f657006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.097+0000 7f656bfff640 1 -- 172.21.15.50:0/853147875 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f65740ab5c0 con 0x7f656c0039a0 2023-12-08T08:20:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.097+0000 7f6582ffd640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f657006ae40 0x7f657006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.098+0000 7f6582ffd640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f657006ae40 0x7f657006d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65780017e0 tx=0x7f6578007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:15.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.101+0000 7f656bfff640 1 -- 172.21.15.50:0/853147875 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65740766b0 con 0x7f656c0039a0 2023-12-08T08:20:15.280 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.278+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65840b80b0 con 0x7f656c0039a0 2023-12-08T08:20:15.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.953+0000 7f656bfff640 1 -- 172.21.15.50:0/853147875 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f65740044e0 con 0x7f656c0039a0 2023-12-08T08:20:15.956 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-08T08:20:15.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.957+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f657006ae40 msgr2=0x7f657006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.957+0000 7f6589c90640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f657006ae40 0x7f657006d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65780017e0 tx=0x7f6578007040 comp rx=0 tx=0).stop 2023-12-08T08:20:15.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.957+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 msgr2=0x7f65841f3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:15.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.957+0000 7f6589c90640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f65841f3190 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f657402c1a0 tx=0x7f6574004730 comp rx=0 tx=0).stop 2023-12-08T08:20:15.960 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 shutdown_connections 2023-12-08T08:20:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f657006ae40 0x7f657006d300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65840cce20 0x7f6584155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6584155ec0 0x7f65841551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 --2- 172.21.15.50:0/853147875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f656c0039a0 0x7f65841f3190 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 >> 172.21.15.50:0/853147875 conn(0x7f658409c340 msgr2=0x7f658415db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 shutdown_connections 2023-12-08T08:20:15.961 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:15.958+0000 7f6589c90640 1 -- 172.21.15.50:0/853147875 wait complete. 2023-12-08T08:20:15.976 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-12-08T08:20:16.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.090+0000 7f2d57748640 1 Processor -- start 2023-12-08T08:20:16.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.090+0000 7f2d57748640 1 -- start start 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d57748640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d5015e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d57748640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d5015eaa0 0x7f2d500cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d57748640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2d500cdc00 0x7f2d50161080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d57748640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500ce090 con 0x7f2d5015eaa0 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d57748640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500ce540 con 0x7f2d500cdc00 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d57748640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5006b950 con 0x7f2d5015d510 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d54ce3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d5015eaa0 0x7f2d500cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d54ce3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2d5015eaa0 0x7f2d500cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40508/0 (socket says 172.21.15.50:40508) 2023-12-08T08:20:16.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d54ce3640 1 -- 172.21.15.50:0/2918636876 learned_addr learned my addr 172.21.15.50:0/2918636876 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d554e4640 1 --2- 172.21.15.50:0/2918636876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d5015e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.091+0000 7f2d55ce5640 1 --2- 172.21.15.50:0/2918636876 >> v2:172.21.15.170:3300/0 conn(0x7f2d500cdc00 0x7f2d50161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.092+0000 7f2d54ce3640 1 -- 172.21.15.50:0/2918636876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 msgr2=0x7f2d5015e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.092+0000 7f2d54ce3640 1 --2- 172.21.15.50:0/2918636876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d5015e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.092+0000 7f2d54ce3640 1 -- 172.21.15.50:0/2918636876 >> v2:172.21.15.170:3300/0 conn(0x7f2d500cdc00 msgr2=0x7f2d50161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.092+0000 7f2d54ce3640 1 --2- 172.21.15.50:0/2918636876 >> v2:172.21.15.170:3300/0 conn(0x7f2d500cdc00 0x7f2d50161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.092+0000 7f2d54ce3640 1 -- 172.21.15.50:0/2918636876 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5006bc30 con 0x7f2d5015eaa0 2023-12-08T08:20:16.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.092+0000 7f2d54ce3640 1 --2- 172.21.15.50:0/2918636876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d500cd6c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2d50162120 tx=0x7f2d4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd98bf1597f2a018 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:16.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.092+0000 7f2d47fff640 1 -- 172.21.15.50:0/2918636876 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40031870 con 0x7f2d5015eaa0 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d47fff640 1 -- 172.21.15.50:0/2918636876 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d400319d0 con 0x7f2d5015eaa0 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d47fff640 1 -- 172.21.15.50:0/2918636876 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40031d60 con 0x7f2d5015eaa0 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 -- 172.21.15.50:0/2918636876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 msgr2=0x7f2d500cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 --2- 172.21.15.50:0/2918636876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d500cd6c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2d50162120 tx=0x7f2d4002b910 comp rx=0 tx=0).stop 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 -- 172.21.15.50:0/2918636876 shutdown_connections 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 --2- 172.21.15.50:0/2918636876 >> v2:172.21.15.170:3300/0 conn(0x7f2d500cdc00 0x7f2d50161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 --2- 172.21.15.50:0/2918636876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d500cd6c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 --2- 172.21.15.50:0/2918636876 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d5015e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 -- 172.21.15.50:0/2918636876 >> 172.21.15.50:0/2918636876 conn(0x7f2d500d0d90 msgr2=0x7f2d500d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 -- 172.21.15.50:0/2918636876 shutdown_connections 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.093+0000 7f2d57748640 1 -- 172.21.15.50:0/2918636876 wait complete. 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.094+0000 7f2d57748640 1 Processor -- start 2023-12-08T08:20:16.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.094+0000 7f2d57748640 1 -- start start 2023-12-08T08:20:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d57748640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d500cdc00 0x7f2d500b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d57748640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d500b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d57748640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d5009e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d57748640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5009df90 con 0x7f2d5015eaa0 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d57748640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5009d380 con 0x7f2d500cdc00 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d57748640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5009d660 con 0x7f2d5015d510 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d55ce5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d5009e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d55ce5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d5009e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40514/0 (socket says 172.21.15.50:40514) 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d55ce5640 1 -- 172.21.15.50:0/1703962301 learned_addr learned my addr 172.21.15.50:0/1703962301 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d554e4640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d500cdc00 0x7f2d500b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.095+0000 7f2d54ce3640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d500b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d55ce5640 1 -- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 msgr2=0x7f2d500b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d55ce5640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d500b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d55ce5640 1 -- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d500cdc00 msgr2=0x7f2d500b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d55ce5640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d500cdc00 0x7f2d500b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d55ce5640 1 -- 172.21.15.50:0/1703962301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400094d0 con 0x7f2d5015eaa0 2023-12-08T08:20:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d55ce5640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d5009e420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2d48007d20 tx=0x7f2d4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d45ffb640 1 -- 172.21.15.50:0/1703962301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48014420 con 0x7f2d5015eaa0 2023-12-08T08:20:16.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d45ffb640 1 -- 172.21.15.50:0/1703962301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480145a0 con 0x7f2d5015eaa0 2023-12-08T08:20:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d45ffb640 1 -- 172.21.15.50:0/1703962301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48014950 con 0x7f2d5015eaa0 2023-12-08T08:20:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5009d940 con 0x7f2d5015eaa0 2023-12-08T08:20:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.096+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d500b6990 con 0x7f2d5015eaa0 2023-12-08T08:20:16.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.097+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d500ce7b0 con 0x7f2d5015eaa0 2023-12-08T08:20:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.098+0000 7f2d45ffb640 1 -- 172.21.15.50:0/1703962301 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d48014ab0 con 0x7f2d5015eaa0 2023-12-08T08:20:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.098+0000 7f2d45ffb640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d3406ae40 0x7f2d3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.098+0000 7f2d45ffb640 1 -- 172.21.15.50:0/1703962301 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5658+0+0 (secure 0 0 0) 0x7f2d48089d60 con 0x7f2d5015eaa0 2023-12-08T08:20:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.099+0000 7f2d554e4640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d3406ae40 0x7f2d3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:16.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.100+0000 7f2d554e4640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d3406ae40 0x7f2d3406d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0079a0 tx=0x7f2d4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:16.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.102+0000 7f2d45ffb640 1 -- 172.21.15.50:0/1703962301 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d48054ef0 con 0x7f2d5015eaa0 2023-12-08T08:20:16.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.288+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d500b6b20 con 0x7f2d5015eaa0 2023-12-08T08:20:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.962+0000 7f2d45ffb640 1 -- 172.21.15.50:0/1703962301 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v47) v1 ==== 160+0+0 (secure 0 0 0) 0x7f2d48058510 con 0x7f2d5015eaa0 2023-12-08T08:20:16.965 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'data_new' removed 2023-12-08T08:20:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.965+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d3406ae40 msgr2=0x7f2d3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.965+0000 7f2d57748640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d3406ae40 0x7f2d3406d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0079a0 tx=0x7f2d4c008040 comp rx=0 tx=0).stop 2023-12-08T08:20:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.965+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 msgr2=0x7f2d5009e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:16.968 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.965+0000 7f2d57748640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d5009e420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f2d48007d20 tx=0x7f2d4800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.966+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 shutdown_connections 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.966+0000 7f2d57748640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2d3406ae40 0x7f2d3406d300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.966+0000 7f2d57748640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d5015eaa0 0x7f2d5009e420 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.966+0000 7f2d57748640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2d5015d510 0x7f2d500b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.966+0000 7f2d57748640 1 --2- 172.21.15.50:0/1703962301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2d500cdc00 0x7f2d500b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.966+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 >> 172.21.15.50:0/1703962301 conn(0x7f2d500d0d90 msgr2=0x7f2d500cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.966+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 shutdown_connections 2023-12-08T08:20:16.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:16.967+0000 7f2d57748640 1 -- 172.21.15.50:0/1703962301 wait complete. 2023-12-08T08:20:16.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:20:17.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.090+0000 7f54b981c640 1 Processor -- start 2023-12-08T08:20:17.093 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.090+0000 7f54b981c640 1 -- start start 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b981c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54b4145d80 0x7f54b4071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b981c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f54b406a4d0 0x7f54b406a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b981c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b406ae60 con 0x7f54b40b4920 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b981c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40b4e00 con 0x7f54b4145d80 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b981c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40b50e0 con 0x7f54b406a4d0 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54b4145d80 0x7f54b4071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b2ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f54b4145d80 0x7f54b4071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40520/0 (socket says 172.21.15.50:40520) 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b2ffd640 1 -- 172.21.15.50:0/3116193623 learned_addr learned my addr 172.21.15.50:0/3116193623 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b27fc640 1 --1- 172.21.15.50:0/3116193623 >> v1:172.21.15.50:6789/0 conn(0x7f54b40b4920 0x7f54b40acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60100/0 (socket says 172.21.15.50:60100) 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b2ffd640 1 -- 172.21.15.50:0/3116193623 >> v2:172.21.15.170:3300/0 conn(0x7f54b406a4d0 msgr2=0x7f54b406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b37fe640 1 --2- 172.21.15.50:0/3116193623 >> v2:172.21.15.170:3300/0 conn(0x7f54b406a4d0 0x7f54b406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b2ffd640 1 --2- 172.21.15.50:0/3116193623 >> v2:172.21.15.170:3300/0 conn(0x7f54b406a4d0 0x7f54b406a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.091+0000 7f54b2ffd640 1 -- 172.21.15.50:0/3116193623 >> v1:172.21.15.50:6789/0 conn(0x7f54b40b4920 legacy=0x7f54b40acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.092+0000 7f54b2ffd640 1 -- 172.21.15.50:0/3116193623 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b406cfb0 con 0x7f54b4145d80 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.092+0000 7f54b1ffb640 1 -- 172.21.15.50:0/3116193623 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734015603 0 0) 0x7f549c001110 con 0x7f54b40b4920 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.092+0000 7f54b37fe640 1 --2- 172.21.15.50:0/3116193623 >> v2:172.21.15.170:3300/0 conn(0x7f54b406a4d0 0x7f54b406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.092+0000 7f54b2ffd640 1 --2- 172.21.15.50:0/3116193623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b4145d80 0x7f54b4071ae0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f54b40af940 tx=0x7f54ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c44a217cad4ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.092+0000 7f54b1ffb640 1 -- 172.21.15.50:0/3116193623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac030860 con 0x7f54b4145d80 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.092+0000 7f54b1ffb640 1 -- 172.21.15.50:0/3116193623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac0309c0 con 0x7f54b4145d80 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.092+0000 7f54b1ffb640 1 -- 172.21.15.50:0/3116193623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac030d50 con 0x7f54b4145d80 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 -- 172.21.15.50:0/3116193623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b4145d80 msgr2=0x7f54b4071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 --2- 172.21.15.50:0/3116193623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b4145d80 0x7f54b4071ae0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f54b40af940 tx=0x7f54ac02b9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 -- 172.21.15.50:0/3116193623 shutdown_connections 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 --2- 172.21.15.50:0/3116193623 >> v2:172.21.15.170:3300/0 conn(0x7f54b406a4d0 0x7f54b406a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 --2- 172.21.15.50:0/3116193623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b4145d80 0x7f54b4071ae0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 -- 172.21.15.50:0/3116193623 >> 172.21.15.50:0/3116193623 conn(0x7f54b406b7c0 msgr2=0x7f54b406bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 -- 172.21.15.50:0/3116193623 shutdown_connections 2023-12-08T08:20:17.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.093+0000 7f54b981c640 1 -- 172.21.15.50:0/3116193623 wait complete. 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.094+0000 7f54b981c640 1 Processor -- start 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.094+0000 7f54b981c640 1 -- start start 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b981c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54b406a4d0 0x7f54b4141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b981c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b40b4920 0x7f54b415f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b981c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4145d80 0x7f54b40b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b981c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415e890 con 0x7f54b40b4920 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b981c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40b00b0 con 0x7f54b4145d80 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b981c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415e5b0 con 0x7f54b406a4d0 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b40b4920 0x7f54b415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b40b4920 0x7f54b415f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40522/0 (socket says 172.21.15.50:40522) 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 -- 172.21.15.50:0/943470646 learned_addr learned my addr 172.21.15.50:0/943470646 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:17.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b37fe640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4145d80 0x7f54b40b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b2ffd640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54b406a4d0 0x7f54b4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 -- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54b406a4d0 msgr2=0x7f54b4141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54b406a4d0 0x7f54b4141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 -- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4145d80 msgr2=0x7f54b40b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4145d80 0x7f54b40b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b27fc640 1 -- 172.21.15.50:0/943470646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0094d0 con 0x7f54b40b4920 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.095+0000 7f54b2ffd640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54b406a4d0 0x7f54b4141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.096+0000 7f54b37fe640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4145d80 0x7f54b40b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.096+0000 7f54b27fc640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b40b4920 0x7f54b415f230 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c780 tx=0x7f549c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.096+0000 7f54abfff640 1 -- 172.21.15.50:0/943470646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0072d0 con 0x7f54b40b4920 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.096+0000 7f54abfff640 1 -- 172.21.15.50:0/943470646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c007430 con 0x7f54b40b4920 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.096+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40b0350 con 0x7f54b40b4920 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.096+0000 7f54abfff640 1 -- 172.21.15.50:0/943470646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c001d10 con 0x7f54b40b4920 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.096+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b4141ec0 con 0x7f54b40b4920 2023-12-08T08:20:17.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.097+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4071460 con 0x7f54b40b4920 2023-12-08T08:20:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.097+0000 7f54abfff640 1 -- 172.21.15.50:0/943470646 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f549c0047e0 con 0x7f54b40b4920 2023-12-08T08:20:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.098+0000 7f54abfff640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f549406ae40 0x7f549406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.098+0000 7f54abfff640 1 -- 172.21.15.50:0/943470646 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f549c088700 con 0x7f54b40b4920 2023-12-08T08:20:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.098+0000 7f54b2ffd640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f549406ae40 0x7f549406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.098+0000 7f54b2ffd640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f549406ae40 0x7f549406d300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f54ac036000 tx=0x7f54ac03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.102+0000 7f54abfff640 1 -- 172.21.15.50:0/943470646 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f549c053a00 con 0x7f54b40b4920 2023-12-08T08:20:17.281 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.279+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f54b40b0870 con 0x7f54b40b4920 2023-12-08T08:20:17.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.282+0000 7f54abfff640 1 -- 172.21.15.50:0/943470646 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f54b40b0870 con 0x7f54b40b4920 2023-12-08T08:20:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f549406ae40 msgr2=0x7f549406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f549406ae40 0x7f549406d300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f54ac036000 tx=0x7f54ac03b040 comp rx=0 tx=0).stop 2023-12-08T08:20:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b40b4920 msgr2=0x7f54b415f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b40b4920 0x7f54b415f230 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c780 tx=0x7f549c00cc40 comp rx=0 tx=0).stop 2023-12-08T08:20:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 shutdown_connections 2023-12-08T08:20:17.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f549406ae40 0x7f549406d300 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54b40b4920 0x7f54b415f230 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54b4145d80 0x7f54b40b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 --2- 172.21.15.50:0/943470646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f54b406a4d0 0x7f54b4141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 >> 172.21.15.50:0/943470646 conn(0x7f54b406b7c0 msgr2=0x7f54b4143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 shutdown_connections 2023-12-08T08:20:17.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.285+0000 7f54b981c640 1 -- 172.21.15.50:0/943470646 wait complete. 2023-12-08T08:20:17.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-12-08T08:20:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.402+0000 7f4d967ec640 1 Processor -- start 2023-12-08T08:20:17.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.402+0000 7f4d967ec640 1 -- start start 2023-12-08T08:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d967ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 0x7f4d9006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d967ec640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d90070db0 con 0x7f4d900ce3e0 2023-12-08T08:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d967ec640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d90071090 con 0x7f4d90140a10 2023-12-08T08:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d967ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90070ba0 con 0x7f4d90071e50 2023-12-08T08:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4d900ce3e0 0x7f4d900b1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60106/0 (socket says 172.21.15.50:60106) 2023-12-08T08:20:17.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/4164470929 learned_addr learned my addr 172.21.15.50:0/4164470929 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d94d89640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 0x7f4d9006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482076218 0 0) 0x7f4d90070db0 con 0x7f4d900ce3e0 2023-12-08T08:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d78003520 con 0x7f4d900ce3e0 2023-12-08T08:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2129403784 0 0) 0x7f4d78003520 con 0x7f4d900ce3e0 2023-12-08T08:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 msgr2=0x7f4d9006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 0x7f4d9006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 >> v1:172.21.15.170:6789/0 conn(0x7f4d90140a10 legacy=0x7f4d900cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d90071370 con 0x7f4d900ce3e0 2023-12-08T08:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.403+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f4d80001670 con 0x7f4d900ce3e0 2023-12-08T08:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 >> v1:172.21.15.50:6789/0 conn(0x7f4d900ce3e0 legacy=0x7f4d900b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8effd640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 0x7f4d780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8effd640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d78003ee0 0x7f4d780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8effd640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78004d00 0x7f4d78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90070ba0 con 0x7f4d78003ee0 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7800ba30 con 0x7f4d78004d00 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7800bbf0 con 0x7f4d90071e50 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8f7fe640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d78003ee0 0x7f4d780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8ffff640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 0x7f4d780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d94d89640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78004d00 0x7f4d78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 msgr2=0x7f4d780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8f7fe640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d90071e50 0x7f4d780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78004d00 msgr2=0x7f4d78005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8f7fe640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78004d00 0x7f4d78005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.404+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/4164470929 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78003520 con 0x7f4d78003ee0 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d8f7fe640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d78003ee0 0x7f4d780047c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4d80007fd0 tx=0x7f4d780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f03f6dc9e79eb5b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80005ad0 con 0x7f4d78003ee0 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80005c30 con 0x7f4d78003ee0 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d8effd640 1 -- 172.21.15.50:0/4164470929 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8002c7c0 con 0x7f4d78003ee0 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d967ec640 1 -- 172.21.15.50:0/4164470929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d78003ee0 msgr2=0x7f4d780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d967ec640 1 --2- 172.21.15.50:0/4164470929 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d78003ee0 0x7f4d780047c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4d80007fd0 tx=0x7f4d780057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d94d89640 1 -- 172.21.15.50:0/4164470929 reap_dead start 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d967ec640 1 -- 172.21.15.50:0/4164470929 shutdown_connections 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d967ec640 1 -- 172.21.15.50:0/4164470929 >> 172.21.15.50:0/4164470929 conn(0x7f4d900b09f0 msgr2=0x7f4d900b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d967ec640 1 -- 172.21.15.50:0/4164470929 shutdown_connections 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.405+0000 7f4d967ec640 1 -- 172.21.15.50:0/4164470929 wait complete. 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.406+0000 7f4d967ec640 1 Processor -- start 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.407+0000 7f4d967ec640 1 -- start start 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.407+0000 7f4d967ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78003ee0 0x7f4d90158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.407+0000 7f4d967ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d901f0f40 0x7f4d9015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.407+0000 7f4d967ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d9015b360 0x7f4d9009b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.407+0000 7f4d967ec640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90142a70 con 0x7f4d901f0f40 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.407+0000 7f4d967ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90159050 con 0x7f4d78003ee0 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.407+0000 7f4d967ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d901420d0 con 0x7f4d9015b360 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d901f0f40 0x7f4d9015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d901f0f40 0x7f4d9015ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40542/0 (socket says 172.21.15.50:40542) 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/2220609270 learned_addr learned my addr 172.21.15.50:0/2220609270 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8ffff640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78003ee0 0x7f4d90158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d94d89640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d9015b360 0x7f4d9009b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d9015b360 msgr2=0x7f4d9009b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d9015b360 0x7f4d9009b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78003ee0 msgr2=0x7f4d90158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78003ee0 0x7f4d90158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 -- 172.21.15.50:0/2220609270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d901423b0 con 0x7f4d901f0f40 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d94d89640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d9015b360 0x7f4d9009b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8f7fe640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d901f0f40 0x7f4d9015ae20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4d80001c50 tx=0x7f4d900b3cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8cff9640 1 -- 172.21.15.50:0/2220609270 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8002dc60 con 0x7f4d901f0f40 2023-12-08T08:20:17.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8cff9640 1 -- 172.21.15.50:0/2220609270 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8002ddc0 con 0x7f4d901f0f40 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d8cff9640 1 -- 172.21.15.50:0/2220609270 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80007270 con 0x7f4d901f0f40 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d90142690 con 0x7f4d901f0f40 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.408+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9013d8c0 con 0x7f4d901f0f40 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.409+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d90142bb0 con 0x7f4d901f0f40 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.410+0000 7f4d8cff9640 1 -- 172.21.15.50:0/2220609270 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d80032070 con 0x7f4d901f0f40 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.410+0000 7f4d8cff9640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d7c06ae70 0x7f4d7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.411+0000 7f4d8cff9640 1 -- 172.21.15.50:0/2220609270 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4d8003c040 con 0x7f4d901f0f40 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.411+0000 7f4d8ffff640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d7c06ae70 0x7f4d7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.411+0000 7f4d8ffff640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d7c06ae70 0x7f4d7c06d330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4d84007fd0 tx=0x7f4d840014b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:17.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.415+0000 7f4d8cff9640 1 -- 172.21.15.50:0/2220609270 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d90142bb0 con 0x7f4d901f0f40 2023-12-08T08:20:17.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.658+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f4d90142bb0 con 0x7f4d901f0f40 2023-12-08T08:20:17.966 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.964+0000 7f4d8cff9640 1 -- 172.21.15.50:0/2220609270 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v150) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4d90142bb0 con 0x7f4d901f0f40 2023-12-08T08:20:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d7c06ae70 msgr2=0x7f4d7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d7c06ae70 0x7f4d7c06d330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4d84007fd0 tx=0x7f4d840014b0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d901f0f40 msgr2=0x7f4d9015ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d901f0f40 0x7f4d9015ae20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4d80001c50 tx=0x7f4d900b3cf0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 shutdown_connections 2023-12-08T08:20:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4d7c06ae70 0x7f4d7c06d330 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d901f0f40 0x7f4d9015ae20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d9015b360 0x7f4d9009b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 --2- 172.21.15.50:0/2220609270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d78003ee0 0x7f4d90158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 >> 172.21.15.50:0/2220609270 conn(0x7f4d900b09f0 msgr2=0x7f4d900ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 shutdown_connections 2023-12-08T08:20:17.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:17.967+0000 7f4d967ec640 1 -- 172.21.15.50:0/2220609270 wait complete. 2023-12-08T08:20:17.981 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2023-12-08T08:20:17.981 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-08T08:20:17.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.092+0000 7fc8fb009640 1 Processor -- start 2023-12-08T08:20:18.094 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.092+0000 7fc8fb009640 1 -- start start 2023-12-08T08:20:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8fb009640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc8f40b6ac0 0x7fc8f40cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8fb009640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8f40ce1c0 0x7fc8f40cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8fb009640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40d0070 con 0x7fc8f40cd660 2023-12-08T08:20:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8fb009640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f4160cb0 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8fb009640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f40d02b0 con 0x7fc8f40b6ac0 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f95a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8f40ce1c0 0x7fc8f40cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f95a6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8f40ce1c0 0x7fc8f40cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40548/0 (socket says 172.21.15.50:40548) 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f95a6640 1 -- 172.21.15.50:0/266849550 learned_addr learned my addr 172.21.15.50:0/266849550 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f8da5640 1 --2- 172.21.15.50:0/266849550 >> v2:172.21.15.170:3300/0 conn(0x7fc8f40b6ac0 0x7fc8f40cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f95a6640 1 -- 172.21.15.50:0/266849550 >> v2:172.21.15.170:3300/0 conn(0x7fc8f40b6ac0 msgr2=0x7fc8f40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f95a6640 1 --2- 172.21.15.50:0/266849550 >> v2:172.21.15.170:3300/0 conn(0x7fc8f40b6ac0 0x7fc8f40cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f95a6640 1 -- 172.21.15.50:0/266849550 >> v1:172.21.15.170:6789/0 conn(0x7fc8f40cd660 legacy=0x7fc8f40cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.093+0000 7fc8f95a6640 1 -- 172.21.15.50:0/266849550 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40cb430 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.094+0000 7fc8f95a6640 1 --2- 172.21.15.50:0/266849550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f40cc1f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40ce8e0 tx=0x7fc8ec02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06d2f9bdef05fd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.094+0000 7fc8f37fe640 1 -- 172.21.15.50:0/266849550 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec02c9f0 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.094+0000 7fc8f37fe640 1 -- 172.21.15.50:0/266849550 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec02cb50 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.094+0000 7fc8f37fe640 1 -- 172.21.15.50:0/266849550 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0343f0 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 -- 172.21.15.50:0/266849550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 msgr2=0x7fc8f40cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 --2- 172.21.15.50:0/266849550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f40cc1f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40ce8e0 tx=0x7fc8ec02be50 comp rx=0 tx=0).stop 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 -- 172.21.15.50:0/266849550 shutdown_connections 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 --2- 172.21.15.50:0/266849550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f40cc1f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 --2- 172.21.15.50:0/266849550 >> v2:172.21.15.170:3300/0 conn(0x7fc8f40b6ac0 0x7fc8f40cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 -- 172.21.15.50:0/266849550 >> 172.21.15.50:0/266849550 conn(0x7fc8f40d0de0 msgr2=0x7fc8f40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 -- 172.21.15.50:0/266849550 shutdown_connections 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.095+0000 7fc8fb009640 1 -- 172.21.15.50:0/266849550 wait complete. 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.096+0000 7fc8fb009640 1 Processor -- start 2023-12-08T08:20:18.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.096+0000 7fc8fb009640 1 -- start start 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8fb009640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f40b6ac0 0x7fc8f4159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8fb009640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f40cd660 0x7fc8f415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8fb009640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8fb009640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f415a470 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8fb009640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f415b530 con 0x7fc8f40cd660 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8fb009640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f415b810 con 0x7fc8f40b6ac0 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f406f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40552/0 (socket says 172.21.15.50:40552) 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 -- 172.21.15.50:0/821370492 learned_addr learned my addr 172.21.15.50:0/821370492 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f3fff640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f40cd660 0x7fc8f415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f8da5640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f40b6ac0 0x7fc8f4159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 -- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f40b6ac0 msgr2=0x7fc8f4159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f40b6ac0 0x7fc8f4159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 -- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f40cd660 msgr2=0x7fc8f415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f40cd660 0x7fc8f415abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 -- 172.21.15.50:0/821370492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec009b30 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f3fff640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f40cd660 0x7fc8f415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f8da5640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f40b6ac0 0x7fc8f4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f95a6640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f406f770 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec036040 tx=0x7fc8ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.097+0000 7fc8f17fa640 1 -- 172.21.15.50:0/821370492 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec009510 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.098+0000 7fc8f17fa640 1 -- 172.21.15.50:0/821370492 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec03e450 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.098+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f415baf0 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.098+0000 7fc8f17fa640 1 -- 172.21.15.50:0/821370492 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec03e800 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.098+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f415c0b0 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.099+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f415c2a0 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.099+0000 7fc8f17fa640 1 -- 172.21.15.50:0/821370492 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8ec03e960 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.099+0000 7fc8f17fa640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc8d806ae40 0x7fc8d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.099+0000 7fc8f17fa640 1 -- 172.21.15.50:0/821370492 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc8ec0ac180 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.100+0000 7fc8f8da5640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc8d806ae40 0x7fc8d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.100+0000 7fc8f8da5640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc8d806ae40 0x7fc8d806d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc8f41f63f0 tx=0x7fc8e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.104+0000 7fc8f17fa640 1 -- 172.21.15.50:0/821370492 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8ec0773f0 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.283+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8f4067430 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.286 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.283+0000 7fc8f17fa640 1 -- 172.21.15.50:0/821370492 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13189 (secure 0 0 0) 0x7fc8ec07aa10 con 0x7fc8f40ce1c0 2023-12-08T08:20:18.286 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:18.286 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":47,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:16.960036+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/209897774":"2023-12-09T08:20:12.609235+0000","172.21.15.50:6832/209897774":"2023-12-09T08:20:12.609235+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc8d806ae40 msgr2=0x7fc8d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc8d806ae40 0x7fc8d806d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc8f41f63f0 tx=0x7fc8e8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 msgr2=0x7fc8f406f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f406f770 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec036040 tx=0x7fc8ec004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 shutdown_connections 2023-12-08T08:20:18.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc8d806ae40 0x7fc8d806d300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8f40ce1c0 0x7fc8f406f770 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8f40cd660 0x7fc8f415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 --2- 172.21.15.50:0/821370492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8f40b6ac0 0x7fc8f4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 >> 172.21.15.50:0/821370492 conn(0x7fc8f40d0de0 msgr2=0x7fc8f406e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 shutdown_connections 2023-12-08T08:20:18.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.286+0000 7fc8fb009640 1 -- 172.21.15.50:0/821370492 wait complete. 2023-12-08T08:20:18.299 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:18.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:18.408 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.406+0000 7f1f02fbe640 1 Processor -- start 2023-12-08T08:20:18.409 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.406+0000 7f1f02fbe640 1 -- start start 2023-12-08T08:20:18.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1f02fbe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1efc0cd1c0 0x7f1efc0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1f02fbe640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0b0e70 con 0x7f1efc0b0a50 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1f02fbe640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0ce360 con 0x7f1efc15e730 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1f02fbe640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc0ce640 con 0x7f1efc0cd1c0 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1efbfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1efc0cd1c0 0x7f1efc0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1f0155b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1efc0b0a50 0x7f1efc15ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60110/0 (socket says 172.21.15.50:60110) 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1f0155b640 1 -- 172.21.15.50:0/3034150995 learned_addr learned my addr 172.21.15.50:0/3034150995 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1efb7fe640 1 -- 172.21.15.50:0/3034150995 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497757245 0 0) 0x7f1efc0b0e70 con 0x7f1efc0b0a50 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.407+0000 7f1efb7fe640 1 -- 172.21.15.50:0/3034150995 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee4003520 con 0x7f1efc0b0a50 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.408+0000 7f1efbfff640 1 -- 172.21.15.50:0/3034150995 >> v1:172.21.15.170:6789/0 conn(0x7f1efc15e730 legacy=0x7f1efc0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.408+0000 7f1efbfff640 1 -- 172.21.15.50:0/3034150995 >> v1:172.21.15.50:6789/0 conn(0x7f1efc0b0a50 legacy=0x7f1efc15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.408+0000 7f1efbfff640 1 -- 172.21.15.50:0/3034150995 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0cbda0 con 0x7f1efc0cd1c0 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.408+0000 7f1efbfff640 1 --2- 172.21.15.50:0/3034150995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc0cd1c0 0x7f1efc0b0510 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00097a0 tx=0x7f1ef002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a065a95a63308d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.408+0000 7f1efb7fe640 1 -- 172.21.15.50:0/3034150995 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0031830 con 0x7f1efc0cd1c0 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.408+0000 7f1efb7fe640 1 -- 172.21.15.50:0/3034150995 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0031990 con 0x7f1efc0cd1c0 2023-12-08T08:20:18.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.408+0000 7f1efb7fe640 1 -- 172.21.15.50:0/3034150995 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0031d20 con 0x7f1efc0cd1c0 2023-12-08T08:20:18.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.409+0000 7f1f02fbe640 1 -- 172.21.15.50:0/3034150995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc0cd1c0 msgr2=0x7f1efc0b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.409+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/3034150995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc0cd1c0 0x7f1efc0b0510 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00097a0 tx=0x7f1ef002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.409+0000 7f1f02fbe640 1 -- 172.21.15.50:0/3034150995 shutdown_connections 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.409+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/3034150995 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc0cd1c0 0x7f1efc0b0510 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.409+0000 7f1f02fbe640 1 -- 172.21.15.50:0/3034150995 >> 172.21.15.50:0/3034150995 conn(0x7f1efc0d0e10 msgr2=0x7f1efc0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.409+0000 7f1f02fbe640 1 -- 172.21.15.50:0/3034150995 shutdown_connections 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.409+0000 7f1f02fbe640 1 -- 172.21.15.50:0/3034150995 wait complete. 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.410+0000 7f1f02fbe640 1 Processor -- start 2023-12-08T08:20:18.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.410+0000 7f1f02fbe640 1 -- start start 2023-12-08T08:20:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f02fbe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1efc0b0a50 0x7f1efc0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f02fbe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1efc0cd1c0 0x7f1efc0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f02fbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc15e730 0x7f1efc1452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f02fbe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0c9b30 con 0x7f1efc15e730 2023-12-08T08:20:18.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f02fbe640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0c8080 con 0x7f1efc0b0a50 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f02fbe640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0c8360 con 0x7f1efc0cd1c0 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f0155b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc15e730 0x7f1efc1452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f0155b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc15e730 0x7f1efc1452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40566/0 (socket says 172.21.15.50:40566) 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f0155b640 1 -- 172.21.15.50:0/1950769323 learned_addr learned my addr 172.21.15.50:0/1950769323 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f00d5a640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1efc0b0a50 0x7f1efc0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1efbfff640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1efc0cd1c0 0x7f1efc0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f0155b640 1 -- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1efc0cd1c0 msgr2=0x7f1efc0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f0155b640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1efc0cd1c0 0x7f1efc0ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f0155b640 1 -- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1efc0b0a50 msgr2=0x7f1efc0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.411+0000 7f1f0155b640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1efc0b0a50 0x7f1efc0ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1f0155b640 1 -- 172.21.15.50:0/1950769323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef0009400 con 0x7f1efc15e730 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1efbfff640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1efc0cd1c0 0x7f1efc0ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1f00d5a640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1efc0b0a50 0x7f1efc0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:18.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1f0155b640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc15e730 0x7f1efc1452a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400cb40 tx=0x7f1ef400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1ef97fa640 1 -- 172.21.15.50:0/1950769323 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400aca0 con 0x7f1efc15e730 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1ef97fa640 1 -- 172.21.15.50:0/1950769323 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef400ae00 con 0x7f1efc15e730 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc0c9d40 con 0x7f1efc15e730 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1ef97fa640 1 -- 172.21.15.50:0/1950769323 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4012620 con 0x7f1efc15e730 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.412+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc0c8640 con 0x7f1efc15e730 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.413+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc0ca260 con 0x7f1efc15e730 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.413+0000 7f1ef97fa640 1 -- 172.21.15.50:0/1950769323 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ef4007070 con 0x7f1efc15e730 2023-12-08T08:20:18.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.414+0000 7f1ef97fa640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ee806ae40 0x7f1ee806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.414+0000 7f1ef97fa640 1 -- 172.21.15.50:0/1950769323 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1ef40894a0 con 0x7f1efc15e730 2023-12-08T08:20:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.414+0000 7f1f00d5a640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ee806ae40 0x7f1ee806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.414+0000 7f1f00d5a640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ee806ae40 0x7f1ee806d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00a830 tx=0x7f1eec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.418+0000 7f1ef97fa640 1 -- 172.21.15.50:0/1950769323 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1efc0ca260 con 0x7f1efc15e730 2023-12-08T08:20:18.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.591+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1efc0ca260 con 0x7f1efc15e730 2023-12-08T08:20:18.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.591+0000 7f1ef97fa640 1 -- 172.21.15.50:0/1950769323 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ef4017020 con 0x7f1efc15e730 2023-12-08T08:20:18.594 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ee806ae40 msgr2=0x7f1ee806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ee806ae40 0x7f1ee806d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00a830 tx=0x7f1eec008040 comp rx=0 tx=0).stop 2023-12-08T08:20:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc15e730 msgr2=0x7f1efc1452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc15e730 0x7f1efc1452a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400cb40 tx=0x7f1ef400a060 comp rx=0 tx=0).stop 2023-12-08T08:20:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 shutdown_connections 2023-12-08T08:20:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ee806ae40 0x7f1ee806d300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1efc15e730 0x7f1efc1452a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1efc0cd1c0 0x7f1efc0ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 --2- 172.21.15.50:0/1950769323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1efc0b0a50 0x7f1efc0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 >> 172.21.15.50:0/1950769323 conn(0x7f1efc0d0e10 msgr2=0x7f1efc06ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 shutdown_connections 2023-12-08T08:20:18.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.593+0000 7f1f02fbe640 1 -- 172.21.15.50:0/1950769323 wait complete. 2023-12-08T08:20:18.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.711+0000 7f4a4d8f3640 1 Processor -- start 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.711+0000 7f4a4d8f3640 1 -- start start 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a4d8f3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 0x7f4a480d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a4d8f3640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4a480d3ad0 0x7f4a4815f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a4d8f3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4815ee90 con 0x7f4a4815f6c0 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a4d8f3640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a480d0fe0 con 0x7f4a480d3ad0 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a4d8f3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a480d1280 con 0x7f4a4815d580 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a477fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4a4815f6c0 0x7f4a480b23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:60118/0 (socket says 172.21.15.50:60118) 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a477fe640 1 -- 172.21.15.50:0/3669505512 learned_addr learned my addr 172.21.15.50:0/3669505512 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:18.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228285115 0 0) 0x7f4a4815ee90 con 0x7f4a4815f6c0 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a34003520 con 0x7f4a4815f6c0 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a3e7fc640 1 --2- 172.21.15.50:0/3669505512 >> v2:172.21.15.170:3300/0 conn(0x7f4a480d3ad0 0x7f4a4815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 0x7f4a480d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1545089803 0 0) 0x7f4a34003520 con 0x7f4a4815f6c0 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 msgr2=0x7f4a480d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 0x7f4a480d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 >> v2:172.21.15.170:3300/0 conn(0x7f4a480d3ad0 msgr2=0x7f4a4815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 --2- 172.21.15.50:0/3669505512 >> v2:172.21.15.170:3300/0 conn(0x7f4a480d3ad0 0x7f4a4815f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480d1560 con 0x7f4a4815f6c0 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f4a400019f0 con 0x7f4a4815f6c0 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.712+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 >> v1:172.21.15.50:6789/0 conn(0x7f4a4815f6c0 legacy=0x7f4a480b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a467fc640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a467fc640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 0x7f4a340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a467fc640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a34004d00 0x7f4a34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a480d0fe0 con 0x7f4a34003970 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a480d1280 con 0x7f4a34004d00 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3400b980 con 0x7f4a4815d580 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a477fe640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a34004d00 0x7f4a34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a3e7fc640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 0x7f4a340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a46ffd640 1 -- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 msgr2=0x7f4a340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a4815d580 0x7f4a340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a46ffd640 1 -- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a34004d00 msgr2=0x7f4a34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a34004d00 0x7f4a34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.713+0000 7f4a46ffd640 1 -- 172.21.15.50:0/3669505512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34003520 con 0x7f4a34003970 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a34003d90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009ac0 tx=0x7f4a340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac873c15130eb57 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3802c6b0 con 0x7f4a34003970 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3802c810 con 0x7f4a34003970 2023-12-08T08:20:18.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a467fc640 1 -- 172.21.15.50:0/3669505512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3802cba0 con 0x7f4a34003970 2023-12-08T08:20:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/3669505512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 msgr2=0x7f4a34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a4d8f3640 1 --2- 172.21.15.50:0/3669505512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a34003d90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009ac0 tx=0x7f4a340057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a477fe640 1 -- 172.21.15.50:0/3669505512 reap_dead start 2023-12-08T08:20:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/3669505512 shutdown_connections 2023-12-08T08:20:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/3669505512 >> 172.21.15.50:0/3669505512 conn(0x7f4a480d2fb0 msgr2=0x7f4a480d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/3669505512 shutdown_connections 2023-12-08T08:20:18.720 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.714+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/3669505512 wait complete. 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.716+0000 7f4a4d8f3640 1 Processor -- start 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.716+0000 7f4a4d8f3640 1 -- start start 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.716+0000 7f4a4d8f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a4814e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.716+0000 7f4a4d8f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a480b4de0 0x7f4a480b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a4d8f3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a480b5b90 0x7f4a480b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a4d8f3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4814e9d0 con 0x7f4a34003970 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a4d8f3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a480b57a0 con 0x7f4a480b4de0 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a4d8f3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a480b6550 con 0x7f4a480b5b90 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a4814e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a4814e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:40592/0 (socket says 172.21.15.50:40592) 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 -- 172.21.15.50:0/1291765556 learned_addr learned my addr 172.21.15.50:0/1291765556 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a3e7fc640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a480b4de0 0x7f4a480b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a477fe640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a480b5b90 0x7f4a480b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 -- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a480b5b90 msgr2=0x7f4a480b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a480b5b90 0x7f4a480b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 -- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a480b4de0 msgr2=0x7f4a480b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a480b4de0 0x7f4a480b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 -- 172.21.15.50:0/1291765556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480b67e0 con 0x7f4a34003970 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a46ffd640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a4814e490 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a38037040 tx=0x7f4a38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a44ff9640 1 -- 172.21.15.50:0/1291765556 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38003810 con 0x7f4a34003970 2023-12-08T08:20:18.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a44ff9640 1 -- 172.21.15.50:0/1291765556 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38003970 con 0x7f4a34003970 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a480b6ac0 con 0x7f4a34003970 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a44ff9640 1 -- 172.21.15.50:0/1291765556 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38003d20 con 0x7f4a34003970 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.717+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a480b7080 con 0x7f4a34003970 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.718+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a480d09d0 con 0x7f4a34003970 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.719+0000 7f4a44ff9640 1 -- 172.21.15.50:0/1291765556 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a38034440 con 0x7f4a34003970 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.719+0000 7f4a44ff9640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a2806ae40 0x7f4a2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.719+0000 7f4a44ff9640 1 -- 172.21.15.50:0/1291765556 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4a380ab700 con 0x7f4a34003970 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.719+0000 7f4a3e7fc640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a2806ae40 0x7f4a2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.720+0000 7f4a3e7fc640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a2806ae40 0x7f4a2806d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b2a20 tx=0x7f4a30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:18.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.724+0000 7f4a44ff9640 1 -- 172.21.15.50:0/1291765556 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a38076a20 con 0x7f4a34003970 2023-12-08T08:20:18.969 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:18.967+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f4a48067430 con 0x7f4a34003970 2023-12-08T08:20:19.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.970+0000 7f4a44ff9640 1 -- 172.21.15.50:0/1291765556 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v152) v1 ==== 137+0+0 (secure 0 0 0) 0x7f4a3807a040 con 0x7f4a34003970 2023-12-08T08:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a2806ae40 msgr2=0x7f4a2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a2806ae40 0x7f4a2806d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4a480b2a20 tx=0x7f4a30008040 comp rx=0 tx=0).stop 2023-12-08T08:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 msgr2=0x7f4a4814e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a4814e490 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a38037040 tx=0x7f4a38004730 comp rx=0 tx=0).stop 2023-12-08T08:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 shutdown_connections 2023-12-08T08:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4a2806ae40 0x7f4a2806d300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a480b5b90 0x7f4a480b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a480b4de0 0x7f4a480b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 --2- 172.21.15.50:0/1291765556 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4a34003970 0x7f4a4814e490 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.972+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 >> 172.21.15.50:0/1291765556 conn(0x7f4a480d2fb0 msgr2=0x7f4a480b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.973+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 shutdown_connections 2023-12-08T08:20:19.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:19.973+0000 7f4a4d8f3640 1 -- 172.21.15.50:0/1291765556 wait complete. 2023-12-08T08:20:19.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-08T08:20:20.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.102+0000 7f057667c640 1 Processor -- start 2023-12-08T08:20:20.105 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.102+0000 7f057667c640 1 -- start start 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f057667c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f057015e790 0x7f05700ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f057667c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f05700cc380 0x7f05700cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f057667c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700cce00 con 0x7f05700cdc30 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f057667c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700ce080 con 0x7f057015e790 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f057667c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700b0f00 con 0x7f05700cc380 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f057015e790 0x7f05700ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f057015e790 0x7f05700ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45990/0 (socket says 172.21.15.50:45990) 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056ffff640 1 -- 172.21.15.50:0/3880781462 learned_addr learned my addr 172.21.15.50:0/3880781462 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056f7fe640 1 --2- 172.21.15.50:0/3880781462 >> v2:172.21.15.170:3300/0 conn(0x7f05700cc380 0x7f05700cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056ffff640 1 -- 172.21.15.50:0/3880781462 >> v2:172.21.15.170:3300/0 conn(0x7f05700cc380 msgr2=0x7f05700cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:20.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056ffff640 1 --2- 172.21.15.50:0/3880781462 >> v2:172.21.15.170:3300/0 conn(0x7f05700cc380 0x7f05700cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056ffff640 1 -- 172.21.15.50:0/3880781462 >> v1:172.21.15.170:6789/0 conn(0x7f05700cdc30 legacy=0x7f05700ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:20.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.103+0000 7f056ffff640 1 -- 172.21.15.50:0/3880781462 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700ccb20 con 0x7f057015e790 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.104+0000 7f056ffff640 1 --2- 172.21.15.50:0/3880781462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057015e790 0x7f05700ce300 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0570071250 tx=0x7f056402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295ee306839aa11d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.104+0000 7f056effd640 1 -- 172.21.15.50:0/3880781462 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640317e0 con 0x7f057015e790 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.104+0000 7f056effd640 1 -- 172.21.15.50:0/3880781462 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564031940 con 0x7f057015e790 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.104+0000 7f056effd640 1 -- 172.21.15.50:0/3880781462 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564031cd0 con 0x7f057015e790 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 -- 172.21.15.50:0/3880781462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057015e790 msgr2=0x7f05700ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 --2- 172.21.15.50:0/3880781462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057015e790 0x7f05700ce300 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0570071250 tx=0x7f056402b880 comp rx=0 tx=0).stop 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 -- 172.21.15.50:0/3880781462 shutdown_connections 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 --2- 172.21.15.50:0/3880781462 >> v2:172.21.15.170:3300/0 conn(0x7f05700cc380 0x7f05700cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 --2- 172.21.15.50:0/3880781462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f057015e790 0x7f05700ce300 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 -- 172.21.15.50:0/3880781462 >> 172.21.15.50:0/3880781462 conn(0x7f05700d0e00 msgr2=0x7f05700d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:20.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 -- 172.21.15.50:0/3880781462 shutdown_connections 2023-12-08T08:20:20.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.105+0000 7f057667c640 1 -- 172.21.15.50:0/3880781462 wait complete. 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.106+0000 7f057667c640 1 Processor -- start 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.106+0000 7f057667c640 1 -- start start 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f057667c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05700cc380 0x7f057015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f057667c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05700cdc30 0x7f0570150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f057667c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f057015e790 0x7f05701513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f057667c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701f3a80 con 0x7f05700cc380 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f057667c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701f3d40 con 0x7f05700cdc30 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f057667c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05701f37a0 con 0x7f057015e790 2023-12-08T08:20:20.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f056ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05700cc380 0x7f057015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f056ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05700cc380 0x7f057015cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:45994/0 (socket says 172.21.15.50:45994) 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f056ffff640 1 -- 172.21.15.50:0/251024349 learned_addr learned my addr 172.21.15.50:0/251024349 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f056f7fe640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05700cdc30 0x7f0570150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.107+0000 7f0574c19640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f057015e790 0x7f05701513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056ffff640 1 -- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f057015e790 msgr2=0x7f05701513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056ffff640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f057015e790 0x7f05701513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056ffff640 1 -- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05700cdc30 msgr2=0x7f0570150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056ffff640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05700cdc30 0x7f0570150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056ffff640 1 -- 172.21.15.50:0/251024349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640094d0 con 0x7f05700cc380 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056f7fe640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05700cdc30 0x7f0570150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f0574c19640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f057015e790 0x7f05701513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056ffff640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05700cc380 0x7f057015cb10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f056402b8c0 tx=0x7f05640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056cff9640 1 -- 172.21.15.50:0/251024349 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640329c0 con 0x7f05700cc380 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056cff9640 1 -- 172.21.15.50:0/251024349 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564032b40 con 0x7f05700cc380 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05701f4000 con 0x7f05700cc380 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f056cff9640 1 -- 172.21.15.50:0/251024349 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640453f0 con 0x7f05700cc380 2023-12-08T08:20:20.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.108+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057015d050 con 0x7f05700cc380 2023-12-08T08:20:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.109+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057015d240 con 0x7f05700cc380 2023-12-08T08:20:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.109+0000 7f056cff9640 1 -- 172.21.15.50:0/251024349 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f056404d3f0 con 0x7f05700cc380 2023-12-08T08:20:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.110+0000 7f056cff9640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f055c06ae40 0x7f055c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.110+0000 7f056cff9640 1 -- 172.21.15.50:0/251024349 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f05640ab370 con 0x7f05700cc380 2023-12-08T08:20:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.110+0000 7f056f7fe640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f055c06ae40 0x7f055c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.111+0000 7f056f7fe640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f055c06ae40 0x7f055c06d300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0560006fd0 tx=0x7f0560008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.114+0000 7f056cff9640 1 -- 172.21.15.50:0/251024349 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0564076690 con 0x7f05700cc380 2023-12-08T08:20:20.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.290+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0570067430 con 0x7f05700cc380 2023-12-08T08:20:20.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.294+0000 7f056cff9640 1 -- 172.21.15.50:0/251024349 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0564079cb0 con 0x7f05700cc380 2023-12-08T08:20:20.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f055c06ae40 msgr2=0x7f055c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f055c06ae40 0x7f055c06d300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0560006fd0 tx=0x7f0560008040 comp rx=0 tx=0).stop 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05700cc380 msgr2=0x7f057015cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05700cc380 0x7f057015cb10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f056402b8c0 tx=0x7f05640046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 shutdown_connections 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f055c06ae40 0x7f055c06d300 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f057015e790 0x7f05701513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05700cdc30 0x7f0570150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 --2- 172.21.15.50:0/251024349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f05700cc380 0x7f057015cb10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 >> 172.21.15.50:0/251024349 conn(0x7f05700d0e00 msgr2=0x7f05700ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 shutdown_connections 2023-12-08T08:20:20.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.296+0000 7f057667c640 1 -- 172.21.15.50:0/251024349 wait complete. 2023-12-08T08:20:20.309 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:20:20.309 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:20.351 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:20.405 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:20:20.405 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:20.405 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:20.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2474 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-08T08:20:20.421 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:20:20.421 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:20.438 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:20:20.438 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:20.438 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:20.476 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2474 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-08T08:20:20.476 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:20:20.476 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:20.494 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:20:20.494 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-08T08:20:20.494 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:20.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.620+0000 7f0a08d78640 1 Processor -- start 2023-12-08T08:20:20.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.620+0000 7f0a08d78640 1 -- start start 2023-12-08T08:20:20.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a08d78640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0a04140a10 0x7f0a040cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a08d78640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a04071e50 0x7f0a040ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a08d78640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a04070db0 con 0x7f0a040b1f30 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a08d78640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a04070ba0 con 0x7f0a04071e50 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a08d78640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a04071090 con 0x7f0a04140a10 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a01d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a04071e50 0x7f0a040ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a01d9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a04071e50 0x7f0a040ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46006/0 (socket says 172.21.15.50:46006) 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a01d9b640 1 -- 172.21.15.50:0/1572509480 learned_addr learned my addr 172.21.15.50:0/1572509480 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a02d9d640 1 --1- 172.21.15.50:0/1572509480 >> v1:172.21.15.50:6789/0 conn(0x7f0a040b1f30 0x7f0a040b23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40768/0 (socket says 172.21.15.50:40768) 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a0259c640 1 --2- 172.21.15.50:0/1572509480 >> v2:172.21.15.170:3300/0 conn(0x7f0a04140a10 0x7f0a040cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a01d9b640 1 -- 172.21.15.50:0/1572509480 >> v2:172.21.15.170:3300/0 conn(0x7f0a04140a10 msgr2=0x7f0a040cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a01d9b640 1 --2- 172.21.15.50:0/1572509480 >> v2:172.21.15.170:3300/0 conn(0x7f0a04140a10 0x7f0a040cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a01d9b640 1 -- 172.21.15.50:0/1572509480 >> v1:172.21.15.50:6789/0 conn(0x7f0a040b1f30 legacy=0x7f0a040b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a01d9b640 1 -- 172.21.15.50:0/1572509480 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04071370 con 0x7f0a04071e50 2023-12-08T08:20:20.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a0159a640 1 -- 172.21.15.50:0/1572509480 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157951867 0 0) 0x7f0a04070db0 con 0x7f0a040b1f30 2023-12-08T08:20:20.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.621+0000 7f0a0259c640 1 --2- 172.21.15.50:0/1572509480 >> v2:172.21.15.170:3300/0 conn(0x7f0a04140a10 0x7f0a040cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.622+0000 7f0a01d9b640 1 --2- 172.21.15.50:0/1572509480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04071e50 0x7f0a040ce210 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0a04066ae0 tx=0x7f09f802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a04cd5efa813cc server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.622+0000 7f0a0159a640 1 -- 172.21.15.50:0/1572509480 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f802f850 con 0x7f0a04071e50 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.622+0000 7f0a0159a640 1 -- 172.21.15.50:0/1572509480 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f802f9b0 con 0x7f0a04071e50 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.622+0000 7f0a0159a640 1 -- 172.21.15.50:0/1572509480 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f802fd40 con 0x7f0a04071e50 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.622+0000 7f0a08d78640 1 -- 172.21.15.50:0/1572509480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04071e50 msgr2=0x7f0a040ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.622+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1572509480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04071e50 0x7f0a040ce210 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0a04066ae0 tx=0x7f09f802ba30 comp rx=0 tx=0).stop 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.623+0000 7f0a08d78640 1 -- 172.21.15.50:0/1572509480 shutdown_connections 2023-12-08T08:20:20.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.623+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1572509480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04071e50 0x7f0a040ce210 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.623+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1572509480 >> v2:172.21.15.170:3300/0 conn(0x7f0a04140a10 0x7f0a040cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.623+0000 7f0a08d78640 1 -- 172.21.15.50:0/1572509480 >> 172.21.15.50:0/1572509480 conn(0x7f0a040b09f0 msgr2=0x7f0a040b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.623+0000 7f0a08d78640 1 -- 172.21.15.50:0/1572509480 shutdown_connections 2023-12-08T08:20:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.623+0000 7f0a08d78640 1 -- 172.21.15.50:0/1572509480 wait complete. 2023-12-08T08:20:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.624+0000 7f0a08d78640 1 Processor -- start 2023-12-08T08:20:20.627 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.624+0000 7f0a08d78640 1 -- start start 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a08d78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a04071e50 0x7f0a0409ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a08d78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a040b1f30 0x7f0a0409c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a08d78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04140a10 0x7f0a041df320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a08d78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0409b1c0 con 0x7f0a04140a10 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a08d78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0409cbf0 con 0x7f0a04071e50 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a08d78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a041df860 con 0x7f0a040b1f30 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04140a10 0x7f0a041df320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04140a10 0x7f0a041df320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46016/0 (socket says 172.21.15.50:46016) 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 -- 172.21.15.50:0/1051614719 learned_addr learned my addr 172.21.15.50:0/1051614719 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:20.629 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a0259c640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a04071e50 0x7f0a0409ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a01d9b640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a040b1f30 0x7f0a0409c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 -- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a040b1f30 msgr2=0x7f0a0409c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a040b1f30 0x7f0a0409c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 -- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a04071e50 msgr2=0x7f0a0409ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a04071e50 0x7f0a0409ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 -- 172.21.15.50:0/1051614719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f80094d0 con 0x7f0a04140a10 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f0a02d9d640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04140a10 0x7f0a041df320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c480 tx=0x7f09fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.625+0000 7f09f2ffd640 1 -- 172.21.15.50:0/1051614719 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0074e0 con 0x7f0a04140a10 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.626+0000 7f09f2ffd640 1 -- 172.21.15.50:0/1051614719 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc007660 con 0x7f0a04140a10 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.626+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a04142440 con 0x7f0a04140a10 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.626+0000 7f09f2ffd640 1 -- 172.21.15.50:0/1051614719 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc004a20 con 0x7f0a04140a10 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.626+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a04142a00 con 0x7f0a04140a10 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.627+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a04067430 con 0x7f0a04140a10 2023-12-08T08:20:20.630 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.627+0000 7f09f2ffd640 1 -- 172.21.15.50:0/1051614719 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09fc004b80 con 0x7f0a04140a10 2023-12-08T08:20:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.627+0000 7f09f2ffd640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f09e406ae40 0x7f09e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.628+0000 7f09f2ffd640 1 -- 172.21.15.50:0/1051614719 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f09fc088560 con 0x7f0a04140a10 2023-12-08T08:20:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.628+0000 7f0a0259c640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f09e406ae40 0x7f09e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:20.631 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.628+0000 7f0a0259c640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f09e406ae40 0x7f09e406d300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0a04143fe0 tx=0x7f09f4007770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:20.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.632+0000 7f09f2ffd640 1 -- 172.21.15.50:0/1051614719 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09fc0539d0 con 0x7f0a04140a10 2023-12-08T08:20:20.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.843+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a040ce990 con 0x7f0a04140a10 2023-12-08T08:20:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.844+0000 7f09f2ffd640 1 -- 172.21.15.50:0/1051614719 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f09fc018090 con 0x7f0a04140a10 2023-12-08T08:20:20.846 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:20.846 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/254803136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":254803136},{"type":"v1","addr":"172.21.15.170:6837","nonce":254803136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3379710814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":3379710814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3379710814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/319282886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":319282886},{"type":"v1","addr":"172.21.15.170:6836","nonce":319282886}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5315,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/3129740129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3129740129},{"type":"v1","addr":"172.21.15.50:6835","nonce":3129740129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-12-08T08:20:20.846 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 19 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.845+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f09e406ae40 msgr2=0x7f09e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.845+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f09e406ae40 0x7f09e406d300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0a04143fe0 tx=0x7f09f4007770 comp rx=0 tx=0).stop 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.845+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04140a10 msgr2=0x7f0a041df320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.845+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04140a10 0x7f0a041df320 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c480 tx=0x7f09fc00c940 comp rx=0 tx=0).stop 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.845+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 shutdown_connections 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.846+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f09e406ae40 0x7f09e406d300 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.846+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a04140a10 0x7f0a041df320 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.846+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a040b1f30 0x7f0a0409c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.846+0000 7f0a08d78640 1 --2- 172.21.15.50:0/1051614719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a04071e50 0x7f0a0409ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.846+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 >> 172.21.15.50:0/1051614719 conn(0x7f0a040b09f0 msgr2=0x7f0a040ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.846+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 shutdown_connections 2023-12-08T08:20:20.849 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:20.846+0000 7f0a08d78640 1 -- 172.21.15.50:0/1051614719 wait complete. 2023-12-08T08:20:20.859 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-08T08:20:20.859 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-08T08:20:20.859 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:20:20.859 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:20.860 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-08T08:20:20.860 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-08T08:20:20.860 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:20:20.860 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:20.860 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-08T08:20:20.860 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-08T08:20:20.860 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:20:20.861 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:20.861 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-08T08:20:20.861 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-08T08:20:20.861 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:20:20.861 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:20.868 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:20:20.869 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-08T08:20:20.870 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:20:20.870 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-08T08:20:20.873 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:20:20.873 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-08T08:20:20.874 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:20:20.874 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-08T08:20:20.912 INFO:tasks.ceph.mds.a:Started 2023-12-08T08:20:20.912 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:20.913 INFO:tasks.ceph.mds.c:Started 2023-12-08T08:20:20.913 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:20.915 INFO:tasks.ceph.mds.b:Started 2023-12-08T08:20:20.916 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:20.916 INFO:tasks.ceph.mds.d:Started 2023-12-08T08:20:20.916 DEBUG:teuthology.parallel:result is None 2023-12-08T08:20:20.916 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-08T08:20:20.995 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2023-12-08T08:20:20.995 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-08T08:20:20.999 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2023-12-08T08:20:20.999 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2023-12-08T08:20:21.001 INFO:tasks.ceph.mds.b.smithi170.stderr:2023-12-08T08:20:20.997+0000 7f3ef6241640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2023-12-08T08:20:21.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.025+0000 7fa891d90640 1 Processor -- start 2023-12-08T08:20:21.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.025+0000 7fa891d90640 1 -- start start 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa891d90640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa88c1608a0 0x7fa88c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa891d90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa891d90640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c0d20b0 con 0x7fa88c0afce0 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa891d90640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c0d0620 con 0x7fa88c1608a0 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa891d90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0d1dd0 con 0x7fa88c0b1d70 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa88c1608a0 0x7fa88c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa88c0afce0 0x7fa88c0b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40788/0 (socket says 172.21.15.50:40788) 2023-12-08T08:20:21.029 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88bfff640 1 -- 172.21.15.50:0/335107812 learned_addr learned my addr 172.21.15.50:0/335107812 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88affd640 1 --2- 172.21.15.50:0/335107812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88b7fe640 1 -- 172.21.15.50:0/335107812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 msgr2=0x7fa88c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88b7fe640 1 --2- 172.21.15.50:0/335107812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88b7fe640 1 -- 172.21.15.50:0/335107812 >> v1:172.21.15.50:6789/0 conn(0x7fa88c0afce0 legacy=0x7fa88c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88b7fe640 1 -- 172.21.15.50:0/335107812 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0cff60 con 0x7fa88c1608a0 2023-12-08T08:20:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88a7fc640 1 -- 172.21.15.50:0/335107812 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342493147 0 0) 0x7fa88c0d20b0 con 0x7fa88c0afce0 2023-12-08T08:20:21.030 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.026+0000 7fa88affd640 1 --2- 172.21.15.50:0/335107812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:21.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.027+0000 7fa88b7fe640 1 --2- 172.21.15.50:0/335107812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0d0f30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097a0 tx=0x7fa87c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31c5c12c9542200 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.031 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.027+0000 7fa88a7fc640 1 -- 172.21.15.50:0/335107812 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c02e070 con 0x7fa88c1608a0 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.027+0000 7fa88a7fc640 1 -- 172.21.15.50:0/335107812 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c0315a0 con 0x7fa88c1608a0 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.027+0000 7fa88a7fc640 1 -- 172.21.15.50:0/335107812 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c031930 con 0x7fa88c1608a0 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 -- 172.21.15.50:0/335107812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 msgr2=0x7fa88c0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 --2- 172.21.15.50:0/335107812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0d0f30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0097a0 tx=0x7fa87c02b840 comp rx=0 tx=0).stop 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 -- 172.21.15.50:0/335107812 shutdown_connections 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 --2- 172.21.15.50:0/335107812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 --2- 172.21.15.50:0/335107812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0d0f30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 -- 172.21.15.50:0/335107812 >> 172.21.15.50:0/335107812 conn(0x7fa88c0d3030 msgr2=0x7fa88c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 -- 172.21.15.50:0/335107812 shutdown_connections 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.028+0000 7fa891d90640 1 -- 172.21.15.50:0/335107812 wait complete. 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.029+0000 7fa891d90640 1 Processor -- start 2023-12-08T08:20:21.032 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.029+0000 7fa891d90640 1 -- start start 2023-12-08T08:20:21.034 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa891d90640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa88c0afce0 0x7fa88c0b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa891d90640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa891d90640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa891d90640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0cbbd0 con 0x7fa88c1608a0 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa891d90640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0cc410 con 0x7fa88c0afce0 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa891d90640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0cbe00 con 0x7fa88c0b1d70 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46062/0 (socket says 172.21.15.50:46062) 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa88bfff640 1 -- 172.21.15.50:0/3091456113 learned_addr learned my addr 172.21.15.50:0/3091456113 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa88b7fe640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa88c0afce0 0x7fa88c0b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.030+0000 7fa88affd640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88bfff640 1 -- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 msgr2=0x7fa88c0b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88bfff640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.035 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88bfff640 1 -- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa88c0afce0 msgr2=0x7fa88c0b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88bfff640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa88c0afce0 0x7fa88c0b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88bfff640 1 -- 172.21.15.50:0/3091456113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009400 con 0x7fa88c1608a0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88b7fe640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa88c0afce0 0x7fa88c0b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88affd640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa88bfff640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0b7720 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c780 tx=0x7fa88400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa873fff640 1 -- 172.21.15.50:0/3091456113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400ce90 con 0x7fa88c1608a0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa873fff640 1 -- 172.21.15.50:0/3091456113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400a640 con 0x7fa88c1608a0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c0ca100 con 0x7fa88c1608a0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa873fff640 1 -- 172.21.15.50:0/3091456113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400a9d0 con 0x7fa88c1608a0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.031+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c0cc0a0 con 0x7fa88c1608a0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.032+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c0b14b0 con 0x7fa88c1608a0 2023-12-08T08:20:21.036 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.032+0000 7fa873fff640 1 -- 172.21.15.50:0/3091456113 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa88400ab30 con 0x7fa88c1608a0 2023-12-08T08:20:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.033+0000 7fa873fff640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa87806ae40 0x7fa87806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.033+0000 7fa873fff640 1 -- 172.21.15.50:0/3091456113 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa884088c30 con 0x7fa88c1608a0 2023-12-08T08:20:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.033+0000 7fa88b7fe640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa87806ae40 0x7fa87806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:21.037 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.034+0000 7fa88b7fe640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa87806ae40 0x7fa87806d300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa87c036000 tx=0x7fa87c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:21.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.037+0000 7fa873fff640 1 -- 172.21.15.50:0/3091456113 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa884053e00 con 0x7fa88c1608a0 2023-12-08T08:20:21.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:21.228+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa88c0cc580 con 0x7fa88c1608a0 2023-12-08T08:20:22.848 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.846+0000 7fa873fff640 1 -- 172.21.15.50:0/3091456113 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa884018020 con 0x7fa88c1608a0 2023-12-08T08:20:22.848 INFO:teuthology.orchestra.run.smithi050.stderr: removed all blocklist entries 2023-12-08T08:20:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.848+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa87806ae40 msgr2=0x7fa87806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa87806ae40 0x7fa87806d300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa87c036000 tx=0x7fa87c03d040 comp rx=0 tx=0).stop 2023-12-08T08:20:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 msgr2=0x7fa88c0b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0b7720 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa88400c780 tx=0x7fa88400cc40 comp rx=0 tx=0).stop 2023-12-08T08:20:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 shutdown_connections 2023-12-08T08:20:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa87806ae40 0x7fa87806d300 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.851 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa88c1608a0 0x7fa88c0b7720 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa88c0b1d70 0x7fa88c0b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 --2- 172.21.15.50:0/3091456113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa88c0afce0 0x7fa88c0b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 >> 172.21.15.50:0/3091456113 conn(0x7fa88c0d3030 msgr2=0x7fa88c0cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 shutdown_connections 2023-12-08T08:20:22.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.849+0000 7fa891d90640 1 -- 172.21.15.50:0/3091456113 wait complete. 2023-12-08T08:20:22.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-08T08:20:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.975+0000 7fde3ad51640 1 Processor -- start 2023-12-08T08:20:22.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.975+0000 7fde3ad51640 1 -- start start 2023-12-08T08:20:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.975+0000 7fde3ad51640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.975+0000 7fde3ad51640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde340b1d70 0x7fde340cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.975+0000 7fde3ad51640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340d20b0 con 0x7fde341608a0 2023-12-08T08:20:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.975+0000 7fde3ad51640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde340d0620 con 0x7fde340b1d70 2023-12-08T08:20:22.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.975+0000 7fde3ad51640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde340d1b80 con 0x7fde340b0cf0 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde392ee640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fde340b1d70 0x7fde340cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde38aed640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fde341608a0 0x7fde340d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40796/0 (socket says 172.21.15.50:40796) 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde38aed640 1 -- 172.21.15.50:0/1183546679 learned_addr learned my addr 172.21.15.50:0/1183546679 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde33fff640 1 --2- 172.21.15.50:0/1183546679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde392ee640 1 -- 172.21.15.50:0/1183546679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 msgr2=0x7fde340d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde392ee640 1 --2- 172.21.15.50:0/1183546679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde392ee640 1 -- 172.21.15.50:0/1183546679 >> v1:172.21.15.50:6789/0 conn(0x7fde341608a0 legacy=0x7fde340d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde337fe640 1 -- 172.21.15.50:0/1183546679 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595319636 0 0) 0x7fde340d20b0 con 0x7fde341608a0 2023-12-08T08:20:22.979 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.976+0000 7fde392ee640 1 -- 172.21.15.50:0/1183546679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340d1dd0 con 0x7fde340b1d70 2023-12-08T08:20:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde392ee640 1 --2- 172.21.15.50:0/1183546679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340cdc40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009d90 tx=0x7fde2c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f15b78eb936b4e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde337fe640 1 -- 172.21.15.50:0/1183546679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c02cbc0 con 0x7fde340b1d70 2023-12-08T08:20:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde337fe640 1 -- 172.21.15.50:0/1183546679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c02cd20 con 0x7fde340b1d70 2023-12-08T08:20:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde337fe640 1 -- 172.21.15.50:0/1183546679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c034660 con 0x7fde340b1d70 2023-12-08T08:20:22.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 -- 172.21.15.50:0/1183546679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 msgr2=0x7fde340cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 --2- 172.21.15.50:0/1183546679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340cdc40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009d90 tx=0x7fde2c02be10 comp rx=0 tx=0).stop 2023-12-08T08:20:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 -- 172.21.15.50:0/1183546679 shutdown_connections 2023-12-08T08:20:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 --2- 172.21.15.50:0/1183546679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340cdc40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 --2- 172.21.15.50:0/1183546679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 -- 172.21.15.50:0/1183546679 >> 172.21.15.50:0/1183546679 conn(0x7fde340d3030 msgr2=0x7fde340d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 -- 172.21.15.50:0/1183546679 shutdown_connections 2023-12-08T08:20:22.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.977+0000 7fde3ad51640 1 -- 172.21.15.50:0/1183546679 wait complete. 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.979+0000 7fde3ad51640 1 Processor -- start 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.979+0000 7fde3ad51640 1 -- start start 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde3ad51640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde3ad51640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde3ad51640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde341608a0 0x7fde340ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde3ad51640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde341f6320 con 0x7fde340b1d70 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde3ad51640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340cbf10 con 0x7fde341608a0 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde3ad51640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde340c8a90 con 0x7fde340b0cf0 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340c7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46082/0 (socket says 172.21.15.50:46082) 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 -- 172.21.15.50:0/974190849 learned_addr learned my addr 172.21.15.50:0/974190849 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde392ee640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde341608a0 0x7fde340ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde38aed640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:22.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 -- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 msgr2=0x7fde340c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 -- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde341608a0 msgr2=0x7fde340ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde341608a0 0x7fde340ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 -- 172.21.15.50:0/974190849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c009a70 con 0x7fde340b1d70 2023-12-08T08:20:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.980+0000 7fde33fff640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340c7b60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fde2000d800 tx=0x7fde2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:22.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.982+0000 7fde317fa640 1 -- 172.21.15.50:0/974190849 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000b6c0 con 0x7fde340b1d70 2023-12-08T08:20:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.982+0000 7fde317fa640 1 -- 172.21.15.50:0/974190849 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000b820 con 0x7fde340b1d70 2023-12-08T08:20:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.982+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde340c81f0 con 0x7fde340b1d70 2023-12-08T08:20:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.982+0000 7fde317fa640 1 -- 172.21.15.50:0/974190849 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000bbb0 con 0x7fde340b1d70 2023-12-08T08:20:22.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.982+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde340c87b0 con 0x7fde340b1d70 2023-12-08T08:20:22.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.983+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde341f6590 con 0x7fde340b1d70 2023-12-08T08:20:22.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.984+0000 7fde317fa640 1 -- 172.21.15.50:0/974190849 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde2000bd10 con 0x7fde340b1d70 2023-12-08T08:20:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.984+0000 7fde317fa640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fde1806ae40 0x7fde1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.985+0000 7fde317fa640 1 -- 172.21.15.50:0/974190849 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fde20089780 con 0x7fde340b1d70 2023-12-08T08:20:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.985+0000 7fde38aed640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fde1806ae40 0x7fde1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.985+0000 7fde38aed640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fde1806ae40 0x7fde1806d300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fde28007fd0 tx=0x7fde28007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:22.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:22.991+0000 7fde317fa640 1 -- 172.21.15.50:0/974190849 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde20054b80 con 0x7fde340b1d70 2023-12-08T08:20:23.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.233+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fde34067430 con 0x7fde340b1d70 2023-12-08T08:20:23.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.234+0000 7fde317fa640 1 -- 172.21.15.50:0/974190849 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fde200581a0 con 0x7fde340b1d70 2023-12-08T08:20:23.236 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:23.236 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_dump": [ 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.a", 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlaG07MRAAZ2C/ACHBbMU0P3IDa4516A==", 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.b", 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJl0UcYAxAAc5kskq3L748xnYJS3a/PqQ==", 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.237 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.c", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlvkB4ORAAEQfiX2naCRnFje/FOMizXg==", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:20:23.238 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mds.d", 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJlrYp1ChAAxmo/NoWZQ0WYvxrDQHg4eQ==", 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.0", 2023-12-08T08:20:23.239 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD60HJlpPofNBAA0REn7uUB/Aw/ZUIJbVXi6w==", 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.1", 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD90HJlbeXjMhAAlllaC0AovOXt52peQyZxUA==", 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.2", 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAA0XJl1wG0MRAAMSfSCEAMMoaZg2yN34XAOg==", 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.3", 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAD0XJl07uHMBAATuVeBNRe/TDGswgteMtbbA==", 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.241 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.4", 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAI0XJlnhr4ABAAd/FP6Mh+uBHwROBFS1NtLQ==", 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.242 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.5", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAK0XJl6ll3OhAADDM1OFDZ7Gj4TR221Emwkg==", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.6", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAN0XJl3hN1OBAA3tbsaT8CSnH4UUqbPlXpug==", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "osd.7", 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQAQ0XJldVlvNhAAHkTT6FkK2/lqQ7CNO2e3wA==", 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow profile osd", 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile osd", 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.0", 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw==", 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.244 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow r", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rw pool=cephfs_data" 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.1", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJlQLWGFhAAwqipxJ5qn/WzWLns1fy2BA==", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.2", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJl8yrWEhAA8ZmN36Sg2PS+3amjVbA14g==", 2023-12-08T08:20:23.245 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.3", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD50HJlgnHlGRAAgLbG+IB+A9ncV9o+9antbA==", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow r", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow rw", 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow rwx" 2023-12-08T08:20:23.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "client.admin", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlv7lkExAAPyIJa8imvyFOTuoaWv3Rkg==", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": "allow *", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow *", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.x", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlau9hLRAAS/TfKtA/MZF8TMtkAvCD7A==", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-08T08:20:23.247 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: "entity": "mgr.y", 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "AQD40HJlGu+ZKRAAIlksM6WcF58EtQMpAY6OGg==", 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": { 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": "allow *", 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: "mon": "allow profile mgr", 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": "allow *" 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2023-12-08T08:20:23.248 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.235+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fde1806ae40 msgr2=0x7fde1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.235+0000 7fde3ad51640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fde1806ae40 0x7fde1806d300 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fde28007fd0 tx=0x7fde28007de0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.235+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 msgr2=0x7fde340c7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.235+0000 7fde3ad51640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340c7b60 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fde2000d800 tx=0x7fde2000dcc0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 shutdown_connections 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fde1806ae40 0x7fde1806d300 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde340b1d70 0x7fde340c7b60 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde341608a0 0x7fde340ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 --2- 172.21.15.50:0/974190849 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde340b0cf0 0x7fde340c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 >> 172.21.15.50:0/974190849 conn(0x7fde340d3030 msgr2=0x7fde340ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 shutdown_connections 2023-12-08T08:20:23.250 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.236+0000 7fde3ad51640 1 -- 172.21.15.50:0/974190849 wait complete. 2023-12-08T08:20:23.251 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.355+0000 7f7f59f43640 1 Processor -- start 2023-12-08T08:20:23.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.355+0000 7f7f59f43640 1 -- start start 2023-12-08T08:20:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.355+0000 7f7f59f43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f540cf760 0x7f7f5406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.355+0000 7f7f59f43640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5406b070 con 0x7f7f5415e150 2023-12-08T08:20:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.355+0000 7f7f59f43640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5406aab0 con 0x7f7f540cf380 2023-12-08T08:20:23.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.355+0000 7f7f59f43640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f54072290 con 0x7f7f540cf760 2023-12-08T08:20:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.356+0000 7f7f52ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7f540cf760 0x7f7f5406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.356+0000 7f7f53fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7f5415e150 0x7f7f540acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40798/0 (socket says 172.21.15.50:40798) 2023-12-08T08:20:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.356+0000 7f7f53fff640 1 -- 172.21.15.50:0/3639232967 learned_addr learned my addr 172.21.15.50:0/3639232967 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.356+0000 7f7f52ffd640 1 -- 172.21.15.50:0/3639232967 >> v1:172.21.15.170:6789/0 conn(0x7f7f540cf380 legacy=0x7f7f54071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.356+0000 7f7f52ffd640 1 -- 172.21.15.50:0/3639232967 >> v1:172.21.15.50:6789/0 conn(0x7f7f5415e150 legacy=0x7f7f540acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.356+0000 7f7f52ffd640 1 -- 172.21.15.50:0/3639232967 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5406ad90 con 0x7f7f540cf760 2023-12-08T08:20:23.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.356+0000 7f7f527fc640 1 -- 172.21.15.50:0/3639232967 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706734890 0 0) 0x7f7f5406b070 con 0x7f7f5415e150 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f52ffd640 1 --2- 172.21.15.50:0/3639232967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf760 0x7f7f5406a4d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7f480097a0 tx=0x7f7f4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65592307e8b2a6de server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f527fc640 1 -- 172.21.15.50:0/3639232967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48031830 con 0x7f7f540cf760 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f527fc640 1 -- 172.21.15.50:0/3639232967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48031990 con 0x7f7f540cf760 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f527fc640 1 -- 172.21.15.50:0/3639232967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48031d20 con 0x7f7f540cf760 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f59f43640 1 -- 172.21.15.50:0/3639232967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf760 msgr2=0x7f7f5406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f59f43640 1 --2- 172.21.15.50:0/3639232967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf760 0x7f7f5406a4d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7f480097a0 tx=0x7f7f4802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f59f43640 1 -- 172.21.15.50:0/3639232967 shutdown_connections 2023-12-08T08:20:23.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f59f43640 1 --2- 172.21.15.50:0/3639232967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf760 0x7f7f5406a4d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f59f43640 1 -- 172.21.15.50:0/3639232967 >> 172.21.15.50:0/3639232967 conn(0x7f7f540cfda0 msgr2=0x7f7f540d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.357+0000 7f7f59f43640 1 -- 172.21.15.50:0/3639232967 shutdown_connections 2023-12-08T08:20:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.358+0000 7f7f59f43640 1 -- 172.21.15.50:0/3639232967 wait complete. 2023-12-08T08:20:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.359+0000 7f7f59f43640 1 Processor -- start 2023-12-08T08:20:23.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.359+0000 7f7f59f43640 1 -- start start 2023-12-08T08:20:23.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf380 0x7f7f5415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f540cf760 0x7f7f5414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f5415e150 0x7f7f540b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f541569c0 con 0x7f7f540cf380 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5415cc20 con 0x7f7f5415e150 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5415c370 con 0x7f7f540cf760 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf380 0x7f7f5415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf380 0x7f7f5415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46100/0 (socket says 172.21.15.50:46100) 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 -- 172.21.15.50:0/560843671 learned_addr learned my addr 172.21.15.50:0/560843671 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f52ffd640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f540cf760 0x7f7f5414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f53fff640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f5415e150 0x7f7f540b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 -- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f540cf760 msgr2=0x7f7f5414fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f540cf760 0x7f7f5414fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 -- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f5415e150 msgr2=0x7f7f540b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f5415e150 0x7f7f540b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 -- 172.21.15.50:0/560843671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48009400 con 0x7f7f540cf380 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f53fff640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f5415e150 0x7f7f540b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f537fe640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf380 0x7f7f5415a9a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400c450 tx=0x7f7f4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f3bfff640 1 -- 172.21.15.50:0/560843671 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f440052d0 con 0x7f7f540cf380 2023-12-08T08:20:23.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f3bfff640 1 -- 172.21.15.50:0/560843671 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f44005430 con 0x7f7f540cf380 2023-12-08T08:20:23.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5415c610 con 0x7f7f540cf380 2023-12-08T08:20:23.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f3bfff640 1 -- 172.21.15.50:0/560843671 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44012870 con 0x7f7f540cf380 2023-12-08T08:20:23.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.360+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f541566e0 con 0x7f7f540cf380 2023-12-08T08:20:23.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.362+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f54067430 con 0x7f7f540cf380 2023-12-08T08:20:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.362+0000 7f7f3bfff640 1 -- 172.21.15.50:0/560843671 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f440129d0 con 0x7f7f540cf380 2023-12-08T08:20:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.362+0000 7f7f3bfff640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7f4006ae40 0x7f7f4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.362+0000 7f7f3bfff640 1 -- 172.21.15.50:0/560843671 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7f44088e30 con 0x7f7f540cf380 2023-12-08T08:20:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.363+0000 7f7f52ffd640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7f4006ae40 0x7f7f4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.363+0000 7f7f52ffd640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7f4006ae40 0x7f7f4006d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f48036000 tx=0x7f7f4803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.367+0000 7f7f3bfff640 1 -- 172.21.15.50:0/560843671 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f440540f0 con 0x7f7f540cf380 2023-12-08T08:20:23.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.543+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f540cda30 con 0x7f7f540cf380 2023-12-08T08:20:23.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.543+0000 7f7f3bfff640 1 -- 172.21.15.50:0/560843671 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f7f44057710 con 0x7f7f540cf380 2023-12-08T08:20:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:23.546 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":52,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:22.845647+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7f4006ae40 msgr2=0x7f7f4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7f4006ae40 0x7f7f4006d300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f48036000 tx=0x7f7f4803c040 comp rx=0 tx=0).stop 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf380 msgr2=0x7f7f5415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf380 0x7f7f5415a9a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400c450 tx=0x7f7f4400c910 comp rx=0 tx=0).stop 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 shutdown_connections 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7f4006ae40 0x7f7f4006d300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f5415e150 0x7f7f540b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f540cf760 0x7f7f5414fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 --2- 172.21.15.50:0/560843671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f540cf380 0x7f7f5415a9a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 >> 172.21.15.50:0/560843671 conn(0x7f7f540cfda0 msgr2=0x7f7f540d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 shutdown_connections 2023-12-08T08:20:23.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.545+0000 7f7f59f43640 1 -- 172.21.15.50:0/560843671 wait complete. 2023-12-08T08:20:23.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:23.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:23.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 Processor -- start 2023-12-08T08:20:23.668 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 -- start start 2023-12-08T08:20:23.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340cfa80 0x7f5c340d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c340ce690 0x7f5c340cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5c340d10f0 0x7f5c340d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c340b5ec0 con 0x7f5c340ce690 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c340d03a0 con 0x7f5c340d10f0 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.666+0000 7f5c39ec9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c340cede0 con 0x7f5c340cfa80 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c340ce690 0x7f5c340cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5c340ce690 0x7f5c340cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46106/0 (socket says 172.21.15.50:46106) 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 -- 172.21.15.50:0/3695115102 learned_addr learned my addr 172.21.15.50:0/3695115102 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c337fe640 1 --2- 172.21.15.50:0/3695115102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340cfa80 0x7f5c340d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c33fff640 1 --2- 172.21.15.50:0/3695115102 >> v2:172.21.15.170:3300/0 conn(0x7f5c340d10f0 0x7f5c340d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 -- 172.21.15.50:0/3695115102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340cfa80 msgr2=0x7f5c340d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 --2- 172.21.15.50:0/3695115102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340cfa80 0x7f5c340d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 -- 172.21.15.50:0/3695115102 >> v2:172.21.15.170:3300/0 conn(0x7f5c340d10f0 msgr2=0x7f5c340d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:23.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 --2- 172.21.15.50:0/3695115102 >> v2:172.21.15.170:3300/0 conn(0x7f5c340d10f0 0x7f5c340d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c32ffd640 1 -- 172.21.15.50:0/3695115102 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340b6110 con 0x7f5c340ce690 2023-12-08T08:20:23.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.667+0000 7f5c33fff640 1 --2- 172.21.15.50:0/3695115102 >> v2:172.21.15.170:3300/0 conn(0x7f5c340d10f0 0x7f5c340d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c32ffd640 1 --2- 172.21.15.50:0/3695115102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340ce690 0x7f5c340cfe60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5c3408c470 tx=0x7f5c2802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5967f2080912859 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c327fc640 1 -- 172.21.15.50:0/3695115102 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c280317e0 con 0x7f5c340ce690 2023-12-08T08:20:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c327fc640 1 -- 172.21.15.50:0/3695115102 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c28031940 con 0x7f5c340ce690 2023-12-08T08:20:23.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c327fc640 1 -- 172.21.15.50:0/3695115102 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28031cd0 con 0x7f5c340ce690 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 -- 172.21.15.50:0/3695115102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340ce690 msgr2=0x7f5c340cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/3695115102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340ce690 0x7f5c340cfe60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5c3408c470 tx=0x7f5c2802b880 comp rx=0 tx=0).stop 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 -- 172.21.15.50:0/3695115102 shutdown_connections 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/3695115102 >> v2:172.21.15.170:3300/0 conn(0x7f5c340d10f0 0x7f5c340d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/3695115102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340ce690 0x7f5c340cfe60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/3695115102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340cfa80 0x7f5c340d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 -- 172.21.15.50:0/3695115102 >> 172.21.15.50:0/3695115102 conn(0x7f5c3409c340 msgr2=0x7f5c340d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 -- 172.21.15.50:0/3695115102 shutdown_connections 2023-12-08T08:20:23.673 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.668+0000 7f5c39ec9640 1 -- 172.21.15.50:0/3695115102 wait complete. 2023-12-08T08:20:23.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.669+0000 7f5c39ec9640 1 Processor -- start 2023-12-08T08:20:23.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.670+0000 7f5c39ec9640 1 -- start start 2023-12-08T08:20:23.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.670+0000 7f5c39ec9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340ce690 0x7f5c3415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.670+0000 7f5c39ec9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c340cfa80 0x7f5c3409d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.670+0000 7f5c39ec9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340d10f0 0x7f5c340c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.670+0000 7f5c39ec9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3415efd0 con 0x7f5c340d10f0 2023-12-08T08:20:23.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.670+0000 7f5c39ec9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3409dc40 con 0x7f5c340cfa80 2023-12-08T08:20:23.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.670+0000 7f5c39ec9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3409de30 con 0x7f5c340ce690 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340d10f0 0x7f5c340c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340d10f0 0x7f5c340c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46110/0 (socket says 172.21.15.50:46110) 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 -- 172.21.15.50:0/1370931755 learned_addr learned my addr 172.21.15.50:0/1370931755 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c337fe640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340ce690 0x7f5c3415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c32ffd640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c340cfa80 0x7f5c3409d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 -- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340ce690 msgr2=0x7f5c3415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340ce690 0x7f5c3415e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 -- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c340cfa80 msgr2=0x7f5c3409d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c340cfa80 0x7f5c3409d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 -- 172.21.15.50:0/1370931755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280094d0 con 0x7f5c340d10f0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c33fff640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340d10f0 0x7f5c340c8f10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00cd50 tx=0x7f5c2c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c1bfff640 1 -- 172.21.15.50:0/1370931755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00f680 con 0x7f5c340d10f0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c1bfff640 1 -- 172.21.15.50:0/1370931755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00f800 con 0x7f5c340d10f0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3409e110 con 0x7f5c340d10f0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c1bfff640 1 -- 172.21.15.50:0/1370931755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00fbb0 con 0x7f5c340d10f0 2023-12-08T08:20:23.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.671+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3409e6d0 con 0x7f5c340d10f0 2023-12-08T08:20:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.672+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3415f110 con 0x7f5c340d10f0 2023-12-08T08:20:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.673+0000 7f5c1bfff640 1 -- 172.21.15.50:0/1370931755 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c2c00b040 con 0x7f5c340d10f0 2023-12-08T08:20:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.673+0000 7f5c1bfff640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c2006ae40 0x7f5c2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.673+0000 7f5c1bfff640 1 -- 172.21.15.50:0/1370931755 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5c2c089e40 con 0x7f5c340d10f0 2023-12-08T08:20:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.674+0000 7f5c337fe640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c2006ae40 0x7f5c2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.674+0000 7f5c337fe640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c2006ae40 0x7f5c2006d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006fd0 tx=0x7f5c24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.678+0000 7f5c1bfff640 1 -- 172.21.15.50:0/1370931755 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c2c0550f0 con 0x7f5c340d10f0 2023-12-08T08:20:23.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.852+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c34067430 con 0x7f5c340d10f0 2023-12-08T08:20:23.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.852+0000 7f5c1bfff640 1 -- 172.21.15.50:0/1370931755 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c2c01d0a0 con 0x7f5c340d10f0 2023-12-08T08:20:23.855 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c2006ae40 msgr2=0x7f5c2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c2006ae40 0x7f5c2006d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006fd0 tx=0x7f5c24008040 comp rx=0 tx=0).stop 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340d10f0 msgr2=0x7f5c340c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340d10f0 0x7f5c340c8f10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00cd50 tx=0x7f5c2c00a650 comp rx=0 tx=0).stop 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 shutdown_connections 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c2006ae40 0x7f5c2006d300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c340d10f0 0x7f5c340c8f10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c340cfa80 0x7f5c3409d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 --2- 172.21.15.50:0/1370931755 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c340ce690 0x7f5c3415e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 >> 172.21.15.50:0/1370931755 conn(0x7f5c3409c340 msgr2=0x7f5c340b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 shutdown_connections 2023-12-08T08:20:23.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.854+0000 7f5c39ec9640 1 -- 172.21.15.50:0/1370931755 wait complete. 2023-12-08T08:20:23.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-08T08:20:23.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.971+0000 7fa612f2c640 1 Processor -- start 2023-12-08T08:20:23.974 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.971+0000 7fa612f2c640 1 -- start start 2023-12-08T08:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa612f2c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa60c0cd240 0x7fa60c0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa612f2c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa60c0cf730 0x7fa60c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa612f2c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0cfb90 con 0x7fa60c15f310 2023-12-08T08:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa612f2c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0cd620 con 0x7fa60c0cf730 2023-12-08T08:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa612f2c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c15c150 con 0x7fa60c0cd240 2023-12-08T08:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa60bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa60c0cf730 0x7fa60c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa6114c9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa60c15f310 0x7fa60c15a9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40808/0 (socket says 172.21.15.50:40808) 2023-12-08T08:20:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.972+0000 7fa6114c9640 1 -- 172.21.15.50:0/2329980164 learned_addr learned my addr 172.21.15.50:0/2329980164 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.973+0000 7fa610cc8640 1 --2- 172.21.15.50:0/2329980164 >> v2:172.21.15.170:3300/0 conn(0x7fa60c0cd240 0x7fa60c0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.973+0000 7fa60bfff640 1 -- 172.21.15.50:0/2329980164 >> v2:172.21.15.170:3300/0 conn(0x7fa60c0cd240 msgr2=0x7fa60c0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.973+0000 7fa60bfff640 1 --2- 172.21.15.50:0/2329980164 >> v2:172.21.15.170:3300/0 conn(0x7fa60c0cd240 0x7fa60c0cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.973+0000 7fa60bfff640 1 -- 172.21.15.50:0/2329980164 >> v1:172.21.15.50:6789/0 conn(0x7fa60c15f310 legacy=0x7fa60c15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.973+0000 7fa60bfff640 1 -- 172.21.15.50:0/2329980164 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c15fb00 con 0x7fa60c0cf730 2023-12-08T08:20:23.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.973+0000 7fa60b7fe640 1 -- 172.21.15.50:0/2329980164 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256285356 0 0) 0x7fa60c0cfb90 con 0x7fa60c15f310 2023-12-08T08:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.973+0000 7fa60bfff640 1 --2- 172.21.15.50:0/2329980164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cf730 0x7fa60c15edd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa60c070a60 tx=0x7fa5f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77e15cb2fb31be server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa60b7fe640 1 -- 172.21.15.50:0/2329980164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4031830 con 0x7fa60c0cf730 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa60b7fe640 1 -- 172.21.15.50:0/2329980164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4031990 con 0x7fa60c0cf730 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa60b7fe640 1 -- 172.21.15.50:0/2329980164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4031d20 con 0x7fa60c0cf730 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 -- 172.21.15.50:0/2329980164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cf730 msgr2=0x7fa60c15edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 --2- 172.21.15.50:0/2329980164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cf730 0x7fa60c15edd0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa60c070a60 tx=0x7fa5f402b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 -- 172.21.15.50:0/2329980164 shutdown_connections 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 --2- 172.21.15.50:0/2329980164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cf730 0x7fa60c15edd0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 --2- 172.21.15.50:0/2329980164 >> v2:172.21.15.170:3300/0 conn(0x7fa60c0cd240 0x7fa60c0cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 -- 172.21.15.50:0/2329980164 >> 172.21.15.50:0/2329980164 conn(0x7fa60c099a10 msgr2=0x7fa60c099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 -- 172.21.15.50:0/2329980164 shutdown_connections 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.974+0000 7fa612f2c640 1 -- 172.21.15.50:0/2329980164 wait complete. 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.975+0000 7fa612f2c640 1 Processor -- start 2023-12-08T08:20:23.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.975+0000 7fa612f2c640 1 -- start start 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa612f2c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cd240 0x7fa60c150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa612f2c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa60c0cf730 0x7fa60c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa612f2c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa60c15f310 0x7fa60c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa612f2c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0c4a00 con 0x7fa60c0cd240 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa612f2c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b2d80 con 0x7fa60c15f310 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa612f2c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b3060 con 0x7fa60c0cf730 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa610cc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cd240 0x7fa60c150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.980 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa610cc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cd240 0x7fa60c150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46128/0 (socket says 172.21.15.50:46128) 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.976+0000 7fa610cc8640 1 -- 172.21.15.50:0/414843439 learned_addr learned my addr 172.21.15.50:0/414843439 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa610cc8640 1 -- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa60c0cf730 msgr2=0x7fa60c06ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa610cc8640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa60c0cf730 0x7fa60c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa610cc8640 1 -- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa60c15f310 msgr2=0x7fa60c06f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa610cc8640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa60c15f310 0x7fa60c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa610cc8640 1 -- 172.21.15.50:0/414843439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4009400 con 0x7fa60c0cd240 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa610cc8640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cd240 0x7fa60c150650 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa60400efc0 tx=0x7fa60400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa6097fa640 1 -- 172.21.15.50:0/414843439 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604014480 con 0x7fa60c0cd240 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa6097fa640 1 -- 172.21.15.50:0/414843439 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400f040 con 0x7fa60c0cd240 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa6097fa640 1 -- 172.21.15.50:0/414843439 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604014800 con 0x7fa60c0cd240 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c0b3340 con 0x7fa60c0cd240 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.977+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c0b2070 con 0x7fa60c0cd240 2023-12-08T08:20:23.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.978+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c067ad0 con 0x7fa60c0cd240 2023-12-08T08:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.978+0000 7fa6097fa640 1 -- 172.21.15.50:0/414843439 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa604014960 con 0x7fa60c0cd240 2023-12-08T08:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.979+0000 7fa6097fa640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa5ec06ae40 0x7fa5ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.979+0000 7fa6097fa640 1 -- 172.21.15.50:0/414843439 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa60408a050 con 0x7fa60c0cd240 2023-12-08T08:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.979+0000 7fa60bfff640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa5ec06ae40 0x7fa5ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:23.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.980+0000 7fa60bfff640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa5ec06ae40 0x7fa5ec06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4036000 tx=0x7fa5f4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:23.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:23.983+0000 7fa6097fa640 1 -- 172.21.15.50:0/414843439 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa604055280 con 0x7fa60c0cd240 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.162+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa60c06d350 con 0x7fa60c0cd240 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.162+0000 7fa6097fa640 1 -- 172.21.15.50:0/414843439 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa6040588a0 con 0x7fa60c0cd240 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": ".mgr" 2023-12-08T08:20:24.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:24.166 INFO:teuthology.orchestra.run.smithi050.stdout:] 2023-12-08T08:20:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa5ec06ae40 msgr2=0x7fa5ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa5ec06ae40 0x7fa5ec06d300 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4036000 tx=0x7fa5f4030000 comp rx=0 tx=0).stop 2023-12-08T08:20:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cd240 msgr2=0x7fa60c150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cd240 0x7fa60c150650 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa60400efc0 tx=0x7fa60400c490 comp rx=0 tx=0).stop 2023-12-08T08:20:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 shutdown_connections 2023-12-08T08:20:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa5ec06ae40 0x7fa5ec06d300 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa60c15f310 0x7fa60c06f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa60c0cf730 0x7fa60c06ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 --2- 172.21.15.50:0/414843439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa60c0cd240 0x7fa60c150650 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 >> 172.21.15.50:0/414843439 conn(0x7fa60c099a10 msgr2=0x7fa60c0d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 shutdown_connections 2023-12-08T08:20:24.168 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.165+0000 7fa612f2c640 1 -- 172.21.15.50:0/414843439 wait complete. 2023-12-08T08:20:24.178 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-08T08:20:24.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-08T08:20:24.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.286+0000 7fecbb341640 1 Processor -- start 2023-12-08T08:20:24.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.286+0000 7fecbb341640 1 -- start start 2023-12-08T08:20:24.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecbb341640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 0x7fecb406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecbb341640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fecb406c8f0 0x7fecb415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecbb341640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40ce900 con 0x7fecb40cf950 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecbb341640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40cdae0 con 0x7fecb406c8f0 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecbb341640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb406bfd0 con 0x7fecb40cfd30 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecb90dd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fecb40cf950 0x7fecb40d17c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40812/0 (socket says 172.21.15.50:40812) 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecb90dd640 1 -- 172.21.15.50:0/1426987136 learned_addr learned my addr 172.21.15.50:0/1426987136 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740860625 0 0) 0x7fecb40ce900 con 0x7fecb40cf950 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecb98de640 1 --2- 172.21.15.50:0/1426987136 >> v2:172.21.15.170:3300/0 conn(0x7fecb406c8f0 0x7fecb415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecb88dc640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 0x7fecb406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca0003520 con 0x7fecb40cf950 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2004514653 0 0) 0x7feca0003520 con 0x7fecb40cf950 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 msgr2=0x7fecb406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 0x7fecb406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 >> v2:172.21.15.170:3300/0 conn(0x7fecb406c8f0 msgr2=0x7fecb415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 --2- 172.21.15.50:0/1426987136 >> v2:172.21.15.170:3300/0 conn(0x7fecb406c8f0 0x7fecb415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40cdcf0 con 0x7fecb40cf950 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fecb0001670 con 0x7fecb40cf950 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 >> v1:172.21.15.50:6789/0 conn(0x7fecb40cf950 legacy=0x7fecb40d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.293 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7feca0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feca00047c0 0x7feca0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 0x7feca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40cdae0 con 0x7feca0003970 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb406bfd0 con 0x7feca00047c0 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.287+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca000b980 con 0x7fecb40cfd30 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb90dd640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7feca0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb88dc640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feca00047c0 0x7feca0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb98de640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 0x7feca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb90dd640 1 -- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 msgr2=0x7feca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb90dd640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40cfd30 0x7feca0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.294 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb90dd640 1 -- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feca00047c0 msgr2=0x7feca0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb90dd640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feca00047c0 0x7feca0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.288+0000 7fecb90dd640 1 -- 172.21.15.50:0/1426987136 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0003520 con 0x7feca0003970 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecb90dd640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7feca0003d90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c110 tx=0x7feca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902b5cafdcfb893 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0005ad0 con 0x7feca0003970 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0005c30 con 0x7feca0003970 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecabfff640 1 -- 172.21.15.50:0/1426987136 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb002c810 con 0x7feca0003970 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecbb341640 1 -- 172.21.15.50:0/1426987136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 msgr2=0x7feca0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecbb341640 1 --2- 172.21.15.50:0/1426987136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7feca0003d90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fecb000c110 tx=0x7feca00057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecb98de640 1 -- 172.21.15.50:0/1426987136 reap_dead start 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecbb341640 1 -- 172.21.15.50:0/1426987136 shutdown_connections 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecbb341640 1 -- 172.21.15.50:0/1426987136 >> 172.21.15.50:0/1426987136 conn(0x7fecb409c2f0 msgr2=0x7fecb40d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecbb341640 1 -- 172.21.15.50:0/1426987136 shutdown_connections 2023-12-08T08:20:24.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.289+0000 7fecbb341640 1 -- 172.21.15.50:0/1426987136 wait complete. 2023-12-08T08:20:24.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.290+0000 7fecbb341640 1 Processor -- start 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecbb341640 1 -- start start 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecbb341640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7fecb415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecbb341640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40ca0a0 0x7fecb41f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecbb341640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb40d3240 0x7fecb4154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecbb341640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ca8f0 con 0x7feca0003970 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecbb341640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40cabd0 con 0x7fecb40d3240 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecbb341640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41f5fd0 con 0x7fecb40ca0a0 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecb90dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7fecb415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecb90dd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7fecb415be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46140/0 (socket says 172.21.15.50:46140) 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecb90dd640 1 -- 172.21.15.50:0/759756424 learned_addr learned my addr 172.21.15.50:0/759756424 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.291+0000 7fecb88dc640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40ca0a0 0x7fecb41f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecb98de640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb40d3240 0x7fecb4154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecb90dd640 1 -- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40ca0a0 msgr2=0x7fecb41f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecb90dd640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40ca0a0 0x7fecb41f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecb90dd640 1 -- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb40d3240 msgr2=0x7fecb4154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecb90dd640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb40d3240 0x7fecb4154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecb90dd640 1 -- 172.21.15.50:0/759756424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb41f62b0 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecb90dd640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7fecb415be10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001030 tx=0x7fecb0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7feca9ffb640 1 -- 172.21.15.50:0/759756424 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb002cc20 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7feca9ffb640 1 -- 172.21.15.50:0/759756424 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb002cd80 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb41f6d10 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7feca9ffb640 1 -- 172.21.15.50:0/759756424 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb00072b0 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.292+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb40ca520 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.293+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb41f6440 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.294+0000 7feca9ffb640 1 -- 172.21.15.50:0/759756424 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecb0032070 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.294+0000 7feca9ffb640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec9806ae40 0x7fec9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.294+0000 7feca9ffb640 1 -- 172.21.15.50:0/759756424 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fecb003c040 con 0x7feca0003970 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.294+0000 7fecb88dc640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec9806ae40 0x7fec9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:24.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.295+0000 7fecb88dc640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec9806ae40 0x7fec9806d300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fecb415b640 tx=0x7feca4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:24.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.298+0000 7feca9ffb640 1 -- 172.21.15.50:0/759756424 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecb0075ad0 con 0x7feca0003970 2023-12-08T08:20:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.474+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fecb4067540 con 0x7feca0003970 2023-12-08T08:20:24.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:24.852 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:24.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.990+0000 7feca9ffb640 1 -- 172.21.15.50:0/759756424 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7fecb00790f0 con 0x7feca0003970 2023-12-08T08:20:25.069 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2023-12-08T08:20:25.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec9806ae40 msgr2=0x7fec9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec9806ae40 0x7fec9806d300 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fecb415b640 tx=0x7feca4008040 comp rx=0 tx=0).stop 2023-12-08T08:20:25.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 msgr2=0x7fecb415be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7fecb415be10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fecb0001030 tx=0x7fecb0001930 comp rx=0 tx=0).stop 2023-12-08T08:20:25.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 shutdown_connections 2023-12-08T08:20:25.071 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fec9806ae40 0x7fec9806d300 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb40d3240 0x7fecb4154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecb40ca0a0 0x7fecb41f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 --2- 172.21.15.50:0/759756424 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feca0003970 0x7fecb415be10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.992+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 >> 172.21.15.50:0/759756424 conn(0x7fecb409c2f0 msgr2=0x7fecb40ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.993+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 shutdown_connections 2023-12-08T08:20:25.072 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:24.993+0000 7fecbb341640 1 -- 172.21.15.50:0/759756424 wait complete. 2023-12-08T08:20:25.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-08T08:20:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.186+0000 7f81ef59e640 1 Processor -- start 2023-12-08T08:20:25.188 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.186+0000 7f81ef59e640 1 -- start start 2023-12-08T08:20:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ef59e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f81f00cf240 0x7f81f006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ef59e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 0x7f81f00ae350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ef59e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f00ae890 con 0x7f81f00b4f60 2023-12-08T08:20:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ef59e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00aeb20 con 0x7f81f00cf240 2023-12-08T08:20:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ef59e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00b41a0 con 0x7f81f01596c0 2023-12-08T08:20:25.192 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81eed9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81f00b4f60 0x7f81f00cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40826/0 (socket says 172.21.15.50:40826) 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81eed9d640 1 -- 172.21.15.50:0/3860204009 learned_addr learned my addr 172.21.15.50:0/3860204009 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ee59c640 1 --2- 172.21.15.50:0/3860204009 >> v2:172.21.15.170:3300/0 conn(0x7f81f00cf240 0x7f81f006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81edd9b640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 0x7f81f00ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269501811 0 0) 0x7f81f00ae890 con 0x7f81f00b4f60 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.187+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d8003520 con 0x7f81f00b4f60 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 387577652 0 0) 0x7f81d8003520 con 0x7f81f00b4f60 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 msgr2=0x7f81f00ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 0x7f81f00ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 >> v2:172.21.15.170:3300/0 conn(0x7f81f00cf240 msgr2=0x7f81f006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 --2- 172.21.15.50:0/3860204009 >> v2:172.21.15.170:3300/0 conn(0x7f81f00cf240 0x7f81f006e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00b4480 con 0x7f81f00b4f60 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f81e80019f0 con 0x7f81f00b4f60 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 >> v1:172.21.15.50:6789/0 conn(0x7f81f00b4f60 legacy=0x7f81f00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d8003970 0x7f81d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d80047c0 0x7f81d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 0x7f81d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00aeb20 con 0x7f81d80047c0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00b41a0 con 0x7f81d8003970 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d800b980 con 0x7f81f01596c0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81edd9b640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d80047c0 0x7f81d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81ee59c640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d8003970 0x7f81d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81eed9d640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 0x7f81d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81edd9b640 1 -- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 msgr2=0x7f81d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81edd9b640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01596c0 0x7f81d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81edd9b640 1 -- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d8003970 msgr2=0x7f81d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81edd9b640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d8003970 0x7f81d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.188+0000 7f81edd9b640 1 -- 172.21.15.50:0/3860204009 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8003520 con 0x7f81d80047c0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.189+0000 7f81edd9b640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d80047c0 0x7f81d8004c40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f81e400aac0 tx=0x7f81d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5c8ee745e329bb server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.189+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4034600 con 0x7f81d80047c0 2023-12-08T08:20:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.189+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4030050 con 0x7f81d80047c0 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.189+0000 7f81ed59a640 1 -- 172.21.15.50:0/3860204009 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4034980 con 0x7f81d80047c0 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.190+0000 7f81ef59e640 1 -- 172.21.15.50:0/3860204009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d80047c0 msgr2=0x7f81d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.190+0000 7f81ef59e640 1 --2- 172.21.15.50:0/3860204009 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81d80047c0 0x7f81d8004c40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f81e400aac0 tx=0x7f81d80057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.190+0000 7f81eed9d640 1 -- 172.21.15.50:0/3860204009 reap_dead start 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.190+0000 7f81ef59e640 1 -- 172.21.15.50:0/3860204009 shutdown_connections 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.190+0000 7f81ef59e640 1 -- 172.21.15.50:0/3860204009 >> 172.21.15.50:0/3860204009 conn(0x7f81f0071bf0 msgr2=0x7f81f0072000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.190+0000 7f81ef59e640 1 -- 172.21.15.50:0/3860204009 shutdown_connections 2023-12-08T08:20:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.190+0000 7f81ef59e640 1 -- 172.21.15.50:0/3860204009 wait complete. 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.191+0000 7f81ef59e640 1 Processor -- start 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.191+0000 7f81ef59e640 1 -- start start 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ef59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d80047c0 0x7f81f0098510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ef59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f01f0800 0x7f81f00b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ef59e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01f19c0 0x7f81f00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ef59e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c4e10 con 0x7f81f01f0800 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ef59e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0098a50 con 0x7f81d80047c0 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ef59e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01f0da0 con 0x7f81f01f19c0 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f01f0800 0x7f81f00b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f01f0800 0x7f81f00b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46166/0 (socket says 172.21.15.50:46166) 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 -- 172.21.15.50:0/4110630241 learned_addr learned my addr 172.21.15.50:0/4110630241 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:25.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81eed9d640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01f19c0 0x7f81f00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ee59c640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d80047c0 0x7f81f0098510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 -- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01f19c0 msgr2=0x7f81f00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01f19c0 0x7f81f00b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 -- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d80047c0 msgr2=0x7f81f0098510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d80047c0 0x7f81f0098510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81edd9b640 1 -- 172.21.15.50:0/4110630241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f01f1080 con 0x7f81f01f0800 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.192+0000 7f81ee59c640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d80047c0 0x7f81f0098510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.193+0000 7f81edd9b640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f01f0800 0x7f81f00b0e30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f81e400a9e0 tx=0x7f81e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.193+0000 7f81deffd640 1 -- 172.21.15.50:0/4110630241 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4003e50 con 0x7f81f01f0800 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.193+0000 7f81deffd640 1 -- 172.21.15.50:0/4110630241 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e403e440 con 0x7f81f01f0800 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.193+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f01f1360 con 0x7f81f01f0800 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.193+0000 7f81deffd640 1 -- 172.21.15.50:0/4110630241 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e403e7f0 con 0x7f81f01f0800 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.193+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f0098d90 con 0x7f81f01f0800 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.194+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f00c4f50 con 0x7f81f01f0800 2023-12-08T08:20:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.194+0000 7f81deffd640 1 -- 172.21.15.50:0/4110630241 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81e403e950 con 0x7f81f01f0800 2023-12-08T08:20:25.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.195+0000 7f81deffd640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81d006ae70 0x7f81d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:25.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.195+0000 7f81deffd640 1 -- 172.21.15.50:0/4110630241 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f81e40abe10 con 0x7f81f01f0800 2023-12-08T08:20:25.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.195+0000 7f81ee59c640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81d006ae70 0x7f81d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:25.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.196+0000 7f81ee59c640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81d006ae70 0x7f81d006d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f81f01ee3f0 tx=0x7f81e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:25.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.199+0000 7f81deffd640 1 -- 172.21.15.50:0/4110630241 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81f00c4f50 con 0x7f81f01f0800 2023-12-08T08:20:25.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.376+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f81f00c4f50 con 0x7f81f01f0800 2023-12-08T08:20:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.996+0000 7f81deffd640 1 -- 172.21.15.50:0/4110630241 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f81f00c4f50 con 0x7f81f01f0800 2023-12-08T08:20:25.998 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2023-12-08T08:20:26.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.999+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81d006ae70 msgr2=0x7f81d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.999+0000 7f81ef59e640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81d006ae70 0x7f81d006d330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f81f01ee3f0 tx=0x7f81e0008040 comp rx=0 tx=0).stop 2023-12-08T08:20:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.999+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f01f0800 msgr2=0x7f81f00b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:25.999+0000 7f81ef59e640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f01f0800 0x7f81f00b0e30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f81e400a9e0 tx=0x7f81e4004730 comp rx=0 tx=0).stop 2023-12-08T08:20:26.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.000+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 shutdown_connections 2023-12-08T08:20:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.000+0000 7f81ef59e640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81d006ae70 0x7f81d006d330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.000+0000 7f81ef59e640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81f01f0800 0x7f81f00b0e30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.000+0000 7f81ef59e640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f01f19c0 0x7f81f00b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.000+0000 7f81ef59e640 1 --2- 172.21.15.50:0/4110630241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d80047c0 0x7f81f0098510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.000+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 >> 172.21.15.50:0/4110630241 conn(0x7f81f0071bf0 msgr2=0x7f81f00adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.000+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 shutdown_connections 2023-12-08T08:20:26.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.001+0000 7f81ef59e640 1 -- 172.21.15.50:0/4110630241 wait complete. 2023-12-08T08:20:26.029 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-08T08:20:26.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.141+0000 7fbb1c72c640 1 Processor -- start 2023-12-08T08:20:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.141+0000 7fbb1c72c640 1 -- start start 2023-12-08T08:20:26.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1c72c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb140cfa30 0x7fbb140b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1c72c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb140c6be0 con 0x7fbb140cfe10 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1c72c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb140d3ff0 con 0x7fbb140b4150 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1c72c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140b4860 con 0x7fbb140cfa30 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1a4c8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbb140cfa30 0x7fbb140b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1acc9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbb140cfe10 0x7fbb140cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40828/0 (socket says 172.21.15.50:40828) 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1acc9640 1 -- 172.21.15.50:0/1198058865 learned_addr learned my addr 172.21.15.50:0/1198058865 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1a4c8640 1 -- 172.21.15.50:0/1198058865 >> v1:172.21.15.170:6789/0 conn(0x7fbb140b4150 legacy=0x7fbb140b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1a4c8640 1 -- 172.21.15.50:0/1198058865 >> v1:172.21.15.50:6789/0 conn(0x7fbb140cfe10 legacy=0x7fbb140cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.142+0000 7fbb1a4c8640 1 -- 172.21.15.50:0/1198058865 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140d3d50 con 0x7fbb140cfa30 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.143+0000 7fbb1a4c8640 1 --2- 172.21.15.50:0/1198058865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfa30 0x7fbb140b2f20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbb100097a0 tx=0x7fbb1002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6087d60d6d2a0a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.143+0000 7fbb194c6640 1 -- 172.21.15.50:0/1198058865 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1002e070 con 0x7fbb140cfa30 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.143+0000 7fbb194c6640 1 -- 172.21.15.50:0/1198058865 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb100315a0 con 0x7fbb140cfa30 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.143+0000 7fbb194c6640 1 -- 172.21.15.50:0/1198058865 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10031930 con 0x7fbb140cfa30 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.144+0000 7fbb1c72c640 1 -- 172.21.15.50:0/1198058865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfa30 msgr2=0x7fbb140b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.144+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/1198058865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfa30 0x7fbb140b2f20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbb100097a0 tx=0x7fbb1002b840 comp rx=0 tx=0).stop 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.144+0000 7fbb1c72c640 1 -- 172.21.15.50:0/1198058865 shutdown_connections 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.144+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/1198058865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfa30 0x7fbb140b2f20 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.144+0000 7fbb1c72c640 1 -- 172.21.15.50:0/1198058865 >> 172.21.15.50:0/1198058865 conn(0x7fbb140d3090 msgr2=0x7fbb140d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.144+0000 7fbb1c72c640 1 -- 172.21.15.50:0/1198058865 shutdown_connections 2023-12-08T08:20:26.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.144+0000 7fbb1c72c640 1 -- 172.21.15.50:0/1198058865 wait complete. 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.145+0000 7fbb1c72c640 1 Processor -- start 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.145+0000 7fbb1c72c640 1 -- start start 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1c72c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140b4150 0x7fbb140b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1c72c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb140cfa30 0x7fbb140cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1c72c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfe10 0x7fbb140ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1c72c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1415aee0 con 0x7fbb140cfe10 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1c72c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140b16e0 con 0x7fbb140b4150 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1c72c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14160e90 con 0x7fbb140cfa30 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1acc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfe10 0x7fbb140ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1acc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfe10 0x7fbb140ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46174/0 (socket says 172.21.15.50:46174) 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1acc9640 1 -- 172.21.15.50:0/3023020393 learned_addr learned my addr 172.21.15.50:0/3023020393 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb1a4c8640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140b4150 0x7fbb140b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.146+0000 7fbb19cc7640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb140cfa30 0x7fbb140cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1acc9640 1 -- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb140cfa30 msgr2=0x7fbb140cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1acc9640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb140cfa30 0x7fbb140cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1acc9640 1 -- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140b4150 msgr2=0x7fbb140b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1acc9640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140b4150 0x7fbb140b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1acc9640 1 -- 172.21.15.50:0/3023020393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10009400 con 0x7fbb140cfe10 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb19cc7640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb140cfa30 0x7fbb140cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1a4c8640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140b4150 0x7fbb140b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1acc9640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfe10 0x7fbb140ccc70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00cbc0 tx=0x7fbb0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb0affd640 1 -- 172.21.15.50:0/3023020393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00ace0 con 0x7fbb140cfe10 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb0affd640 1 -- 172.21.15.50:0/3023020393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00ae40 con 0x7fbb140cfe10 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb0affd640 1 -- 172.21.15.50:0/3023020393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c012600 con 0x7fbb140cfe10 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb140b0db0 con 0x7fbb140cfe10 2023-12-08T08:20:26.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.147+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb140b1370 con 0x7fbb140cfe10 2023-12-08T08:20:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.148+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb14067430 con 0x7fbb140cfe10 2023-12-08T08:20:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.149+0000 7fbb0affd640 1 -- 172.21.15.50:0/3023020393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb0c007070 con 0x7fbb140cfe10 2023-12-08T08:20:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.149+0000 7fbb0affd640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbaf806ae40 0x7fbaf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.149+0000 7fbb0affd640 1 -- 172.21.15.50:0/3023020393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fbb0c089a00 con 0x7fbb140cfe10 2023-12-08T08:20:26.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.149+0000 7fbb1a4c8640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbaf806ae40 0x7fbaf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:26.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.150+0000 7fbb1a4c8640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbaf806ae40 0x7fbaf806d300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb10036000 tx=0x7fbb1003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:26.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.153+0000 7fbb0affd640 1 -- 172.21.15.50:0/3023020393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb0c054b60 con 0x7fbb140cfe10 2023-12-08T08:20:26.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.366+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbb140b1820 con 0x7fbb140cfe10 2023-12-08T08:20:26.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:26.997+0000 7fbb0affd640 1 -- 172.21.15.50:0/3023020393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbb0c058180 con 0x7fbb140cfe10 2023-12-08T08:20:27.000 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 8 and data pool 9 2023-12-08T08:20:27.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbaf806ae40 msgr2=0x7fbaf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbaf806ae40 0x7fbaf806d300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb10036000 tx=0x7fbb1003d040 comp rx=0 tx=0).stop 2023-12-08T08:20:27.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfe10 msgr2=0x7fbb140ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfe10 0x7fbb140ccc70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00cbc0 tx=0x7fbb0c00a430 comp rx=0 tx=0).stop 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 shutdown_connections 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbaf806ae40 0x7fbaf806d300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb140cfe10 0x7fbb140ccc70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb140cfa30 0x7fbb140cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 --2- 172.21.15.50:0/3023020393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb140b4150 0x7fbb140b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.000+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 >> 172.21.15.50:0/3023020393 conn(0x7fbb140d3090 msgr2=0x7fbb1406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.001+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 shutdown_connections 2023-12-08T08:20:27.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.001+0000 7fbb1c72c640 1 -- 172.21.15.50:0/3023020393 wait complete. 2023-12-08T08:20:27.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.131+0000 7f2e1c4bb640 1 Processor -- start 2023-12-08T08:20:27.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.131+0000 7f2e1c4bb640 1 -- start start 2023-12-08T08:20:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.132+0000 7f2e1c4bb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e141608a0 0x7f2e140d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.132+0000 7f2e1c4bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 0x7f2e140d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.132+0000 7f2e1c4bb640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e140d20b0 con 0x7f2e140afce0 2023-12-08T08:20:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.132+0000 7f2e1c4bb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e140d0620 con 0x7f2e141608a0 2023-12-08T08:20:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.132+0000 7f2e1c4bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140d1dd0 con 0x7f2e140b1d70 2023-12-08T08:20:27.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.132+0000 7f2e1aa58640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2e140afce0 0x7f2e140b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40834/0 (socket says 172.21.15.50:40834) 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.132+0000 7f2e1aa58640 1 -- 172.21.15.50:0/3612208409 learned_addr learned my addr 172.21.15.50:0/3612208409 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1a257640 1 --2- 172.21.15.50:0/3612208409 >> v2:172.21.15.170:3300/0 conn(0x7f2e141608a0 0x7f2e140d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19a56640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 0x7f2e140d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13891174 0 0) 0x7f2e140d20b0 con 0x7f2e140afce0 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dfc003520 con 0x7f2e140afce0 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761311329 0 0) 0x7f2dfc003520 con 0x7f2e140afce0 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 msgr2=0x7f2e140d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 0x7f2e140d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 >> v2:172.21.15.170:3300/0 conn(0x7f2e141608a0 msgr2=0x7f2e140d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 --2- 172.21.15.50:0/3612208409 >> v2:172.21.15.170:3300/0 conn(0x7f2e141608a0 0x7f2e140d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140cff60 con 0x7f2e140afce0 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f2e0c001670 con 0x7f2e140afce0 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 >> v1:172.21.15.50:6789/0 conn(0x7f2e140afce0 legacy=0x7f2e140b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2dfc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2dfc0047c0 0x7f2dfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 0x7f2dfc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140d0620 con 0x7f2dfc003970 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140d1dd0 con 0x7f2dfc0047c0 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc00b980 con 0x7f2e140b1d70 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1a257640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2dfc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e19a56640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2dfc0047c0 0x7f2dfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1aa58640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 0x7f2dfc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1a257640 1 -- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 msgr2=0x7f2dfc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1a257640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e140b1d70 0x7f2dfc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1a257640 1 -- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2dfc0047c0 msgr2=0x7f2dfc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1a257640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2dfc0047c0 0x7f2dfc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.133+0000 7f2e1a257640 1 -- 172.21.15.50:0/3612208409 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc003520 con 0x7f2dfc003970 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.134+0000 7f2e1a257640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2dfc003d90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400e170 tx=0x7f2dfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bdaff83be3cbde server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.134+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0402cc20 con 0x7f2dfc003970 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.134+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400f040 con 0x7f2dfc003970 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.134+0000 7f2e19255640 1 -- 172.21.15.50:0/3612208409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04034440 con 0x7f2dfc003970 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.135+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/3612208409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 msgr2=0x7f2dfc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.135+0000 7f2e1c4bb640 1 --2- 172.21.15.50:0/3612208409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2dfc003d90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400e170 tx=0x7f2dfc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.135+0000 7f2e1aa58640 1 -- 172.21.15.50:0/3612208409 reap_dead start 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.135+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/3612208409 shutdown_connections 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.135+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/3612208409 >> 172.21.15.50:0/3612208409 conn(0x7f2e140d3030 msgr2=0x7f2e140d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.135+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/3612208409 shutdown_connections 2023-12-08T08:20:27.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.135+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/3612208409 wait complete. 2023-12-08T08:20:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.136+0000 7f2e1c4bb640 1 Processor -- start 2023-12-08T08:20:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.136+0000 7f2e1c4bb640 1 -- start start 2023-12-08T08:20:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1c4bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2e140ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1c4bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e1414d520 0x7f2e1414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1c4bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e140c9310 0x7f2e140c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1c4bb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140cd420 con 0x7f2dfc003970 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1c4bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140cd1d0 con 0x7f2e140c9310 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1c4bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c82d0 con 0x7f2e1414d520 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2e140ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2e140ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46198/0 (socket says 172.21.15.50:46198) 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 -- 172.21.15.50:0/2972060534 learned_addr learned my addr 172.21.15.50:0/2972060534 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 -- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e1414d520 msgr2=0x7f2e1414cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e1414d520 0x7f2e1414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 -- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e140c9310 msgr2=0x7f2e140c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e140c9310 0x7f2e140c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 -- 172.21.15.50:0/2972060534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140c8550 con 0x7f2dfc003970 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.137+0000 7f2e1a257640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2e140ccc90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2e04037040 tx=0x7f2e04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.138+0000 7f2e12ffd640 1 -- 172.21.15.50:0/2972060534 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04034e50 con 0x7f2dfc003970 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.138+0000 7f2e12ffd640 1 -- 172.21.15.50:0/2972060534 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e04040450 con 0x7f2dfc003970 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.138+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e140c8830 con 0x7f2dfc003970 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.138+0000 7f2e12ffd640 1 -- 172.21.15.50:0/2972060534 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04040800 con 0x7f2dfc003970 2023-12-08T08:20:27.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.138+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e140c8df0 con 0x7f2dfc003970 2023-12-08T08:20:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.139+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e140c8f80 con 0x7f2dfc003970 2023-12-08T08:20:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.139+0000 7f2e12ffd640 1 -- 172.21.15.50:0/2972060534 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e04040960 con 0x7f2dfc003970 2023-12-08T08:20:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.139+0000 7f2e12ffd640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e0006ae70 0x7f2e0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.140+0000 7f2e12ffd640 1 -- 172.21.15.50:0/2972060534 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e040abf20 con 0x7f2dfc003970 2023-12-08T08:20:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.140+0000 7f2e19a56640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e0006ae70 0x7f2e0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.140+0000 7f2e19a56640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e0006ae70 0x7f2e0006d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e140ca220 tx=0x7f2e08009320 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.144+0000 7f2e12ffd640 1 -- 172.21.15.50:0/2972060534 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e04076df0 con 0x7f2dfc003970 2023-12-08T08:20:27.323 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.321+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e14067430 con 0x7f2dfc003970 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.322+0000 7f2e12ffd640 1 -- 172.21.15.50:0/2972060534 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16783 (secure 0 0 0) 0x7f2e04044090 con 0x7f2dfc003970 2023-12-08T08:20:27.324 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:27.325 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":55,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:26.367891+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:27.326 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e0006ae70 msgr2=0x7f2e0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e0006ae70 0x7f2e0006d330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2e140ca220 tx=0x7f2e08009320 comp rx=0 tx=0).stop 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 msgr2=0x7f2e140ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2e140ccc90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2e04037040 tx=0x7f2e04009750 comp rx=0 tx=0).stop 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 shutdown_connections 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2e0006ae70 0x7f2e0006d330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e140c9310 0x7f2e140c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e1414d520 0x7f2e1414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 --2- 172.21.15.50:0/2972060534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2dfc003970 0x7f2e140ccc90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 >> 172.21.15.50:0/2972060534 conn(0x7f2e140d3030 msgr2=0x7f2e1415f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 shutdown_connections 2023-12-08T08:20:27.327 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.324+0000 7f2e1c4bb640 1 -- 172.21.15.50:0/2972060534 wait complete. 2023-12-08T08:20:27.337 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.442+0000 7fb3be95a640 1 Processor -- start 2023-12-08T08:20:27.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.442+0000 7fb3be95a640 1 -- start start 2023-12-08T08:20:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3be95a640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3b80ccd70 0x7fb3b80ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3be95a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb3b806c650 0x7fb3b815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3be95a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b80cf9c0 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3be95a640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b80d0a60 con 0x7fb3b80ccd70 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3be95a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b80ce7b0 con 0x7fb3b806c650 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3b7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3b80ccd70 0x7fb3b80ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3b7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb3b80ccd70 0x7fb3b80ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46206/0 (socket says 172.21.15.50:46206) 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3b7fff640 1 -- 172.21.15.50:0/1204983077 learned_addr learned my addr 172.21.15.50:0/1204983077 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3bcef7640 1 --2- 172.21.15.50:0/1204983077 >> v2:172.21.15.170:3300/0 conn(0x7fb3b806c650 0x7fb3b815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3b7fff640 1 -- 172.21.15.50:0/1204983077 >> v2:172.21.15.170:3300/0 conn(0x7fb3b806c650 msgr2=0x7fb3b815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3b7fff640 1 --2- 172.21.15.50:0/1204983077 >> v2:172.21.15.170:3300/0 conn(0x7fb3b806c650 0x7fb3b815ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3b7fff640 1 -- 172.21.15.50:0/1204983077 >> v1:172.21.15.170:6789/0 conn(0x7fb3b80cf1e0 legacy=0x7fb3b806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.443+0000 7fb3b7fff640 1 -- 172.21.15.50:0/1204983077 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b80cfca0 con 0x7fb3b80ccd70 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3b7fff640 1 --2- 172.21.15.50:0/1204983077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80ccd70 0x7fb3b80ce270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80711a0 tx=0x7fb3a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a925f77d556585 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3b6ffd640 1 -- 172.21.15.50:0/1204983077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8031870 con 0x7fb3b80ccd70 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3b6ffd640 1 -- 172.21.15.50:0/1204983077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a80319d0 con 0x7fb3b80ccd70 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3b6ffd640 1 -- 172.21.15.50:0/1204983077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8031d60 con 0x7fb3b80ccd70 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3be95a640 1 -- 172.21.15.50:0/1204983077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80ccd70 msgr2=0x7fb3b80ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3be95a640 1 --2- 172.21.15.50:0/1204983077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80ccd70 0x7fb3b80ce270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80711a0 tx=0x7fb3a802b910 comp rx=0 tx=0).stop 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3be95a640 1 -- 172.21.15.50:0/1204983077 shutdown_connections 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3be95a640 1 --2- 172.21.15.50:0/1204983077 >> v2:172.21.15.170:3300/0 conn(0x7fb3b806c650 0x7fb3b815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3be95a640 1 --2- 172.21.15.50:0/1204983077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80ccd70 0x7fb3b80ce270 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.448 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.444+0000 7fb3be95a640 1 -- 172.21.15.50:0/1204983077 >> 172.21.15.50:0/1204983077 conn(0x7fb3b80d0de0 msgr2=0x7fb3b80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.445+0000 7fb3be95a640 1 -- 172.21.15.50:0/1204983077 shutdown_connections 2023-12-08T08:20:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.445+0000 7fb3be95a640 1 -- 172.21.15.50:0/1204983077 wait complete. 2023-12-08T08:20:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.446+0000 7fb3be95a640 1 Processor -- start 2023-12-08T08:20:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.446+0000 7fb3be95a640 1 -- start start 2023-12-08T08:20:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b806c650 0x7fb3b814f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3b80ccd70 0x7fb3b815c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80cf1e0 0x7fb3b815c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80adb00 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80adda0 con 0x7fb3b806c650 2023-12-08T08:20:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b80ae080 con 0x7fb3b80ccd70 2023-12-08T08:20:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80cf1e0 0x7fb3b815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80cf1e0 0x7fb3b815c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46218/0 (socket says 172.21.15.50:46218) 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 -- 172.21.15.50:0/3489525410 learned_addr learned my addr 172.21.15.50:0/3489525410 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3b7fff640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b806c650 0x7fb3b814f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3b77fe640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3b80ccd70 0x7fb3b815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 -- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3b80ccd70 msgr2=0x7fb3b815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3b80ccd70 0x7fb3b815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 -- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b806c650 msgr2=0x7fb3b814f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b806c650 0x7fb3b814f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 -- 172.21.15.50:0/3489525410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80094d0 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3bcef7640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80cf1e0 0x7fb3b815c740 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000cd20 tx=0x7fb3b000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3b4ff9640 1 -- 172.21.15.50:0/3489525410 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0003b90 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3b4ff9640 1 -- 172.21.15.50:0/3489525410 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b0003cf0 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b80ae360 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3b4ff9640 1 -- 172.21.15.50:0/3489525410 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0004240 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.447+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b814f930 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.448+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b80ae880 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.449+0000 7fb3b4ff9640 1 -- 172.21.15.50:0/3489525410 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3b00043a0 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.449+0000 7fb3b4ff9640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb3a406ae40 0x7fb3a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.449+0000 7fb3b4ff9640 1 -- 172.21.15.50:0/3489525410 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb3b0012070 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.450+0000 7fb3b7fff640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb3a406ae40 0x7fb3a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.450+0000 7fb3b7fff640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb3a406ae40 0x7fb3a406d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036000 tx=0x7fb3a803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.453+0000 7fb3b4ff9640 1 -- 172.21.15.50:0/3489525410 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3b80ae880 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.633 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.631+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3b80ae880 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.634 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.632+0000 7fb3b4ff9640 1 -- 172.21.15.50:0/3489525410 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16783 (secure 0 0 0) 0x7fb3b80ae880 con 0x7fb3b80cf1e0 2023-12-08T08:20:27.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:27.635 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":55,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:26.367891+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:27.636 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb3a406ae40 msgr2=0x7fb3a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb3a406ae40 0x7fb3a406d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036000 tx=0x7fb3a803c040 comp rx=0 tx=0).stop 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80cf1e0 msgr2=0x7fb3b815c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80cf1e0 0x7fb3b815c740 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000cd20 tx=0x7fb3b000a660 comp rx=0 tx=0).stop 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 shutdown_connections 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb3a406ae40 0x7fb3a406d300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3b80cf1e0 0x7fb3b815c740 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3b80ccd70 0x7fb3b815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 --2- 172.21.15.50:0/3489525410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b806c650 0x7fb3b814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 >> 172.21.15.50:0/3489525410 conn(0x7fb3b80d0de0 msgr2=0x7fb3b80d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 shutdown_connections 2023-12-08T08:20:27.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.634+0000 7fb3be95a640 1 -- 172.21.15.50:0/3489525410 wait complete. 2023-12-08T08:20:27.647 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-08T08:20:27.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.754+0000 7f16fea6b640 1 Processor -- start 2023-12-08T08:20:27.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.755+0000 7f16fea6b640 1 -- start start 2023-12-08T08:20:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.755+0000 7f16fea6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 0x7f16f80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.755+0000 7f16fea6b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f80c6be0 con 0x7f16f80cfa30 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.755+0000 7f16fea6b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f80d3ff0 con 0x7f16f80b4150 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.755+0000 7f16fea6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80b4860 con 0x7f16f80cfe10 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.755+0000 7f16fc807640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f16f80cfa30 0x7f16f80b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40844/0 (socket says 172.21.15.50:40844) 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.755+0000 7f16fc807640 1 -- 172.21.15.50:0/2670853571 learned_addr learned my addr 172.21.15.50:0/2670853571 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fd008640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 0x7f16f80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511851155 0 0) 0x7f16f80c6be0 con 0x7f16f80cfa30 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e4003520 con 0x7f16f80cfa30 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2365130663 0 0) 0x7f16e4003520 con 0x7f16f80cfa30 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 msgr2=0x7f16f80b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 0x7f16f80b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 >> v1:172.21.15.170:6789/0 conn(0x7f16f80b4150 legacy=0x7f16f80cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f80d3d50 con 0x7f16f80cfa30 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f16f0001690 con 0x7f16f80cfa30 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 >> v1:172.21.15.50:6789/0 conn(0x7f16f80cfa30 legacy=0x7f16f80b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 0x7f16e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e4004d00 0x7f16e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80b4860 con 0x7f16e40039a0 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e400bb40 con 0x7f16e4004d00 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e400bd00 con 0x7f16f80cfe10 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fc807640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16f7fff640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 0x7f16e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fd008640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e4004d00 0x7f16e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fc807640 1 -- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 msgr2=0x7f16e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fc807640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f80cfe10 0x7f16e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fc807640 1 -- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e4004d00 msgr2=0x7f16e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:27.763 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fc807640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e4004d00 0x7f16e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.756+0000 7f16fc807640 1 -- 172.21.15.50:0/2670853571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4003520 con 0x7f16e40039a0 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.757+0000 7f16fd008640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16e4004d00 0x7f16e4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.757+0000 7f16fc807640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16e4003dc0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c210 tx=0x7f16e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd7428fdb4b5d20 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.757+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0005ad0 con 0x7f16e40039a0 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.757+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f0005c30 con 0x7f16e40039a0 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.757+0000 7f16f77fe640 1 -- 172.21.15.50:0/2670853571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f002c870 con 0x7f16e40039a0 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.758+0000 7f16fea6b640 1 -- 172.21.15.50:0/2670853571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 msgr2=0x7f16e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.758+0000 7f16fea6b640 1 --2- 172.21.15.50:0/2670853571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16e4003dc0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c210 tx=0x7f16e40057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.758+0000 7f16fd008640 1 -- 172.21.15.50:0/2670853571 reap_dead start 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.758+0000 7f16fea6b640 1 -- 172.21.15.50:0/2670853571 shutdown_connections 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.758+0000 7f16fea6b640 1 -- 172.21.15.50:0/2670853571 >> 172.21.15.50:0/2670853571 conn(0x7f16f80d3090 msgr2=0x7f16f80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.758+0000 7f16fea6b640 1 -- 172.21.15.50:0/2670853571 shutdown_connections 2023-12-08T08:20:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.758+0000 7f16fea6b640 1 -- 172.21.15.50:0/2670853571 wait complete. 2023-12-08T08:20:27.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.759+0000 7f16fea6b640 1 Processor -- start 2023-12-08T08:20:27.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.759+0000 7f16fea6b640 1 -- start start 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fea6b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16f8160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fea6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f8153ee0 0x7f16f8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fea6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f8143570 0x7f16f81439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fea6b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81548a0 con 0x7f16e40039a0 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fea6b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f815edb0 con 0x7f16f8143570 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fea6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f815f090 con 0x7f16f8153ee0 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16f8160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16f8160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46238/0 (socket says 172.21.15.50:46238) 2023-12-08T08:20:27.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 -- 172.21.15.50:0/3783807781 learned_addr learned my addr 172.21.15.50:0/3783807781 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16f7fff640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f8153ee0 0x7f16f8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fd008640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f8143570 0x7f16f81439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 -- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f8153ee0 msgr2=0x7f16f8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f8153ee0 0x7f16f8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 -- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f8143570 msgr2=0x7f16f81439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f8143570 0x7f16f81439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fc807640 1 -- 172.21.15.50:0/3783807781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f815f370 con 0x7f16e40039a0 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16f7fff640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f8153ee0 0x7f16f8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.760+0000 7f16fd008640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f8143570 0x7f16f81439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.761+0000 7f16fc807640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16f8160130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c210 tx=0x7f16f815dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.761+0000 7f16f57fa640 1 -- 172.21.15.50:0/3783807781 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f002ca80 con 0x7f16e40039a0 2023-12-08T08:20:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.761+0000 7f16f57fa640 1 -- 172.21.15.50:0/3783807781 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f002cbe0 con 0x7f16e40039a0 2023-12-08T08:20:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.761+0000 7f16f57fa640 1 -- 172.21.15.50:0/3783807781 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0007070 con 0x7f16e40039a0 2023-12-08T08:20:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.761+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f815f650 con 0x7f16e40039a0 2023-12-08T08:20:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.761+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f815fc10 con 0x7f16e40039a0 2023-12-08T08:20:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.762+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f815fdd0 con 0x7f16e40039a0 2023-12-08T08:20:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.762+0000 7f16f57fa640 1 -- 172.21.15.50:0/3783807781 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16f0032070 con 0x7f16e40039a0 2023-12-08T08:20:27.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.763+0000 7f16f57fa640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f16d806ae40 0x7f16d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.763+0000 7f16f57fa640 1 -- 172.21.15.50:0/3783807781 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f16f00aa600 con 0x7f16e40039a0 2023-12-08T08:20:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.763+0000 7f16f7fff640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f16d806ae40 0x7f16d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.764+0000 7f16f7fff640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f16d806ae40 0x7f16d806d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f16f8153420 tx=0x7f16e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:27.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.767+0000 7f16f57fa640 1 -- 172.21.15.50:0/3783807781 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16f0075580 con 0x7f16e40039a0 2023-12-08T08:20:27.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:27.980+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f16f8067430 con 0x7f16e40039a0 2023-12-08T08:20:28.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.002+0000 7f16f57fa640 1 -- 172.21.15.50:0/3783807781 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f16f00450b0 con 0x7f16e40039a0 2023-12-08T08:20:28.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f16d806ae40 msgr2=0x7f16d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f16d806ae40 0x7f16d806d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f16f8153420 tx=0x7f16e8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:28.007 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 msgr2=0x7f16f8160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16f8160130 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c210 tx=0x7f16f815dcf0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 shutdown_connections 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f16d806ae40 0x7f16d806d300 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16f8143570 0x7f16f81439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16f8153ee0 0x7f16f8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 --2- 172.21.15.50:0/3783807781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16e40039a0 0x7f16f8160130 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 >> 172.21.15.50:0/3783807781 conn(0x7f16f80d3090 msgr2=0x7f16f80b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 shutdown_connections 2023-12-08T08:20:28.008 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.005+0000 7f16fea6b640 1 -- 172.21.15.50:0/3783807781 wait complete. 2023-12-08T08:20:28.019 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-08T08:20:28.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-08T08:20:28.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.126+0000 7f1bdb12c640 1 Processor -- start 2023-12-08T08:20:28.129 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.126+0000 7f1bdb12c640 1 -- start start 2023-12-08T08:20:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.127+0000 7f1bdb12c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 0x7f1bd406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.127+0000 7f1bdb12c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1bd40b0b10 0x7f1bd4160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.127+0000 7f1bdb12c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40ce180 con 0x7f1bd40b1a80 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.127+0000 7f1bdb12c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40b3830 con 0x7f1bd40b0b10 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.127+0000 7f1bdb12c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40b0fa0 con 0x7f1bd40cdda0 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.127+0000 7f1bd3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1bd40b1a80 0x7f1bd40b0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40856/0 (socket says 172.21.15.50:40856) 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.127+0000 7f1bd3fff640 1 -- 172.21.15.50:0/130524166 learned_addr learned my addr 172.21.15.50:0/130524166 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 0x7f1bd406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd96c9640 1 --2- 172.21.15.50:0/130524166 >> v2:172.21.15.170:3300/0 conn(0x7f1bd40b0b10 0x7f1bd4160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546903788 0 0) 0x7f1bd40ce180 con 0x7f1bd40b1a80 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc0003520 con 0x7f1bd40b1a80 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3122006026 0 0) 0x7f1bc0003520 con 0x7f1bd40b1a80 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 msgr2=0x7f1bd406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 0x7f1bd406ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 >> v2:172.21.15.170:3300/0 conn(0x7f1bd40b0b10 msgr2=0x7f1bd4160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 --2- 172.21.15.50:0/130524166 >> v2:172.21.15.170:3300/0 conn(0x7f1bd40b0b10 0x7f1bd4160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40ce770 con 0x7f1bd40b1a80 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f1bc4001670 con 0x7f1bd40b1a80 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd96c9640 1 --2- 172.21.15.50:0/130524166 >> v2:172.21.15.170:3300/0 conn(0x7f1bd40b0b10 0x7f1bd4160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 >> v1:172.21.15.50:6789/0 conn(0x7f1bd40b1a80 legacy=0x7f1bd40b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc0003970 0x7f1bc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 0x7f1bc00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0004d00 0x7f1bc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40b3830 con 0x7f1bc0003970 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc000b980 con 0x7f1bc0004d00 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc000bb40 con 0x7f1bd40cdda0 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc0003970 0x7f1bc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd3fff640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 0x7f1bc00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd96c9640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0004d00 0x7f1bc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd8ec8640 1 -- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 msgr2=0x7f1bc00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 0x7f1bc00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd8ec8640 1 -- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0004d00 msgr2=0x7f1bc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0004d00 0x7f1bc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd8ec8640 1 -- 172.21.15.50:0/130524166 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0003520 con 0x7f1bc0003970 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd3fff640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd40cdda0 0x7f1bc00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.128+0000 7f1bd96c9640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0004d00 0x7f1bc0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.129+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc0003970 0x7f1bc0003d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009fc0 tx=0x7f1bc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be16fa8f34deac28 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.129+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc02cc20 con 0x7f1bc0003970 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.129+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc00f040 con 0x7f1bc0003970 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.129+0000 7f1bd37fe640 1 -- 172.21.15.50:0/130524166 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc034440 con 0x7f1bc0003970 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.130+0000 7f1bdb12c640 1 -- 172.21.15.50:0/130524166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc0003970 msgr2=0x7f1bc0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.130+0000 7f1bdb12c640 1 --2- 172.21.15.50:0/130524166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bc0003970 0x7f1bc0003d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009fc0 tx=0x7f1bc00057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.130+0000 7f1bd96c9640 1 -- 172.21.15.50:0/130524166 reap_dead start 2023-12-08T08:20:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.130+0000 7f1bdb12c640 1 -- 172.21.15.50:0/130524166 shutdown_connections 2023-12-08T08:20:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.130+0000 7f1bdb12c640 1 -- 172.21.15.50:0/130524166 >> 172.21.15.50:0/130524166 conn(0x7f1bd40b2900 msgr2=0x7f1bd40b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.130+0000 7f1bdb12c640 1 -- 172.21.15.50:0/130524166 shutdown_connections 2023-12-08T08:20:28.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.130+0000 7f1bdb12c640 1 -- 172.21.15.50:0/130524166 wait complete. 2023-12-08T08:20:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.131+0000 7f1bdb12c640 1 Processor -- start 2023-12-08T08:20:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.131+0000 7f1bdb12c640 1 -- start start 2023-12-08T08:20:28.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bdb12c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0003970 0x7f1bd41572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bdb12c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd40c7070 0x7f1bd4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bdb12c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd406f490 0x7f1bd406f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bdb12c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41595e0 con 0x7f1bd40c7070 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bdb12c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd406fe50 con 0x7f1bc0003970 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bdb12c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41597f0 con 0x7f1bd406f490 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd40c7070 0x7f1bd4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd40c7070 0x7f1bd4148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46264/0 (socket says 172.21.15.50:46264) 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 -- 172.21.15.50:0/4184618387 learned_addr learned my addr 172.21.15.50:0/4184618387 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd96c9640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd406f490 0x7f1bd406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0003970 0x7f1bd41572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 -- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd406f490 msgr2=0x7f1bd406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd406f490 0x7f1bd406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 -- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0003970 msgr2=0x7f1bd41572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:28.139 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0003970 0x7f1bd41572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.132+0000 7f1bd3fff640 1 -- 172.21.15.50:0/4184618387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4159ad0 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.133+0000 7f1bd3fff640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd40c7070 0x7f1bd4148f30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000fb0 tx=0x7f1bc400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.133+0000 7f1bd17fa640 1 -- 172.21.15.50:0/4184618387 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400c690 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.133+0000 7f1bd17fa640 1 -- 172.21.15.50:0/4184618387 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc400c7f0 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.133+0000 7f1bd17fa640 1 -- 172.21.15.50:0/4184618387 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400cb80 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.133+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd4159db0 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.133+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd40c74d0 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.134+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd415a2d0 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.134+0000 7f1bd17fa640 1 -- 172.21.15.50:0/4184618387 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1bc401d460 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.135+0000 7f1bd17fa640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1bb406ae40 0x7f1bb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.135+0000 7f1bd17fa640 1 -- 172.21.15.50:0/4184618387 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1bc4089940 con 0x7f1bd40c7070 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.135+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1bb406ae40 0x7f1bb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:28.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.135+0000 7f1bd8ec8640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1bb406ae40 0x7f1bb406d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc036000 tx=0x7f1bcc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:28.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.139+0000 7f1bd17fa640 1 -- 172.21.15.50:0/4184618387 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1bd415a2d0 con 0x7f1bd40c7070 2023-12-08T08:20:28.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:28.351+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1bd415a2d0 con 0x7f1bd40c7070 2023-12-08T08:20:29.013 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.010+0000 7f1bd17fa640 1 -- 172.21.15.50:0/4184618387 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1bd415a2d0 con 0x7f1bd40c7070 2023-12-08T08:20:29.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1bb406ae40 msgr2=0x7f1bb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1bb406ae40 0x7f1bb406d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc036000 tx=0x7f1bcc02e000 comp rx=0 tx=0).stop 2023-12-08T08:20:29.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd40c7070 msgr2=0x7f1bd4148f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd40c7070 0x7f1bd4148f30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000fb0 tx=0x7f1bc400eb90 comp rx=0 tx=0).stop 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 shutdown_connections 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1bb406ae40 0x7f1bb406d300 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1bd40c7070 0x7f1bd4148f30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1bd406f490 0x7f1bd406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 --2- 172.21.15.50:0/4184618387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bc0003970 0x7f1bd41572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 >> 172.21.15.50:0/4184618387 conn(0x7f1bd40b2900 msgr2=0x7f1bd40af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 shutdown_connections 2023-12-08T08:20:29.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.013+0000 7f1bdb12c640 1 -- 172.21.15.50:0/4184618387 wait complete. 2023-12-08T08:20:29.029 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-08T08:20:29.030 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.139+0000 7f7656de5640 1 Processor -- start 2023-12-08T08:20:29.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f7656de5640 1 -- start start 2023-12-08T08:20:29.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f7656de5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76501608a0 0x7f76500d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f7656de5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76500b0cf0 0x7f76500cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f7656de5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76500d20b0 con 0x7f76500b1d70 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f7656de5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500d0620 con 0x7f76500b0cf0 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f7656de5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500d1b80 con 0x7f76501608a0 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f7655382640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f76500b0cf0 0x7f76500cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f764ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f76500b1d70 0x7f76500d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40860/0 (socket says 172.21.15.50:40860) 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.140+0000 7f764ffff640 1 -- 172.21.15.50:0/2624982724 learned_addr learned my addr 172.21.15.50:0/2624982724 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.141+0000 7f7654b81640 1 --2- 172.21.15.50:0/2624982724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76501608a0 0x7f76500d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.141+0000 7f764f7fe640 1 -- 172.21.15.50:0/2624982724 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916709260 0 0) 0x7f76500d20b0 con 0x7f76500b1d70 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.141+0000 7f764f7fe640 1 -- 172.21.15.50:0/2624982724 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7640003520 con 0x7f76500b1d70 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.141+0000 7f7655382640 1 -- 172.21.15.50:0/2624982724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76501608a0 msgr2=0x7f76500d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.141+0000 7f7655382640 1 --2- 172.21.15.50:0/2624982724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76501608a0 0x7f76500d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.141+0000 7f7655382640 1 -- 172.21.15.50:0/2624982724 >> v1:172.21.15.50:6789/0 conn(0x7f76500b1d70 legacy=0x7f76500d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.141+0000 7f7655382640 1 -- 172.21.15.50:0/2624982724 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500d1dd0 con 0x7f76500b0cf0 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.142+0000 7f7655382640 1 --2- 172.21.15.50:0/2624982724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b0cf0 0x7f76500cdc40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7648009d90 tx=0x7f764802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a249b448a0ab4d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.142+0000 7f764f7fe640 1 -- 172.21.15.50:0/2624982724 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764802cbc0 con 0x7f76500b0cf0 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.142+0000 7f764f7fe640 1 -- 172.21.15.50:0/2624982724 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764802cd20 con 0x7f76500b0cf0 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.142+0000 7f764f7fe640 1 -- 172.21.15.50:0/2624982724 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648034660 con 0x7f76500b0cf0 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.142+0000 7f7656de5640 1 -- 172.21.15.50:0/2624982724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b0cf0 msgr2=0x7f76500cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.142+0000 7f7656de5640 1 --2- 172.21.15.50:0/2624982724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b0cf0 0x7f76500cdc40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7648009d90 tx=0x7f764802be10 comp rx=0 tx=0).stop 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.143+0000 7f7656de5640 1 -- 172.21.15.50:0/2624982724 shutdown_connections 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.143+0000 7f7656de5640 1 --2- 172.21.15.50:0/2624982724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b0cf0 0x7f76500cdc40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.143+0000 7f7656de5640 1 --2- 172.21.15.50:0/2624982724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76501608a0 0x7f76500d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.143+0000 7f7656de5640 1 -- 172.21.15.50:0/2624982724 >> 172.21.15.50:0/2624982724 conn(0x7f76500d3030 msgr2=0x7f76500d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.143+0000 7f7656de5640 1 -- 172.21.15.50:0/2624982724 shutdown_connections 2023-12-08T08:20:29.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.143+0000 7f7656de5640 1 -- 172.21.15.50:0/2624982724 wait complete. 2023-12-08T08:20:29.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.144+0000 7f7656de5640 1 Processor -- start 2023-12-08T08:20:29.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.144+0000 7f7656de5640 1 -- start start 2023-12-08T08:20:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7656de5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76500b0cf0 0x7f76501499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7656de5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b1d70 0x7f76501f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7656de5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76501608a0 0x7f7650146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7656de5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7650149f30 con 0x7f76500b1d70 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7656de5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b5fc0 con 0x7f76501608a0 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7656de5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b62a0 con 0x7f76500b0cf0 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b1d70 0x7f76501f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b1d70 0x7f76501f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46288/0 (socket says 172.21.15.50:46288) 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 -- 172.21.15.50:0/2938536661 learned_addr learned my addr 172.21.15.50:0/2938536661 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7654b81640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76500b0cf0 0x7f76501499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f7655382640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76501608a0 0x7f7650146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 -- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76500b0cf0 msgr2=0x7f76501499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76500b0cf0 0x7f76501499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 -- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76501608a0 msgr2=0x7f7650146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76501608a0 0x7f7650146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 -- 172.21.15.50:0/2938536661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648009a70 con 0x7f76500b1d70 2023-12-08T08:20:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.145+0000 7f764ffff640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b1d70 0x7f76501f61d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c430 tx=0x7f763c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.146+0000 7f764d7fa640 1 -- 172.21.15.50:0/2938536661 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c005ce0 con 0x7f76500b1d70 2023-12-08T08:20:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.146+0000 7f764d7fa640 1 -- 172.21.15.50:0/2938536661 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c005e40 con 0x7f76500b1d70 2023-12-08T08:20:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.146+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500b79f0 con 0x7f76500b1d70 2023-12-08T08:20:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.146+0000 7f764d7fa640 1 -- 172.21.15.50:0/2938536661 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0072f0 con 0x7f76500b1d70 2023-12-08T08:20:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.146+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76500b7fb0 con 0x7f76500b1d70 2023-12-08T08:20:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.147+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500b7850 con 0x7f76500b1d70 2023-12-08T08:20:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.147+0000 7f764d7fa640 1 -- 172.21.15.50:0/2938536661 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f763c007450 con 0x7f76500b1d70 2023-12-08T08:20:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.148+0000 7f764d7fa640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f763406ae70 0x7f763406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.148+0000 7f764d7fa640 1 -- 172.21.15.50:0/2938536661 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f763c088dc0 con 0x7f76500b1d70 2023-12-08T08:20:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.148+0000 7f7654b81640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f763406ae70 0x7f763406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.149+0000 7f7654b81640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f763406ae70 0x7f763406d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7644009aa0 tx=0x7f7644009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.152+0000 7f764d7fa640 1 -- 172.21.15.50:0/2938536661 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76500b7850 con 0x7f76500b1d70 2023-12-08T08:20:29.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.366+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76500b7850 con 0x7f76500b1d70 2023-12-08T08:20:29.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.366+0000 7f764d7fa640 1 -- 172.21.15.50:0/2938536661 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f76500b7850 con 0x7f76500b1d70 2023-12-08T08:20:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:29.370 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/3932110318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":3932110318},{"type":"v1","addr":"172.21.15.170:6836","nonce":3932110318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/1019645291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":1019645291},{"type":"v1","addr":"172.21.15.170:6837","nonce":1019645291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3216810814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3216810814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3216810814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:26.368189+0000","modified":"2023-12-08T08:20:28.353010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4199554410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4199554410},{"type":"v1","addr":"172.21.15.50:6835","nonce":4199554410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:20:29.370 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-12-08T08:20:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f763406ae70 msgr2=0x7f763406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f763406ae70 0x7f763406d330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7644009aa0 tx=0x7f7644009190 comp rx=0 tx=0).stop 2023-12-08T08:20:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b1d70 msgr2=0x7f76501f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b1d70 0x7f76501f61d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c430 tx=0x7f763c00c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 shutdown_connections 2023-12-08T08:20:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f763406ae70 0x7f763406d330 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76500b1d70 0x7f76501f61d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76501608a0 0x7f7650146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 --2- 172.21.15.50:0/2938536661 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f76500b0cf0 0x7f76501499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 >> 172.21.15.50:0/2938536661 conn(0x7f76500d3030 msgr2=0x7f765015ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 shutdown_connections 2023-12-08T08:20:29.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.368+0000 7f7656de5640 1 -- 172.21.15.50:0/2938536661 wait complete. 2023-12-08T08:20:29.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.485+0000 7fe6547f1640 1 Processor -- start 2023-12-08T08:20:29.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.486+0000 7fe6547f1640 1 -- start start 2023-12-08T08:20:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.486+0000 7fe6547f1640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe64c0b3340 0x7fe64c0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.486+0000 7fe6547f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.486+0000 7fe6547f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe64c0d15f0 0x7fe64c0d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.486+0000 7fe6547f1640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c0d1fa0 con 0x7fe64c0b3340 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.486+0000 7fe6547f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c0cdc20 con 0x7fe64c0d15f0 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.486+0000 7fe6547f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0d11d0 con 0x7fe64c0b3bf0 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe64c0b3340 0x7fe64c0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe64c0b3340 0x7fe64c0d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46302/0 (socket says 172.21.15.50:46302) 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 -- 172.21.15.50:0/3253062965 learned_addr learned my addr 172.21.15.50:0/3253062965 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe651d8c640 1 --2- 172.21.15.50:0/3253062965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe652d8e640 1 --2- 172.21.15.50:0/3253062965 >> v2:172.21.15.170:3300/0 conn(0x7fe64c0d15f0 0x7fe64c0d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 -- 172.21.15.50:0/3253062965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 msgr2=0x7fe64c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 --2- 172.21.15.50:0/3253062965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 -- 172.21.15.50:0/3253062965 >> v2:172.21.15.170:3300/0 conn(0x7fe64c0d15f0 msgr2=0x7fe64c0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 --2- 172.21.15.50:0/3253062965 >> v2:172.21.15.170:3300/0 conn(0x7fe64c0d15f0 0x7fe64c0d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.487+0000 7fe65258d640 1 -- 172.21.15.50:0/3253062965 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c0d3a60 con 0x7fe64c0b3340 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.488+0000 7fe65258d640 1 --2- 172.21.15.50:0/3253062965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0b3340 0x7fe64c0d00c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe64c09c800 tx=0x7fe64802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a003987f1815c309 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.488+0000 7fe65158b640 1 -- 172.21.15.50:0/3253062965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6480317e0 con 0x7fe64c0b3340 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.488+0000 7fe65158b640 1 -- 172.21.15.50:0/3253062965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe648031940 con 0x7fe64c0b3340 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.488+0000 7fe65158b640 1 -- 172.21.15.50:0/3253062965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648031cd0 con 0x7fe64c0b3340 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.488+0000 7fe6547f1640 1 -- 172.21.15.50:0/3253062965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0b3340 msgr2=0x7fe64c0d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.488+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3253062965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0b3340 0x7fe64c0d00c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe64c09c800 tx=0x7fe64802b880 comp rx=0 tx=0).stop 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.489+0000 7fe6547f1640 1 -- 172.21.15.50:0/3253062965 shutdown_connections 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.489+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3253062965 >> v2:172.21.15.170:3300/0 conn(0x7fe64c0d15f0 0x7fe64c0d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.489+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3253062965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.489+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3253062965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0b3340 0x7fe64c0d00c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.489+0000 7fe6547f1640 1 -- 172.21.15.50:0/3253062965 >> 172.21.15.50:0/3253062965 conn(0x7fe64c09c2f0 msgr2=0x7fe64c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.489+0000 7fe6547f1640 1 -- 172.21.15.50:0/3253062965 shutdown_connections 2023-12-08T08:20:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.489+0000 7fe6547f1640 1 -- 172.21.15.50:0/3253062965 wait complete. 2023-12-08T08:20:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.490+0000 7fe6547f1640 1 Processor -- start 2023-12-08T08:20:29.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.490+0000 7fe6547f1640 1 -- start start 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.490+0000 7fe6547f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64c0b3340 0x7fe64c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.490+0000 7fe6547f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe6547f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0d15f0 0x7fe64c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe6547f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0b1db0 con 0x7fe64c0d15f0 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe6547f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0b28c0 con 0x7fe64c0b3340 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe6547f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0b2020 con 0x7fe64c0b3bf0 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0d15f0 0x7fe64c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0d15f0 0x7fe64c0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46306/0 (socket says 172.21.15.50:46306) 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 -- 172.21.15.50:0/3794890974 learned_addr learned my addr 172.21.15.50:0/3794890974 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe651d8c640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe65258d640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64c0b3340 0x7fe64c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 -- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 msgr2=0x7fe64c156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 -- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64c0b3340 msgr2=0x7fe64c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64c0b3340 0x7fe64c158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 -- 172.21.15.50:0/3794890974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480094d0 con 0x7fe64c0d15f0 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe65258d640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64c0b3340 0x7fe64c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe652d8e640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0d15f0 0x7fe64c0b1870 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe64400efc0 tx=0x7fe64400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe642ffd640 1 -- 172.21.15.50:0/3794890974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644009ba0 con 0x7fe64c0d15f0 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe642ffd640 1 -- 172.21.15.50:0/3794890974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64400f040 con 0x7fe64c0d15f0 2023-12-08T08:20:29.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c0b2300 con 0x7fe64c0d15f0 2023-12-08T08:20:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe642ffd640 1 -- 172.21.15.50:0/3794890974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440146c0 con 0x7fe64c0d15f0 2023-12-08T08:20:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.491+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c159c10 con 0x7fe64c0d15f0 2023-12-08T08:20:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.492+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c067430 con 0x7fe64c0d15f0 2023-12-08T08:20:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.493+0000 7fe642ffd640 1 -- 172.21.15.50:0/3794890974 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe644014820 con 0x7fe64c0d15f0 2023-12-08T08:20:29.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.493+0000 7fe642ffd640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe63006ae40 0x7fe63006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.493+0000 7fe642ffd640 1 -- 172.21.15.50:0/3794890974 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe64408a1a0 con 0x7fe64c0d15f0 2023-12-08T08:20:29.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.493+0000 7fe65258d640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe63006ae40 0x7fe63006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.494+0000 7fe65258d640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe63006ae40 0x7fe63006d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe648036000 tx=0x7fe64803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.497+0000 7fe642ffd640 1 -- 172.21.15.50:0/3794890974 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe644055080 con 0x7fe64c0d15f0 2023-12-08T08:20:29.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.674+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe64c0b6a50 con 0x7fe64c0d15f0 2023-12-08T08:20:29.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.675+0000 7fe642ffd640 1 -- 172.21.15.50:0/3794890974 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fe6440586a0 con 0x7fe64c0d15f0 2023-12-08T08:20:29.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:29.679 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe63006ae40 msgr2=0x7fe63006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe63006ae40 0x7fe63006d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe648036000 tx=0x7fe64803d040 comp rx=0 tx=0).stop 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0d15f0 msgr2=0x7fe64c0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0d15f0 0x7fe64c0b1870 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe64400efc0 tx=0x7fe64400c490 comp rx=0 tx=0).stop 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 shutdown_connections 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe63006ae40 0x7fe63006d300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe64c0d15f0 0x7fe64c0b1870 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe64c0b3bf0 0x7fe64c156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 --2- 172.21.15.50:0/3794890974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe64c0b3340 0x7fe64c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 >> 172.21.15.50:0/3794890974 conn(0x7fe64c09c2f0 msgr2=0x7fe64c0cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 shutdown_connections 2023-12-08T08:20:29.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.677+0000 7fe6547f1640 1 -- 172.21.15.50:0/3794890974 wait complete. 2023-12-08T08:20:29.691 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-08T08:20:29.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:29.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.795+0000 7f2349456640 1 Processor -- start 2023-12-08T08:20:29.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.795+0000 7f2349456640 1 -- start start 2023-12-08T08:20:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f2349456640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2344144440 0x7f23440cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f2349456640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2344144930 0x7f23440cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f2349456640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23440cc110 0x7f234415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f2349456640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440ca720 con 0x7f23440cc110 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f2349456640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440cfb50 con 0x7f2344144440 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f2349456640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440711e0 con 0x7f2344144930 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23440cc110 0x7f234415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f23440cc110 0x7f234415ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57130/0 (socket says 172.21.15.50:57130) 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 -- 172.21.15.50:0/3562998284 learned_addr learned my addr 172.21.15.50:0/3562998284 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23427fc640 1 --2- 172.21.15.50:0/3562998284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2344144930 0x7f23440cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f2342ffd640 1 --2- 172.21.15.50:0/3562998284 >> v2:172.21.15.170:3300/0 conn(0x7f2344144440 0x7f23440cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 -- 172.21.15.50:0/3562998284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2344144930 msgr2=0x7f23440cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:29.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 --2- 172.21.15.50:0/3562998284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2344144930 0x7f23440cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 -- 172.21.15.50:0/3562998284 >> v2:172.21.15.170:3300/0 conn(0x7f2344144440 msgr2=0x7f23440cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:29.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 --2- 172.21.15.50:0/3562998284 >> v2:172.21.15.170:3300/0 conn(0x7f2344144440 0x7f23440cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.796+0000 7f23437fe640 1 -- 172.21.15.50:0/3562998284 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440714a0 con 0x7f23440cc110 2023-12-08T08:20:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.797+0000 7f23437fe640 1 --2- 172.21.15.50:0/3562998284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23440cc110 0x7f234415ebf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f234404f230 tx=0x7f233c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379d4e25927748b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.797+0000 7f2341ffb640 1 -- 172.21.15.50:0/3562998284 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c031640 con 0x7f23440cc110 2023-12-08T08:20:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.797+0000 7f2341ffb640 1 -- 172.21.15.50:0/3562998284 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c0317a0 con 0x7f23440cc110 2023-12-08T08:20:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.797+0000 7f2341ffb640 1 -- 172.21.15.50:0/3562998284 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c031b30 con 0x7f23440cc110 2023-12-08T08:20:29.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 -- 172.21.15.50:0/3562998284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23440cc110 msgr2=0x7f234415ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 --2- 172.21.15.50:0/3562998284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23440cc110 0x7f234415ebf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f234404f230 tx=0x7f233c02b8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 -- 172.21.15.50:0/3562998284 shutdown_connections 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 --2- 172.21.15.50:0/3562998284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23440cc110 0x7f234415ebf0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 --2- 172.21.15.50:0/3562998284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2344144930 0x7f23440cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 --2- 172.21.15.50:0/3562998284 >> v2:172.21.15.170:3300/0 conn(0x7f2344144440 0x7f23440cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 -- 172.21.15.50:0/3562998284 >> 172.21.15.50:0/3562998284 conn(0x7f23440cfda0 msgr2=0x7f23440d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 -- 172.21.15.50:0/3562998284 shutdown_connections 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.798+0000 7f2349456640 1 -- 172.21.15.50:0/3562998284 wait complete. 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.799+0000 7f2349456640 1 Processor -- start 2023-12-08T08:20:29.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.799+0000 7f2349456640 1 -- start start 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2349456640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23440cc110 0x7f2344099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2349456640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344144440 0x7f23440ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2349456640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2344144930 0x7f2344153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2349456640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234409ae30 con 0x7f2344144440 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2349456640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344099f50 con 0x7f2344144930 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2349456640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234409a220 con 0x7f23440cc110 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344144440 0x7f23440ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344144440 0x7f23440ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57140/0 (socket says 172.21.15.50:57140) 2023-12-08T08:20:29.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 -- 172.21.15.50:0/204772314 learned_addr learned my addr 172.21.15.50:0/204772314 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2342ffd640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23440cc110 0x7f2344099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23437fe640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2344144930 0x7f2344153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 -- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23440cc110 msgr2=0x7f2344099a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23440cc110 0x7f2344099a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 -- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2344144930 msgr2=0x7f2344153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2344144930 0x7f2344153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 -- 172.21.15.50:0/204772314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0094d0 con 0x7f2344144440 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f2342ffd640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23440cc110 0x7f2344099a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.800+0000 7f23427fc640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344144440 0x7f23440ae680 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f232c00d5f0 tx=0x7f232c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.801+0000 7f233b7fe640 1 -- 172.21.15.50:0/204772314 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0125f0 con 0x7f2344144440 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.801+0000 7f233b7fe640 1 -- 172.21.15.50:0/204772314 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c012750 con 0x7f2344144440 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.801+0000 7f233b7fe640 1 -- 172.21.15.50:0/204772314 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c012b00 con 0x7f2344144440 2023-12-08T08:20:29.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.801+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234409a500 con 0x7f2344144440 2023-12-08T08:20:29.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.801+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234409aac0 con 0x7f2344144440 2023-12-08T08:20:29.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.802+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234409afe0 con 0x7f2344144440 2023-12-08T08:20:29.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.802+0000 7f233b7fe640 1 -- 172.21.15.50:0/204772314 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f232c012c60 con 0x7f2344144440 2023-12-08T08:20:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.803+0000 7f233b7fe640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f232406ae40 0x7f232406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.803+0000 7f233b7fe640 1 -- 172.21.15.50:0/204772314 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f232c089c00 con 0x7f2344144440 2023-12-08T08:20:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.803+0000 7f2342ffd640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f232406ae40 0x7f232406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:29.808 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.803+0000 7f2342ffd640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f232406ae40 0x7f232406d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2334009b20 tx=0x7f23340039d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:29.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.807+0000 7f233b7fe640 1 -- 172.21.15.50:0/204772314 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f234409afe0 con 0x7f2344144440 2023-12-08T08:20:29.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.980+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23440d0180 con 0x7f232406ae40 2023-12-08T08:20:29.991 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.988+0000 7f233b7fe640 1 -- 172.21.15.50:0/204772314 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274858 (secure 0 0 0) 0x7f23440d0180 con 0x7f232406ae40 2023-12-08T08:20:29.996 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:29.998 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f232406ae40 msgr2=0x7f232406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f232406ae40 0x7f232406d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2334009b20 tx=0x7f23340039d0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344144440 msgr2=0x7f23440ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344144440 0x7f23440ae680 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f232c00d5f0 tx=0x7f232c00dab0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 shutdown_connections 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f232406ae40 0x7f232406d300 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2344144440 0x7f23440ae680 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2344144930 0x7f2344153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 --2- 172.21.15.50:0/204772314 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23440cc110 0x7f2344099a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 >> 172.21.15.50:0/204772314 conn(0x7f23440cfda0 msgr2=0x7f23440ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 shutdown_connections 2023-12-08T08:20:30.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:29.991+0000 7f2349456640 1 -- 172.21.15.50:0/204772314 wait complete. 2023-12-08T08:20:30.006 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-12-08T08:20:28.151872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255508,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754719212,"statfs":{"total":773094113280,"available":772832473088,"internally_reserved":0,"allocated":6164480,"data_stored":3388133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000993"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:25.991378+0000","last_change":"2023-12-08T08:20:25.991378+0000","last_active":"2023-12-08T08:20:25.991378+0000","last_peered":"2023-12-08T08:20:25.991378+0000","last_clean":"2023-12-08T08:20:25.991378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:25.991378+0000","last_undegraded":"2023-12-08T08:20:25.991378+0000","last_fullsized":"2023-12-08T08:20:25.991378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-08T08:20:24.986340+0000","last_change":"2023-12-08T08:20:24.986340+0000","last_active":"2023-12-08T08:20:24.986340+0000","last_peered":"2023-12-08T08:20:24.986340+0000","last_clean":"2023-12-08T08:20:24.986340+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-08T08:20:24.986340+0000","last_undegraded":"2023-12-08T08:20:24.986340+0000","last_fullsized":"2023-12-08T08:20:24.986340+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-08T08:20:21.847383+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:20:21.847383+0000","last_peered":"2023-12-08T08:20:21.847383+0000","last_clean":"2023-12-08T08:20:21.847383+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:20:21.847383+0000","last_undegraded":"2023-12-08T08:20:21.847383+0000","last_fullsized":"2023-12-08T08:20:21.847383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1216512,"data_stored":866420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67300000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.38700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.496},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.88,"15min":0.88},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70399999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54100000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.503,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.496},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.505}]},{"osd":5,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.375},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42199999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78800000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":276052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.67500000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80100000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.627}]},{"osd":2,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70099999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.501}]},{"osd":3,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.754,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69999999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71999999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":276052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69699999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.622},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.503,"15min":0.497},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.68200000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68700000000000006}]},{"osd":4,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63600000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69599999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.78800000000000003,"5min":0.88,"15min":0.88},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31804,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":622592,"data_stored":276052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53800000000000003,"15min":0.54700000000000004},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.621,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":1.022,"15min":1.022},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64100000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77300000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.62}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":622592,"data_stored":276052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35999999999999999,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28100000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.44900000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57499999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.433,"15min":0.439},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52000000000000002,"5min":0.623,"15min":0.623},"last":0.439},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56100000000000005,"5min":0.751,"15min":0.751},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.748},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79000000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":622592,"data_stored":276052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.33000000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.377}]},{"osd":1,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.50700000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.311},{"interface":"front","average":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35299999999999998},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53500000000000003,"5min":0.623,"15min":0.623},"last":0.27300000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.30599999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.55500000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.45600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.432,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.48299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76200000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.36599999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.879,"15min":0.879},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.42899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":622592,"data_stored":276052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.17199999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.45800000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.30099999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.439,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38,"5min":0.377,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52900000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.23999999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41499999999999998,"15min":0.42099999999999999},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.48399999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.376,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.46600000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.255}]},{"osd":4,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.378}]},{"osd":5,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79000000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65100000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.36799999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70099999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1212416,"data_stored":865401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.33700000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.61599999999999999,"5min":0.628,"15min":0.628},"last":0.307},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.58599999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.372},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.71399999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.52200000000000002,"15min":0.54200000000000004},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63400000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86499999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.621}]},{"osd":5,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.626},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70499999999999996}]},{"osd":7,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:30.011 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:20:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.150+0000 7f14b7a3d640 1 Processor -- start 2023-12-08T08:20:30.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.150+0000 7f14b7a3d640 1 -- start start 2023-12-08T08:20:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.150+0000 7f14b7a3d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b7a3d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f14b015e150 0x7f14b0161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b7a3d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b006b070 con 0x7f14b00cf760 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b7a3d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b0072290 con 0x7f14b015e150 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b7a3d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00d0d00 con 0x7f14b00cf380 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b5fda640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f14b015e150 0x7f14b0161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b5fda640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f14b015e150 0x7f14b0161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57146/0 (socket says 172.21.15.50:57146) 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b5fda640 1 -- 172.21.15.50:0/3218052113 learned_addr learned my addr 172.21.15.50:0/3218052113 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b57d9640 1 --2- 172.21.15.50:0/3218052113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b5fda640 1 -- 172.21.15.50:0/3218052113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 msgr2=0x7f14b006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b5fda640 1 --2- 172.21.15.50:0/3218052113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b006a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b5fda640 1 -- 172.21.15.50:0/3218052113 >> v1:172.21.15.170:6789/0 conn(0x7f14b00cf760 legacy=0x7f14b0071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14affff640 1 -- 172.21.15.50:0/3218052113 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089136242 0 0) 0x7f14b006b070 con 0x7f14b00cf760 2023-12-08T08:20:30.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.151+0000 7f14b5fda640 1 -- 172.21.15.50:0/3218052113 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b006aab0 con 0x7f14b015e150 2023-12-08T08:20:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.152+0000 7f14b5fda640 1 --2- 172.21.15.50:0/3218052113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b015e150 0x7f14b0161690 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009e80 tx=0x7f14a002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f7bdc829bb3124 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.152+0000 7f14affff640 1 -- 172.21.15.50:0/3218052113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a002ca50 con 0x7f14b015e150 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.152+0000 7f14affff640 1 -- 172.21.15.50:0/3218052113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a002cbb0 con 0x7f14b015e150 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.152+0000 7f14affff640 1 -- 172.21.15.50:0/3218052113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00343f0 con 0x7f14b015e150 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.152+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3218052113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b015e150 msgr2=0x7f14b0161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.152+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3218052113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b015e150 0x7f14b0161690 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009e80 tx=0x7f14a002beb0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.153+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3218052113 shutdown_connections 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.153+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3218052113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b015e150 0x7f14b0161690 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.153+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3218052113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b006a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.153+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3218052113 >> 172.21.15.50:0/3218052113 conn(0x7f14b00cfda0 msgr2=0x7f14b00d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.153+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3218052113 shutdown_connections 2023-12-08T08:20:30.157 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.153+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3218052113 wait complete. 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.154+0000 7f14b7a3d640 1 Processor -- start 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.154+0000 7f14b7a3d640 1 -- start start 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b7a3d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b015b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b7a3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b00cf760 0x7f14b00b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b7a3d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14b015e150 0x7f14b00b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b7a3d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015c450 con 0x7f14b00cf760 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b7a3d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015b840 con 0x7f14b015e150 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b7a3d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015bb20 con 0x7f14b00cf380 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b00cf760 0x7f14b00b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b00cf760 0x7f14b00b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57156/0 (socket says 172.21.15.50:57156) 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 -- 172.21.15.50:0/3471425813 learned_addr learned my addr 172.21.15.50:0/3471425813 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b57d9640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b015b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b5fda640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14b015e150 0x7f14b00b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 -- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 msgr2=0x7f14b015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b015b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 -- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14b015e150 msgr2=0x7f14b00b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14b015e150 0x7f14b00b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 -- 172.21.15.50:0/3471425813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0009b30 con 0x7f14b00cf760 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b5fda640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14b015e150 0x7f14b00b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b57d9640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b4fd8640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b00cf760 0x7f14b00b0a10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c410 tx=0x7f14a400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14adffb640 1 -- 172.21.15.50:0/3471425813 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40035f0 con 0x7f14b00cf760 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14adffb640 1 -- 172.21.15.50:0/3471425813 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4003770 con 0x7f14b00cf760 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14adffb640 1 -- 172.21.15.50:0/3471425813 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003b20 con 0x7f14b00cf760 2023-12-08T08:20:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.155+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b015be00 con 0x7f14b00cf760 2023-12-08T08:20:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.156+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b015c8e0 con 0x7f14b00cf760 2023-12-08T08:20:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.157+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b015ca70 con 0x7f14b00cf760 2023-12-08T08:20:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.157+0000 7f14adffb640 1 -- 172.21.15.50:0/3471425813 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14a4003c80 con 0x7f14b00cf760 2023-12-08T08:20:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.157+0000 7f14adffb640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f149c06ae40 0x7f149c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.157+0000 7f14adffb640 1 -- 172.21.15.50:0/3471425813 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f14a4088cf0 con 0x7f14b00cf760 2023-12-08T08:20:30.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.158+0000 7f14b57d9640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f149c06ae40 0x7f149c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.158+0000 7f14b57d9640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f149c06ae40 0x7f149c06d300 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14b006b570 tx=0x7f14a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.161+0000 7f14adffb640 1 -- 172.21.15.50:0/3471425813 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14b015ca70 con 0x7f14b00cf760 2023-12-08T08:20:30.336 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.333+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14b0161bd0 con 0x7f149c06ae40 2023-12-08T08:20:30.344 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.341+0000 7f14adffb640 1 -- 172.21.15.50:0/3471425813 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289636 (secure 0 0 0) 0x7f14a8011980 con 0x7f149c06ae40 2023-12-08T08:20:30.347 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:30.348 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f149c06ae40 msgr2=0x7f149c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f149c06ae40 0x7f149c06d300 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14b006b570 tx=0x7f14a8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b00cf760 msgr2=0x7f14b00b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b00cf760 0x7f14b00b0a10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c410 tx=0x7f14a400c8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 shutdown_connections 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f149c06ae40 0x7f149c06d300 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f14b00cf760 0x7f14b00b0a10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14b015e150 0x7f14b00b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 --2- 172.21.15.50:0/3471425813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14b00cf380 0x7f14b015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 >> 172.21.15.50:0/3471425813 conn(0x7f14b00cfda0 msgr2=0x7f14b0160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 shutdown_connections 2023-12-08T08:20:30.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.344+0000 7f14b7a3d640 1 -- 172.21.15.50:0/3471425813 wait complete. 2023-12-08T08:20:30.358 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2023-12-08T08:20:30.152324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255896,"kb_used_data":6432,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718824,"statfs":{"total":773094113280,"available":772832075776,"internally_reserved":0,"allocated":6586368,"data_stored":3584605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.160644"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.586585+0000","last_change":"2023-12-08T08:20:26.857450+0000","last_active":"2023-12-08T08:20:28.586585+0000","last_peered":"2023-12-08T08:20:28.586585+0000","last_clean":"2023-12-08T08:20:28.586585+0000","last_became_active":"2023-12-08T08:20:26.857205+0000","last_became_peered":"2023-12-08T08:20:26.857205+0000","last_unstale":"2023-12-08T08:20:28.586585+0000","last_undegraded":"2023-12-08T08:20:28.586585+0000","last_fullsized":"2023-12-08T08:20:28.586585+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:31:22.729904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654095+0000","last_change":"2023-12-08T08:20:26.851177+0000","last_active":"2023-12-08T08:20:28.654095+0000","last_peered":"2023-12-08T08:20:28.654095+0000","last_clean":"2023-12-08T08:20:28.654095+0000","last_became_active":"2023-12-08T08:20:26.850900+0000","last_became_peered":"2023-12-08T08:20:26.850900+0000","last_unstale":"2023-12-08T08:20:28.654095+0000","last_undegraded":"2023-12-08T08:20:28.654095+0000","last_fullsized":"2023-12-08T08:20:28.654095+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:26:56.549468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841737+0000","last_change":"2023-12-08T08:20:26.848263+0000","last_active":"2023-12-08T08:20:27.841737+0000","last_peered":"2023-12-08T08:20:27.841737+0000","last_clean":"2023-12-08T08:20:27.841737+0000","last_became_active":"2023-12-08T08:20:26.847308+0000","last_became_peered":"2023-12-08T08:20:26.847308+0000","last_unstale":"2023-12-08T08:20:27.841737+0000","last_undegraded":"2023-12-08T08:20:27.841737+0000","last_fullsized":"2023-12-08T08:20:27.841737+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:56:43.746978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654824+0000","last_change":"2023-12-08T08:20:26.858268+0000","last_active":"2023-12-08T08:20:28.654824+0000","last_peered":"2023-12-08T08:20:28.654824+0000","last_clean":"2023-12-08T08:20:28.654824+0000","last_became_active":"2023-12-08T08:20:26.858015+0000","last_became_peered":"2023-12-08T08:20:26.858015+0000","last_unstale":"2023-12-08T08:20:28.654824+0000","last_undegraded":"2023-12-08T08:20:28.654824+0000","last_fullsized":"2023-12-08T08:20:28.654824+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.351296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.586407+0000","last_change":"2023-12-08T08:20:26.850716+0000","last_active":"2023-12-08T08:20:28.586407+0000","last_peered":"2023-12-08T08:20:28.586407+0000","last_clean":"2023-12-08T08:20:28.586407+0000","last_became_active":"2023-12-08T08:20:26.850462+0000","last_became_peered":"2023-12-08T08:20:26.850462+0000","last_unstale":"2023-12-08T08:20:28.586407+0000","last_undegraded":"2023-12-08T08:20:28.586407+0000","last_fullsized":"2023-12-08T08:20:28.586407+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:41:15.423350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.839869+0000","last_change":"2023-12-08T08:20:26.854407+0000","last_active":"2023-12-08T08:20:27.839869+0000","last_peered":"2023-12-08T08:20:27.839869+0000","last_clean":"2023-12-08T08:20:27.839869+0000","last_became_active":"2023-12-08T08:20:26.854045+0000","last_became_peered":"2023-12-08T08:20:26.854045+0000","last_unstale":"2023-12-08T08:20:27.839869+0000","last_undegraded":"2023-12-08T08:20:27.839869+0000","last_fullsized":"2023-12-08T08:20:27.839869+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:58.775918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654076+0000","last_change":"2023-12-08T08:20:26.852152+0000","last_active":"2023-12-08T08:20:28.654076+0000","last_peered":"2023-12-08T08:20:28.654076+0000","last_clean":"2023-12-08T08:20:28.654076+0000","last_became_active":"2023-12-08T08:20:26.851893+0000","last_became_peered":"2023-12-08T08:20:26.851893+0000","last_unstale":"2023-12-08T08:20:28.654076+0000","last_undegraded":"2023-12-08T08:20:28.654076+0000","last_fullsized":"2023-12-08T08:20:28.654076+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:46.714216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654132+0000","last_change":"2023-12-08T08:20:26.844806+0000","last_active":"2023-12-08T08:20:28.654132+0000","last_peered":"2023-12-08T08:20:28.654132+0000","last_clean":"2023-12-08T08:20:28.654132+0000","last_became_active":"2023-12-08T08:20:26.843939+0000","last_became_peered":"2023-12-08T08:20:26.843939+0000","last_unstale":"2023-12-08T08:20:28.654132+0000","last_undegraded":"2023-12-08T08:20:28.654132+0000","last_fullsized":"2023-12-08T08:20:28.654132+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T12:46:34.563593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654438+0000","last_change":"2023-12-08T08:20:26.854629+0000","last_active":"2023-12-08T08:20:28.654438+0000","last_peered":"2023-12-08T08:20:28.654438+0000","last_clean":"2023-12-08T08:20:28.654438+0000","last_became_active":"2023-12-08T08:20:26.854362+0000","last_became_peered":"2023-12-08T08:20:26.854362+0000","last_unstale":"2023-12-08T08:20:28.654438+0000","last_undegraded":"2023-12-08T08:20:28.654438+0000","last_fullsized":"2023-12-08T08:20:28.654438+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:28:52.067023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653689+0000","last_change":"2023-12-08T08:20:26.852272+0000","last_active":"2023-12-08T08:20:28.653689+0000","last_peered":"2023-12-08T08:20:28.653689+0000","last_clean":"2023-12-08T08:20:28.653689+0000","last_became_active":"2023-12-08T08:20:26.851605+0000","last_became_peered":"2023-12-08T08:20:26.851605+0000","last_unstale":"2023-12-08T08:20:28.653689+0000","last_undegraded":"2023-12-08T08:20:28.653689+0000","last_fullsized":"2023-12-08T08:20:28.653689+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:13:17.315050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654086+0000","last_change":"2023-12-08T08:20:26.856971+0000","last_active":"2023-12-08T08:20:28.654086+0000","last_peered":"2023-12-08T08:20:28.654086+0000","last_clean":"2023-12-08T08:20:28.654086+0000","last_became_active":"2023-12-08T08:20:26.856639+0000","last_became_peered":"2023-12-08T08:20:26.856639+0000","last_unstale":"2023-12-08T08:20:28.654086+0000","last_undegraded":"2023-12-08T08:20:28.654086+0000","last_fullsized":"2023-12-08T08:20:28.654086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:51:05.909982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654819+0000","last_change":"2023-12-08T08:20:26.856822+0000","last_active":"2023-12-08T08:20:28.654819+0000","last_peered":"2023-12-08T08:20:28.654819+0000","last_clean":"2023-12-08T08:20:28.654819+0000","last_became_active":"2023-12-08T08:20:26.856526+0000","last_became_peered":"2023-12-08T08:20:26.856526+0000","last_unstale":"2023-12-08T08:20:28.654819+0000","last_undegraded":"2023-12-08T08:20:28.654819+0000","last_fullsized":"2023-12-08T08:20:28.654819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:56.938841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841203+0000","last_change":"2023-12-08T08:20:26.861578+0000","last_active":"2023-12-08T08:20:27.841203+0000","last_peered":"2023-12-08T08:20:27.841203+0000","last_clean":"2023-12-08T08:20:27.841203+0000","last_became_active":"2023-12-08T08:20:26.861299+0000","last_became_peered":"2023-12-08T08:20:26.861299+0000","last_unstale":"2023-12-08T08:20:27.841203+0000","last_undegraded":"2023-12-08T08:20:27.841203+0000","last_fullsized":"2023-12-08T08:20:27.841203+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:35:09.723758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654381+0000","last_change":"2023-12-08T08:20:26.848387+0000","last_active":"2023-12-08T08:20:28.654381+0000","last_peered":"2023-12-08T08:20:28.654381+0000","last_clean":"2023-12-08T08:20:28.654381+0000","last_became_active":"2023-12-08T08:20:26.848107+0000","last_became_peered":"2023-12-08T08:20:26.848107+0000","last_unstale":"2023-12-08T08:20:28.654381+0000","last_undegraded":"2023-12-08T08:20:28.654381+0000","last_fullsized":"2023-12-08T08:20:28.654381+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:57:14.246031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654182+0000","last_change":"2023-12-08T08:20:26.851864+0000","last_active":"2023-12-08T08:20:28.654182+0000","last_peered":"2023-12-08T08:20:28.654182+0000","last_clean":"2023-12-08T08:20:28.654182+0000","last_became_active":"2023-12-08T08:20:26.851540+0000","last_became_peered":"2023-12-08T08:20:26.851540+0000","last_unstale":"2023-12-08T08:20:28.654182+0000","last_undegraded":"2023-12-08T08:20:28.654182+0000","last_fullsized":"2023-12-08T08:20:28.654182+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:35:09.723758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.839784+0000","last_change":"2023-12-08T08:20:26.858511+0000","last_active":"2023-12-08T08:20:27.839784+0000","last_peered":"2023-12-08T08:20:27.839784+0000","last_clean":"2023-12-08T08:20:27.839784+0000","last_became_active":"2023-12-08T08:20:26.858230+0000","last_became_peered":"2023-12-08T08:20:26.858230+0000","last_unstale":"2023-12-08T08:20:27.839784+0000","last_undegraded":"2023-12-08T08:20:27.839784+0000","last_fullsized":"2023-12-08T08:20:27.839784+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:08:23.120356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653927+0000","last_change":"2023-12-08T08:20:26.847368+0000","last_active":"2023-12-08T08:20:28.653927+0000","last_peered":"2023-12-08T08:20:28.653927+0000","last_clean":"2023-12-08T08:20:28.653927+0000","last_became_active":"2023-12-08T08:20:26.847071+0000","last_became_peered":"2023-12-08T08:20:26.847071+0000","last_unstale":"2023-12-08T08:20:28.653927+0000","last_undegraded":"2023-12-08T08:20:28.653927+0000","last_fullsized":"2023-12-08T08:20:28.653927+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:38:41.733255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841740+0000","last_change":"2023-12-08T08:20:26.859912+0000","last_active":"2023-12-08T08:20:27.841740+0000","last_peered":"2023-12-08T08:20:27.841740+0000","last_clean":"2023-12-08T08:20:27.841740+0000","last_became_active":"2023-12-08T08:20:26.859603+0000","last_became_peered":"2023-12-08T08:20:26.859603+0000","last_unstale":"2023-12-08T08:20:27.841740+0000","last_undegraded":"2023-12-08T08:20:27.841740+0000","last_fullsized":"2023-12-08T08:20:27.841740+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:34.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.586512+0000","last_change":"2023-12-08T08:20:26.852515+0000","last_active":"2023-12-08T08:20:28.586512+0000","last_peered":"2023-12-08T08:20:28.586512+0000","last_clean":"2023-12-08T08:20:28.586512+0000","last_became_active":"2023-12-08T08:20:26.852228+0000","last_became_peered":"2023-12-08T08:20:26.852228+0000","last_unstale":"2023-12-08T08:20:28.586512+0000","last_undegraded":"2023-12-08T08:20:28.586512+0000","last_fullsized":"2023-12-08T08:20:28.586512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:02:18.718976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654044+0000","last_change":"2023-12-08T08:20:26.857133+0000","last_active":"2023-12-08T08:20:28.654044+0000","last_peered":"2023-12-08T08:20:28.654044+0000","last_clean":"2023-12-08T08:20:28.654044+0000","last_became_active":"2023-12-08T08:20:26.856861+0000","last_became_peered":"2023-12-08T08:20:26.856861+0000","last_unstale":"2023-12-08T08:20:28.654044+0000","last_undegraded":"2023-12-08T08:20:28.654044+0000","last_fullsized":"2023-12-08T08:20:28.654044+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:30:45.702191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841175+0000","last_change":"2023-12-08T08:20:26.853043+0000","last_active":"2023-12-08T08:20:27.841175+0000","last_peered":"2023-12-08T08:20:27.841175+0000","last_clean":"2023-12-08T08:20:27.841175+0000","last_became_active":"2023-12-08T08:20:26.852391+0000","last_became_peered":"2023-12-08T08:20:26.852391+0000","last_unstale":"2023-12-08T08:20:27.841175+0000","last_undegraded":"2023-12-08T08:20:27.841175+0000","last_fullsized":"2023-12-08T08:20:27.841175+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:01.822540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653408+0000","last_change":"2023-12-08T08:20:26.853029+0000","last_active":"2023-12-08T08:20:28.653408+0000","last_peered":"2023-12-08T08:20:28.653408+0000","last_clean":"2023-12-08T08:20:28.653408+0000","last_became_active":"2023-12-08T08:20:26.852272+0000","last_became_peered":"2023-12-08T08:20:26.852272+0000","last_unstale":"2023-12-08T08:20:28.653408+0000","last_undegraded":"2023-12-08T08:20:28.653408+0000","last_fullsized":"2023-12-08T08:20:28.653408+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:59:51.426739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841500+0000","last_change":"2023-12-08T08:20:26.845951+0000","last_active":"2023-12-08T08:20:27.841500+0000","last_peered":"2023-12-08T08:20:27.841500+0000","last_clean":"2023-12-08T08:20:27.841500+0000","last_became_active":"2023-12-08T08:20:26.845651+0000","last_became_peered":"2023-12-08T08:20:26.845651+0000","last_unstale":"2023-12-08T08:20:27.841500+0000","last_undegraded":"2023-12-08T08:20:27.841500+0000","last_fullsized":"2023-12-08T08:20:27.841500+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:58.561045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840894+0000","last_change":"2023-12-08T08:20:26.856337+0000","last_active":"2023-12-08T08:20:27.840894+0000","last_peered":"2023-12-08T08:20:27.840894+0000","last_clean":"2023-12-08T08:20:27.840894+0000","last_became_active":"2023-12-08T08:20:26.856069+0000","last_became_peered":"2023-12-08T08:20:26.856069+0000","last_unstale":"2023-12-08T08:20:27.840894+0000","last_undegraded":"2023-12-08T08:20:27.840894+0000","last_fullsized":"2023-12-08T08:20:27.840894+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:08:46.714216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.586579+0000","last_change":"2023-12-08T08:20:26.853158+0000","last_active":"2023-12-08T08:20:28.586579+0000","last_peered":"2023-12-08T08:20:28.586579+0000","last_clean":"2023-12-08T08:20:28.586579+0000","last_became_active":"2023-12-08T08:20:26.852909+0000","last_became_peered":"2023-12-08T08:20:26.852909+0000","last_unstale":"2023-12-08T08:20:28.586579+0000","last_undegraded":"2023-12-08T08:20:28.586579+0000","last_fullsized":"2023-12-08T08:20:28.586579+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:21.479472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654688+0000","last_change":"2023-12-08T08:20:26.853811+0000","last_active":"2023-12-08T08:20:28.654688+0000","last_peered":"2023-12-08T08:20:28.654688+0000","last_clean":"2023-12-08T08:20:28.654688+0000","last_became_active":"2023-12-08T08:20:26.853545+0000","last_became_peered":"2023-12-08T08:20:26.853545+0000","last_unstale":"2023-12-08T08:20:28.654688+0000","last_undegraded":"2023-12-08T08:20:28.654688+0000","last_fullsized":"2023-12-08T08:20:28.654688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:56:43.746978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840202+0000","last_change":"2023-12-08T08:20:26.860157+0000","last_active":"2023-12-08T08:20:27.840202+0000","last_peered":"2023-12-08T08:20:27.840202+0000","last_clean":"2023-12-08T08:20:27.840202+0000","last_became_active":"2023-12-08T08:20:26.859624+0000","last_became_peered":"2023-12-08T08:20:26.859624+0000","last_unstale":"2023-12-08T08:20:27.840202+0000","last_undegraded":"2023-12-08T08:20:27.840202+0000","last_fullsized":"2023-12-08T08:20:27.840202+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:37:19.498736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.586620+0000","last_change":"2023-12-08T08:20:26.850033+0000","last_active":"2023-12-08T08:20:28.586620+0000","last_peered":"2023-12-08T08:20:28.586620+0000","last_clean":"2023-12-08T08:20:28.586620+0000","last_became_active":"2023-12-08T08:20:26.849780+0000","last_became_peered":"2023-12-08T08:20:26.849780+0000","last_unstale":"2023-12-08T08:20:28.586620+0000","last_undegraded":"2023-12-08T08:20:28.586620+0000","last_fullsized":"2023-12-08T08:20:28.586620+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:18:02.092590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654133+0000","last_change":"2023-12-08T08:20:26.852505+0000","last_active":"2023-12-08T08:20:28.654133+0000","last_peered":"2023-12-08T08:20:28.654133+0000","last_clean":"2023-12-08T08:20:28.654133+0000","last_became_active":"2023-12-08T08:20:26.852197+0000","last_became_peered":"2023-12-08T08:20:26.852197+0000","last_unstale":"2023-12-08T08:20:28.654133+0000","last_undegraded":"2023-12-08T08:20:28.654133+0000","last_fullsized":"2023-12-08T08:20:28.654133+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:36:55.591339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841169+0000","last_change":"2023-12-08T08:20:26.846249+0000","last_active":"2023-12-08T08:20:27.841169+0000","last_peered":"2023-12-08T08:20:27.841169+0000","last_clean":"2023-12-08T08:20:27.841169+0000","last_became_active":"2023-12-08T08:20:26.845954+0000","last_became_peered":"2023-12-08T08:20:26.845954+0000","last_unstale":"2023-12-08T08:20:27.841169+0000","last_undegraded":"2023-12-08T08:20:27.841169+0000","last_fullsized":"2023-12-08T08:20:27.841169+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:12:29.960315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.586351+0000","last_change":"2023-12-08T08:20:26.852573+0000","last_active":"2023-12-08T08:20:28.586351+0000","last_peered":"2023-12-08T08:20:28.586351+0000","last_clean":"2023-12-08T08:20:28.586351+0000","last_became_active":"2023-12-08T08:20:26.852303+0000","last_became_peered":"2023-12-08T08:20:26.852303+0000","last_unstale":"2023-12-08T08:20:28.586351+0000","last_undegraded":"2023-12-08T08:20:28.586351+0000","last_fullsized":"2023-12-08T08:20:28.586351+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:23:14.395100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.839842+0000","last_change":"2023-12-08T08:20:26.859413+0000","last_active":"2023-12-08T08:20:27.839842+0000","last_peered":"2023-12-08T08:20:27.839842+0000","last_clean":"2023-12-08T08:20:27.839842+0000","last_became_active":"2023-12-08T08:20:26.859110+0000","last_became_peered":"2023-12-08T08:20:26.859110+0000","last_unstale":"2023-12-08T08:20:27.839842+0000","last_undegraded":"2023-12-08T08:20:27.839842+0000","last_fullsized":"2023-12-08T08:20:27.839842+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:34.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840391+0000","last_change":"2023-12-08T08:20:26.858785+0000","last_active":"2023-12-08T08:20:27.840391+0000","last_peered":"2023-12-08T08:20:27.840391+0000","last_clean":"2023-12-08T08:20:27.840391+0000","last_became_active":"2023-12-08T08:20:26.858499+0000","last_became_peered":"2023-12-08T08:20:26.858499+0000","last_unstale":"2023-12-08T08:20:27.840391+0000","last_undegraded":"2023-12-08T08:20:27.840391+0000","last_fullsized":"2023-12-08T08:20:27.840391+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:14:07.753389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"55'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840337+0000","last_change":"2023-12-08T08:20:26.014811+0000","last_active":"2023-12-08T08:20:27.840337+0000","last_peered":"2023-12-08T08:20:27.840337+0000","last_clean":"2023-12-08T08:20:27.840337+0000","last_became_active":"2023-12-08T08:20:26.014441+0000","last_became_peered":"2023-12-08T08:20:26.014441+0000","last_unstale":"2023-12-08T08:20:27.840337+0000","last_undegraded":"2023-12-08T08:20:27.840337+0000","last_fullsized":"2023-12-08T08:20:27.840337+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:09:59.727681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653912+0000","last_change":"2023-12-08T08:20:26.859415+0000","last_active":"2023-12-08T08:20:28.653912+0000","last_peered":"2023-12-08T08:20:28.653912+0000","last_clean":"2023-12-08T08:20:28.653912+0000","last_became_active":"2023-12-08T08:20:26.859132+0000","last_became_peered":"2023-12-08T08:20:26.859132+0000","last_unstale":"2023-12-08T08:20:28.653912+0000","last_undegraded":"2023-12-08T08:20:28.653912+0000","last_fullsized":"2023-12-08T08:20:28.653912+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:21:04.066814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654117+0000","last_change":"2023-12-08T08:20:26.017262+0000","last_active":"2023-12-08T08:20:28.654117+0000","last_peered":"2023-12-08T08:20:28.654117+0000","last_clean":"2023-12-08T08:20:28.654117+0000","last_became_active":"2023-12-08T08:20:26.016991+0000","last_became_peered":"2023-12-08T08:20:26.016991+0000","last_unstale":"2023-12-08T08:20:28.654117+0000","last_undegraded":"2023-12-08T08:20:28.654117+0000","last_fullsized":"2023-12-08T08:20:28.654117+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:31:34.735991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840176+0000","last_change":"2023-12-08T08:20:26.855790+0000","last_active":"2023-12-08T08:20:27.840176+0000","last_peered":"2023-12-08T08:20:27.840176+0000","last_clean":"2023-12-08T08:20:27.840176+0000","last_became_active":"2023-12-08T08:20:26.855496+0000","last_became_peered":"2023-12-08T08:20:26.855496+0000","last_unstale":"2023-12-08T08:20:27.840176+0000","last_undegraded":"2023-12-08T08:20:27.840176+0000","last_fullsized":"2023-12-08T08:20:27.840176+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.351296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840324+0000","last_change":"2023-12-08T08:20:26.017760+0000","last_active":"2023-12-08T08:20:27.840324+0000","last_peered":"2023-12-08T08:20:27.840324+0000","last_clean":"2023-12-08T08:20:27.840324+0000","last_became_active":"2023-12-08T08:20:26.014830+0000","last_became_peered":"2023-12-08T08:20:26.014830+0000","last_unstale":"2023-12-08T08:20:27.840324+0000","last_undegraded":"2023-12-08T08:20:27.840324+0000","last_fullsized":"2023-12-08T08:20:27.840324+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:28:53.286508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840233+0000","last_change":"2023-12-08T08:20:26.854982+0000","last_active":"2023-12-08T08:20:27.840233+0000","last_peered":"2023-12-08T08:20:27.840233+0000","last_clean":"2023-12-08T08:20:27.840233+0000","last_became_active":"2023-12-08T08:20:26.854704+0000","last_became_peered":"2023-12-08T08:20:26.854704+0000","last_unstale":"2023-12-08T08:20:27.840233+0000","last_undegraded":"2023-12-08T08:20:27.840233+0000","last_fullsized":"2023-12-08T08:20:27.840233+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:06:50.890775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654909+0000","last_change":"2023-12-08T08:20:26.011350+0000","last_active":"2023-12-08T08:20:28.654909+0000","last_peered":"2023-12-08T08:20:28.654909+0000","last_clean":"2023-12-08T08:20:28.654909+0000","last_became_active":"2023-12-08T08:20:26.011082+0000","last_became_peered":"2023-12-08T08:20:26.011082+0000","last_unstale":"2023-12-08T08:20:28.654909+0000","last_undegraded":"2023-12-08T08:20:28.654909+0000","last_fullsized":"2023-12-08T08:20:28.654909+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:18:00.817501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653532+0000","last_change":"2023-12-08T08:20:26.852841+0000","last_active":"2023-12-08T08:20:28.653532+0000","last_peered":"2023-12-08T08:20:28.653532+0000","last_clean":"2023-12-08T08:20:28.653532+0000","last_became_active":"2023-12-08T08:20:26.848337+0000","last_became_peered":"2023-12-08T08:20:26.848337+0000","last_unstale":"2023-12-08T08:20:28.653532+0000","last_undegraded":"2023-12-08T08:20:28.653532+0000","last_fullsized":"2023-12-08T08:20:28.653532+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:20:48.002389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654465+0000","last_change":"2023-12-08T08:20:26.016841+0000","last_active":"2023-12-08T08:20:28.654465+0000","last_peered":"2023-12-08T08:20:28.654465+0000","last_clean":"2023-12-08T08:20:28.654465+0000","last_became_active":"2023-12-08T08:20:26.016567+0000","last_became_peered":"2023-12-08T08:20:26.016567+0000","last_unstale":"2023-12-08T08:20:28.654465+0000","last_undegraded":"2023-12-08T08:20:28.654465+0000","last_fullsized":"2023-12-08T08:20:28.654465+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:01:00.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653974+0000","last_change":"2023-12-08T08:20:26.857734+0000","last_active":"2023-12-08T08:20:28.653974+0000","last_peered":"2023-12-08T08:20:28.653974+0000","last_clean":"2023-12-08T08:20:28.653974+0000","last_became_active":"2023-12-08T08:20:26.857476+0000","last_became_peered":"2023-12-08T08:20:26.857476+0000","last_unstale":"2023-12-08T08:20:28.653974+0000","last_undegraded":"2023-12-08T08:20:28.653974+0000","last_fullsized":"2023-12-08T08:20:28.653974+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:29:20.718326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.839898+0000","last_change":"2023-12-08T08:20:26.012362+0000","last_active":"2023-12-08T08:20:27.839898+0000","last_peered":"2023-12-08T08:20:27.839898+0000","last_clean":"2023-12-08T08:20:27.839898+0000","last_became_active":"2023-12-08T08:20:26.012084+0000","last_became_peered":"2023-12-08T08:20:26.012084+0000","last_unstale":"2023-12-08T08:20:27.839898+0000","last_undegraded":"2023-12-08T08:20:27.839898+0000","last_fullsized":"2023-12-08T08:20:27.839898+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:52:11.303067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840895+0000","last_change":"2023-12-08T08:20:26.849795+0000","last_active":"2023-12-08T08:20:27.840895+0000","last_peered":"2023-12-08T08:20:27.840895+0000","last_clean":"2023-12-08T08:20:27.840895+0000","last_became_active":"2023-12-08T08:20:26.849491+0000","last_became_peered":"2023-12-08T08:20:26.849491+0000","last_unstale":"2023-12-08T08:20:27.840895+0000","last_undegraded":"2023-12-08T08:20:27.840895+0000","last_fullsized":"2023-12-08T08:20:27.840895+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:19.943333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653959+0000","last_change":"2023-12-08T08:20:26.009833+0000","last_active":"2023-12-08T08:20:28.653959+0000","last_peered":"2023-12-08T08:20:28.653959+0000","last_clean":"2023-12-08T08:20:28.653959+0000","last_became_active":"2023-12-08T08:20:26.009554+0000","last_became_peered":"2023-12-08T08:20:26.009554+0000","last_unstale":"2023-12-08T08:20:28.653959+0000","last_undegraded":"2023-12-08T08:20:28.653959+0000","last_fullsized":"2023-12-08T08:20:28.653959+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:40.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653622+0000","last_change":"2023-12-08T08:20:26.848441+0000","last_active":"2023-12-08T08:20:28.653622+0000","last_peered":"2023-12-08T08:20:28.653622+0000","last_clean":"2023-12-08T08:20:28.653622+0000","last_became_active":"2023-12-08T08:20:26.848164+0000","last_became_peered":"2023-12-08T08:20:26.848164+0000","last_unstale":"2023-12-08T08:20:28.653622+0000","last_undegraded":"2023-12-08T08:20:28.653622+0000","last_fullsized":"2023-12-08T08:20:28.653622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:47:57.295277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654075+0000","last_change":"2023-12-08T08:20:26.012780+0000","last_active":"2023-12-08T08:20:28.654075+0000","last_peered":"2023-12-08T08:20:28.654075+0000","last_clean":"2023-12-08T08:20:28.654075+0000","last_became_active":"2023-12-08T08:20:26.011902+0000","last_became_peered":"2023-12-08T08:20:26.011902+0000","last_unstale":"2023-12-08T08:20:28.654075+0000","last_undegraded":"2023-12-08T08:20:28.654075+0000","last_fullsized":"2023-12-08T08:20:28.654075+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:21:00.591615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654676+0000","last_change":"2023-12-08T08:20:26.851062+0000","last_active":"2023-12-08T08:20:28.654676+0000","last_peered":"2023-12-08T08:20:28.654676+0000","last_clean":"2023-12-08T08:20:28.654676+0000","last_became_active":"2023-12-08T08:20:26.850738+0000","last_became_peered":"2023-12-08T08:20:26.850738+0000","last_unstale":"2023-12-08T08:20:28.654676+0000","last_undegraded":"2023-12-08T08:20:28.654676+0000","last_fullsized":"2023-12-08T08:20:28.654676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:29:24.933227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841923+0000","last_change":"2023-12-08T08:20:26.016166+0000","last_active":"2023-12-08T08:20:27.841923+0000","last_peered":"2023-12-08T08:20:27.841923+0000","last_clean":"2023-12-08T08:20:27.841923+0000","last_became_active":"2023-12-08T08:20:26.015911+0000","last_became_peered":"2023-12-08T08:20:26.015911+0000","last_unstale":"2023-12-08T08:20:27.841923+0000","last_undegraded":"2023-12-08T08:20:27.841923+0000","last_fullsized":"2023-12-08T08:20:27.841923+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:36:43.760970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841757+0000","last_change":"2023-12-08T08:20:26.853455+0000","last_active":"2023-12-08T08:20:27.841757+0000","last_peered":"2023-12-08T08:20:27.841757+0000","last_clean":"2023-12-08T08:20:27.841757+0000","last_became_active":"2023-12-08T08:20:26.852830+0000","last_became_peered":"2023-12-08T08:20:26.852830+0000","last_unstale":"2023-12-08T08:20:27.841757+0000","last_undegraded":"2023-12-08T08:20:27.841757+0000","last_fullsized":"2023-12-08T08:20:27.841757+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:58.775918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654184+0000","last_change":"2023-12-08T08:20:26.020565+0000","last_active":"2023-12-08T08:20:28.654184+0000","last_peered":"2023-12-08T08:20:28.654184+0000","last_clean":"2023-12-08T08:20:28.654184+0000","last_became_active":"2023-12-08T08:20:26.020286+0000","last_became_peered":"2023-12-08T08:20:26.020286+0000","last_unstale":"2023-12-08T08:20:28.654184+0000","last_undegraded":"2023-12-08T08:20:28.654184+0000","last_fullsized":"2023-12-08T08:20:28.654184+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:06:59.098028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653556+0000","last_change":"2023-12-08T08:20:26.853325+0000","last_active":"2023-12-08T08:20:28.653556+0000","last_peered":"2023-12-08T08:20:28.653556+0000","last_clean":"2023-12-08T08:20:28.653556+0000","last_became_active":"2023-12-08T08:20:26.852889+0000","last_became_peered":"2023-12-08T08:20:26.852889+0000","last_unstale":"2023-12-08T08:20:28.653556+0000","last_undegraded":"2023-12-08T08:20:28.653556+0000","last_fullsized":"2023-12-08T08:20:28.653556+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:34:24.629440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"55'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841992+0000","last_change":"2023-12-08T08:20:26.015195+0000","last_active":"2023-12-08T08:20:27.841992+0000","last_peered":"2023-12-08T08:20:27.841992+0000","last_clean":"2023-12-08T08:20:27.841992+0000","last_became_active":"2023-12-08T08:20:26.014875+0000","last_became_peered":"2023-12-08T08:20:26.014875+0000","last_unstale":"2023-12-08T08:20:27.841992+0000","last_undegraded":"2023-12-08T08:20:27.841992+0000","last_fullsized":"2023-12-08T08:20:27.841992+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:33.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841899+0000","last_change":"2023-12-08T08:20:26.854213+0000","last_active":"2023-12-08T08:20:27.841899+0000","last_peered":"2023-12-08T08:20:27.841899+0000","last_clean":"2023-12-08T08:20:27.841899+0000","last_became_active":"2023-12-08T08:20:26.853575+0000","last_became_peered":"2023-12-08T08:20:26.853575+0000","last_unstale":"2023-12-08T08:20:27.841899+0000","last_undegraded":"2023-12-08T08:20:27.841899+0000","last_fullsized":"2023-12-08T08:20:27.841899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:09:25.351296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"55'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654652+0000","last_change":"2023-12-08T08:20:26.016171+0000","last_active":"2023-12-08T08:20:28.654652+0000","last_peered":"2023-12-08T08:20:28.654652+0000","last_clean":"2023-12-08T08:20:28.654652+0000","last_became_active":"2023-12-08T08:20:26.015862+0000","last_became_peered":"2023-12-08T08:20:26.015862+0000","last_unstale":"2023-12-08T08:20:28.654652+0000","last_undegraded":"2023-12-08T08:20:28.654652+0000","last_fullsized":"2023-12-08T08:20:28.654652+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T15:03:20.474433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654056+0000","last_change":"2023-12-08T08:20:26.852104+0000","last_active":"2023-12-08T08:20:28.654056+0000","last_peered":"2023-12-08T08:20:28.654056+0000","last_clean":"2023-12-08T08:20:28.654056+0000","last_became_active":"2023-12-08T08:20:26.851819+0000","last_became_peered":"2023-12-08T08:20:26.851819+0000","last_unstale":"2023-12-08T08:20:28.654056+0000","last_undegraded":"2023-12-08T08:20:28.654056+0000","last_fullsized":"2023-12-08T08:20:28.654056+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:28:58.561045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653964+0000","last_change":"2023-12-08T08:20:26.019723+0000","last_active":"2023-12-08T08:20:28.653964+0000","last_peered":"2023-12-08T08:20:28.653964+0000","last_clean":"2023-12-08T08:20:28.653964+0000","last_became_active":"2023-12-08T08:20:26.019468+0000","last_became_peered":"2023-12-08T08:20:26.019468+0000","last_unstale":"2023-12-08T08:20:28.653964+0000","last_undegraded":"2023-12-08T08:20:28.653964+0000","last_fullsized":"2023-12-08T08:20:28.653964+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:15:15.961381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841332+0000","last_change":"2023-12-08T08:20:26.848225+0000","last_active":"2023-12-08T08:20:27.841332+0000","last_peered":"2023-12-08T08:20:27.841332+0000","last_clean":"2023-12-08T08:20:27.841332+0000","last_became_active":"2023-12-08T08:20:26.847949+0000","last_became_peered":"2023-12-08T08:20:26.847949+0000","last_unstale":"2023-12-08T08:20:27.841332+0000","last_undegraded":"2023-12-08T08:20:27.841332+0000","last_fullsized":"2023-12-08T08:20:27.841332+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:47.019145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840934+0000","last_change":"2023-12-08T08:20:26.012065+0000","last_active":"2023-12-08T08:20:27.840934+0000","last_peered":"2023-12-08T08:20:27.840934+0000","last_clean":"2023-12-08T08:20:27.840934+0000","last_became_active":"2023-12-08T08:20:26.011758+0000","last_became_peered":"2023-12-08T08:20:26.011758+0000","last_unstale":"2023-12-08T08:20:27.840934+0000","last_undegraded":"2023-12-08T08:20:27.840934+0000","last_fullsized":"2023-12-08T08:20:27.840934+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:38.178182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654097+0000","last_change":"2023-12-08T08:20:26.849332+0000","last_active":"2023-12-08T08:20:28.654097+0000","last_peered":"2023-12-08T08:20:28.654097+0000","last_clean":"2023-12-08T08:20:28.654097+0000","last_became_active":"2023-12-08T08:20:26.849048+0000","last_became_peered":"2023-12-08T08:20:26.849048+0000","last_unstale":"2023-12-08T08:20:28.654097+0000","last_undegraded":"2023-12-08T08:20:28.654097+0000","last_fullsized":"2023-12-08T08:20:28.654097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:19.943333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653975+0000","last_change":"2023-12-08T08:20:26.010674+0000","last_active":"2023-12-08T08:20:28.653975+0000","last_peered":"2023-12-08T08:20:28.653975+0000","last_clean":"2023-12-08T08:20:28.653975+0000","last_became_active":"2023-12-08T08:20:26.010401+0000","last_became_peered":"2023-12-08T08:20:26.010401+0000","last_unstale":"2023-12-08T08:20:28.653975+0000","last_undegraded":"2023-12-08T08:20:28.653975+0000","last_fullsized":"2023-12-08T08:20:28.653975+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:28:53.286508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841639+0000","last_change":"2023-12-08T08:20:26.851388+0000","last_active":"2023-12-08T08:20:27.841639+0000","last_peered":"2023-12-08T08:20:27.841639+0000","last_clean":"2023-12-08T08:20:27.841639+0000","last_became_active":"2023-12-08T08:20:26.851098+0000","last_became_peered":"2023-12-08T08:20:26.851098+0000","last_unstale":"2023-12-08T08:20:27.841639+0000","last_undegraded":"2023-12-08T08:20:27.841639+0000","last_fullsized":"2023-12-08T08:20:27.841639+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:08:23.120356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"55'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841225+0000","last_change":"2023-12-08T08:20:26.013392+0000","last_active":"2023-12-08T08:20:27.841225+0000","last_peered":"2023-12-08T08:20:27.841225+0000","last_clean":"2023-12-08T08:20:27.841225+0000","last_became_active":"2023-12-08T08:20:26.013126+0000","last_became_peered":"2023-12-08T08:20:26.013126+0000","last_unstale":"2023-12-08T08:20:27.841225+0000","last_undegraded":"2023-12-08T08:20:27.841225+0000","last_fullsized":"2023-12-08T08:20:27.841225+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:28:51.061984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841813+0000","last_change":"2023-12-08T08:20:26.848165+0000","last_active":"2023-12-08T08:20:27.841813+0000","last_peered":"2023-12-08T08:20:27.841813+0000","last_clean":"2023-12-08T08:20:27.841813+0000","last_became_active":"2023-12-08T08:20:26.847084+0000","last_became_peered":"2023-12-08T08:20:26.847084+0000","last_unstale":"2023-12-08T08:20:27.841813+0000","last_undegraded":"2023-12-08T08:20:27.841813+0000","last_fullsized":"2023-12-08T08:20:27.841813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:56.938841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654301+0000","last_change":"2023-12-08T08:20:26.021132+0000","last_active":"2023-12-08T08:20:28.654301+0000","last_peered":"2023-12-08T08:20:28.654301+0000","last_clean":"2023-12-08T08:20:28.654301+0000","last_became_active":"2023-12-08T08:20:26.020885+0000","last_became_peered":"2023-12-08T08:20:26.020885+0000","last_unstale":"2023-12-08T08:20:28.654301+0000","last_undegraded":"2023-12-08T08:20:28.654301+0000","last_fullsized":"2023-12-08T08:20:28.654301+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:24:08.078637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654804+0000","last_change":"2023-12-08T08:20:26.855923+0000","last_active":"2023-12-08T08:20:28.654804+0000","last_peered":"2023-12-08T08:20:28.654804+0000","last_clean":"2023-12-08T08:20:28.654804+0000","last_became_active":"2023-12-08T08:20:26.855656+0000","last_became_peered":"2023-12-08T08:20:26.855656+0000","last_unstale":"2023-12-08T08:20:28.654804+0000","last_undegraded":"2023-12-08T08:20:28.654804+0000","last_fullsized":"2023-12-08T08:20:28.654804+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:58.775918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840425+0000","last_change":"2023-12-08T08:20:26.016564+0000","last_active":"2023-12-08T08:20:27.840425+0000","last_peered":"2023-12-08T08:20:27.840425+0000","last_clean":"2023-12-08T08:20:27.840425+0000","last_became_active":"2023-12-08T08:20:26.016260+0000","last_became_peered":"2023-12-08T08:20:26.016260+0000","last_unstale":"2023-12-08T08:20:27.840425+0000","last_undegraded":"2023-12-08T08:20:27.840425+0000","last_fullsized":"2023-12-08T08:20:27.840425+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:10:46.014106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653923+0000","last_change":"2023-12-08T08:20:26.845078+0000","last_active":"2023-12-08T08:20:28.653923+0000","last_peered":"2023-12-08T08:20:28.653923+0000","last_clean":"2023-12-08T08:20:28.653923+0000","last_became_active":"2023-12-08T08:20:26.844815+0000","last_became_peered":"2023-12-08T08:20:26.844815+0000","last_unstale":"2023-12-08T08:20:28.653923+0000","last_undegraded":"2023-12-08T08:20:28.653923+0000","last_fullsized":"2023-12-08T08:20:28.653923+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:38:06.263424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"55'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654535+0000","last_change":"2023-12-08T08:20:26.012423+0000","last_active":"2023-12-08T08:20:28.654535+0000","last_peered":"2023-12-08T08:20:28.654535+0000","last_clean":"2023-12-08T08:20:28.654535+0000","last_became_active":"2023-12-08T08:20:26.012088+0000","last_became_peered":"2023-12-08T08:20:26.012088+0000","last_unstale":"2023-12-08T08:20:28.654535+0000","last_undegraded":"2023-12-08T08:20:28.654535+0000","last_fullsized":"2023-12-08T08:20:28.654535+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:57:11.385549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841954+0000","last_change":"2023-12-08T08:20:26.854042+0000","last_active":"2023-12-08T08:20:27.841954+0000","last_peered":"2023-12-08T08:20:27.841954+0000","last_clean":"2023-12-08T08:20:27.841954+0000","last_became_active":"2023-12-08T08:20:26.853212+0000","last_became_peered":"2023-12-08T08:20:26.853212+0000","last_unstale":"2023-12-08T08:20:27.841954+0000","last_undegraded":"2023-12-08T08:20:27.841954+0000","last_fullsized":"2023-12-08T08:20:27.841954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:37:19.498736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840168+0000","last_change":"2023-12-08T08:20:26.019277+0000","last_active":"2023-12-08T08:20:27.840168+0000","last_peered":"2023-12-08T08:20:27.840168+0000","last_clean":"2023-12-08T08:20:27.840168+0000","last_became_active":"2023-12-08T08:20:26.018998+0000","last_became_peered":"2023-12-08T08:20:26.018998+0000","last_unstale":"2023-12-08T08:20:27.840168+0000","last_undegraded":"2023-12-08T08:20:27.840168+0000","last_fullsized":"2023-12-08T08:20:27.840168+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:57:11.385549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654279+0000","last_change":"2023-12-08T08:20:26.852001+0000","last_active":"2023-12-08T08:20:28.654279+0000","last_peered":"2023-12-08T08:20:28.654279+0000","last_clean":"2023-12-08T08:20:28.654279+0000","last_became_active":"2023-12-08T08:20:26.851297+0000","last_became_peered":"2023-12-08T08:20:26.851297+0000","last_unstale":"2023-12-08T08:20:28.654279+0000","last_undegraded":"2023-12-08T08:20:28.654279+0000","last_fullsized":"2023-12-08T08:20:28.654279+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T19:08:23.120356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654196+0000","last_change":"2023-12-08T08:20:26.010049+0000","last_active":"2023-12-08T08:20:28.654196+0000","last_peered":"2023-12-08T08:20:28.654196+0000","last_clean":"2023-12-08T08:20:28.654196+0000","last_became_active":"2023-12-08T08:20:26.009728+0000","last_became_peered":"2023-12-08T08:20:26.009728+0000","last_unstale":"2023-12-08T08:20:28.654196+0000","last_undegraded":"2023-12-08T08:20:28.654196+0000","last_fullsized":"2023-12-08T08:20:28.654196+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:33:07.020465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840063+0000","last_change":"2023-12-08T08:20:26.859970+0000","last_active":"2023-12-08T08:20:27.840063+0000","last_peered":"2023-12-08T08:20:27.840063+0000","last_clean":"2023-12-08T08:20:27.840063+0000","last_became_active":"2023-12-08T08:20:26.859679+0000","last_became_peered":"2023-12-08T08:20:26.859679+0000","last_unstale":"2023-12-08T08:20:27.840063+0000","last_undegraded":"2023-12-08T08:20:27.840063+0000","last_fullsized":"2023-12-08T08:20:27.840063+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:17:56.938841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653384+0000","last_change":"2023-12-08T08:20:26.016359+0000","last_active":"2023-12-08T08:20:28.653384+0000","last_peered":"2023-12-08T08:20:28.653384+0000","last_clean":"2023-12-08T08:20:28.653384+0000","last_became_active":"2023-12-08T08:20:26.015521+0000","last_became_peered":"2023-12-08T08:20:26.015521+0000","last_unstale":"2023-12-08T08:20:28.653384+0000","last_undegraded":"2023-12-08T08:20:28.653384+0000","last_fullsized":"2023-12-08T08:20:28.653384+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:35:08.718719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.839811+0000","last_change":"2023-12-08T08:20:26.855001+0000","last_active":"2023-12-08T08:20:27.839811+0000","last_peered":"2023-12-08T08:20:27.839811+0000","last_clean":"2023-12-08T08:20:27.839811+0000","last_became_active":"2023-12-08T08:20:26.854681+0000","last_became_peered":"2023-12-08T08:20:26.854681+0000","last_unstale":"2023-12-08T08:20:27.839811+0000","last_undegraded":"2023-12-08T08:20:27.839811+0000","last_fullsized":"2023-12-08T08:20:27.839811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:56:43.746978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653835+0000","last_change":"2023-12-08T08:20:26.015793+0000","last_active":"2023-12-08T08:20:28.653835+0000","last_peered":"2023-12-08T08:20:28.653835+0000","last_clean":"2023-12-08T08:20:28.653835+0000","last_became_active":"2023-12-08T08:20:26.015457+0000","last_became_peered":"2023-12-08T08:20:26.015457+0000","last_unstale":"2023-12-08T08:20:28.653835+0000","last_undegraded":"2023-12-08T08:20:28.653835+0000","last_fullsized":"2023-12-08T08:20:28.653835+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:10:33.954487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654871+0000","last_change":"2023-12-08T08:20:26.857628+0000","last_active":"2023-12-08T08:20:28.654871+0000","last_peered":"2023-12-08T08:20:28.654871+0000","last_clean":"2023-12-08T08:20:28.654871+0000","last_became_active":"2023-12-08T08:20:26.857360+0000","last_became_peered":"2023-12-08T08:20:26.857360+0000","last_unstale":"2023-12-08T08:20:28.654871+0000","last_undegraded":"2023-12-08T08:20:28.654871+0000","last_fullsized":"2023-12-08T08:20:28.654871+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:37:19.498736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"55'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654084+0000","last_change":"2023-12-08T08:20:26.009482+0000","last_active":"2023-12-08T08:20:28.654084+0000","last_peered":"2023-12-08T08:20:28.654084+0000","last_clean":"2023-12-08T08:20:28.654084+0000","last_became_active":"2023-12-08T08:20:26.009215+0000","last_became_peered":"2023-12-08T08:20:26.009215+0000","last_unstale":"2023-12-08T08:20:28.654084+0000","last_undegraded":"2023-12-08T08:20:28.654084+0000","last_fullsized":"2023-12-08T08:20:28.654084+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T16:12:28.521902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654795+0000","last_change":"2023-12-08T08:20:26.856851+0000","last_active":"2023-12-08T08:20:28.654795+0000","last_peered":"2023-12-08T08:20:28.654795+0000","last_clean":"2023-12-08T08:20:28.654795+0000","last_became_active":"2023-12-08T08:20:26.856519+0000","last_became_peered":"2023-12-08T08:20:26.856519+0000","last_unstale":"2023-12-08T08:20:28.654795+0000","last_undegraded":"2023-12-08T08:20:28.654795+0000","last_fullsized":"2023-12-08T08:20:28.654795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T18:29:34.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840467+0000","last_change":"2023-12-08T08:20:26.015481+0000","last_active":"2023-12-08T08:20:27.840467+0000","last_peered":"2023-12-08T08:20:27.840467+0000","last_clean":"2023-12-08T08:20:27.840467+0000","last_became_active":"2023-12-08T08:20:26.015177+0000","last_became_peered":"2023-12-08T08:20:26.015177+0000","last_unstale":"2023-12-08T08:20:27.840467+0000","last_undegraded":"2023-12-08T08:20:27.840467+0000","last_fullsized":"2023-12-08T08:20:27.840467+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:24.443350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653686+0000","last_change":"2023-12-08T08:20:26.853156+0000","last_active":"2023-12-08T08:20:28.653686+0000","last_peered":"2023-12-08T08:20:28.653686+0000","last_clean":"2023-12-08T08:20:28.653686+0000","last_became_active":"2023-12-08T08:20:26.852536+0000","last_became_peered":"2023-12-08T08:20:26.852536+0000","last_unstale":"2023-12-08T08:20:28.653686+0000","last_undegraded":"2023-12-08T08:20:28.653686+0000","last_fullsized":"2023-12-08T08:20:28.653686+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:06:07.627022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841324+0000","last_change":"2023-12-08T08:20:26.012270+0000","last_active":"2023-12-08T08:20:27.841324+0000","last_peered":"2023-12-08T08:20:27.841324+0000","last_clean":"2023-12-08T08:20:27.841324+0000","last_became_active":"2023-12-08T08:20:26.011937+0000","last_became_peered":"2023-12-08T08:20:26.011937+0000","last_unstale":"2023-12-08T08:20:27.841324+0000","last_undegraded":"2023-12-08T08:20:27.841324+0000","last_fullsized":"2023-12-08T08:20:27.841324+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T10:21:00.591615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.840326+0000","last_change":"2023-12-08T08:20:26.860546+0000","last_active":"2023-12-08T08:20:27.840326+0000","last_peered":"2023-12-08T08:20:27.840326+0000","last_clean":"2023-12-08T08:20:27.840326+0000","last_became_active":"2023-12-08T08:20:26.860274+0000","last_became_peered":"2023-12-08T08:20:26.860274+0000","last_unstale":"2023-12-08T08:20:27.840326+0000","last_undegraded":"2023-12-08T08:20:27.840326+0000","last_fullsized":"2023-12-08T08:20:27.840326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:24:09.083676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654915+0000","last_change":"2023-12-08T08:20:26.010028+0000","last_active":"2023-12-08T08:20:28.654915+0000","last_peered":"2023-12-08T08:20:28.654915+0000","last_clean":"2023-12-08T08:20:28.654915+0000","last_became_active":"2023-12-08T08:20:26.009493+0000","last_became_peered":"2023-12-08T08:20:26.009493+0000","last_unstale":"2023-12-08T08:20:28.654915+0000","last_undegraded":"2023-12-08T08:20:28.654915+0000","last_fullsized":"2023-12-08T08:20:28.654915+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:12:28.955276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654185+0000","last_change":"2023-12-08T08:20:26.853046+0000","last_active":"2023-12-08T08:20:28.654185+0000","last_peered":"2023-12-08T08:20:28.654185+0000","last_clean":"2023-12-08T08:20:28.654185+0000","last_became_active":"2023-12-08T08:20:26.852652+0000","last_became_peered":"2023-12-08T08:20:26.852652+0000","last_unstale":"2023-12-08T08:20:28.654185+0000","last_undegraded":"2023-12-08T08:20:28.654185+0000","last_fullsized":"2023-12-08T08:20:28.654185+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T20:05:45.159221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653279+0000","last_change":"2023-12-08T08:20:26.004589+0000","last_active":"2023-12-08T08:20:28.653279+0000","last_peered":"2023-12-08T08:20:28.653279+0000","last_clean":"2023-12-08T08:20:28.653279+0000","last_became_active":"2023-12-08T08:20:26.004295+0000","last_became_peered":"2023-12-08T08:20:26.004295+0000","last_unstale":"2023-12-08T08:20:28.653279+0000","last_undegraded":"2023-12-08T08:20:28.653279+0000","last_fullsized":"2023-12-08T08:20:28.653279+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:41:38.178182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841410+0000","last_change":"2023-12-08T08:20:26.844777+0000","last_active":"2023-12-08T08:20:27.841410+0000","last_peered":"2023-12-08T08:20:27.841410+0000","last_clean":"2023-12-08T08:20:27.841410+0000","last_became_active":"2023-12-08T08:20:26.844447+0000","last_became_peered":"2023-12-08T08:20:26.844447+0000","last_unstale":"2023-12-08T08:20:27.841410+0000","last_undegraded":"2023-12-08T08:20:27.841410+0000","last_fullsized":"2023-12-08T08:20:27.841410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:55:25.448388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.654513+0000","last_change":"2023-12-08T08:20:26.016191+0000","last_active":"2023-12-08T08:20:28.654513+0000","last_peered":"2023-12-08T08:20:28.654513+0000","last_clean":"2023-12-08T08:20:28.654513+0000","last_became_active":"2023-12-08T08:20:26.015879+0000","last_became_peered":"2023-12-08T08:20:26.015879+0000","last_unstale":"2023-12-08T08:20:28.654513+0000","last_undegraded":"2023-12-08T08:20:28.654513+0000","last_fullsized":"2023-12-08T08:20:28.654513+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:00:16.171336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653208+0000","last_change":"2023-12-08T08:20:26.851243+0000","last_active":"2023-12-08T08:20:28.653208+0000","last_peered":"2023-12-08T08:20:28.653208+0000","last_clean":"2023-12-08T08:20:28.653208+0000","last_became_active":"2023-12-08T08:20:26.850971+0000","last_became_peered":"2023-12-08T08:20:26.850971+0000","last_unstale":"2023-12-08T08:20:28.653208+0000","last_undegraded":"2023-12-08T08:20:28.653208+0000","last_fullsized":"2023-12-08T08:20:28.653208+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T14:54:18.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653295+0000","last_change":"2023-12-08T08:20:26.010654+0000","last_active":"2023-12-08T08:20:28.653295+0000","last_peered":"2023-12-08T08:20:28.653295+0000","last_clean":"2023-12-08T08:20:28.653295+0000","last_became_active":"2023-12-08T08:20:26.010377+0000","last_became_peered":"2023-12-08T08:20:26.010377+0000","last_unstale":"2023-12-08T08:20:28.653295+0000","last_undegraded":"2023-12-08T08:20:28.653295+0000","last_fullsized":"2023-12-08T08:20:28.653295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:09:18.938294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653752+0000","last_change":"2023-12-08T08:20:26.847443+0000","last_active":"2023-12-08T08:20:28.653752+0000","last_peered":"2023-12-08T08:20:28.653752+0000","last_clean":"2023-12-08T08:20:28.653752+0000","last_became_active":"2023-12-08T08:20:26.847180+0000","last_became_peered":"2023-12-08T08:20:26.847180+0000","last_unstale":"2023-12-08T08:20:28.653752+0000","last_undegraded":"2023-12-08T08:20:28.653752+0000","last_fullsized":"2023-12-08T08:20:28.653752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T17:52:34.319116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653837+0000","last_change":"2023-12-08T08:20:26.018787+0000","last_active":"2023-12-08T08:20:28.653837+0000","last_peered":"2023-12-08T08:20:28.653837+0000","last_clean":"2023-12-08T08:20:28.653837+0000","last_became_active":"2023-12-08T08:20:26.018443+0000","last_became_peered":"2023-12-08T08:20:26.018443+0000","last_unstale":"2023-12-08T08:20:28.653837+0000","last_undegraded":"2023-12-08T08:20:28.653837+0000","last_fullsized":"2023-12-08T08:20:28.653837+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:48:57.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:28.653679+0000","last_change":"2023-12-08T08:20:26.854520+0000","last_active":"2023-12-08T08:20:28.653679+0000","last_peered":"2023-12-08T08:20:28.653679+0000","last_clean":"2023-12-08T08:20:28.653679+0000","last_became_active":"2023-12-08T08:20:26.854252+0000","last_became_peered":"2023-12-08T08:20:26.854252+0000","last_unstale":"2023-12-08T08:20:28.653679+0000","last_undegraded":"2023-12-08T08:20:28.653679+0000","last_fullsized":"2023-12-08T08:20:28.653679+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:25.991378+0000","last_clean_scrub_stamp":"2023-12-08T08:20:25.991378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:49:26.168060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-08T08:20:27.841060+0000","last_change":"2023-12-08T08:20:26.010549+0000","last_active":"2023-12-08T08:20:27.841060+0000","last_peered":"2023-12-08T08:20:27.841060+0000","last_clean":"2023-12-08T08:20:27.841060+0000","last_became_active":"2023-12-08T08:20:26.010274+0000","last_became_peered":"2023-12-08T08:20:26.010274+0000","last_unstale":"2023-12-08T08:20:27.841060+0000","last_undegraded":"2023-12-08T08:20:27.841060+0000","last_fullsized":"2023-12-08T08:20:27.841060+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:20:24.986340+0000","last_clean_scrub_stamp":"2023-12-08T08:20:24.986340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:01:00.641902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-08T08:20:26.840874+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:20:26.840874+0000","last_peered":"2023-12-08T08:20:26.840874+0000","last_clean":"2023-12-08T08:20:26.840874+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:20:26.840874+0000","last_undegraded":"2023-12-08T08:20:26.840874+0000","last_fullsized":"2023-12-08T08:20:26.840874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1273856,"data_stored":893019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67300000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.38700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69799999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.40300000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.502,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.748,"5min":0.88,"15min":0.88},"last":0.438}]},{"osd":2,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.70399999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.496}]},{"osd":3,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.73599999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.503,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.497,"15min":0.496},"min":{"1min":0.34799999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75600000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78800000000000003,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":671744,"data_stored":302491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.46800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.67500000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80100000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.623},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58399999999999996,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70099999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.46600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.754,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.50700000000000001,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69999999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71999999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.435}]},{"osd":5,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":296523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.503,"15min":0.499},"min":{"1min":0.39700000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.72699999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.621}]},{"osd":1,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69699999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.503,"15min":0.497},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.443},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.40000000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.67400000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.68200000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.496},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63600000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69599999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.78800000000000003,"5min":0.88,"15min":0.88},"last":0.63900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":304103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53800000000000003,"15min":0.54700000000000004},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.621,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":1.022,"15min":1.022},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64100000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77300000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46000000000000002,"15min":0.45600000000000002},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.32700000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.746,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55700000000000005,"15min":0.54900000000000004},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":679936,"data_stored":302547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.51000000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35999999999999999,"15min":0.36199999999999999},"min":{"1min":0.26700000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.49099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38200000000000001,"15min":0.38400000000000001},"min":{"1min":0.248,"5min":0.246,"15min":0.246},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.44900000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57499999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.376}]},{"osd":2,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.433,"15min":0.439},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52000000000000002,"5min":0.623,"15min":0.623},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.56100000000000005,"5min":0.751,"15min":0.751},"last":0.434}]},{"osd":4,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63700000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56299999999999994}]},{"osd":5,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.624},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67600000000000005,"15min":0.67900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:19:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79000000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31840,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340000,"statfs":{"total":96636764160,"available":96604160000,"internally_reserved":0,"allocated":667648,"data_stored":295927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.57899999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.41099999999999998,"15min":0.40600000000000003},"min":{"1min":0.33000000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27000000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.50700000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35599999999999998,"15min":0.35299999999999998},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53500000000000003,"5min":0.623,"15min":0.623},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.30599999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.55500000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.29099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.45600000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.432,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.48299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76200000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:19:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.879,"15min":0.879},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":663552,"data_stored":295961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48899999999999999,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.45800000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.436}]},{"osd":2,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.26000000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.439,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.377,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.52900000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.41499999999999998,"15min":0.42099999999999999},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.48399999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.376,"15min":0.379},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.46600000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.42399999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.79000000000000004,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65100000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39700000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.70099999999999996,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.77700000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1277952,"data_stored":894034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.33700000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.61599999999999999,"5min":0.628,"15min":0.628},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.58599999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.219}]},{"osd":2,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.25},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40600000000000003,"15min":0.40699999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.71399999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.52200000000000002,"15min":0.54200000000000004},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63400000000000001,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45300000000000001,"15min":0.45400000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.73699999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.29599999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86499999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.623,"15min":0.626},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.749},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.498}]},{"osd":7,"last update":"Fri Dec 8 08:19:43 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:20:30.363 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-08T08:20:30.363 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-08T08:20:30.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.508+0000 7f5cbbc4f640 1 Processor -- start 2023-12-08T08:20:30.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.509+0000 7f5cbbc4f640 1 -- start start 2023-12-08T08:20:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.509+0000 7f5cbbc4f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5cb415d3a0 0x7f5cb40cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.509+0000 7f5cbbc4f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb40cdd60 0x7f5cb40cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.509+0000 7f5cbbc4f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb406b680 con 0x7f5cb406c6b0 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.509+0000 7f5cbbc4f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb406b8f0 con 0x7f5cb415d3a0 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.509+0000 7f5cbbc4f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb406bbd0 con 0x7f5cb40cdd60 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.509+0000 7f5cb91ea640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5cb406c6b0 0x7f5cb40cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52960/0 (socket says 172.21.15.50:52960) 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb91ea640 1 -- 172.21.15.50:0/1870526972 learned_addr learned my addr 172.21.15.50:0/1870526972 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb99eb640 1 --2- 172.21.15.50:0/1870526972 >> v2:172.21.15.170:3300/0 conn(0x7f5cb415d3a0 0x7f5cb40cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cba1ec640 1 --2- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb40cdd60 0x7f5cb40cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb89e9640 1 -- 172.21.15.50:0/1870526972 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911750284 0 0) 0x7f5cb406b680 con 0x7f5cb406c6b0 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb89e9640 1 -- 172.21.15.50:0/1870526972 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca0003520 con 0x7f5cb406c6b0 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb99eb640 1 -- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb40cdd60 msgr2=0x7f5cb40cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb99eb640 1 --2- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb40cdd60 0x7f5cb40cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb99eb640 1 -- 172.21.15.50:0/1870526972 >> v1:172.21.15.50:6789/0 conn(0x7f5cb406c6b0 legacy=0x7f5cb40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb89e9640 1 -- 172.21.15.50:0/1870526972 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1616828604 0 0) 0x7f5ca0003520 con 0x7f5cb406c6b0 2023-12-08T08:20:30.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.510+0000 7f5cb99eb640 1 -- 172.21.15.50:0/1870526972 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb406beb0 con 0x7f5cb415d3a0 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.511+0000 7f5cb99eb640 1 --2- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb415d3a0 0x7f5cb40cffc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00097a0 tx=0x7f5cb002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840a3ecf691f3a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.511+0000 7f5cb89e9640 1 -- 172.21.15.50:0/1870526972 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4001670 con 0x7f5cb415d3a0 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.511+0000 7f5cb89e9640 1 -- 172.21.15.50:0/1870526972 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb002e050 con 0x7f5cb415d3a0 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.511+0000 7f5cb89e9640 1 -- 172.21.15.50:0/1870526972 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0030710 con 0x7f5cb415d3a0 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb415d3a0 msgr2=0x7f5cb40cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb415d3a0 0x7f5cb40cffc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00097a0 tx=0x7f5cb002b790 comp rx=0 tx=0).stop 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1870526972 shutdown_connections 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb40cdd60 0x7f5cb40cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1870526972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb415d3a0 0x7f5cb40cffc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1870526972 >> 172.21.15.50:0/1870526972 conn(0x7f5cb40d0dd0 msgr2=0x7f5cb40d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1870526972 shutdown_connections 2023-12-08T08:20:30.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.512+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1870526972 wait complete. 2023-12-08T08:20:30.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.513+0000 7f5cbbc4f640 1 Processor -- start 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.513+0000 7f5cbbc4f640 1 -- start start 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cbbc4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb406c6b0 0x7f5cb4160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cbbc4f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb40cdd60 0x7f5cb414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cbbc4f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb415d3a0 0x7f5cb415f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cbbc4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb415f7b0 con 0x7f5cb406c6b0 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cbbc4f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb415e820 con 0x7f5cb40cdd60 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cbbc4f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb415ede0 con 0x7f5cb415d3a0 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb406c6b0 0x7f5cb4160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb406c6b0 0x7f5cb4160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57166/0 (socket says 172.21.15.50:57166) 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 -- 172.21.15.50:0/1185651488 learned_addr learned my addr 172.21.15.50:0/1185651488 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cba1ec640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb415d3a0 0x7f5cb415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb91ea640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb40cdd60 0x7f5cb414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 -- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb415d3a0 msgr2=0x7f5cb415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb415d3a0 0x7f5cb415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 -- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb40cdd60 msgr2=0x7f5cb414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb40cdd60 0x7f5cb414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 -- 172.21.15.50:0/1185651488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb0009400 con 0x7f5cb406c6b0 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5cb99eb640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb406c6b0 0x7f5cb4160520 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00098c0 tx=0x7f5cb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.514+0000 7f5caa7fc640 1 -- 172.21.15.50:0/1185651488 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb003d890 con 0x7f5cb406c6b0 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.515+0000 7f5caa7fc640 1 -- 172.21.15.50:0/1185651488 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb003da10 con 0x7f5cb406c6b0 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.515+0000 7f5caa7fc640 1 -- 172.21.15.50:0/1185651488 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb003ddc0 con 0x7f5cb406c6b0 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.515+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb414c5b0 con 0x7f5cb406c6b0 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.515+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb415ffa0 con 0x7f5cb406c6b0 2023-12-08T08:20:30.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.515+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb40d1530 con 0x7f5cb406c6b0 2023-12-08T08:20:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.516+0000 7f5caa7fc640 1 -- 172.21.15.50:0/1185651488 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5cb0039040 con 0x7f5cb406c6b0 2023-12-08T08:20:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.516+0000 7f5caa7fc640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9806ae40 0x7f5c9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.516+0000 7f5caa7fc640 1 -- 172.21.15.50:0/1185651488 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5cb00ab5f0 con 0x7f5cb406c6b0 2023-12-08T08:20:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.517+0000 7f5cb91ea640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9806ae40 0x7f5c9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.517+0000 7f5cb91ea640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9806ae40 0x7f5c9806d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5cb406fe10 tx=0x7f5ca4001d20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.521+0000 7f5caa7fc640 1 -- 172.21.15.50:0/1185651488 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5cb00767c0 con 0x7f5cb406c6b0 2023-12-08T08:20:30.768 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.765+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5cb4067430 con 0x7f5cb406c6b0 2023-12-08T08:20:30.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.767+0000 7f5caa7fc640 1 -- 172.21.15.50:0/1185651488 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5cb004d0b0 con 0x7f5cb406c6b0 2023-12-08T08:20:30.770 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:20:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:20:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-12-08T08:20:30.770 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:20:30.771 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-08T08:20:30.771 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:20:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.768+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9806ae40 msgr2=0x7f5c9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.768+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9806ae40 0x7f5c9806d300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5cb406fe10 tx=0x7f5ca4001d20 comp rx=0 tx=0).stop 2023-12-08T08:20:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.768+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb406c6b0 msgr2=0x7f5cb4160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.768+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb406c6b0 0x7f5cb4160520 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00098c0 tx=0x7f5cb00046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 shutdown_connections 2023-12-08T08:20:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5c9806ae40 0x7f5c9806d300 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5cb415d3a0 0x7f5cb415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cb40cdd60 0x7f5cb414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 --2- 172.21.15.50:0/1185651488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb406c6b0 0x7f5cb4160520 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 >> 172.21.15.50:0/1185651488 conn(0x7f5cb40d0dd0 msgr2=0x7f5cb415d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 shutdown_connections 2023-12-08T08:20:30.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.769+0000 7f5cbbc4f640 1 -- 172.21.15.50:0/1185651488 wait complete. 2023-12-08T08:20:30.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.885+0000 7f08933c9640 1 Processor -- start 2023-12-08T08:20:30.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.885+0000 7f08933c9640 1 -- start start 2023-12-08T08:20:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f08933c9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f088c1608a0 0x7f088c0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f08933c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b0cf0 0x7f088c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f08933c9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c0d20b0 con 0x7f088c0b1d70 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f08933c9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0d0620 con 0x7f088c1608a0 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f08933c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0d1b80 con 0x7f088c0b0cf0 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f0891165640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f088c1608a0 0x7f088c0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f0890964640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f088c0b1d70 0x7f088c0d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52972/0 (socket says 172.21.15.50:52972) 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.886+0000 7f0890964640 1 -- 172.21.15.50:0/1938426709 learned_addr learned my addr 172.21.15.50:0/1938426709 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.887+0000 7f088bfff640 1 -- 172.21.15.50:0/1938426709 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247398870 0 0) 0x7f088c0d20b0 con 0x7f088c0b1d70 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.887+0000 7f0891966640 1 --2- 172.21.15.50:0/1938426709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b0cf0 0x7f088c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.887+0000 7f088bfff640 1 -- 172.21.15.50:0/1938426709 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0874003520 con 0x7f088c0b1d70 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.887+0000 7f0891165640 1 -- 172.21.15.50:0/1938426709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b0cf0 msgr2=0x7f088c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.887+0000 7f0891165640 1 --2- 172.21.15.50:0/1938426709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b0cf0 0x7f088c0cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.887+0000 7f0891165640 1 -- 172.21.15.50:0/1938426709 >> v1:172.21.15.50:6789/0 conn(0x7f088c0b1d70 legacy=0x7f088c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.887+0000 7f0891165640 1 -- 172.21.15.50:0/1938426709 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0d1dd0 con 0x7f088c1608a0 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f0891165640 1 --2- 172.21.15.50:0/1938426709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c1608a0 0x7f088c0d0f30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f087c009d90 tx=0x7f087c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741b3a497eb43516 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f088bfff640 1 -- 172.21.15.50:0/1938426709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c02cbc0 con 0x7f088c1608a0 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f088bfff640 1 -- 172.21.15.50:0/1938426709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c02cd20 con 0x7f088c1608a0 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f088bfff640 1 -- 172.21.15.50:0/1938426709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c034660 con 0x7f088c1608a0 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 -- 172.21.15.50:0/1938426709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c1608a0 msgr2=0x7f088c0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 --2- 172.21.15.50:0/1938426709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c1608a0 0x7f088c0d0f30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f087c009d90 tx=0x7f087c02be10 comp rx=0 tx=0).stop 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 -- 172.21.15.50:0/1938426709 shutdown_connections 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 --2- 172.21.15.50:0/1938426709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b0cf0 0x7f088c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 --2- 172.21.15.50:0/1938426709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c1608a0 0x7f088c0d0f30 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 -- 172.21.15.50:0/1938426709 >> 172.21.15.50:0/1938426709 conn(0x7f088c0d3030 msgr2=0x7f088c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 -- 172.21.15.50:0/1938426709 shutdown_connections 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.888+0000 7f08933c9640 1 -- 172.21.15.50:0/1938426709 wait complete. 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 Processor -- start 2023-12-08T08:20:30.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 -- start start 2023-12-08T08:20:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c0b0cf0 0x7f088c15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b1d70 0x7f088c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.895 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f088c1608a0 0x7f088c0b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c15e2b0 con 0x7f088c0b0cf0 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0b5c20 con 0x7f088c1608a0 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f08933c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0c6b10 con 0x7f088c0b1d70 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f0891165640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c0b0cf0 0x7f088c15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f0891165640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c0b0cf0 0x7f088c15a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57184/0 (socket says 172.21.15.50:57184) 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.890+0000 7f0891165640 1 -- 172.21.15.50:0/2587621204 learned_addr learned my addr 172.21.15.50:0/2587621204 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891966640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f088c1608a0 0x7f088c0b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0890964640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b1d70 0x7f088c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891165640 1 -- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b1d70 msgr2=0x7f088c0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891165640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b1d70 0x7f088c0b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891165640 1 -- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f088c1608a0 msgr2=0x7f088c0b70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891165640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f088c1608a0 0x7f088c0b70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891165640 1 -- 172.21.15.50:0/2587621204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c009a70 con 0x7f088c0b0cf0 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891966640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f088c1608a0 0x7f088c0b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:30.896 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0890964640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b1d70 0x7f088c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0891165640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c0b0cf0 0x7f088c15a640 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f087c009d90 tx=0x7f087c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0889ffb640 1 -- 172.21.15.50:0/2587621204 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c040650 con 0x7f088c0b0cf0 2023-12-08T08:20:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0889ffb640 1 -- 172.21.15.50:0/2587621204 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c02ce90 con 0x7f088c0b0cf0 2023-12-08T08:20:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c0c6df0 con 0x7f088c0b0cf0 2023-12-08T08:20:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f0889ffb640 1 -- 172.21.15.50:0/2587621204 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0409f0 con 0x7f088c0b0cf0 2023-12-08T08:20:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.891+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c0b5e70 con 0x7f088c0b0cf0 2023-12-08T08:20:30.897 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.892+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c067430 con 0x7f088c0b0cf0 2023-12-08T08:20:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.893+0000 7f0889ffb640 1 -- 172.21.15.50:0/2587621204 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f087c040b50 con 0x7f088c0b0cf0 2023-12-08T08:20:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.893+0000 7f0889ffb640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f087806ae40 0x7f087806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.893+0000 7f0889ffb640 1 -- 172.21.15.50:0/2587621204 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f087c0ac400 con 0x7f088c0b0cf0 2023-12-08T08:20:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.893+0000 7f0890964640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f087806ae40 0x7f087806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:30.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.894+0000 7f0890964640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f087806ae40 0x7f087806d300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f088c15d7d0 tx=0x7f0880009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:30.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:30.897+0000 7f0889ffb640 1 -- 172.21.15.50:0/2587621204 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f087c077400 con 0x7f088c0b0cf0 2023-12-08T08:20:31.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.112+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f088c0cf410 con 0x7f088c0b0cf0 2023-12-08T08:20:31.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.112+0000 7f0889ffb640 1 -- 172.21.15.50:0/2587621204 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f087c07aa20 con 0x7f088c0b0cf0 2023-12-08T08:20:31.116 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:31.116 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/3932110318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":3932110318},{"type":"v1","addr":"172.21.15.170:6836","nonce":3932110318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/1019645291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":1019645291},{"type":"v1","addr":"172.21.15.170:6837","nonce":1019645291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3216810814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3216810814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3216810814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:26.368189+0000","modified":"2023-12-08T08:20:28.353010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4199554410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4199554410},{"type":"v1","addr":"172.21.15.50:6835","nonce":4199554410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:20:31.116 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f087806ae40 msgr2=0x7f087806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f087806ae40 0x7f087806d300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f088c15d7d0 tx=0x7f0880009040 comp rx=0 tx=0).stop 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c0b0cf0 msgr2=0x7f088c15a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c0b0cf0 0x7f088c15a640 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f087c009d90 tx=0x7f087c004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 shutdown_connections 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f087806ae40 0x7f087806d300 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f088c1608a0 0x7f088c0b70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f088c0b1d70 0x7f088c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 --2- 172.21.15.50:0/2587621204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f088c0b0cf0 0x7f088c15a640 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 >> 172.21.15.50:0/2587621204 conn(0x7f088c0d3030 msgr2=0x7f088c0d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 shutdown_connections 2023-12-08T08:20:31.118 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.114+0000 7f08933c9640 1 -- 172.21.15.50:0/2587621204 wait complete. 2023-12-08T08:20:31.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-08T08:20:26.368189+0000', 'modified': '2023-12-08T08:20:28.353010+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6222}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6222': {'gid': 6222, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.50:6835/4199554410', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6833', 'nonce': 4199554410}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 4199554410}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-08T08:20:31.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-08T08:20:31.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-08T08:20:31.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.637+0000 7f2a5874c640 1 Processor -- start 2023-12-08T08:20:31.641 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.637+0000 7f2a5874c640 1 -- start start 2023-12-08T08:20:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a5874c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cf900 0x7f2a5015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a5874c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a5015f310 0x7f2a5015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a5874c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5015c150 con 0x7f2a500cd240 2023-12-08T08:20:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a5874c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a500cd620 con 0x7f2a5015f310 2023-12-08T08:20:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a5874c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5015fb00 con 0x7f2a500cf900 2023-12-08T08:20:31.642 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a56ce9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a5015f310 0x7f2a5015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a56ce9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2a5015f310 0x7f2a5015a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57190/0 (socket says 172.21.15.50:57190) 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.638+0000 7f2a56ce9640 1 -- 172.21.15.50:0/1713663590 learned_addr learned my addr 172.21.15.50:0/1713663590 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.639+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/1713663590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cf900 0x7f2a5015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.639+0000 7f2a56ce9640 1 -- 172.21.15.50:0/1713663590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cf900 msgr2=0x7f2a5015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.639+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/1713663590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cf900 0x7f2a5015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.639+0000 7f2a56ce9640 1 -- 172.21.15.50:0/1713663590 >> v1:172.21.15.170:6789/0 conn(0x7f2a500cd240 legacy=0x7f2a500cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.639+0000 7f2a56ce9640 1 -- 172.21.15.50:0/1713663590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5015b820 con 0x7f2a5015f310 2023-12-08T08:20:31.643 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.639+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/1713663590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cf900 0x7f2a5015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.639+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/1713663590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a5015f310 0x7f2a5015a9f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009e50 tx=0x7f2a4002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e4dd8f1188e281 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a554e6640 1 -- 172.21.15.50:0/1713663590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4002ca70 con 0x7f2a5015f310 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a554e6640 1 -- 172.21.15.50:0/1713663590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4002cbd0 con 0x7f2a5015f310 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a554e6640 1 -- 172.21.15.50:0/1713663590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400343f0 con 0x7f2a5015f310 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 -- 172.21.15.50:0/1713663590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a5015f310 msgr2=0x7f2a5015a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 --2- 172.21.15.50:0/1713663590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a5015f310 0x7f2a5015a9f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009e50 tx=0x7f2a4002bed0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 -- 172.21.15.50:0/1713663590 shutdown_connections 2023-12-08T08:20:31.644 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 --2- 172.21.15.50:0/1713663590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a5015f310 0x7f2a5015a9f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 --2- 172.21.15.50:0/1713663590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cf900 0x7f2a5015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 -- 172.21.15.50:0/1713663590 >> 172.21.15.50:0/1713663590 conn(0x7f2a50099a10 msgr2=0x7f2a50099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 -- 172.21.15.50:0/1713663590 shutdown_connections 2023-12-08T08:20:31.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.640+0000 7f2a5874c640 1 -- 172.21.15.50:0/1713663590 wait complete. 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.641+0000 7f2a5874c640 1 Processor -- start 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a5874c640 1 -- start start 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a5874c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cd240 0x7f2a5006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a5874c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500cf900 0x7f2a500b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a5874c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5015f310 0x7f2a500c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a5874c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500b21d0 con 0x7f2a500cf900 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a5874c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500c9e20 con 0x7f2a5015f310 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a5874c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500b2490 con 0x7f2a500cd240 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a55ce7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500cf900 0x7f2a500b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a55ce7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500cf900 0x7f2a500b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57198/0 (socket says 172.21.15.50:57198) 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.642+0000 7f2a55ce7640 1 -- 172.21.15.50:0/3172633953 learned_addr learned my addr 172.21.15.50:0/3172633953 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a55ce7640 1 -- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cd240 msgr2=0x7f2a5006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cd240 0x7f2a5006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.647 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a55ce7640 1 -- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5015f310 msgr2=0x7f2a500c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5015f310 0x7f2a500c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5015f310 0x7f2a500c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a55ce7640 1 -- 172.21.15.50:0/3172633953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40009b30 con 0x7f2a500cf900 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500cf900 0x7f2a500b3bf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c820 tx=0x7f2a4400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a4effd640 1 -- 172.21.15.50:0/3172633953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44007a30 con 0x7f2a500cf900 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a4effd640 1 -- 172.21.15.50:0/3172633953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44007b90 con 0x7f2a500cf900 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a500b0b30 con 0x7f2a500cf900 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a4effd640 1 -- 172.21.15.50:0/3172633953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400ce70 con 0x7f2a500cf900 2023-12-08T08:20:31.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.643+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a500c9860 con 0x7f2a500cf900 2023-12-08T08:20:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.645+0000 7f2a4effd640 1 -- 172.21.15.50:0/3172633953 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a440113f0 con 0x7f2a500cf900 2023-12-08T08:20:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.645+0000 7f2a4effd640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a3c06ae40 0x7f2a3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.645+0000 7f2a4effd640 1 -- 172.21.15.50:0/3172633953 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a440898e0 con 0x7f2a500cf900 2023-12-08T08:20:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.645+0000 7f2a564e8640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a3c06ae40 0x7f2a3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.646+0000 7f2a564e8640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a3c06ae40 0x7f2a3c06d300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2a48003cc0 tx=0x7f2a480079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.646+0000 7f2a5b3c0740 1 Processor -- start 2023-12-08T08:20:31.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.646+0000 7f2a5b3c0740 1 -- start start 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 0x5648f1d08bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d09130 0x5648f1d38f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1cc9980 con 0x5648f1d09130 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1c7bb90 con 0x5648f1d36030 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648f1c79280 con 0x5648f1d35c50 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d09130 0x5648f1d38f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d09130 0x5648f1d38f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57214/0 (socket says 172.21.15.50:57214) 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 -- 172.21.15.50:0/3974937332 learned_addr learned my addr 172.21.15.50:0/3974937332 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a564e8640 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 0x5648f1d08bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 -- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 msgr2=0x5648f1d08bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.652 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 0x5648f1d08bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 -- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 msgr2=0x5648f1d389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.647+0000 7f2a56ce9640 1 -- 172.21.15.50:0/3974937332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f1c3a500 con 0x5648f1d09130 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d09130 0x5648f1d38f20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009f70 tx=0x7f2a4002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7925d0735e9b2066 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a37fff640 1 -- 172.21.15.50:0/3974937332 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40040470 con 0x5648f1d09130 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a37fff640 1 -- 172.21.15.50:0/3974937332 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a400405d0 con 0x5648f1d09130 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a37fff640 1 -- 172.21.15.50:0/3974937332 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40040940 con 0x5648f1d09130 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/3974937332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d09130 msgr2=0x5648f1d38f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d09130 0x5648f1d38f20 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009f70 tx=0x7f2a4002e000 comp rx=0 tx=0).stop 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/3974937332 shutdown_connections 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d09130 0x5648f1d38f20 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/3974937332 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 0x5648f1d08bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/3974937332 >> 172.21.15.50:0/3974937332 conn(0x5648f1d0ae60 msgr2=0x5648f1d539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.648+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/3974937332 shutdown_connections 2023-12-08T08:20:31.653 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.649+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/3974937332 wait complete. 2023-12-08T08:20:31.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.649+0000 7f2a5b3c0740 1 -- start start 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.649+0000 7f2a5b3c0740 1 Processor -- start 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d35c50 0x5648f1d39ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d22460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d256f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1c74b70 con 0x5648f1d35c50 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1c2ee00 con 0x5648f1d36030 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648f1c2eaa0 con 0x5648f1d229a0 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d35c50 0x5648f1d39ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a5b3c0740 10 client.0 _ll_register_callbacks cb 0x5648f1986ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d35c50 0x5648f1d39ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57228/0 (socket says 172.21.15.50:57228) 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 -- 172.21.15.50:0/2542856427 learned_addr learned my addr 172.21.15.50:0/2542856427 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d256f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d22460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.658 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 -- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 msgr2=0x5648f1d256f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d256f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 -- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 msgr2=0x5648f1d22460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d22460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a564e8640 1 -- 172.21.15.50:0/2542856427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5015b820 con 0x5648f1d35c50 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d22460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.650+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d256f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a564e8640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d35c50 0x5648f1d39ce0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2a480166c0 tx=0x7f2a4800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825699bd7db6ba84 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a357fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a357fa640 1 -- 172.21.15.50:0/2542856427 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4801d040 con 0x5648f1d35c50 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a357fa640 1 -- 172.21.15.50:0/2542856427 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a48007250 con 0x5648f1d35c50 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648f1c6db50 con 0x5648f1d35c50 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a357fa640 1 -- 172.21.15.50:0/2542856427 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a480162e0 con 0x5648f1d35c50 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 10 client.6369 fetch_fsmap learned FSMap version 23 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5648f1c731f0 con 0x5648f1d35c50 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a357fa640 1 -- 172.21.15.50:0/2542856427 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5648f1c6db50 con 0x5648f1d35c50 2023-12-08T08:20:31.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a357fa640 1 -- 172.21.15.50:0/2542856427 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a48007410 con 0x5648f1d35c50 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 10 client.6369 fetch_fsmap finished waiting for FSMap version 23 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 10 client.6369 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 20 client.6369 populate_metadata read hostname 'smithi050' 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d20b10 0x5648f1d20ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 4 client.6369 mds_command: new command op to 6222 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 --> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648f1c6d870 con 0x5648f1d20b10 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.651+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d20b10 0x5648f1d20ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d20b10 0x5648f1d20ef0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b1a98a7d1e9d60 server_cookie=42af51b37d7dc363 in_seq=0 out_seq=0 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a357fa640 10 client.6369 ms_handle_connect on v2:172.21.15.50:6833/4199554410 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a357fa640 1 -- 172.21.15.50:0/2542856427 <== mds.0 v2:172.21.15.50:6833/4199554410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5648f1c6d870 con 0x5648f1d20b10 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a357fa640 10 client.6369 handle_command_reply: tid=0 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 client.6369 shutdown 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d35c50 msgr2=0x5648f1d39ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d35c50 0x5648f1d39ce0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2a480166c0 tx=0x7f2a4800f000 comp rx=0 tx=0).stop 2023-12-08T08:20:31.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 shutdown_connections 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d20b10 0x5648f1d20ef0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d256f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a357fa640 0 client.6369 ms_handle_reset on v2:172.21.15.50:6833/4199554410 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d36030 0x5648f1d22460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.652+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2542856427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d35c50 0x5648f1d39ce0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.653+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 >> 172.21.15.50:0/2542856427 conn(0x5648f1d09130 msgr2=0x5648f1d352c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.653+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 shutdown_connections 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.653+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2542856427 wait complete. 2023-12-08T08:20:31.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.653+0000 7f2a5b3c0740 20 client.6369 trim_cache size 0 max 16384 2023-12-08T08:20:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.668+0000 7f2a5b3c0740 1 Processor -- start 2023-12-08T08:20:31.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a5b3c0740 1 -- start start 2023-12-08T08:20:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d21040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d229a0 0x5648f1d0c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 0x5648f1d21dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1bf4270 con 0x5648f1d20b10 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1d25650 con 0x5648f1d229a0 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648f1c47230 con 0x5648f1d35c50 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a564e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d21040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a564e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d21040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57232/0 (socket says 172.21.15.50:57232) 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.669+0000 7f2a564e8640 1 -- 172.21.15.50:0/2712256317 learned_addr learned my addr 172.21.15.50:0/2712256317 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a564e8640 1 -- 172.21.15.50:0/2712256317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 msgr2=0x5648f1d21dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a564e8640 1 --2- 172.21.15.50:0/2712256317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 0x5648f1d21dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a564e8640 1 -- 172.21.15.50:0/2712256317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d229a0 msgr2=0x5648f1d0c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a564e8640 1 --2- 172.21.15.50:0/2712256317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d229a0 0x5648f1d0c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a564e8640 1 -- 172.21.15.50:0/2712256317 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f1c10d00 con 0x5648f1d20b10 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a564e8640 1 --2- 172.21.15.50:0/2712256317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d21040 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2a48003aa0 tx=0x7f2a48013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5574bee5716ffd18 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a4cff9640 1 -- 172.21.15.50:0/2712256317 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480162e0 con 0x5648f1d20b10 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a4cff9640 1 -- 172.21.15.50:0/2712256317 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48013d20 con 0x5648f1d20b10 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a4cff9640 1 -- 172.21.15.50:0/2712256317 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48022910 con 0x5648f1d20b10 2023-12-08T08:20:31.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2712256317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 msgr2=0x5648f1d21040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2712256317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d21040 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f2a48003aa0 tx=0x7f2a48013000 comp rx=0 tx=0).stop 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2712256317 shutdown_connections 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2712256317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d35c50 0x5648f1d21dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2712256317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d229a0 0x5648f1d0c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/2712256317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d21040 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.670+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2712256317 >> 172.21.15.50:0/2712256317 conn(0x5648f1d09130 msgr2=0x5648f1d07da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.671+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2712256317 shutdown_connections 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.671+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/2712256317 wait complete. 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.671+0000 7f2a5b3c0740 1 -- start start 2023-12-08T08:20:31.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.671+0000 7f2a5b3c0740 1 Processor -- start 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d55640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d53000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a5b3c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d35c50 0x5648f1d53540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1d53ad0 con 0x5648f1d20b10 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f1d62f30 con 0x5648f1d35c50 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a5b3c0740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648f1d634a0 con 0x5648f1d229a0 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a5b3c0740 10 client.0 _ll_register_callbacks cb 0x7f2a40009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d55640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d55640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57240/0 (socket says 172.21.15.50:57240) 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 -- 172.21.15.50:0/33249949 learned_addr learned my addr 172.21.15.50:0/33249949 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d35c50 0x5648f1d53540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d53000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 -- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 msgr2=0x5648f1d53000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d53000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 -- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d35c50 msgr2=0x5648f1d53540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d35c50 0x5648f1d53540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a564e8640 1 -- 172.21.15.50:0/33249949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648f1c731f0 con 0x5648f1d20b10 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.672+0000 7f2a56ce9640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d35c50 0x5648f1d53540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a564e8640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d55640 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2a48005620 tx=0x7f2a480037d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a466fce039e91f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a357fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a357fa640 1 -- 172.21.15.50:0/33249949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48022c70 con 0x5648f1d20b10 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a357fa640 1 -- 172.21.15.50:0/33249949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a48022dd0 con 0x5648f1d20b10 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a400405d0 con 0x5648f1d20b10 2023-12-08T08:20:31.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a357fa640 1 -- 172.21.15.50:0/33249949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a480133b0 con 0x5648f1d20b10 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 10 client.6375 fetch_fsmap learned FSMap version 23 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5648f1c364f0 con 0x5648f1d20b10 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a357fa640 1 -- 172.21.15.50:0/33249949 <== mon.0 v2:172.21.15.50:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a400405d0 con 0x5648f1d20b10 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a357fa640 1 -- 172.21.15.50:0/33249949 <== mon.0 v2:172.21.15.50:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a48005020 con 0x5648f1d20b10 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 10 client.6375 fetch_fsmap finished waiting for FSMap version 23 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 10 client.6375 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 20 client.6375 populate_metadata read hostname 'smithi050' 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d36030 0x5648f1d65f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 4 client.6375 mds_command: new command op to 6222 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 --> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5648f19756c0 con 0x5648f1d36030 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.673+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d36030 0x5648f1d65f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a357fa640 10 client.6375 ms_handle_connect on v2:172.21.15.50:6833/4199554410 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a55ce7640 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d36030 0x5648f1d65f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd7569d6f91d0063 server_cookie=fca3e2cde472ced4 in_seq=0 out_seq=0 2023-12-08T08:20:31.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a357fa640 1 -- 172.21.15.50:0/33249949 <== mds.0 v2:172.21.15.50:6833/4199554410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5648f19756c0 con 0x5648f1d36030 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a357fa640 10 client.6375 handle_command_reply: tid=0 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 client.6375 shutdown 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 msgr2=0x5648f1d55640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d55640 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2a48005620 tx=0x7f2a480037d0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 shutdown_connections 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:6833/4199554410,v1:172.21.15.50:6835/4199554410] conn(0x5648f1d36030 0x5648f1d65f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648f1d35c50 0x5648f1d53540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5648f1d229a0 0x5648f1d53000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 --2- 172.21.15.50:0/33249949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648f1d20b10 0x5648f1d55640 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a357fa640 0 client.6375 ms_handle_reset on v2:172.21.15.50:6833/4199554410 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 >> 172.21.15.50:0/33249949 conn(0x5648f1d09130 msgr2=0x5648f1d04550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 shutdown_connections 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 1 -- 172.21.15.50:0/33249949 wait complete. 2023-12-08T08:20:31.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.674+0000 7f2a5b3c0740 20 client.6375 trim_cache size 0 max 16384 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "e65cfade-ffb6-4f9a-b644-0a4f3f758761", 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6222, 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs", 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 4.677379019, 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 23, 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 56, 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 56, 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 10.679690126000001 2023-12-08T08:20:31.684 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:20:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a3c06ae40 msgr2=0x7f2a3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a3c06ae40 0x7f2a3c06d300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2a48003cc0 tx=0x7f2a480079b0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500cf900 msgr2=0x7f2a500b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500cf900 0x7f2a500b3bf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c820 tx=0x7f2a4400cc20 comp rx=0 tx=0).stop 2023-12-08T08:20:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 shutdown_connections 2023-12-08T08:20:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2a3c06ae40 0x7f2a3c06d300 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a500cf900 0x7f2a500b3bf0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a5015f310 0x7f2a500c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 --2- 172.21.15.50:0/3172633953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a500cd240 0x7f2a5006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 >> 172.21.15.50:0/3172633953 conn(0x7f2a50099a10 msgr2=0x7f2a50099df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 shutdown_connections 2023-12-08T08:20:31.686 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.675+0000 7f2a5874c640 1 -- 172.21.15.50:0/3172633953 wait complete. 2023-12-08T08:20:31.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:20:31.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.792+0000 7fc3eff41640 1 Processor -- start 2023-12-08T08:20:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.792+0000 7fc3eff41640 1 -- start start 2023-12-08T08:20:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3eff41640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc3e815b1f0 0x7fc3e80ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3eff41640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3e80c6140 0x7fc3e80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3eff41640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e815b5d0 con 0x7fc3e80ceef0 2023-12-08T08:20:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3eff41640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80c4d10 con 0x7fc3e80c6140 2023-12-08T08:20:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3eff41640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80cf850 con 0x7fc3e815b1f0 2023-12-08T08:20:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3ee4de640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc3e80c6140 0x7fc3e80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3ed4dc640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc3e80ceef0 0x7fc3e80cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52978/0 (socket says 172.21.15.50:52978) 2023-12-08T08:20:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3ed4dc640 1 -- 172.21.15.50:0/1244864125 learned_addr learned my addr 172.21.15.50:0/1244864125 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.793+0000 7fc3edcdd640 1 --2- 172.21.15.50:0/1244864125 >> v2:172.21.15.170:3300/0 conn(0x7fc3e815b1f0 0x7fc3e80ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.794+0000 7fc3ee4de640 1 -- 172.21.15.50:0/1244864125 >> v2:172.21.15.170:3300/0 conn(0x7fc3e815b1f0 msgr2=0x7fc3e80ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.794+0000 7fc3ee4de640 1 --2- 172.21.15.50:0/1244864125 >> v2:172.21.15.170:3300/0 conn(0x7fc3e815b1f0 0x7fc3e80ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.794+0000 7fc3ee4de640 1 -- 172.21.15.50:0/1244864125 >> v1:172.21.15.50:6789/0 conn(0x7fc3e80ceef0 legacy=0x7fc3e80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.794+0000 7fc3ee4de640 1 -- 172.21.15.50:0/1244864125 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80cc710 con 0x7fc3e80c6140 2023-12-08T08:20:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.794+0000 7fc3eccdb640 1 -- 172.21.15.50:0/1244864125 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138062570 0 0) 0x7fc3e815b5d0 con 0x7fc3e80ceef0 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.794+0000 7fc3ee4de640 1 --2- 172.21.15.50:0/1244864125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80c6140 0x7fc3e80cf310 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80ce8e0 tx=0x7fc3e402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e3697574b4438d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.794+0000 7fc3eccdb640 1 -- 172.21.15.50:0/1244864125 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e402cb60 con 0x7fc3e80c6140 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eccdb640 1 -- 172.21.15.50:0/1244864125 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e402ccc0 con 0x7fc3e80c6140 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eccdb640 1 -- 172.21.15.50:0/1244864125 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4034660 con 0x7fc3e80c6140 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 -- 172.21.15.50:0/1244864125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80c6140 msgr2=0x7fc3e80cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 --2- 172.21.15.50:0/1244864125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80c6140 0x7fc3e80cf310 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80ce8e0 tx=0x7fc3e402bdb0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 -- 172.21.15.50:0/1244864125 shutdown_connections 2023-12-08T08:20:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 --2- 172.21.15.50:0/1244864125 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80c6140 0x7fc3e80cf310 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 --2- 172.21.15.50:0/1244864125 >> v2:172.21.15.170:3300/0 conn(0x7fc3e815b1f0 0x7fc3e80ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 -- 172.21.15.50:0/1244864125 >> 172.21.15.50:0/1244864125 conn(0x7fc3e80d0de0 msgr2=0x7fc3e80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 -- 172.21.15.50:0/1244864125 shutdown_connections 2023-12-08T08:20:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.795+0000 7fc3eff41640 1 -- 172.21.15.50:0/1244864125 wait complete. 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.796+0000 7fc3eff41640 1 Processor -- start 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.796+0000 7fc3eff41640 1 -- start start 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3eff41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e80c6140 0x7fc3e8159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3eff41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80ceef0 0x7fc3e806c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3eff41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3e815b1f0 0x7fc3e80b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3eff41640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8159f60 con 0x7fc3e80ceef0 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3eff41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81f3320 con 0x7fc3e80c6140 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3eff41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81f3600 con 0x7fc3e815b1f0 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ed4dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80ceef0 0x7fc3e806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ed4dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80ceef0 0x7fc3e806c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57256/0 (socket says 172.21.15.50:57256) 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ed4dc640 1 -- 172.21.15.50:0/3754773105 learned_addr learned my addr 172.21.15.50:0/3754773105 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3edcdd640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e80c6140 0x7fc3e8159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ee4de640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3e815b1f0 0x7fc3e80b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ed4dc640 1 -- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3e815b1f0 msgr2=0x7fc3e80b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ed4dc640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3e815b1f0 0x7fc3e80b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ed4dc640 1 -- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e80c6140 msgr2=0x7fc3e8159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.797+0000 7fc3ed4dc640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e80c6140 0x7fc3e8159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3ed4dc640 1 -- 172.21.15.50:0/3754773105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4009a70 con 0x7fc3e80ceef0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3edcdd640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e80c6140 0x7fc3e8159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3ed4dc640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80ceef0 0x7fc3e806c270 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c430 tx=0x7fc3d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3de7fc640 1 -- 172.21.15.50:0/3754773105 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d80074e0 con 0x7fc3e80ceef0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3de7fc640 1 -- 172.21.15.50:0/3754773105 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d8007660 con 0x7fc3e80ceef0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e81f38e0 con 0x7fc3e80ceef0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3de7fc640 1 -- 172.21.15.50:0/3754773105 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8004a20 con 0x7fc3e80ceef0 2023-12-08T08:20:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.798+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e81f3ea0 con 0x7fc3e80ceef0 2023-12-08T08:20:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.799+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8067430 con 0x7fc3e80ceef0 2023-12-08T08:20:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.799+0000 7fc3de7fc640 1 -- 172.21.15.50:0/3754773105 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc3d8004b80 con 0x7fc3e80ceef0 2023-12-08T08:20:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.800+0000 7fc3de7fc640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc3cc06ae40 0x7fc3cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.800+0000 7fc3de7fc640 1 -- 172.21.15.50:0/3754773105 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3d80894d0 con 0x7fc3e80ceef0 2023-12-08T08:20:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.800+0000 7fc3edcdd640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc3cc06ae40 0x7fc3cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.801+0000 7fc3edcdd640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc3cc06ae40 0x7fc3cc06d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0006fd0 tx=0x7fc3e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:31.804+0000 7fc3de7fc640 1 -- 172.21.15.50:0/3754773105 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3d80544d0 con 0x7fc3e80ceef0 2023-12-08T08:20:31.987 INFO:tasks.ceph.mds.c.smithi050.stderr:2023-12-08T08:20:31.984+0000 7f6543d3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:20:32.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.021+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc3e815b7c0 con 0x7fc3e80ceef0 2023-12-08T08:20:32.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.021+0000 7fc3de7fc640 1 -- 172.21.15.50:0/3754773105 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc3d8057af0 con 0x7fc3e80ceef0 2023-12-08T08:20:32.025 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:20:32.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc3cc06ae40 msgr2=0x7fc3cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc3cc06ae40 0x7fc3cc06d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0006fd0 tx=0x7fc3e0008040 comp rx=0 tx=0).stop 2023-12-08T08:20:32.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80ceef0 msgr2=0x7fc3e806c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:32.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80ceef0 0x7fc3e806c270 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c430 tx=0x7fc3d800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.027 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 shutdown_connections 2023-12-08T08:20:32.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc3cc06ae40 0x7fc3cc06d300 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc3e80ceef0 0x7fc3e806c270 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc3e815b1f0 0x7fc3e80b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 --2- 172.21.15.50:0/3754773105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3e80c6140 0x7fc3e8159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:32.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 >> 172.21.15.50:0/3754773105 conn(0x7fc3e80d0de0 msgr2=0x7fc3e806fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:32.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 shutdown_connections 2023-12-08T08:20:32.028 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32.024+0000 7fc3eff41640 1 -- 172.21.15.50:0/3754773105 wait complete. 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:20:32.038 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:32.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.039 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:20:32.055 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42342sec preferred_lft 42342sec 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c008:83ff:fe50:e6c0/64 scope link 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:20:32.056 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:32.057 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::403f:3fff:fee6:f2fc/64 scope link 2023-12-08T08:20:32.057 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:32.057 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:20:32.057 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:32.057 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::2880:6dff:fe2e:b579/64 scope link 2023-12-08T08:20:32.057 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:32.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.057 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:20:32.125 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:20:32.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.127 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:20:32.183 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:20:32.183 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:20:32.183 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:20:32.183 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:20:32.183 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:20:32.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.184 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:20:32.184 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:20:32.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:20:32.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:20:32.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:20:32.184 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:20:32.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.289 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:20:32.304 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-08T08:20:32.305 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:20:32.305 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:32.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:20:32.376 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-08T08:20:32.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:32.376 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:32.431 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:32.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:32.432 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:32.487 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:20:32.558 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:20:32.614 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:20:32.614 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:20:32.614 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:20:32.614 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:20:32.614 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:20:32.614 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:20:32.614 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:20:32.615 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:32.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.617 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:20:32.669 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:20:32.669 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T08:20:32.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:20:32.742 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:20:32.798 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:20:32.798 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:20:32.798 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:20:32.798 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:20:32.798 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:20:32.798 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:20:32.799 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:32.800 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:32.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.801 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:20:32.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-12-08T08:20:32.802+0000 7f5e4de37480 -1 init, newargv = 0x559b20490780 newargc=15 2023-12-08T08:20:32.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[110999]: starting ceph client 2023-12-08T08:20:32.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[110999]: starting fuse 2023-12-08T08:20:32.820 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:20:32.820 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:20:32.821 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:32.822 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-12-08T08:20:32.823 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:20:32.946 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.110999.asok 2023-12-08T08:20:32.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:20:32.956 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110999.asok 2023-12-08T08:20:32.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:32.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110999.asok status 2023-12-08T08:20:33.099 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "110999", 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6390, 2023-12-08T08:20:33.100 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 6390 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4010749397 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 4010749397 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:33.101 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.6390 192.168.0.1:0/4010749397", 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/4010749397", 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 23, 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 56, 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:20:33.102 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:20:33.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:33.108 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:20:33.108 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:33.123 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:20:33.124 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:33.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:33.124 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:33.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:33.197 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-12-08T08:20:33.258 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2023-12-08T08:20:33.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.408+0000 7f24eea2b640 1 Processor -- start 2023-12-08T08:20:33.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.408+0000 7f24eea2b640 1 -- start start 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24eea2b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f24e815e930 0x7f24e80cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24eea2b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24e80ccd60 0x7f24e80cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24eea2b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e80d1900 con 0x7f24e80b2380 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24eea2b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e80cebc0 con 0x7f24e80ccd60 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24eea2b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e80d1be0 con 0x7f24e815e930 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24ecfc8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24e80ccd60 0x7f24e80cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24ecfc8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f24e80ccd60 0x7f24e80cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57266/0 (socket says 172.21.15.50:57266) 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24e77fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f24e80b2380 0x7f24e80b0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52984/0 (socket says 172.21.15.50:52984) 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24ecfc8640 1 -- 172.21.15.50:0/409820057 learned_addr learned my addr 172.21.15.50:0/409820057 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24e7fff640 1 --2- 172.21.15.50:0/409820057 >> v2:172.21.15.170:3300/0 conn(0x7f24e815e930 0x7f24e80cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24ecfc8640 1 -- 172.21.15.50:0/409820057 >> v2:172.21.15.170:3300/0 conn(0x7f24e815e930 msgr2=0x7f24e80cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24ecfc8640 1 --2- 172.21.15.50:0/409820057 >> v2:172.21.15.170:3300/0 conn(0x7f24e815e930 0x7f24e80cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24ecfc8640 1 -- 172.21.15.50:0/409820057 >> v1:172.21.15.50:6789/0 conn(0x7f24e80b2380 legacy=0x7f24e80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24ecfc8640 1 -- 172.21.15.50:0/409820057 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e815ed10 con 0x7f24e80ccd60 2023-12-08T08:20:33.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.409+0000 7f24e6ffd640 1 -- 172.21.15.50:0/409820057 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197148630 0 0) 0x7f24e80d1900 con 0x7f24e80b2380 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.410+0000 7f24ecfc8640 1 --2- 172.21.15.50:0/409820057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e80cdd30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f24e80ce8e0 tx=0x7f24e002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3d24e39d907746 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.410+0000 7f24e6ffd640 1 -- 172.21.15.50:0/409820057 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e002cbb0 con 0x7f24e80ccd60 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.410+0000 7f24e6ffd640 1 -- 172.21.15.50:0/409820057 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e002cd10 con 0x7f24e80ccd60 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.410+0000 7f24e6ffd640 1 -- 172.21.15.50:0/409820057 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0034610 con 0x7f24e80ccd60 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 -- 172.21.15.50:0/409820057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 msgr2=0x7f24e80cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 --2- 172.21.15.50:0/409820057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e80cdd30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f24e80ce8e0 tx=0x7f24e002c010 comp rx=0 tx=0).stop 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 -- 172.21.15.50:0/409820057 shutdown_connections 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 --2- 172.21.15.50:0/409820057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e80cdd30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 --2- 172.21.15.50:0/409820057 >> v2:172.21.15.170:3300/0 conn(0x7f24e815e930 0x7f24e80cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 -- 172.21.15.50:0/409820057 >> 172.21.15.50:0/409820057 conn(0x7f24e80d0de0 msgr2=0x7f24e80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 -- 172.21.15.50:0/409820057 shutdown_connections 2023-12-08T08:20:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.411+0000 7f24eea2b640 1 -- 172.21.15.50:0/409820057 wait complete. 2023-12-08T08:20:33.416 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.412+0000 7f24eea2b640 1 Processor -- start 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.412+0000 7f24eea2b640 1 -- start start 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24eea2b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24e80b2380 0x7f24e81520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24eea2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e8150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24eea2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24e815e930 0x7f24e80c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24eea2b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8154cf0 con 0x7f24e80ccd60 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24eea2b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8154fd0 con 0x7f24e815e930 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24eea2b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e80c7f50 con 0x7f24e80b2380 2023-12-08T08:20:33.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e8150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e8150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57272/0 (socket says 172.21.15.50:57272) 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 -- 172.21.15.50:0/3651283208 learned_addr learned my addr 172.21.15.50:0/3651283208 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24ecfc8640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24e815e930 0x7f24e80c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e7fff640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24e80b2380 0x7f24e81520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 -- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24e80b2380 msgr2=0x7f24e81520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24e80b2380 0x7f24e81520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 -- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24e815e930 msgr2=0x7f24e80c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24e815e930 0x7f24e80c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.413+0000 7f24e77fe640 1 -- 172.21.15.50:0/3651283208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e0009b30 con 0x7f24e80ccd60 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.414+0000 7f24e77fe640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e8150a70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f24d800c4b0 tx=0x7f24d800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.414+0000 7f24e4ff9640 1 -- 172.21.15.50:0/3651283208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d80074e0 con 0x7f24e80ccd60 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.414+0000 7f24e4ff9640 1 -- 172.21.15.50:0/3651283208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8007660 con 0x7f24e80ccd60 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.414+0000 7f24e4ff9640 1 -- 172.21.15.50:0/3651283208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8004a20 con 0x7f24e80ccd60 2023-12-08T08:20:33.419 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.414+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e80c8230 con 0x7f24e80ccd60 2023-12-08T08:20:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.414+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e81512c0 con 0x7f24e80ccd60 2023-12-08T08:20:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.415+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e80c8750 con 0x7f24e80ccd60 2023-12-08T08:20:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.415+0000 7f24e4ff9640 1 -- 172.21.15.50:0/3651283208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f24d8004b80 con 0x7f24e80ccd60 2023-12-08T08:20:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.416+0000 7f24e4ff9640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24d406ae40 0x7f24d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.416+0000 7f24e4ff9640 1 -- 172.21.15.50:0/3651283208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f24d8088890 con 0x7f24e80ccd60 2023-12-08T08:20:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.416+0000 7f24e7fff640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24d406ae40 0x7f24d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.417+0000 7f24e7fff640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24d406ae40 0x7f24d406d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f24dc006fd0 tx=0x7f24dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.420+0000 7f24e4ff9640 1 -- 172.21.15.50:0/3651283208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24e80c8750 con 0x7f24e80ccd60 2023-12-08T08:20:33.672 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.669+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f24e80c8750 con 0x7f24e80ccd60 2023-12-08T08:20:33.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.671+0000 7f24e4ff9640 1 -- 172.21.15.50:0/3651283208 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 183+0+140 (secure 0 0 0) 0x7f24e80c8750 con 0x7f24e80ccd60 2023-12-08T08:20:33.674 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:20:33.674 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:20:33.674 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-12-08T08:20:33.675 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:20:33.675 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow r pool=cephfs_data" 2023-12-08T08:20:33.675 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24d406ae40 msgr2=0x7f24d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24d406ae40 0x7f24d406d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f24dc006fd0 tx=0x7f24dc008040 comp rx=0 tx=0).stop 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 msgr2=0x7f24e8150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e8150a70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f24d800c4b0 tx=0x7f24d800c970 comp rx=0 tx=0).stop 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 shutdown_connections 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f24d406ae40 0x7f24d406d300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f24e80ccd60 0x7f24e8150a70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f24e815e930 0x7f24e80c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 --2- 172.21.15.50:0/3651283208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f24e80b2380 0x7f24e81520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 >> 172.21.15.50:0/3651283208 conn(0x7f24e80d0de0 msgr2=0x7f24e80cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 shutdown_connections 2023-12-08T08:20:33.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.673+0000 7f24eea2b640 1 -- 172.21.15.50:0/3651283208 wait complete. 2023-12-08T08:20:33.687 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:33.687 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:33.704 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.847+0000 7fd4bd41e640 1 Processor -- start 2023-12-08T08:20:33.850 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.847+0000 7fd4bd41e640 1 -- start start 2023-12-08T08:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4bd41e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b815d580 0x7fd4b80d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4bd41e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4b80d3ad0 0x7fd4b815f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4bd41e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd4b815f6c0 0x7fd4b815fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4bd41e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b815ee90 con 0x7fd4b80d3ad0 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4bd41e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80d0fe0 con 0x7fd4b815f6c0 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4bd41e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80d1280 con 0x7fd4b815d580 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4b80d3ad0 0x7fd4b815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd4b80d3ad0 0x7fd4b815f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57284/0 (socket says 172.21.15.50:57284) 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 -- 172.21.15.50:0/3001174355 learned_addr learned my addr 172.21.15.50:0/3001174355 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b77fe640 1 --2- 172.21.15.50:0/3001174355 >> v2:172.21.15.170:3300/0 conn(0x7fd4b815f6c0 0x7fd4b815fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b6ffd640 1 --2- 172.21.15.50:0/3001174355 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b815d580 0x7fd4b80d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 -- 172.21.15.50:0/3001174355 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b815d580 msgr2=0x7fd4b80d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 --2- 172.21.15.50:0/3001174355 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b815d580 0x7fd4b80d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 -- 172.21.15.50:0/3001174355 >> v2:172.21.15.170:3300/0 conn(0x7fd4b815f6c0 msgr2=0x7fd4b815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 --2- 172.21.15.50:0/3001174355 >> v2:172.21.15.170:3300/0 conn(0x7fd4b815f6c0 0x7fd4b815fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.848+0000 7fd4b67fc640 1 -- 172.21.15.50:0/3001174355 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80d1560 con 0x7fd4b80d3ad0 2023-12-08T08:20:33.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.849+0000 7fd4b67fc640 1 --2- 172.21.15.50:0/3001174355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b80d3ad0 0x7fd4b815f180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80b39d0 tx=0x7fd4ac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e561db5f63b037 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.849+0000 7fd4b5ffb640 1 -- 172.21.15.50:0/3001174355 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0317e0 con 0x7fd4b80d3ad0 2023-12-08T08:20:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.849+0000 7fd4b5ffb640 1 -- 172.21.15.50:0/3001174355 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac031940 con 0x7fd4b80d3ad0 2023-12-08T08:20:33.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.849+0000 7fd4b5ffb640 1 -- 172.21.15.50:0/3001174355 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac031cd0 con 0x7fd4b80d3ad0 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 -- 172.21.15.50:0/3001174355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b80d3ad0 msgr2=0x7fd4b815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/3001174355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b80d3ad0 0x7fd4b815f180 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80b39d0 tx=0x7fd4ac02b880 comp rx=0 tx=0).stop 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 -- 172.21.15.50:0/3001174355 shutdown_connections 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/3001174355 >> v2:172.21.15.170:3300/0 conn(0x7fd4b815f6c0 0x7fd4b815fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/3001174355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b80d3ad0 0x7fd4b815f180 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/3001174355 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b815d580 0x7fd4b80d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 -- 172.21.15.50:0/3001174355 >> 172.21.15.50:0/3001174355 conn(0x7fd4b80d2fb0 msgr2=0x7fd4b80d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 -- 172.21.15.50:0/3001174355 shutdown_connections 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.850+0000 7fd4bd41e640 1 -- 172.21.15.50:0/3001174355 wait complete. 2023-12-08T08:20:33.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.851+0000 7fd4bd41e640 1 Processor -- start 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.851+0000 7fd4bd41e640 1 -- start start 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4bd41e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b80d3ad0 0x7fd4b80b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4bd41e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4b815d580 0x7fd4b815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4bd41e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b815f6c0 0x7fd4b80b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4bd41e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81f6680 con 0x7fd4b815f6c0 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4bd41e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81f6940 con 0x7fd4b815d580 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4bd41e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b81f6c20 con 0x7fd4b80d3ad0 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b815f6c0 0x7fd4b80b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b815f6c0 0x7fd4b80b5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57294/0 (socket says 172.21.15.50:57294) 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 -- 172.21.15.50:0/2233521208 learned_addr learned my addr 172.21.15.50:0/2233521208 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b6ffd640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b80d3ad0 0x7fd4b80b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b67fc640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4b815d580 0x7fd4b815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 -- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b80d3ad0 msgr2=0x7fd4b80b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b80d3ad0 0x7fd4b80b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 -- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4b815d580 msgr2=0x7fd4b815a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4b815d580 0x7fd4b815a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 -- 172.21.15.50:0/2233521208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0094d0 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b6ffd640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b80d3ad0 0x7fd4b80b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.852+0000 7fd4b77fe640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b815f6c0 0x7fd4b80b5b90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8007e60 tx=0x7fd4a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.853+0000 7fd49f7fe640 1 -- 172.21.15.50:0/2233521208 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8014420 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.853+0000 7fd49f7fe640 1 -- 172.21.15.50:0/2233521208 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a80145a0 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.853+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b81f6f00 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.853+0000 7fd49f7fe640 1 -- 172.21.15.50:0/2233521208 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8014950 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.853+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b815ab00 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.854+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b80d09d0 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.854+0000 7fd49f7fe640 1 -- 172.21.15.50:0/2233521208 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4a8014ab0 con 0x7fd4b815f6c0 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.854+0000 7fd49f7fe640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd4a406ae40 0x7fd4a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:33.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.855+0000 7fd49f7fe640 1 -- 172.21.15.50:0/2233521208 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd4a808a140 con 0x7fd4b815f6c0 2023-12-08T08:20:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.855+0000 7fd4b6ffd640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd4a406ae40 0x7fd4a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:33.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.855+0000 7fd4b6ffd640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd4a406ae40 0x7fd4a406d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0006fd0 tx=0x7fd4b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:33.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:33.859+0000 7fd49f7fe640 1 -- 172.21.15.50:0/2233521208 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4a8055010 con 0x7fd4b815f6c0 2023-12-08T08:20:34.039 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.036+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4b81f7420 con 0x7fd4b815f6c0 2023-12-08T08:20:34.040 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.037+0000 7fd49f7fe640 1 -- 172.21.15.50:0/2233521208 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fd4b81f7420 con 0x7fd4b815f6c0 2023-12-08T08:20:34.041 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:34.041 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd4a406ae40 msgr2=0x7fd4a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd4a406ae40 0x7fd4a406d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0006fd0 tx=0x7fd4b0008040 comp rx=0 tx=0).stop 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b815f6c0 msgr2=0x7fd4b80b5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b815f6c0 0x7fd4b80b5b90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8007e60 tx=0x7fd4a800e4b0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 shutdown_connections 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd4a406ae40 0x7fd4a406d300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b815f6c0 0x7fd4b80b5b90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4b815d580 0x7fd4b815a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 --2- 172.21.15.50:0/2233521208 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4b80d3ad0 0x7fd4b80b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 >> 172.21.15.50:0/2233521208 conn(0x7fd4b80d2fb0 msgr2=0x7fd4b806b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 shutdown_connections 2023-12-08T08:20:34.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.039+0000 7fd4bd41e640 1 -- 172.21.15.50:0/2233521208 wait complete. 2023-12-08T08:20:34.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:24.505729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:25.407648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:34.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:34.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.160+0000 7f3d1a0bb640 1 Processor -- start 2023-12-08T08:20:34.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.160+0000 7f3d1a0bb640 1 -- start start 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d1a0bb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3d140cfa30 0x7f3d140b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d1a0bb640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d140cfe10 0x7f3d140cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d1a0bb640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140c6be0 con 0x7f3d140b4150 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d1a0bb640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d140d3ff0 con 0x7f3d140cfe10 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d1a0bb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d140b4860 con 0x7f3d140cfa30 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d13fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d140cfe10 0x7f3d140cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d13fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3d140cfe10 0x7f3d140cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57304/0 (socket says 172.21.15.50:57304) 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.161+0000 7f3d13fff640 1 -- 172.21.15.50:0/296627325 learned_addr learned my addr 172.21.15.50:0/296627325 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d13fff640 1 -- 172.21.15.50:0/296627325 >> v2:172.21.15.170:3300/0 conn(0x7f3d140cfa30 msgr2=0x7f3d140b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d13fff640 1 --2- 172.21.15.50:0/296627325 >> v2:172.21.15.170:3300/0 conn(0x7f3d140cfa30 0x7f3d140b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d13fff640 1 -- 172.21.15.50:0/296627325 >> v1:172.21.15.170:6789/0 conn(0x7f3d140b4150 legacy=0x7f3d140b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:34.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d13fff640 1 -- 172.21.15.50:0/296627325 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140d3d50 con 0x7f3d140cfe10 2023-12-08T08:20:34.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d13fff640 1 --2- 172.21.15.50:0/296627325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfe10 0x7f3d140cdf50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3d1408b930 tx=0x7f3d0c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830db78166e06042 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d127fc640 1 -- 172.21.15.50:0/296627325 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c02c9f0 con 0x7f3d140cfe10 2023-12-08T08:20:34.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d127fc640 1 -- 172.21.15.50:0/296627325 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c02cb50 con 0x7f3d140cfe10 2023-12-08T08:20:34.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.162+0000 7f3d127fc640 1 -- 172.21.15.50:0/296627325 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0343f0 con 0x7f3d140cfe10 2023-12-08T08:20:34.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/296627325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfe10 msgr2=0x7f3d140cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/296627325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfe10 0x7f3d140cdf50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3d1408b930 tx=0x7f3d0c02be50 comp rx=0 tx=0).stop 2023-12-08T08:20:34.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/296627325 shutdown_connections 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/296627325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfe10 0x7f3d140cdf50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/296627325 >> v2:172.21.15.170:3300/0 conn(0x7f3d140cfa30 0x7f3d140b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/296627325 >> 172.21.15.50:0/296627325 conn(0x7f3d140d3090 msgr2=0x7f3d140d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/296627325 shutdown_connections 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.163+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/296627325 wait complete. 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.164+0000 7f3d1a0bb640 1 Processor -- start 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.164+0000 7f3d1a0bb640 1 -- start start 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d1a0bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d140b4150 0x7f3d14155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d1a0bb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfa30 0x7f3d140c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d1a0bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d140cfe10 0x7f3d140c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d1a0bb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14155b90 con 0x7f3d140cfa30 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d1a0bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140b7020 con 0x7f3d140cfe10 2023-12-08T08:20:34.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d1a0bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140b7300 con 0x7f3d140b4150 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfa30 0x7f3d140c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfa30 0x7f3d140c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57320/0 (socket says 172.21.15.50:57320) 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 -- 172.21.15.50:0/2477206799 learned_addr learned my addr 172.21.15.50:0/2477206799 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d137fe640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d140b4150 0x7f3d14155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d13fff640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d140cfe10 0x7f3d140c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 -- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d140b4150 msgr2=0x7f3d14155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d140b4150 0x7f3d14155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 -- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d140cfe10 msgr2=0x7f3d140c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d140cfe10 0x7f3d140c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.165+0000 7f3d12ffd640 1 -- 172.21.15.50:0/2477206799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c009b30 con 0x7f3d140cfa30 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.166+0000 7f3d12ffd640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfa30 0x7f3d140c8b30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c410 tx=0x7f3d0800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.166+0000 7f3cfbfff640 1 -- 172.21.15.50:0/2477206799 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080035f0 con 0x7f3d140cfa30 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.166+0000 7f3cfbfff640 1 -- 172.21.15.50:0/2477206799 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d08003750 con 0x7f3d140cfa30 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.166+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d140b75e0 con 0x7f3d140cfa30 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.166+0000 7f3cfbfff640 1 -- 172.21.15.50:0/2477206799 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d08003b00 con 0x7f3d140cfa30 2023-12-08T08:20:34.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.166+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d140b7de0 con 0x7f3d140cfa30 2023-12-08T08:20:34.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.167+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d140b7b00 con 0x7f3d140cfa30 2023-12-08T08:20:34.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.167+0000 7f3cfbfff640 1 -- 172.21.15.50:0/2477206799 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d08003c60 con 0x7f3d140cfa30 2023-12-08T08:20:34.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.168+0000 7f3cfbfff640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3d0006ae40 0x7f3d0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.168+0000 7f3cfbfff640 1 -- 172.21.15.50:0/2477206799 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3d08088de0 con 0x7f3d140cfa30 2023-12-08T08:20:34.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.168+0000 7f3d137fe640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3d0006ae40 0x7f3d0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.169+0000 7f3d137fe640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3d0006ae40 0x7f3d0006d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009890 tx=0x7f3d04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.172+0000 7f3cfbfff640 1 -- 172.21.15.50:0/2477206799 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d140b7b00 con 0x7f3d140cfa30 2023-12-08T08:20:34.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.345+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d140b7b00 con 0x7f3d140cfa30 2023-12-08T08:20:34.348 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.345+0000 7f3cfbfff640 1 -- 172.21.15.50:0/2477206799 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d140b7b00 con 0x7f3d140cfa30 2023-12-08T08:20:34.349 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:34.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3d0006ae40 msgr2=0x7f3d0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3d0006ae40 0x7f3d0006d300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009890 tx=0x7f3d04008040 comp rx=0 tx=0).stop 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfa30 msgr2=0x7f3d140c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfa30 0x7f3d140c8b30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c410 tx=0x7f3d0800c8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 shutdown_connections 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3d0006ae40 0x7f3d0006d300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3d140cfa30 0x7f3d140c8b30 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d140cfe10 0x7f3d140c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 --2- 172.21.15.50:0/2477206799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d140b4150 0x7f3d14155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 >> 172.21.15.50:0/2477206799 conn(0x7f3d140d3090 msgr2=0x7f3d140d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 shutdown_connections 2023-12-08T08:20:34.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.347+0000 7f3d1a0bb640 1 -- 172.21.15.50:0/2477206799 wait complete. 2023-12-08T08:20:34.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:34.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.466+0000 7f3a1a6b4640 1 Processor -- start 2023-12-08T08:20:34.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.467+0000 7f3a1a6b4640 1 -- start start 2023-12-08T08:20:34.477 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.467+0000 7f3a1a6b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140b4150 0x7f3a140b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.467+0000 7f3a1a6b4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a140cfe10 0x7f3a140cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.467+0000 7f3a1a6b4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a140c6be0 con 0x7f3a140cfa30 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.467+0000 7f3a1a6b4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a140d3ff0 con 0x7f3a140cfe10 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.467+0000 7f3a1a6b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140b4860 con 0x7f3a140b4150 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a13fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3a140cfa30 0x7f3a140b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:52994/0 (socket says 172.21.15.50:52994) 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a18c51640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a140cfe10 0x7f3a140cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a13fff640 1 -- 172.21.15.50:0/258743785 learned_addr learned my addr 172.21.15.50:0/258743785 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a137fe640 1 --2- 172.21.15.50:0/258743785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140b4150 0x7f3a140b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a18c51640 1 -- 172.21.15.50:0/258743785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140b4150 msgr2=0x7f3a140b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:34.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a18c51640 1 --2- 172.21.15.50:0/258743785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140b4150 0x7f3a140b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a18c51640 1 -- 172.21.15.50:0/258743785 >> v1:172.21.15.50:6789/0 conn(0x7f3a140cfa30 legacy=0x7f3a140b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a18c51640 1 -- 172.21.15.50:0/258743785 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140d3d50 con 0x7f3a140cfe10 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.468+0000 7f3a12ffd640 1 -- 172.21.15.50:0/258743785 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648838226 0 0) 0x7f3a140c6be0 con 0x7f3a140cfa30 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a18c51640 1 --2- 172.21.15.50:0/258743785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfe10 0x7f3a140cdf50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009d90 tx=0x7f3a0c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ea27dd88172cd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a12ffd640 1 -- 172.21.15.50:0/258743785 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c02cbc0 con 0x7f3a140cfe10 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a12ffd640 1 -- 172.21.15.50:0/258743785 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c02cd20 con 0x7f3a140cfe10 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a12ffd640 1 -- 172.21.15.50:0/258743785 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c034660 con 0x7f3a140cfe10 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/258743785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfe10 msgr2=0x7f3a140cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/258743785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfe10 0x7f3a140cdf50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009d90 tx=0x7f3a0c02be10 comp rx=0 tx=0).stop 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/258743785 shutdown_connections 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/258743785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfe10 0x7f3a140cdf50 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/258743785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140b4150 0x7f3a140b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/258743785 >> 172.21.15.50:0/258743785 conn(0x7f3a140d3090 msgr2=0x7f3a140d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/258743785 shutdown_connections 2023-12-08T08:20:34.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.469+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/258743785 wait complete. 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.470+0000 7f3a1a6b4640 1 Processor -- start 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.471+0000 7f3a1a6b4640 1 -- start start 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.471+0000 7f3a1a6b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a140b4150 0x7f3a140cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.471+0000 7f3a1a6b4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfa30 0x7f3a14154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.471+0000 7f3a1a6b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140cfe10 0x7f3a140b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.471+0000 7f3a1a6b4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a141f2c50 con 0x7f3a140cfa30 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.471+0000 7f3a1a6b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140cbab0 con 0x7f3a140b4150 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.471+0000 7f3a1a6b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a140ca4d0 con 0x7f3a140cfe10 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfa30 0x7f3a14154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfa30 0x7f3a14154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57330/0 (socket says 172.21.15.50:57330) 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 -- 172.21.15.50:0/971549295 learned_addr learned my addr 172.21.15.50:0/971549295 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a13fff640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a140b4150 0x7f3a140cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a18c51640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140cfe10 0x7f3a140b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 -- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140cfe10 msgr2=0x7f3a140b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140cfe10 0x7f3a140b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 -- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a140b4150 msgr2=0x7f3a140cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a140b4150 0x7f3a140cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 -- 172.21.15.50:0/971549295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c009a70 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a137fe640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfa30 0x7f3a14154ed0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800d5f0 tx=0x7f3a0800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a10ff9640 1 -- 172.21.15.50:0/971549295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080125f0 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a10ff9640 1 -- 172.21.15.50:0/971549295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08012750 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a140ca7b0 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a10ff9640 1 -- 172.21.15.50:0/971549295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08012b00 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.472+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a140cad70 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.473+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a14067430 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.474+0000 7f3a10ff9640 1 -- 172.21.15.50:0/971549295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a08012c60 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.474+0000 7f3a10ff9640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a0006ae40 0x7f3a0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.474+0000 7f3a10ff9640 1 -- 172.21.15.50:0/971549295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3a08089ce0 con 0x7f3a140cfa30 2023-12-08T08:20:34.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.474+0000 7f3a13fff640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a0006ae40 0x7f3a0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.475+0000 7f3a13fff640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a0006ae40 0x7f3a0006d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000f60 tx=0x7f3a04007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.479+0000 7f3a10ff9640 1 -- 172.21.15.50:0/971549295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a08054bb0 con 0x7f3a140cfa30 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.653+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a140743e0 con 0x7f3a140cfa30 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.654+0000 7f3a10ff9640 1 -- 172.21.15.50:0/971549295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a080581d0 con 0x7f3a140cfa30 2023-12-08T08:20:34.657 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:34.659 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a0006ae40 msgr2=0x7f3a0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a0006ae40 0x7f3a0006d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000f60 tx=0x7f3a04007b50 comp rx=0 tx=0).stop 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfa30 msgr2=0x7f3a14154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfa30 0x7f3a14154ed0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800d5f0 tx=0x7f3a0800dab0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 shutdown_connections 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f3a0006ae40 0x7f3a0006d300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a140cfa30 0x7f3a14154ed0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a140cfe10 0x7f3a140b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 --2- 172.21.15.50:0/971549295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a140b4150 0x7f3a140cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 >> 172.21.15.50:0/971549295 conn(0x7f3a140d3090 msgr2=0x7f3a140cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.660 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 shutdown_connections 2023-12-08T08:20:34.661 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.656+0000 7f3a1a6b4640 1 -- 172.21.15.50:0/971549295 wait complete. 2023-12-08T08:20:34.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:34.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.777+0000 7f000bcd3640 1 Processor -- start 2023-12-08T08:20:34.780 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.777+0000 7f000bcd3640 1 -- start start 2023-12-08T08:20:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.778+0000 7f000bcd3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040b4150 0x7f00040b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.778+0000 7f000bcd3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040c6be0 con 0x7f00040cfe10 2023-12-08T08:20:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.778+0000 7f000bcd3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040d3ff0 con 0x7f00040cfa30 2023-12-08T08:20:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.778+0000 7f000bcd3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040b4860 con 0x7f00040b4150 2023-12-08T08:20:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.778+0000 7f000a270640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f00040cfe10 0x7f00040cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53002/0 (socket says 172.21.15.50:53002) 2023-12-08T08:20:34.783 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.778+0000 7f000a270640 1 -- 172.21.15.50:0/707478600 learned_addr learned my addr 172.21.15.50:0/707478600 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f000926e640 1 --2- 172.21.15.50:0/707478600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040b4150 0x7f00040b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046480626 0 0) 0x7f00040c6be0 con 0x7f00040cfe10 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec003520 con 0x7f00040cfe10 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572969448 0 0) 0x7f00040d3ff0 con 0x7f00040cfa30 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00040c6be0 con 0x7f00040cfa30 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282460130 0 0) 0x7effec003520 con 0x7f00040cfe10 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f000926e640 1 -- 172.21.15.50:0/707478600 >> v1:172.21.15.170:6789/0 conn(0x7f00040cfa30 legacy=0x7f00040b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f000926e640 1 -- 172.21.15.50:0/707478600 >> v1:172.21.15.50:6789/0 conn(0x7f00040cfe10 legacy=0x7f00040cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.779+0000 7f000926e640 1 -- 172.21.15.50:0/707478600 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040d3d50 con 0x7f00040b4150 2023-12-08T08:20:34.784 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f000926e640 1 --2- 172.21.15.50:0/707478600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040b4150 0x7f00040b3630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efff80097d0 tx=0x7efff802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae892f7e26f7f4a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4001670 con 0x7f00040b4150 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff802e050 con 0x7f00040b4150 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f0008a6d640 1 -- 172.21.15.50:0/707478600 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8030730 con 0x7f00040b4150 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f000bcd3640 1 -- 172.21.15.50:0/707478600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040b4150 msgr2=0x7f00040b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f000bcd3640 1 --2- 172.21.15.50:0/707478600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040b4150 0x7f00040b3630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efff80097d0 tx=0x7efff802b770 comp rx=0 tx=0).stop 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f000bcd3640 1 -- 172.21.15.50:0/707478600 shutdown_connections 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f000bcd3640 1 --2- 172.21.15.50:0/707478600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040b4150 0x7f00040b3630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.780+0000 7f000bcd3640 1 -- 172.21.15.50:0/707478600 >> 172.21.15.50:0/707478600 conn(0x7f00040d3090 msgr2=0x7f00040d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.781+0000 7f000bcd3640 1 -- 172.21.15.50:0/707478600 shutdown_connections 2023-12-08T08:20:34.785 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.781+0000 7f000bcd3640 1 -- 172.21.15.50:0/707478600 wait complete. 2023-12-08T08:20:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 Processor -- start 2023-12-08T08:20:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 -- start start 2023-12-08T08:20:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00040b4150 0x7f00040b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040cfa30 0x7f00041f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00040cfe10 0x7f00040caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00041f40e0 con 0x7f00040b4150 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040cb4c0 con 0x7f00040cfe10 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.782+0000 7f000bcd3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040ca200 con 0x7f00040cfa30 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00040b4150 0x7f00040b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00040b4150 0x7f00040b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57334/0 (socket says 172.21.15.50:57334) 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 -- 172.21.15.50:0/4124492584 learned_addr learned my addr 172.21.15.50:0/4124492584 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 -- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040cfa30 msgr2=0x7f00041f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040cfa30 0x7f00041f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 -- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00040cfe10 msgr2=0x7f00040caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00040cfe10 0x7f00040caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 -- 172.21.15.50:0/4124492584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8009400 con 0x7f00040b4150 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f0009a6f640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00040b4150 0x7f00040b85c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c800 tx=0x7efffc00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f00027fc640 1 -- 172.21.15.50:0/4124492584 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc003b70 con 0x7f00040b4150 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040ca4a0 con 0x7f00040b4150 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f00027fc640 1 -- 172.21.15.50:0/4124492584 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc003cd0 con 0x7f00040b4150 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f00027fc640 1 -- 172.21.15.50:0/4124492584 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00aa90 con 0x7f00040b4150 2023-12-08T08:20:34.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.783+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040caa60 con 0x7f00040b4150 2023-12-08T08:20:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.784+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0004067430 con 0x7f00040b4150 2023-12-08T08:20:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.785+0000 7f00027fc640 1 -- 172.21.15.50:0/4124492584 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efffc00abf0 con 0x7f00040b4150 2023-12-08T08:20:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.785+0000 7f00027fc640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efff006ae40 0x7efff006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.785+0000 7f00027fc640 1 -- 172.21.15.50:0/4124492584 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efffc0896b0 con 0x7f00040b4150 2023-12-08T08:20:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.785+0000 7f000926e640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efff006ae40 0x7efff006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:34.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.786+0000 7f000926e640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efff006ae40 0x7efff006d300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efff8034000 tx=0x7efff802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:34.791 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.789+0000 7f00027fc640 1 -- 172.21.15.50:0/4124492584 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efffc0545a0 con 0x7f00040b4150 2023-12-08T08:20:34.970 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.968+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00040743e0 con 0x7f00040b4150 2023-12-08T08:20:34.971 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.968+0000 7f00027fc640 1 -- 172.21.15.50:0/4124492584 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7efffc057bc0 con 0x7f00040b4150 2023-12-08T08:20:34.971 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efff006ae40 msgr2=0x7efff006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efff006ae40 0x7efff006d300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efff8034000 tx=0x7efff802f000 comp rx=0 tx=0).stop 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00040b4150 msgr2=0x7f00040b85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00040b4150 0x7f00040b85c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c800 tx=0x7efffc00ccc0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 shutdown_connections 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7efff006ae40 0x7efff006d300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00040cfe10 0x7f00040caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00040cfa30 0x7f00041f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 --2- 172.21.15.50:0/4124492584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00040b4150 0x7f00040b85c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 >> 172.21.15.50:0/4124492584 conn(0x7f00040d3090 msgr2=0x7f00040cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 shutdown_connections 2023-12-08T08:20:34.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:34.970+0000 7f000bcd3640 1 -- 172.21.15.50:0/4124492584 wait complete. 2023-12-08T08:20:34.983 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:35.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.089+0000 7ff36f50f640 1 Processor -- start 2023-12-08T08:20:35.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.089+0000 7ff36f50f640 1 -- start start 2023-12-08T08:20:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36f50f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff36815d580 0x7ff3680d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36f50f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff3680d3ad0 0x7ff36815f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36f50f640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36815ee90 con 0x7ff36815f6c0 2023-12-08T08:20:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36f50f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680d0fe0 con 0x7ff36815d580 2023-12-08T08:20:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36f50f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680d1280 con 0x7ff3680d3ad0 2023-12-08T08:20:35.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36d2ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff36815d580 0x7ff3680d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36d2ab640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff36815d580 0x7ff3680d1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57336/0 (socket says 172.21.15.50:57336) 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.090+0000 7ff36d2ab640 1 -- 172.21.15.50:0/451914446 learned_addr learned my addr 172.21.15.50:0/451914446 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.091+0000 7ff36caaa640 1 --2- 172.21.15.50:0/451914446 >> v2:172.21.15.170:3300/0 conn(0x7ff3680d3ad0 0x7ff36815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.091+0000 7ff36d2ab640 1 -- 172.21.15.50:0/451914446 >> v2:172.21.15.170:3300/0 conn(0x7ff3680d3ad0 msgr2=0x7ff36815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.091+0000 7ff36d2ab640 1 --2- 172.21.15.50:0/451914446 >> v2:172.21.15.170:3300/0 conn(0x7ff3680d3ad0 0x7ff36815f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.091+0000 7ff36d2ab640 1 -- 172.21.15.50:0/451914446 >> v1:172.21.15.50:6789/0 conn(0x7ff36815f6c0 legacy=0x7ff3680b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.091+0000 7ff35ffff640 1 -- 172.21.15.50:0/451914446 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668596574 0 0) 0x7ff36815ee90 con 0x7ff36815f6c0 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.091+0000 7ff36d2ab640 1 -- 172.21.15.50:0/451914446 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3680d1560 con 0x7ff36815d580 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.091+0000 7ff36d2ab640 1 --2- 172.21.15.50:0/451914446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36815d580 0x7ff3680d1d60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff364009870 tx=0x7ff36402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13c34c80a6c5ccd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff35ffff640 1 -- 172.21.15.50:0/451914446 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364031870 con 0x7ff36815d580 2023-12-08T08:20:35.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff35ffff640 1 -- 172.21.15.50:0/451914446 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3640319d0 con 0x7ff36815d580 2023-12-08T08:20:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff35ffff640 1 -- 172.21.15.50:0/451914446 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364031d60 con 0x7ff36815d580 2023-12-08T08:20:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 -- 172.21.15.50:0/451914446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36815d580 msgr2=0x7ff3680d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 --2- 172.21.15.50:0/451914446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36815d580 0x7ff3680d1d60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff364009870 tx=0x7ff36402b910 comp rx=0 tx=0).stop 2023-12-08T08:20:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 -- 172.21.15.50:0/451914446 shutdown_connections 2023-12-08T08:20:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 --2- 172.21.15.50:0/451914446 >> v2:172.21.15.170:3300/0 conn(0x7ff3680d3ad0 0x7ff36815f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 --2- 172.21.15.50:0/451914446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff36815d580 0x7ff3680d1d60 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 -- 172.21.15.50:0/451914446 >> 172.21.15.50:0/451914446 conn(0x7ff3680d2fb0 msgr2=0x7ff3680d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 -- 172.21.15.50:0/451914446 shutdown_connections 2023-12-08T08:20:35.098 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.092+0000 7ff36f50f640 1 -- 172.21.15.50:0/451914446 wait complete. 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.093+0000 7ff36f50f640 1 Processor -- start 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36f50f640 1 -- start start 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36f50f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3680d3ad0 0x7ff3680cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36f50f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff36815d580 0x7ff3681f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36f50f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff36815f6c0 0x7ff368159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36f50f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3681f3b40 con 0x7ff3680d3ad0 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36f50f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680b7300 con 0x7ff36815d580 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36f50f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3681595a0 con 0x7ff36815f6c0 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36d2ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3680d3ad0 0x7ff3680cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36d2ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3680d3ad0 0x7ff3680cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57342/0 (socket says 172.21.15.50:57342) 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.094+0000 7ff36d2ab640 1 -- 172.21.15.50:0/1037942422 learned_addr learned my addr 172.21.15.50:0/1037942422 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36d2ab640 1 -- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff36815f6c0 msgr2=0x7ff368159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36daac640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff36815f6c0 0x7ff368159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36d2ab640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff36815f6c0 0x7ff368159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36caaa640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff36815d580 0x7ff3681f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36d2ab640 1 -- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff36815d580 msgr2=0x7ff3681f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36d2ab640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff36815d580 0x7ff3681f3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36d2ab640 1 -- 172.21.15.50:0/1037942422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640094d0 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36d2ab640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3680d3ad0 0x7ff3680cdbc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff364000c00 tx=0x7ff3640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff35dffb640 1 -- 172.21.15.50:0/1037942422 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36403abe0 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff35dffb640 1 -- 172.21.15.50:0/1037942422 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36403ad40 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3680caa90 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff35dffb640 1 -- 172.21.15.50:0/1037942422 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364044630 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.095+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3680b75a0 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.096+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3680d09d0 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.097+0000 7ff35dffb640 1 -- 172.21.15.50:0/1037942422 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff36404d450 con 0x7ff3680d3ad0 2023-12-08T08:20:35.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.097+0000 7ff35dffb640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff34c06ae40 0x7ff34c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.097+0000 7ff35dffb640 1 -- 172.21.15.50:0/1037942422 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff36402d040 con 0x7ff3680d3ad0 2023-12-08T08:20:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.097+0000 7ff36caaa640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff34c06ae40 0x7ff34c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.098+0000 7ff36caaa640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff34c06ae40 0x7ff34c06d300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff3680ca2c0 tx=0x7ff358008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.102+0000 7ff35dffb640 1 -- 172.21.15.50:0/1037942422 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff364076c90 con 0x7ff3680d3ad0 2023-12-08T08:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.294+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff368067430 con 0x7ff3680d3ad0 2023-12-08T08:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.294+0000 7ff35dffb640 1 -- 172.21.15.50:0/1037942422 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff36407a2b0 con 0x7ff3680d3ad0 2023-12-08T08:20:35.298 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff34c06ae40 msgr2=0x7ff34c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff34c06ae40 0x7ff34c06d300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff3680ca2c0 tx=0x7ff358008040 comp rx=0 tx=0).stop 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3680d3ad0 msgr2=0x7ff3680cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3680d3ad0 0x7ff3680cdbc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff364000c00 tx=0x7ff3640046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 shutdown_connections 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff34c06ae40 0x7ff34c06d300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff36815f6c0 0x7ff368159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff36815d580 0x7ff3681f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 --2- 172.21.15.50:0/1037942422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3680d3ad0 0x7ff3680cdbc0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 >> 172.21.15.50:0/1037942422 conn(0x7ff3680d2fb0 msgr2=0x7ff36815b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 shutdown_connections 2023-12-08T08:20:35.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.296+0000 7ff36f50f640 1 -- 172.21.15.50:0/1037942422 wait complete. 2023-12-08T08:20:35.309 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:35.309 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:35.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:35.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.468+0000 7f1fe9790640 1 Processor -- start 2023-12-08T08:20:35.471 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.468+0000 7f1fe9790640 1 -- start start 2023-12-08T08:20:35.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.469+0000 7f1fe9790640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1fe415d490 0x7f1fe406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.473 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.469+0000 7f1fe9790640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40ce270 con 0x7f1fe406ea40 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.469+0000 7f1fe9790640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40ce550 con 0x7f1fe406c940 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.469+0000 7f1fe9790640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe406b920 con 0x7f1fe415d490 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.469+0000 7f1fe37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1fe406ea40 0x7f1fe40d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53022/0 (socket says 172.21.15.50:53022) 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.469+0000 7f1fe37fe640 1 -- 172.21.15.50:0/709179949 learned_addr learned my addr 172.21.15.50:0/709179949 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198374500 0 0) 0x7f1fe40ce270 con 0x7f1fe406ea40 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd0003520 con 0x7f1fe406ea40 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/709179949 >> v2:172.21.15.170:3300/0 conn(0x7f1fe415d490 0x7f1fe406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2015293988 0 0) 0x7f1fd0003520 con 0x7f1fe406ea40 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 >> v2:172.21.15.170:3300/0 conn(0x7f1fe415d490 msgr2=0x7f1fe406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 --2- 172.21.15.50:0/709179949 >> v2:172.21.15.170:3300/0 conn(0x7f1fe415d490 0x7f1fe406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 >> v1:172.21.15.170:6789/0 conn(0x7f1fe406c940 legacy=0x7f1fe406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe406bc00 con 0x7f1fe406ea40 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f1fd40019f0 con 0x7f1fe406ea40 2023-12-08T08:20:35.474 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 >> v1:172.21.15.50:6789/0 conn(0x7f1fe406ea40 legacy=0x7f1fe40d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd0003970 0x7f1fd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd00047c0 0x7f1fd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fd0005180 0x7f1fd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe406b920 con 0x7f1fd0003970 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd000c020 con 0x7f1fd0005180 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd000c1e0 con 0x7f1fd00047c0 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd0003970 0x7f1fd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe37fe640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fd0005180 0x7f1fd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe27fc640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd00047c0 0x7f1fd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe2ffd640 1 -- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd00047c0 msgr2=0x7f1fd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd00047c0 0x7f1fd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe2ffd640 1 -- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fd0005180 msgr2=0x7f1fd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fd0005180 0x7f1fd000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe2ffd640 1 -- 172.21.15.50:0/709179949 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0003520 con 0x7f1fd0003970 2023-12-08T08:20:35.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe37fe640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fd0005180 0x7f1fd000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:35.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.470+0000 7f1fe37fe640 1 -- 172.21.15.50:0/709179949 reap_dead start 2023-12-08T08:20:35.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.471+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd0003970 0x7f1fd0003d90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009ac0 tx=0x7f1fd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ed5f6f7a745d4b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.471+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc02c6b0 con 0x7f1fd0003970 2023-12-08T08:20:35.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.471+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc02c810 con 0x7f1fd0003970 2023-12-08T08:20:35.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.471+0000 7f1fe1ffb640 1 -- 172.21.15.50:0/709179949 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc02cba0 con 0x7f1fd0003970 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.472+0000 7f1fe9790640 1 -- 172.21.15.50:0/709179949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd0003970 msgr2=0x7f1fd0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.472+0000 7f1fe9790640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd0003970 0x7f1fd0003d90 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009ac0 tx=0x7f1fd00057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.472+0000 7f1fe9790640 1 -- 172.21.15.50:0/709179949 shutdown_connections 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.472+0000 7f1fe9790640 1 --2- 172.21.15.50:0/709179949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fd0003970 0x7f1fd0003d90 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.472+0000 7f1fe9790640 1 -- 172.21.15.50:0/709179949 >> 172.21.15.50:0/709179949 conn(0x7f1fe4099a10 msgr2=0x7f1fe4099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.472+0000 7f1fe9790640 1 -- 172.21.15.50:0/709179949 shutdown_connections 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.472+0000 7f1fe9790640 1 -- 172.21.15.50:0/709179949 wait complete. 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.473+0000 7f1fe9790640 1 Processor -- start 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.473+0000 7f1fe9790640 1 -- start start 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe9790640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd0003970 0x7f1fe414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe9790640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fe4159530 0x7f1fe4159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe9790640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe40c9720 0x7f1fe40c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe9790640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4159ed0 con 0x7f1fe40c9720 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe9790640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40c7e70 con 0x7f1fe4159530 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe9790640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40ca0e0 con 0x7f1fd0003970 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe40c9720 0x7f1fe40c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe40c9720 0x7f1fe40c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57356/0 (socket says 172.21.15.50:57356) 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 -- 172.21.15.50:0/124455983 learned_addr learned my addr 172.21.15.50:0/124455983 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd0003970 0x7f1fe414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe27fc640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fe4159530 0x7f1fe4159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 -- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd0003970 msgr2=0x7f1fe414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.480 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd0003970 0x7f1fe414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 -- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fe4159530 msgr2=0x7f1fe4159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fe4159530 0x7f1fe4159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 -- 172.21.15.50:0/124455983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40c9160 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe27fc640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fe4159530 0x7f1fe4159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.474+0000 7f1fe37fe640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe40c9720 0x7f1fe40c9ba0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4000f80 tx=0x7f1fd400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.475+0000 7f1fdb7fe640 1 -- 172.21.15.50:0/124455983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400eb90 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.475+0000 7f1fdb7fe640 1 -- 172.21.15.50:0/124455983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400ecf0 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.475+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe40c80c0 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.475+0000 7f1fdb7fe640 1 -- 172.21.15.50:0/124455983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40146a0 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.475+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe40c8680 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.476+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe409a350 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.476+0000 7f1fdb7fe640 1 -- 172.21.15.50:0/124455983 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1fd401c3f0 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.476+0000 7f1fdb7fe640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fc406ae70 0x7f1fc406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.477+0000 7f1fdb7fe640 1 -- 172.21.15.50:0/124455983 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1fd40890d0 con 0x7f1fe40c9720 2023-12-08T08:20:35.481 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.477+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fc406ae70 0x7f1fc406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.482 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.477+0000 7f1fe2ffd640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fc406ae70 0x7f1fc406d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc036000 tx=0x7f1fdc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.483 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.481+0000 7f1fdb7fe640 1 -- 172.21.15.50:0/124455983 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1fd4057a40 con 0x7f1fe40c9720 2023-12-08T08:20:35.662 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.660+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fe4067ad0 con 0x7f1fe40c9720 2023-12-08T08:20:35.663 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.661+0000 7f1fdb7fe640 1 -- 172.21.15.50:0/124455983 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7f1fd40575d0 con 0x7f1fe40c9720 2023-12-08T08:20:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:35.664 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fc406ae70 msgr2=0x7f1fc406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fc406ae70 0x7f1fc406d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc036000 tx=0x7f1fdc030000 comp rx=0 tx=0).stop 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe40c9720 msgr2=0x7f1fe40c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe40c9720 0x7f1fe40c9ba0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4000f80 tx=0x7f1fd400e530 comp rx=0 tx=0).stop 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 shutdown_connections 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1fc406ae70 0x7f1fc406d330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1fe40c9720 0x7f1fe40c9ba0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fe4159530 0x7f1fe4159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 --2- 172.21.15.50:0/124455983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1fd0003970 0x7f1fe414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 >> 172.21.15.50:0/124455983 conn(0x7f1fe4099a10 msgr2=0x7f1fe40cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 shutdown_connections 2023-12-08T08:20:35.666 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.663+0000 7f1fe9790640 1 -- 172.21.15.50:0/124455983 wait complete. 2023-12-08T08:20:35.676 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:24.505729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:25.407648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:35.677 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.784+0000 7f06ef448640 1 Processor -- start 2023-12-08T08:20:35.786 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.784+0000 7f06ef448640 1 -- start start 2023-12-08T08:20:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ef448640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06e8157a20 0x7f06e815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ef448640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e8157e00 con 0x7f06e80cb370 2023-12-08T08:20:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ef448640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e806dd20 con 0x7f06e806d7d0 2023-12-08T08:20:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ef448640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e8070cd0 con 0x7f06e8157a20 2023-12-08T08:20:35.787 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ed1e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f06e8157a20 0x7f06e815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ec9e3640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f06e80cb370 0x7f06e815df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53034/0 (socket says 172.21.15.50:53034) 2023-12-08T08:20:35.788 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ec9e3640 1 -- 172.21.15.50:0/1840011113 learned_addr learned my addr 172.21.15.50:0/1840011113 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ed1e4640 1 -- 172.21.15.50:0/1840011113 >> v1:172.21.15.170:6789/0 conn(0x7f06e806d7d0 legacy=0x7f06e80b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ed1e4640 1 -- 172.21.15.50:0/1840011113 >> v1:172.21.15.50:6789/0 conn(0x7f06e80cb370 legacy=0x7f06e815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06ed1e4640 1 -- 172.21.15.50:0/1840011113 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8070fb0 con 0x7f06e8157a20 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.785+0000 7f06dffff640 1 -- 172.21.15.50:0/1840011113 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033813160 0 0) 0x7f06e8157e00 con 0x7f06e80cb370 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.786+0000 7f06ed1e4640 1 --2- 172.21.15.50:0/1840011113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e815d9d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009d90 tx=0x7f06e002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee4158024f1672c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.786+0000 7f06dffff640 1 -- 172.21.15.50:0/1840011113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e002cd00 con 0x7f06e8157a20 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.786+0000 7f06dffff640 1 -- 172.21.15.50:0/1840011113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e002ce60 con 0x7f06e8157a20 2023-12-08T08:20:35.789 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.786+0000 7f06dffff640 1 -- 172.21.15.50:0/1840011113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0034660 con 0x7f06e8157a20 2023-12-08T08:20:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.787+0000 7f06ef448640 1 -- 172.21.15.50:0/1840011113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 msgr2=0x7f06e815d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.787+0000 7f06ef448640 1 --2- 172.21.15.50:0/1840011113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e815d9d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009d90 tx=0x7f06e002bf50 comp rx=0 tx=0).stop 2023-12-08T08:20:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.787+0000 7f06ef448640 1 -- 172.21.15.50:0/1840011113 shutdown_connections 2023-12-08T08:20:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.787+0000 7f06ef448640 1 --2- 172.21.15.50:0/1840011113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e815d9d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.787+0000 7f06ef448640 1 -- 172.21.15.50:0/1840011113 >> 172.21.15.50:0/1840011113 conn(0x7f06e80b0850 msgr2=0x7f06e80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.787+0000 7f06ef448640 1 -- 172.21.15.50:0/1840011113 shutdown_connections 2023-12-08T08:20:35.790 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.787+0000 7f06ef448640 1 -- 172.21.15.50:0/1840011113 wait complete. 2023-12-08T08:20:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.788+0000 7f06ef448640 1 Processor -- start 2023-12-08T08:20:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.788+0000 7f06ef448640 1 -- start start 2023-12-08T08:20:35.792 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ef448640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06e806d7d0 0x7f06e80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ef448640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e80cb370 0x7f06e81539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ef448640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e814b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ef448640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e8153f20 con 0x7f06e8157a20 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ef448640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80acef0 con 0x7f06e80cb370 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ef448640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80ad1d0 con 0x7f06e806d7d0 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed9e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e814b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed9e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e814b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57368/0 (socket says 172.21.15.50:57368) 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed9e5640 1 -- 172.21.15.50:0/2844886415 learned_addr learned my addr 172.21.15.50:0/2844886415 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed1e4640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06e806d7d0 0x7f06e80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ec9e3640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e80cb370 0x7f06e81539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed9e5640 1 -- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06e806d7d0 msgr2=0x7f06e80ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed9e5640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06e806d7d0 0x7f06e80ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.793 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed9e5640 1 -- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e80cb370 msgr2=0x7f06e81539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.789+0000 7f06ed9e5640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e80cb370 0x7f06e81539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ed9e5640 1 -- 172.21.15.50:0/2844886415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0009a70 con 0x7f06e8157a20 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ed1e4640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06e806d7d0 0x7f06e80ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ec9e3640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e80cb370 0x7f06e81539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ed9e5640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e814b760 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f06e4001eb0 tx=0x7f06e400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ddffb640 1 -- 172.21.15.50:0/2844886415 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40052d0 con 0x7f06e8157a20 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ddffb640 1 -- 172.21.15.50:0/2844886415 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e4005430 con 0x7f06e8157a20 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ddffb640 1 -- 172.21.15.50:0/2844886415 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4003810 con 0x7f06e8157a20 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e80ad4b0 con 0x7f06e8157a20 2023-12-08T08:20:35.794 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.790+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e80ada70 con 0x7f06e8157a20 2023-12-08T08:20:35.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.791+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e8067430 con 0x7f06e8157a20 2023-12-08T08:20:35.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.791+0000 7f06ddffb640 1 -- 172.21.15.50:0/2844886415 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06e4003970 con 0x7f06e8157a20 2023-12-08T08:20:35.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.792+0000 7f06ddffb640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06cc06ae40 0x7f06cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:35.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.792+0000 7f06ddffb640 1 -- 172.21.15.50:0/2844886415 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f06e4088c70 con 0x7f06e8157a20 2023-12-08T08:20:35.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.792+0000 7f06ed1e4640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06cc06ae40 0x7f06cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:35.795 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.792+0000 7f06ed1e4640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06cc06ae40 0x7f06cc06d300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f06e0036000 tx=0x7f06e0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:35.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.796+0000 7f06ddffb640 1 -- 172.21.15.50:0/2844886415 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06e4053c70 con 0x7f06e8157a20 2023-12-08T08:20:35.972 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.970+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06e806bfe0 con 0x7f06e8157a20 2023-12-08T08:20:35.973 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.970+0000 7f06ddffb640 1 -- 172.21.15.50:0/2844886415 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06e40170a0 con 0x7f06e8157a20 2023-12-08T08:20:35.973 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06cc06ae40 msgr2=0x7f06cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06cc06ae40 0x7f06cc06d300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f06e0036000 tx=0x7f06e0030000 comp rx=0 tx=0).stop 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 msgr2=0x7f06e814b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e814b760 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f06e4001eb0 tx=0x7f06e400c890 comp rx=0 tx=0).stop 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 shutdown_connections 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f06cc06ae40 0x7f06cc06d300 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06e8157a20 0x7f06e814b760 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e80cb370 0x7f06e81539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 --2- 172.21.15.50:0/2844886415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06e806d7d0 0x7f06e80ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 >> 172.21.15.50:0/2844886415 conn(0x7f06e80b0850 msgr2=0x7f06e806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 shutdown_connections 2023-12-08T08:20:35.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:35.972+0000 7f06ef448640 1 -- 172.21.15.50:0/2844886415 wait complete. 2023-12-08T08:20:35.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:36.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.092+0000 7f4f11810640 1 Processor -- start 2023-12-08T08:20:36.095 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.092+0000 7f4f11810640 1 -- start start 2023-12-08T08:20:36.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f11810640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f11810640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f0c0b4150 0x7f4f0c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f11810640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0c6be0 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.096 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f11810640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0d3ff0 con 0x7f4f0c0b4150 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f11810640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0b4860 con 0x7f4f0c0cfa30 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f0a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f0c0b4150 0x7f4f0c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f0a7fc640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4f0c0b4150 0x7f4f0c0b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57380/0 (socket says 172.21.15.50:57380) 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f0b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4f0c0cfe10 0x7f4f0c161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53040/0 (socket says 172.21.15.50:53040) 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.093+0000 7f4f0a7fc640 1 -- 172.21.15.50:0/2026318302 learned_addr learned my addr 172.21.15.50:0/2026318302 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.094+0000 7f4f0affd640 1 --2- 172.21.15.50:0/2026318302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.094+0000 7f4f0a7fc640 1 -- 172.21.15.50:0/2026318302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0cfa30 msgr2=0x7f4f0c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.094+0000 7f4f0a7fc640 1 --2- 172.21.15.50:0/2026318302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.094+0000 7f4f0a7fc640 1 -- 172.21.15.50:0/2026318302 >> v1:172.21.15.50:6789/0 conn(0x7f4f0c0cfe10 legacy=0x7f4f0c161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.094+0000 7f4f09ffb640 1 -- 172.21.15.50:0/2026318302 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664397044 0 0) 0x7f4f0c0c6be0 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.097 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.094+0000 7f4f0a7fc640 1 -- 172.21.15.50:0/2026318302 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0d3d50 con 0x7f4f0c0b4150 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f0a7fc640 1 --2- 172.21.15.50:0/2026318302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0b4150 0x7f4f0c0b3460 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009870 tx=0x7f4ef402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10d8432389122f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f09ffb640 1 -- 172.21.15.50:0/2026318302 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4031640 con 0x7f4f0c0b4150 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f09ffb640 1 -- 172.21.15.50:0/2026318302 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef40317a0 con 0x7f4f0c0b4150 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f09ffb640 1 -- 172.21.15.50:0/2026318302 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4031b30 con 0x7f4f0c0b4150 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 -- 172.21.15.50:0/2026318302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0b4150 msgr2=0x7f4f0c0b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 --2- 172.21.15.50:0/2026318302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0b4150 0x7f4f0c0b3460 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009870 tx=0x7f4ef402b8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 -- 172.21.15.50:0/2026318302 shutdown_connections 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 --2- 172.21.15.50:0/2026318302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0b4150 0x7f4f0c0b3460 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 --2- 172.21.15.50:0/2026318302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 -- 172.21.15.50:0/2026318302 >> 172.21.15.50:0/2026318302 conn(0x7f4f0c0d3090 msgr2=0x7f4f0c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 -- 172.21.15.50:0/2026318302 shutdown_connections 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.095+0000 7f4f11810640 1 -- 172.21.15.50:0/2026318302 wait complete. 2023-12-08T08:20:36.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.096+0000 7f4f11810640 1 Processor -- start 2023-12-08T08:20:36.100 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f11810640 1 -- start start 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f11810640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0b4150 0x7f4f0c151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f11810640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f11810640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0cfe10 0x7f4f0c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f11810640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0b1590 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f11810640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0b0980 con 0x7f4f0c0cfa30 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f11810640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0b0c60 con 0x7f4f0c0b4150 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f0b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0cfe10 0x7f4f0c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f0b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0cfe10 0x7f4f0c0b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57384/0 (socket says 172.21.15.50:57384) 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.097+0000 7f4f0b7fe640 1 -- 172.21.15.50:0/2021194430 learned_addr learned my addr 172.21.15.50:0/2021194430 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0affd640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0b4150 0x7f4f0c151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0b7fe640 1 -- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0b4150 msgr2=0x7f4f0c151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0b7fe640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0b4150 0x7f4f0c151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0b7fe640 1 -- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0cfa30 msgr2=0x7f4f0c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0a7fc640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0b7fe640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0b7fe640 1 -- 172.21.15.50:0/2021194430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40094d0 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f0b7fe640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0cfe10 0x7f4f0c0b2820 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c780 tx=0x7f4efc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f03fff640 1 -- 172.21.15.50:0/2021194430 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00ce90 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f03fff640 1 -- 172.21.15.50:0/2021194430 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00a640 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c0b0f40 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f03fff640 1 -- 172.21.15.50:0/2021194430 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00a9d0 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.098+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c151aa0 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.099+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c072730 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.103 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.100+0000 7f4f03fff640 1 -- 172.21.15.50:0/2021194430 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4efc00ab30 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.100+0000 7f4f03fff640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4eec06ae40 0x7f4eec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.100+0000 7f4f03fff640 1 -- 172.21.15.50:0/2021194430 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4efc088f30 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.100+0000 7f4f0affd640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4eec06ae40 0x7f4eec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.104 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.101+0000 7f4f0affd640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4eec06ae40 0x7f4eec06d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009970 tx=0x7f4f04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.106 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.104+0000 7f4f03fff640 1 -- 172.21.15.50:0/2021194430 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4efc053ea0 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.279+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f0c067430 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.282 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.280+0000 7f4f03fff640 1 -- 172.21.15.50:0/2021194430 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4efc0180a0 con 0x7f4f0c0cfe10 2023-12-08T08:20:36.282 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:36.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4eec06ae40 msgr2=0x7f4eec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4eec06ae40 0x7f4eec06d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009970 tx=0x7f4f04008040 comp rx=0 tx=0).stop 2023-12-08T08:20:36.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0cfe10 msgr2=0x7f4f0c0b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0cfe10 0x7f4f0c0b2820 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c780 tx=0x7f4efc00cc40 comp rx=0 tx=0).stop 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 shutdown_connections 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f4eec06ae40 0x7f4eec06d300 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f0c0cfe10 0x7f4f0c0b2820 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c0cfa30 0x7f4f0c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 --2- 172.21.15.50:0/2021194430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4f0c0b4150 0x7f4f0c151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 >> 172.21.15.50:0/2021194430 conn(0x7f4f0c0d3090 msgr2=0x7f4f0c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 shutdown_connections 2023-12-08T08:20:36.285 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.282+0000 7f4f11810640 1 -- 172.21.15.50:0/2021194430 wait complete. 2023-12-08T08:20:36.295 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:36.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.402+0000 7f5532353640 1 Processor -- start 2023-12-08T08:20:36.404 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.402+0000 7f5532353640 1 -- start start 2023-12-08T08:20:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.402+0000 7f5532353640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f552c0b4150 0x7f552c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.402+0000 7f5532353640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f552c0cfe10 0x7f552c0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.402+0000 7f5532353640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0c6be0 con 0x7f552c0cfa30 2023-12-08T08:20:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.402+0000 7f5532353640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0d3ff0 con 0x7f552c0b4150 2023-12-08T08:20:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.402+0000 7f5532353640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0b4860 con 0x7f552c0cfe10 2023-12-08T08:20:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f552b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f552c0b4150 0x7f552c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.406 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f552b7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f552c0b4150 0x7f552c0b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57400/0 (socket says 172.21.15.50:57400) 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f552b7fe640 1 -- 172.21.15.50:0/1413838063 learned_addr learned my addr 172.21.15.50:0/1413838063 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f55308f0640 1 --2- 172.21.15.50:0/1413838063 >> v2:172.21.15.170:3300/0 conn(0x7f552c0cfe10 0x7f552c0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f552b7fe640 1 -- 172.21.15.50:0/1413838063 >> v2:172.21.15.170:3300/0 conn(0x7f552c0cfe10 msgr2=0x7f552c0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f552b7fe640 1 --2- 172.21.15.50:0/1413838063 >> v2:172.21.15.170:3300/0 conn(0x7f552c0cfe10 0x7f552c0cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f552b7fe640 1 -- 172.21.15.50:0/1413838063 >> v1:172.21.15.170:6789/0 conn(0x7f552c0cfa30 legacy=0x7f552c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f552b7fe640 1 -- 172.21.15.50:0/1413838063 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0d3d50 con 0x7f552c0b4150 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.403+0000 7f55308f0640 1 --2- 172.21.15.50:0/1413838063 >> v2:172.21.15.170:3300/0 conn(0x7f552c0cfe10 0x7f552c0cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f552b7fe640 1 --2- 172.21.15.50:0/1413838063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0b4150 0x7f552c0b3630 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f552c08b250 tx=0x7f552002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e00834fef5a52bd server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f552affd640 1 -- 172.21.15.50:0/1413838063 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55200317e0 con 0x7f552c0b4150 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f552affd640 1 -- 172.21.15.50:0/1413838063 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520031940 con 0x7f552c0b4150 2023-12-08T08:20:36.407 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f552affd640 1 -- 172.21.15.50:0/1413838063 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520031cd0 con 0x7f552c0b4150 2023-12-08T08:20:36.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 -- 172.21.15.50:0/1413838063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0b4150 msgr2=0x7f552c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 --2- 172.21.15.50:0/1413838063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0b4150 0x7f552c0b3630 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f552c08b250 tx=0x7f552002b880 comp rx=0 tx=0).stop 2023-12-08T08:20:36.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 -- 172.21.15.50:0/1413838063 shutdown_connections 2023-12-08T08:20:36.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 --2- 172.21.15.50:0/1413838063 >> v2:172.21.15.170:3300/0 conn(0x7f552c0cfe10 0x7f552c0cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 --2- 172.21.15.50:0/1413838063 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0b4150 0x7f552c0b3630 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.410 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 -- 172.21.15.50:0/1413838063 >> 172.21.15.50:0/1413838063 conn(0x7f552c0d3090 msgr2=0x7f552c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 -- 172.21.15.50:0/1413838063 shutdown_connections 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.404+0000 7f5532353640 1 -- 172.21.15.50:0/1413838063 wait complete. 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 Processor -- start 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 -- start start 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f552c0b4150 0x7f552c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f552c0cfa30 0x7f552c15f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0cfe10 0x7f552c15f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c15f010 con 0x7f552c0cfe10 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c15e390 con 0x7f552c0b4150 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.406+0000 7f5532353640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c15e670 con 0x7f552c0cfa30 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0cfe10 0x7f552c15f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0cfe10 0x7f552c15f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57416/0 (socket says 172.21.15.50:57416) 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 -- 172.21.15.50:0/3989811429 learned_addr learned my addr 172.21.15.50:0/3989811429 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f552b7fe640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f552c0cfa30 0x7f552c15f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f552bfff640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f552c0b4150 0x7f552c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 -- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f552c0cfa30 msgr2=0x7f552c15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f552c0cfa30 0x7f552c15f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 -- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f552c0b4150 msgr2=0x7f552c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f552c0b4150 0x7f552c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 -- 172.21.15.50:0/3989811429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200094d0 con 0x7f552c0cfe10 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f552bfff640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f552c0b4150 0x7f552c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f55308f0640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0cfe10 0x7f552c15f970 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f552400cef0 tx=0x7f552400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f5528ff9640 1 -- 172.21.15.50:0/3989811429 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400d840 con 0x7f552c0cfe10 2023-12-08T08:20:36.412 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f5528ff9640 1 -- 172.21.15.50:0/3989811429 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552400d9c0 con 0x7f552c0cfe10 2023-12-08T08:20:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c15e950 con 0x7f552c0cfe10 2023-12-08T08:20:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f5528ff9640 1 -- 172.21.15.50:0/3989811429 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400dd70 con 0x7f552c0cfe10 2023-12-08T08:20:36.413 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.407+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c15ab00 con 0x7f552c0cfe10 2023-12-08T08:20:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.408+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c15acf0 con 0x7f552c0cfe10 2023-12-08T08:20:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.409+0000 7f5528ff9640 1 -- 172.21.15.50:0/3989811429 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f552401e3b0 con 0x7f552c0cfe10 2023-12-08T08:20:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.409+0000 7f5528ff9640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f551806ae40 0x7f551806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.409+0000 7f5528ff9640 1 -- 172.21.15.50:0/3989811429 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f552408a230 con 0x7f552c0cfe10 2023-12-08T08:20:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.409+0000 7f552bfff640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f551806ae40 0x7f551806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.410+0000 7f552bfff640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f551806ae40 0x7f551806d300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f551c00a830 tx=0x7f551c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.413+0000 7f5528ff9640 1 -- 172.21.15.50:0/3989811429 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5524055260 con 0x7f552c0cfe10 2023-12-08T08:20:36.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.590+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f552c15f150 con 0x7f552c0cfe10 2023-12-08T08:20:36.592 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.590+0000 7f5528ff9640 1 -- 172.21.15.50:0/3989811429 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f552c15f150 con 0x7f552c0cfe10 2023-12-08T08:20:36.593 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f551806ae40 msgr2=0x7f551806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f551806ae40 0x7f551806d300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f551c00a830 tx=0x7f551c008040 comp rx=0 tx=0).stop 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0cfe10 msgr2=0x7f552c15f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0cfe10 0x7f552c15f970 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f552400cef0 tx=0x7f552400a710 comp rx=0 tx=0).stop 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 shutdown_connections 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f551806ae40 0x7f551806d300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f552c0cfe10 0x7f552c15f970 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f552c0cfa30 0x7f552c15f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 --2- 172.21.15.50:0/3989811429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f552c0b4150 0x7f552c0b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 >> 172.21.15.50:0/3989811429 conn(0x7f552c0d3090 msgr2=0x7f552c15b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 shutdown_connections 2023-12-08T08:20:36.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.592+0000 7f5532353640 1 -- 172.21.15.50:0/3989811429 wait complete. 2023-12-08T08:20:36.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.710+0000 7f4644ada640 1 Processor -- start 2023-12-08T08:20:36.713 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.710+0000 7f4644ada640 1 -- start start 2023-12-08T08:20:36.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.711+0000 7f4644ada640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f464015d490 0x7f464006c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.711+0000 7f4644ada640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f464006ea40 0x7f46400d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.711+0000 7f4644ada640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46400ce270 con 0x7f464006c940 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.711+0000 7f4644ada640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46400ce550 con 0x7f464006ea40 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.711+0000 7f4644ada640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464006b920 con 0x7f464015d490 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.711+0000 7f463dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f464006c940 0x7f464006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53056/0 (socket says 172.21.15.50:53056) 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463dd9b640 1 -- 172.21.15.50:0/56737189 learned_addr learned my addr 172.21.15.50:0/56737189 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463ed9d640 1 --2- 172.21.15.50:0/56737189 >> v2:172.21.15.170:3300/0 conn(0x7f464006ea40 0x7f46400d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463e59c640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f464015d490 0x7f464006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984146359 0 0) 0x7f46400ce270 con 0x7f464006c940 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f462c003520 con 0x7f464006c940 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044584186 0 0) 0x7f462c003520 con 0x7f464006c940 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f464015d490 msgr2=0x7f464006c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f464015d490 0x7f464006c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 >> v2:172.21.15.170:3300/0 conn(0x7f464006ea40 msgr2=0x7f46400d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 --2- 172.21.15.50:0/56737189 >> v2:172.21.15.170:3300/0 conn(0x7f464006ea40 0x7f46400d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464006bc00 con 0x7f464006c940 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f4628001690 con 0x7f464006c940 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 >> v1:172.21.15.50:6789/0 conn(0x7f464006c940 legacy=0x7f464006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c003970 0x7f462c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f462c0042d0 0x7f462c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f462c004e10 0x7f462c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46400ce550 con 0x7f462c004e10 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464006b920 con 0x7f462c0042d0 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c00bd00 con 0x7f462c003970 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463ed9d640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f462c004e10 0x7f462c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463e59c640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c003970 0x7f462c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.712+0000 7f463dd9b640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f462c0042d0 0x7f462c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463ed9d640 1 -- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c003970 msgr2=0x7f462c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463ed9d640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c003970 0x7f462c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463ed9d640 1 -- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f462c0042d0 msgr2=0x7f462c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463ed9d640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f462c0042d0 0x7f462c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463ed9d640 1 -- 172.21.15.50:0/56737189 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c003520 con 0x7f462c004e10 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463dd9b640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f462c0042d0 0x7f462c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463ed9d640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f462c004e10 0x7f462c005290 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4638009a90 tx=0x7f462c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f977e3787623ac8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463802c6b0 con 0x7f462c004e10 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.713+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463802c810 con 0x7f462c004e10 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f463d59a640 1 -- 172.21.15.50:0/56737189 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463802cba0 con 0x7f462c004e10 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f4644ada640 1 -- 172.21.15.50:0/56737189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f462c004e10 msgr2=0x7f462c005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f4644ada640 1 --2- 172.21.15.50:0/56737189 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f462c004e10 0x7f462c005290 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4638009a90 tx=0x7f462c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f463ed9d640 1 -- 172.21.15.50:0/56737189 reap_dead start 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f4644ada640 1 -- 172.21.15.50:0/56737189 shutdown_connections 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f4644ada640 1 -- 172.21.15.50:0/56737189 >> 172.21.15.50:0/56737189 conn(0x7f4640099a10 msgr2=0x7f4640099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f4644ada640 1 -- 172.21.15.50:0/56737189 shutdown_connections 2023-12-08T08:20:36.719 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.714+0000 7f4644ada640 1 -- 172.21.15.50:0/56737189 wait complete. 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.715+0000 7f4644ada640 1 Processor -- start 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f4644ada640 1 -- start start 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f4644ada640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c004e10 0x7f4640159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f4644ada640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4640157a30 0x7f46401506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f4644ada640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46400d0060 0x7f46400d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f4644ada640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46400c8d20 con 0x7f46400d0060 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f4644ada640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4640159590 con 0x7f4640157a30 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f4644ada640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4640158a20 con 0x7f462c004e10 2023-12-08T08:20:36.723 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f463ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46400d0060 0x7f46400d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f463ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46400d0060 0x7f46400d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57430/0 (socket says 172.21.15.50:57430) 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f463ed9d640 1 -- 172.21.15.50:0/2998555011 learned_addr learned my addr 172.21.15.50:0/2998555011 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f463dd9b640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4640157a30 0x7f46401506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.716+0000 7f463e59c640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c004e10 0x7f4640159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f463ed9d640 1 -- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c004e10 msgr2=0x7f4640159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f463ed9d640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c004e10 0x7f4640159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f463ed9d640 1 -- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4640157a30 msgr2=0x7f46401506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f463ed9d640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4640157a30 0x7f46401506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f463ed9d640 1 -- 172.21.15.50:0/2998555011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640157eb0 con 0x7f46400d0060 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f463ed9d640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46400d0060 0x7f46400d04e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4638009bb0 tx=0x7f4638004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f4636ffd640 1 -- 172.21.15.50:0/2998555011 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463802c6b0 con 0x7f46400d0060 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f4636ffd640 1 -- 172.21.15.50:0/2998555011 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4638003830 con 0x7f46400d0060 2023-12-08T08:20:36.724 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4640158180 con 0x7f46400d0060 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f4636ffd640 1 -- 172.21.15.50:0/2998555011 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638003be0 con 0x7f46400d0060 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.717+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4640158740 con 0x7f46400d0060 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.718+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46400c8e60 con 0x7f46400d0060 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.718+0000 7f4636ffd640 1 -- 172.21.15.50:0/2998555011 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4638003d40 con 0x7f46400d0060 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.719+0000 7f4636ffd640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f462006ae70 0x7f462006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.719+0000 7f4636ffd640 1 -- 172.21.15.50:0/2998555011 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f46380aae30 con 0x7f46400d0060 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.719+0000 7f463e59c640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f462006ae70 0x7f462006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.720+0000 7f463e59c640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f462006ae70 0x7f462006d330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4640159180 tx=0x7f463000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:36.725 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.723+0000 7f4636ffd640 1 -- 172.21.15.50:0/2998555011 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46400c8e60 con 0x7f46400d0060 2023-12-08T08:20:36.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.915+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f46400c8e60 con 0x7f46400d0060 2023-12-08T08:20:36.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.915+0000 7f4636ffd640 1 -- 172.21.15.50:0/2998555011 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f46400c8e60 con 0x7f46400d0060 2023-12-08T08:20:36.918 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f462006ae70 msgr2=0x7f462006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f462006ae70 0x7f462006d330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4640159180 tx=0x7f463000b040 comp rx=0 tx=0).stop 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46400d0060 msgr2=0x7f46400d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46400d0060 0x7f46400d04e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4638009bb0 tx=0x7f4638004730 comp rx=0 tx=0).stop 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 shutdown_connections 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f462006ae70 0x7f462006d330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f46400d0060 0x7f46400d04e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4640157a30 0x7f46401506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.920 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 --2- 172.21.15.50:0/2998555011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f462c004e10 0x7f4640159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 >> 172.21.15.50:0/2998555011 conn(0x7f4640099a10 msgr2=0x7f464015b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 shutdown_connections 2023-12-08T08:20:36.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:36.917+0000 7f4644ada640 1 -- 172.21.15.50:0/2998555011 wait complete. 2023-12-08T08:20:36.930 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:20:36.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:36.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:36.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[110999]: fuse finished with error 0 and tester_r 0 2023-12-08T08:20:36.963 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:36.998 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:20:36.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:36.998 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:20:37.054 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:20:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.198+0000 7fd36703d640 1 Processor -- start 2023-12-08T08:20:37.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.198+0000 7fd36703d640 1 -- start start 2023-12-08T08:20:37.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd36703d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd360140a10 0x7fd3600cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd36703d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3600b2640 0x7fd3600ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd36703d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd360070db0 con 0x7fd360071e50 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd36703d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd360070ba0 con 0x7fd360140a10 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd36703d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd360071090 con 0x7fd3600b2640 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd3655da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3600b2640 0x7fd3600ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd364dd9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd360140a10 0x7fd3600cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd3655da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3600b2640 0x7fd3600ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:48338/0 (socket says 172.21.15.50:48338) 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd3655da640 1 -- 172.21.15.50:0/2090414099 learned_addr learned my addr 172.21.15.50:0/2090414099 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd35ffff640 1 --1- 172.21.15.50:0/2090414099 >> v1:172.21.15.170:6789/0 conn(0x7fd360071e50 0x7fd3600b1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:49728/0 (socket says 172.21.15.50:49728) 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd3655da640 1 -- 172.21.15.50:0/2090414099 >> v2:172.21.15.170:3300/0 conn(0x7fd360140a10 msgr2=0x7fd3600cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd3655da640 1 --2- 172.21.15.50:0/2090414099 >> v2:172.21.15.170:3300/0 conn(0x7fd360140a10 0x7fd3600cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd3655da640 1 -- 172.21.15.50:0/2090414099 >> v1:172.21.15.170:6789/0 conn(0x7fd360071e50 legacy=0x7fd3600b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.199+0000 7fd3655da640 1 -- 172.21.15.50:0/2090414099 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360071370 con 0x7fd3600b2640 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.200+0000 7fd3655da640 1 --2- 172.21.15.50:0/2090414099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3600b2640 0x7fd3600ce210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd35800d150 tx=0x7fd35802e1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0082b6d10c3ae8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.200+0000 7fd35f7fe640 1 -- 172.21.15.50:0/2090414099 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800b0d0 con 0x7fd3600b2640 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd35f7fe640 1 -- 172.21.15.50:0/2090414099 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800b230 con 0x7fd3600b2640 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd35f7fe640 1 -- 172.21.15.50:0/2090414099 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358009600 con 0x7fd3600b2640 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 -- 172.21.15.50:0/2090414099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3600b2640 msgr2=0x7fd3600ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 --2- 172.21.15.50:0/2090414099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3600b2640 0x7fd3600ce210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd35800d150 tx=0x7fd35802e1f0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 -- 172.21.15.50:0/2090414099 shutdown_connections 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 --2- 172.21.15.50:0/2090414099 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3600b2640 0x7fd3600ce210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 --2- 172.21.15.50:0/2090414099 >> v2:172.21.15.170:3300/0 conn(0x7fd360140a10 0x7fd3600cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 -- 172.21.15.50:0/2090414099 >> 172.21.15.50:0/2090414099 conn(0x7fd3600b09f0 msgr2=0x7fd3600b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 -- 172.21.15.50:0/2090414099 shutdown_connections 2023-12-08T08:20:37.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.201+0000 7fd36703d640 1 -- 172.21.15.50:0/2090414099 wait complete. 2023-12-08T08:20:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.202+0000 7fd36703d640 1 Processor -- start 2023-12-08T08:20:37.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.202+0000 7fd36703d640 1 -- start start 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd36703d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd360071e50 0x7fd36015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd36703d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600b2640 0x7fd3600aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd36703d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd360140a10 0x7fd3600af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd36703d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3600b0850 con 0x7fd3600b2640 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd36703d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3601566f0 con 0x7fd360071e50 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd36703d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3601569d0 con 0x7fd360140a10 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd35ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600b2640 0x7fd3600aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd35ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600b2640 0x7fd3600aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57442/0 (socket says 172.21.15.50:57442) 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.203+0000 7fd35ffff640 1 -- 172.21.15.50:0/2614476688 learned_addr learned my addr 172.21.15.50:0/2614476688 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd3655da640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd360140a10 0x7fd3600af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd364dd9640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd360071e50 0x7fd36015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35ffff640 1 -- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd360140a10 msgr2=0x7fd3600af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35ffff640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd360140a10 0x7fd3600af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35ffff640 1 -- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd360071e50 msgr2=0x7fd36015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35ffff640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd360071e50 0x7fd36015a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35ffff640 1 -- 172.21.15.50:0/2614476688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35800bd40 con 0x7fd3600b2640 2023-12-08T08:20:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35ffff640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600b2640 0x7fd3600aef80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00c450 tx=0x7fd34c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2614476688 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c007480 con 0x7fd3600b2640 2023-12-08T08:20:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2614476688 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0075e0 con 0x7fd3600b2640 2023-12-08T08:20:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd360156cb0 con 0x7fd3600b2640 2023-12-08T08:20:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2614476688 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c004a00 con 0x7fd3600b2640 2023-12-08T08:20:37.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.204+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36015ab50 con 0x7fd3600b2640 2023-12-08T08:20:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.205+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3601571d0 con 0x7fd3600b2640 2023-12-08T08:20:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.205+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2614476688 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd34c004b60 con 0x7fd3600b2640 2023-12-08T08:20:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.206+0000 7fd35d7fa640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd34406ae40 0x7fd34406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.206+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2614476688 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd34c088b50 con 0x7fd3600b2640 2023-12-08T08:20:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.206+0000 7fd364dd9640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd34406ae40 0x7fd34406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:37.209 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.207+0000 7fd364dd9640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd34406ae40 0x7fd34406d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd354009a30 tx=0x7fd354008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:37.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.210+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2614476688 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3601571d0 con 0x7fd3600b2640 2023-12-08T08:20:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.422+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd3601571d0 con 0x7fd3600b2640 2023-12-08T08:20:37.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.422+0000 7fd35d7fa640 1 -- 172.21.15.50:0/2614476688 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd3601571d0 con 0x7fd3600b2640 2023-12-08T08:20:37.425 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:20:37.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd34406ae40 msgr2=0x7fd34406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd34406ae40 0x7fd34406d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd354009a30 tx=0x7fd354008040 comp rx=0 tx=0).stop 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600b2640 msgr2=0x7fd3600aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600b2640 0x7fd3600aef80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00c450 tx=0x7fd34c00c910 comp rx=0 tx=0).stop 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 shutdown_connections 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd34406ae40 0x7fd34406d300 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3600b2640 0x7fd3600aef80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd360140a10 0x7fd3600af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 --2- 172.21.15.50:0/2614476688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd360071e50 0x7fd36015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 >> 172.21.15.50:0/2614476688 conn(0x7fd3600b09f0 msgr2=0x7fd36013f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 shutdown_connections 2023-12-08T08:20:37.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:37.424+0000 7fd36703d640 1 -- 172.21.15.50:0/2614476688 wait complete. 2023-12-08T08:20:37.437 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:20:37.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:20:37.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:20:37.437 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:20:37.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:37.438 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:20:37.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:20:37.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:20:37.438 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:37.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.438 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:20:37.454 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:20:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:20:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:20:37.454 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42336sec preferred_lft 42336sec 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:20:37.455 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c008:83ff:fe50:e6c0/64 scope link 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::403f:3fff:fee6:f2fc/64 scope link 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:20:37.456 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::2880:6dff:fe2e:b579/64 scope link 2023-12-08T08:20:37.457 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:37.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.457 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:20:37.524 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:20:37.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.526 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:20:37.582 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:20:37.582 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:20:37.582 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:20:37.583 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:20:37.583 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:20:37.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.583 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:20:37.583 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:20:37.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:20:37.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:20:37.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:20:37.583 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:20:37.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.689 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:20:37.704 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-08T08:20:37.704 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:20:37.704 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:37.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:37.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:20:37.775 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-08T08:20:37.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:37.775 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:37.830 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:37.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:37.831 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:37.886 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:20:37.957 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:20:38.012 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:20:38.012 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:20:38.013 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:20:38.014 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:38.015 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:38.015 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:38.015 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:38.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.016 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:20:38.071 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:20:38.071 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T08:20:38.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:20:38.144 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:20:38.200 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:20:38.201 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:38.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.202 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:20:38.207 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-12-08T08:20:38.205+0000 7f9126e38480 -1 init, newargv = 0x5630fab624f0 newargc=15 2023-12-08T08:20:38.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[111964]: starting ceph client 2023-12-08T08:20:38.212 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[111964]: starting fuse 2023-12-08T08:20:38.223 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:20:38.223 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:20:38.223 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:20:38.224 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:38.225 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-12-08T08:20:38.225 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:20:38.348 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.111964.asok 2023-12-08T08:20:38.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:20:38.358 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.111964.asok 2023-12-08T08:20:38.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.358 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.111964.asok status 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "111964", 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:20:38.500 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6480, 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 6480 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1105478168 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1105478168 2023-12-08T08:20:38.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.6480 192.168.0.1:0/1105478168", 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/1105478168", 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 23, 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 56, 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:20:38.502 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:20:38.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.508 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:20:38.508 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:38.523 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:20:38.523 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:38.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:38.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> import errno 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> if False: 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> ret = os.read(fd, 1024) 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> os.write(fd, b'"'"'content'"'"') 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2023-12-08T08:20:38.595 DEBUG:teuthology.orchestra.run.smithi050:> if e.errno != errno.EPERM: 2023-12-08T08:20:38.596 DEBUG:teuthology.orchestra.run.smithi050:> raise 2023-12-08T08:20:38.596 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-12-08T08:20:38.596 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("client does not check permission of data pool") 2023-12-08T08:20:38.596 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:20:38.707 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:20:38.714 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2023-12-08T08:20:38.867 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.865+0000 7fc1af6d4640 1 Processor -- start 2023-12-08T08:20:38.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.865+0000 7fc1af6d4640 1 -- start start 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1af6d4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc1a815d320 0x7fc1a80aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1af6d4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1a80af3d0 0x7fc1a80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1af6d4640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a80b30e0 con 0x7fc1a806a4d0 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1af6d4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a815d700 con 0x7fc1a80af3d0 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1af6d4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a80b4cb0 con 0x7fc1a815d320 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1acc6f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc1a80af3d0 0x7fc1a80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1adc71640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc1a806a4d0 0x7fc1a806d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53066/0 (socket says 172.21.15.50:53066) 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.866+0000 7fc1adc71640 1 -- 172.21.15.50:0/1427026803 learned_addr learned my addr 172.21.15.50:0/1427026803 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.867+0000 7fc1ad470640 1 --2- 172.21.15.50:0/1427026803 >> v2:172.21.15.170:3300/0 conn(0x7fc1a815d320 0x7fc1a80aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.867+0000 7fc1acc6f640 1 -- 172.21.15.50:0/1427026803 >> v2:172.21.15.170:3300/0 conn(0x7fc1a815d320 msgr2=0x7fc1a80aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.867+0000 7fc1acc6f640 1 --2- 172.21.15.50:0/1427026803 >> v2:172.21.15.170:3300/0 conn(0x7fc1a815d320 0x7fc1a80aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.867+0000 7fc1acc6f640 1 -- 172.21.15.50:0/1427026803 >> v1:172.21.15.50:6789/0 conn(0x7fc1a806a4d0 legacy=0x7fc1a806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.867+0000 7fc19ffff640 1 -- 172.21.15.50:0/1427026803 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470931854 0 0) 0x7fc1a80b30e0 con 0x7fc1a806a4d0 2023-12-08T08:20:38.870 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.867+0000 7fc1acc6f640 1 -- 172.21.15.50:0/1427026803 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a80b4f90 con 0x7fc1a80af3d0 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.867+0000 7fc1acc6f640 1 --2- 172.21.15.50:0/1427026803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a80af3d0 0x7fc1a80acd50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8070e30 tx=0x7fc19802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d2379caf3cf1e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc19ffff640 1 -- 172.21.15.50:0/1427026803 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198031830 con 0x7fc1a80af3d0 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc19ffff640 1 -- 172.21.15.50:0/1427026803 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc198031990 con 0x7fc1a80af3d0 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc19ffff640 1 -- 172.21.15.50:0/1427026803 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198031d20 con 0x7fc1a80af3d0 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1427026803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a80af3d0 msgr2=0x7fc1a80acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1427026803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a80af3d0 0x7fc1a80acd50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8070e30 tx=0x7fc19802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1427026803 shutdown_connections 2023-12-08T08:20:38.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1427026803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a80af3d0 0x7fc1a80acd50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1427026803 >> v2:172.21.15.170:3300/0 conn(0x7fc1a815d320 0x7fc1a80aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1427026803 >> 172.21.15.50:0/1427026803 conn(0x7fc1a80b1a70 msgr2=0x7fc1a80b1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1427026803 shutdown_connections 2023-12-08T08:20:38.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.868+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1427026803 wait complete. 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.869+0000 7fc1af6d4640 1 Processor -- start 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.869+0000 7fc1af6d4640 1 -- start start 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1af6d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a806a4d0 0x7fc1a814baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1af6d4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80af3d0 0x7fc1a815a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1af6d4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a815d320 0x7fc1a815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1af6d4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a815b980 con 0x7fc1a806a4d0 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1af6d4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a815dd70 con 0x7fc1a80af3d0 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1af6d4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a815b3c0 con 0x7fc1a815d320 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1ad470640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a806a4d0 0x7fc1a814baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1ad470640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a806a4d0 0x7fc1a814baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57448/0 (socket says 172.21.15.50:57448) 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1ad470640 1 -- 172.21.15.50:0/1515500670 learned_addr learned my addr 172.21.15.50:0/1515500670 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:38.874 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1adc71640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a815d320 0x7fc1a815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.870+0000 7fc1acc6f640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80af3d0 0x7fc1a815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1ad470640 1 -- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a815d320 msgr2=0x7fc1a815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1ad470640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a815d320 0x7fc1a815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1ad470640 1 -- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80af3d0 msgr2=0x7fc1a815a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1ad470640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80af3d0 0x7fc1a815a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1ad470640 1 -- 172.21.15.50:0/1515500670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198009400 con 0x7fc1a806a4d0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1acc6f640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80af3d0 0x7fc1a815a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1adc71640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a815d320 0x7fc1a815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1ad470640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a806a4d0 0x7fc1a814baa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000d620 tx=0x7fc1a000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc19dffb640 1 -- 172.21.15.50:0/1515500670 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000b620 con 0x7fc1a806a4d0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc19dffb640 1 -- 172.21.15.50:0/1515500670 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a000b780 con 0x7fc1a806a4d0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a815b6a0 con 0x7fc1a806a4d0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc19dffb640 1 -- 172.21.15.50:0/1515500670 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000bb30 con 0x7fc1a806a4d0 2023-12-08T08:20:38.875 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.871+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a815bf40 con 0x7fc1a806a4d0 2023-12-08T08:20:38.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.872+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a815c0d0 con 0x7fc1a806a4d0 2023-12-08T08:20:38.876 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.873+0000 7fc19dffb640 1 -- 172.21.15.50:0/1515500670 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1a000bc90 con 0x7fc1a806a4d0 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.873+0000 7fc19dffb640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc18c06ae40 0x7fc18c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.873+0000 7fc19dffb640 1 -- 172.21.15.50:0/1515500670 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc1a0089bd0 con 0x7fc1a806a4d0 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.873+0000 7fc1acc6f640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc18c06ae40 0x7fc18c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.874+0000 7fc1acc6f640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc18c06ae40 0x7fc18c06d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc198036000 tx=0x7fc19803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:38.877+0000 7fc19dffb640 1 -- 172.21.15.50:0/1515500670 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1a0054bd0 con 0x7fc1a806a4d0 2023-12-08T08:20:39.122 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.119+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7fc1a8067430 con 0x7fc1a806a4d0 2023-12-08T08:20:39.123 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.121+0000 7fc19dffb640 1 -- 172.21.15.50:0/1515500670 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 183+0+140 (secure 0 0 0) 0x7fc1a00581f0 con 0x7fc1a806a4d0 2023-12-08T08:20:39.123 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:20:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:20:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-12-08T08:20:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:20:39.124 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow w pool=cephfs_data" 2023-12-08T08:20:39.124 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc18c06ae40 msgr2=0x7fc18c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc18c06ae40 0x7fc18c06d300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc198036000 tx=0x7fc19803c040 comp rx=0 tx=0).stop 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a806a4d0 msgr2=0x7fc1a814baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a806a4d0 0x7fc1a814baa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000d620 tx=0x7fc1a000dae0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 shutdown_connections 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc18c06ae40 0x7fc18c06d300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a815d320 0x7fc1a815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80af3d0 0x7fc1a815a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.126 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 --2- 172.21.15.50:0/1515500670 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1a806a4d0 0x7fc1a814baa0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 >> 172.21.15.50:0/1515500670 conn(0x7fc1a80b1a70 msgr2=0x7fc1a80b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:39.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.123+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 shutdown_connections 2023-12-08T08:20:39.127 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.124+0000 7fc1af6d4640 1 -- 172.21.15.50:0/1515500670 wait complete. 2023-12-08T08:20:39.136 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:39.136 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:39.152 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:39.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.296+0000 7fd3df2d4640 1 Processor -- start 2023-12-08T08:20:39.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.297+0000 7fd3df2d4640 1 -- start start 2023-12-08T08:20:39.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.297+0000 7fd3df2d4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd3d81608a0 0x7fd3d80d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.297+0000 7fd3df2d4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80b1d70 0x7fd3d80d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.297+0000 7fd3df2d4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3d80afce0 0x7fd3d80b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.297+0000 7fd3df2d4640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d80d0620 con 0x7fd3d80afce0 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.297+0000 7fd3df2d4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d80d20b0 con 0x7fd3d81608a0 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.297+0000 7fd3df2d4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80d1dd0 con 0x7fd3d80b1d70 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3d80afce0 0x7fd3d80b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3d80afce0 0x7fd3d80b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57454/0 (socket says 172.21.15.50:57454) 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 -- 172.21.15.50:0/3407822886 learned_addr learned my addr 172.21.15.50:0/3407822886 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd070640 1 --2- 172.21.15.50:0/3407822886 >> v2:172.21.15.170:3300/0 conn(0x7fd3d81608a0 0x7fd3d80d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dc86f640 1 --2- 172.21.15.50:0/3407822886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80b1d70 0x7fd3d80d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 -- 172.21.15.50:0/3407822886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80b1d70 msgr2=0x7fd3d80d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 --2- 172.21.15.50:0/3407822886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80b1d70 0x7fd3d80d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 -- 172.21.15.50:0/3407822886 >> v2:172.21.15.170:3300/0 conn(0x7fd3d81608a0 msgr2=0x7fd3d80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 --2- 172.21.15.50:0/3407822886 >> v2:172.21.15.170:3300/0 conn(0x7fd3d81608a0 0x7fd3d80d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.298+0000 7fd3dd871640 1 -- 172.21.15.50:0/3407822886 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80cff60 con 0x7fd3d80afce0 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3dd871640 1 --2- 172.21.15.50:0/3407822886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d80afce0 0x7fd3d80b0170 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd3d808b770 tx=0x7fd3c802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239f4f7251b4f4ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3d7fff640 1 -- 172.21.15.50:0/3407822886 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c802c9e0 con 0x7fd3d80afce0 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3d7fff640 1 -- 172.21.15.50:0/3407822886 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c802cb40 con 0x7fd3d80afce0 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3d7fff640 1 -- 172.21.15.50:0/3407822886 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80343f0 con 0x7fd3d80afce0 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3407822886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d80afce0 msgr2=0x7fd3d80b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3407822886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d80afce0 0x7fd3d80b0170 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd3d808b770 tx=0x7fd3c802be40 comp rx=0 tx=0).stop 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3407822886 shutdown_connections 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3407822886 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d80afce0 0x7fd3d80b0170 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3407822886 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80b1d70 0x7fd3d80d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.303 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3407822886 >> v2:172.21.15.170:3300/0 conn(0x7fd3d81608a0 0x7fd3d80d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3407822886 >> 172.21.15.50:0/3407822886 conn(0x7fd3d80d3030 msgr2=0x7fd3d80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3407822886 shutdown_connections 2023-12-08T08:20:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.299+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3407822886 wait complete. 2023-12-08T08:20:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 Processor -- start 2023-12-08T08:20:39.304 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 -- start start 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80afce0 0x7fd3d8152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3d80b1d70 0x7fd3d80ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d81608a0 0x7fd3d80ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80ca2a0 con 0x7fd3d81608a0 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80ca580 con 0x7fd3d80b1d70 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3df2d4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80ca860 con 0x7fd3d80afce0 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3dd871640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d81608a0 0x7fd3d80ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3dd871640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d81608a0 0x7fd3d80ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57462/0 (socket says 172.21.15.50:57462) 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.301+0000 7fd3dd871640 1 -- 172.21.15.50:0/3205810893 learned_addr learned my addr 172.21.15.50:0/3205810893 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dc86f640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3d80b1d70 0x7fd3d80ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.306 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dd070640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80afce0 0x7fd3d8152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dd871640 1 -- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80afce0 msgr2=0x7fd3d8152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dd871640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80afce0 0x7fd3d8152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dd871640 1 -- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3d80b1d70 msgr2=0x7fd3d80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dd871640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3d80b1d70 0x7fd3d80ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dd871640 1 -- 172.21.15.50:0/3205810893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c8009b30 con 0x7fd3d81608a0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3dd871640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d81608a0 0x7fd3d80ce900 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8036040 tx=0x7fd3c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3d5ffb640 1 -- 172.21.15.50:0/3205810893 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8009510 con 0x7fd3d81608a0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3d5ffb640 1 -- 172.21.15.50:0/3205810893 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c803e450 con 0x7fd3d81608a0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d80cab40 con 0x7fd3d81608a0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3d5ffb640 1 -- 172.21.15.50:0/3205810893 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c803e800 con 0x7fd3d81608a0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.302+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d80cb060 con 0x7fd3d81608a0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.303+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d8067430 con 0x7fd3d81608a0 2023-12-08T08:20:39.307 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.304+0000 7fd3d5ffb640 1 -- 172.21.15.50:0/3205810893 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3c803e960 con 0x7fd3d81608a0 2023-12-08T08:20:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.304+0000 7fd3d5ffb640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd3c406ae70 0x7fd3c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.304+0000 7fd3d5ffb640 1 -- 172.21.15.50:0/3205810893 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd3c80ac4b0 con 0x7fd3d81608a0 2023-12-08T08:20:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.304+0000 7fd3dd070640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd3c406ae70 0x7fd3c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.308 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.305+0000 7fd3dd070640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd3c406ae70 0x7fd3c406d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0006fd0 tx=0x7fd3d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.310 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.308+0000 7fd3d5ffb640 1 -- 172.21.15.50:0/3205810893 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3c8077420 con 0x7fd3d81608a0 2023-12-08T08:20:39.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.486+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3d80ca3e0 con 0x7fd3d81608a0 2023-12-08T08:20:39.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.488+0000 7fd3d5ffb640 1 -- 172.21.15.50:0/3205810893 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fd3d80ca3e0 con 0x7fd3d81608a0 2023-12-08T08:20:39.490 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:39.490 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd3c406ae70 msgr2=0x7fd3c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd3c406ae70 0x7fd3c406d330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0006fd0 tx=0x7fd3d0008040 comp rx=0 tx=0).stop 2023-12-08T08:20:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d81608a0 msgr2=0x7fd3d80ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d81608a0 0x7fd3d80ce900 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8036040 tx=0x7fd3c8004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 shutdown_connections 2023-12-08T08:20:39.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd3c406ae70 0x7fd3c406d330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3d81608a0 0x7fd3d80ce900 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3d80b1d70 0x7fd3d80ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 --2- 172.21.15.50:0/3205810893 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3d80afce0 0x7fd3d8152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.489+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 >> 172.21.15.50:0/3205810893 conn(0x7fd3d80d3030 msgr2=0x7fd3d80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.490+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 shutdown_connections 2023-12-08T08:20:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.490+0000 7fd3df2d4640 1 -- 172.21.15.50:0/3205810893 wait complete. 2023-12-08T08:20:39.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:24.505729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:25.407648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:39.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.610+0000 7ff807943640 1 Processor -- start 2023-12-08T08:20:39.612 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.610+0000 7ff807943640 1 -- start start 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff807943640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000b0af0 0x7ff8000b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff807943640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000b2280 con 0x7ff8000cef90 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff807943640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000b1430 con 0x7ff80015d4f0 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff807943640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80006bb40 con 0x7ff8000b0af0 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff805ee0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff8000cef90 0x7ff8000cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53082/0 (socket says 172.21.15.50:53082) 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff805ee0640 1 -- 172.21.15.50:0/1466311955 learned_addr learned my addr 172.21.15.50:0/1466311955 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff804ede640 1 --2- 172.21.15.50:0/1466311955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000b0af0 0x7ff8000b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff7fffff640 1 -- 172.21.15.50:0/1466311955 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866163160 0 0) 0x7ff8000b2280 con 0x7ff8000cef90 2023-12-08T08:20:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.611+0000 7ff7fffff640 1 -- 172.21.15.50:0/1466311955 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e8003520 con 0x7ff8000cef90 2023-12-08T08:20:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.612+0000 7ff7fffff640 1 -- 172.21.15.50:0/1466311955 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365007011 0 0) 0x7ff8000b1430 con 0x7ff80015d4f0 2023-12-08T08:20:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.612+0000 7ff7fffff640 1 -- 172.21.15.50:0/1466311955 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8000b2280 con 0x7ff80015d4f0 2023-12-08T08:20:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.612+0000 7ff804ede640 1 -- 172.21.15.50:0/1466311955 >> v1:172.21.15.170:6789/0 conn(0x7ff80015d4f0 legacy=0x7ff8000b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.612+0000 7ff804ede640 1 -- 172.21.15.50:0/1466311955 >> v1:172.21.15.50:6789/0 conn(0x7ff8000cef90 legacy=0x7ff8000cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.612+0000 7ff804ede640 1 -- 172.21.15.50:0/1466311955 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000b2710 con 0x7ff8000b0af0 2023-12-08T08:20:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.612+0000 7ff804ede640 1 --2- 172.21.15.50:0/1466311955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000b0af0 0x7ff8000b0ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40097d0 tx=0x7ff7f402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a708ca24c7fdd493 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff7fffff640 1 -- 172.21.15.50:0/1466311955 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4031890 con 0x7ff8000b0af0 2023-12-08T08:20:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff7fffff640 1 -- 172.21.15.50:0/1466311955 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f40319f0 con 0x7ff8000b0af0 2023-12-08T08:20:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff7fffff640 1 -- 172.21.15.50:0/1466311955 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4031d60 con 0x7ff8000b0af0 2023-12-08T08:20:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff807943640 1 -- 172.21.15.50:0/1466311955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000b0af0 msgr2=0x7ff8000b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff807943640 1 --2- 172.21.15.50:0/1466311955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000b0af0 0x7ff8000b0ef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40097d0 tx=0x7ff7f402b930 comp rx=0 tx=0).stop 2023-12-08T08:20:39.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff807943640 1 -- 172.21.15.50:0/1466311955 shutdown_connections 2023-12-08T08:20:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff807943640 1 --2- 172.21.15.50:0/1466311955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000b0af0 0x7ff8000b0ef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff807943640 1 -- 172.21.15.50:0/1466311955 >> 172.21.15.50:0/1466311955 conn(0x7ff8000d0e00 msgr2=0x7ff8000d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff807943640 1 -- 172.21.15.50:0/1466311955 shutdown_connections 2023-12-08T08:20:39.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.613+0000 7ff807943640 1 -- 172.21.15.50:0/1466311955 wait complete. 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.614+0000 7ff807943640 1 Processor -- start 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.614+0000 7ff807943640 1 -- start start 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff807943640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8000b0af0 0x7ff8000c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff807943640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000cef90 0x7ff8000ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff807943640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80015d4f0 0x7ff8000cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff807943640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000cd220 con 0x7ff8000b0af0 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff807943640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c5b90 con 0x7ff80015d4f0 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff807943640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c5e70 con 0x7ff8000cef90 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff8056df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8000b0af0 0x7ff8000c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff8056df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8000b0af0 0x7ff8000c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:57468/0 (socket says 172.21.15.50:57468) 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff8056df640 1 -- 172.21.15.50:0/2691191222 learned_addr learned my addr 172.21.15.50:0/2691191222 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.615+0000 7ff804ede640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000cef90 0x7ff8000ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff805ee0640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80015d4f0 0x7ff8000cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff8056df640 1 -- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000cef90 msgr2=0x7ff8000ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff8056df640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000cef90 0x7ff8000ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff8056df640 1 -- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80015d4f0 msgr2=0x7ff8000cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff8056df640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80015d4f0 0x7ff8000cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff8056df640 1 -- 172.21.15.50:0/2691191222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4009400 con 0x7ff8000b0af0 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff805ee0640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80015d4f0 0x7ff8000cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff8056df640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8000b0af0 0x7ff8000c7620 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c430 tx=0x7ff7f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff7fdffb640 1 -- 172.21.15.50:0/2691191222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80052d0 con 0x7ff8000b0af0 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff7fdffb640 1 -- 172.21.15.50:0/2691191222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8005450 con 0x7ff8000b0af0 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8000cceb0 con 0x7ff8000b0af0 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff7fdffb640 1 -- 172.21.15.50:0/2691191222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8003830 con 0x7ff8000b0af0 2023-12-08T08:20:39.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.616+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8000c6150 con 0x7ff8000b0af0 2023-12-08T08:20:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.617+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80006bdd0 con 0x7ff8000b0af0 2023-12-08T08:20:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.618+0000 7ff7fdffb640 1 -- 172.21.15.50:0/2691191222 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7f8003990 con 0x7ff8000b0af0 2023-12-08T08:20:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.618+0000 7ff7fdffb640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7ec06ae70 0x7ff7ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.618+0000 7ff7fdffb640 1 -- 172.21.15.50:0/2691191222 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff7f8088c70 con 0x7ff8000b0af0 2023-12-08T08:20:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.618+0000 7ff804ede640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7ec06ae70 0x7ff7ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.619+0000 7ff804ede640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7ec06ae70 0x7ff7ec06d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4036000 tx=0x7ff7f403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.624 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.622+0000 7ff7fdffb640 1 -- 172.21.15.50:0/2691191222 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7f8053c70 con 0x7ff8000b0af0 2023-12-08T08:20:39.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.797+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff800067410 con 0x7ff8000b0af0 2023-12-08T08:20:39.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.797+0000 7ff7fdffb640 1 -- 172.21.15.50:0/2691191222 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7f80170a0 con 0x7ff8000b0af0 2023-12-08T08:20:39.802 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7ec06ae70 msgr2=0x7ff7ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7ec06ae70 0x7ff7ec06d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4036000 tx=0x7ff7f403c040 comp rx=0 tx=0).stop 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8000b0af0 msgr2=0x7ff8000c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8000b0af0 0x7ff8000c7620 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c430 tx=0x7ff7f800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 shutdown_connections 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff7ec06ae70 0x7ff7ec06d330 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff80015d4f0 0x7ff8000cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff8000cef90 0x7ff8000ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 --2- 172.21.15.50:0/2691191222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8000b0af0 0x7ff8000c7620 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 >> 172.21.15.50:0/2691191222 conn(0x7ff8000d0e00 msgr2=0x7ff8000af410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 shutdown_connections 2023-12-08T08:20:39.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.799+0000 7ff807943640 1 -- 172.21.15.50:0/2691191222 wait complete. 2023-12-08T08:20:39.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.918+0000 7fb6e7ae0640 1 Processor -- start 2023-12-08T08:20:39.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.919+0000 7fb6e7ae0640 1 -- start start 2023-12-08T08:20:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.919+0000 7fb6e7ae0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00b4150 0x7fb6e00b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.919+0000 7fb6e7ae0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00c6be0 con 0x7fb6e00cfe10 2023-12-08T08:20:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.919+0000 7fb6e7ae0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00d3ff0 con 0x7fb6e00cfa30 2023-12-08T08:20:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.919+0000 7fb6e7ae0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00b4860 con 0x7fb6e00b4150 2023-12-08T08:20:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e607d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb6e00cfe10 0x7fb6e00cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38122/0 (socket says 172.21.15.50:38122) 2023-12-08T08:20:39.922 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e607d640 1 -- 172.21.15.50:0/2384654646 learned_addr learned my addr 172.21.15.50:0/2384654646 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e507b640 1 --2- 172.21.15.50:0/2384654646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00b4150 0x7fb6e00b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e487a640 1 -- 172.21.15.50:0/2384654646 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847332544 0 0) 0x7fb6e00c6be0 con 0x7fb6e00cfe10 2023-12-08T08:20:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e487a640 1 -- 172.21.15.50:0/2384654646 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6cc003520 con 0x7fb6e00cfe10 2023-12-08T08:20:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e507b640 1 -- 172.21.15.50:0/2384654646 >> v1:172.21.15.170:6789/0 conn(0x7fb6e00cfa30 legacy=0x7fb6e00b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e507b640 1 -- 172.21.15.50:0/2384654646 >> v1:172.21.15.50:6789/0 conn(0x7fb6e00cfe10 legacy=0x7fb6e00cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e487a640 1 -- 172.21.15.50:0/2384654646 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948907948 0 0) 0x7fb6e00d3ff0 con 0x7fb6e00cfa30 2023-12-08T08:20:39.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.920+0000 7fb6e507b640 1 -- 172.21.15.50:0/2384654646 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e00d3d50 con 0x7fb6e00b4150 2023-12-08T08:20:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.921+0000 7fb6e507b640 1 --2- 172.21.15.50:0/2384654646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00b4150 0x7fb6e00b3630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097d0 tx=0x7fb6d002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c498cde507fab7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.921+0000 7fb6e487a640 1 -- 172.21.15.50:0/2384654646 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0031800 con 0x7fb6e00b4150 2023-12-08T08:20:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.921+0000 7fb6e487a640 1 -- 172.21.15.50:0/2384654646 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d0031960 con 0x7fb6e00b4150 2023-12-08T08:20:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.921+0000 7fb6e487a640 1 -- 172.21.15.50:0/2384654646 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0031cd0 con 0x7fb6e00b4150 2023-12-08T08:20:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.922+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/2384654646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00b4150 msgr2=0x7fb6e00b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.922+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/2384654646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00b4150 0x7fb6e00b3630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097d0 tx=0x7fb6d002b8a0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.922+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/2384654646 shutdown_connections 2023-12-08T08:20:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.922+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/2384654646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00b4150 0x7fb6e00b3630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.922+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/2384654646 >> 172.21.15.50:0/2384654646 conn(0x7fb6e00d3090 msgr2=0x7fb6e00d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.922+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/2384654646 shutdown_connections 2023-12-08T08:20:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.922+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/2384654646 wait complete. 2023-12-08T08:20:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.923+0000 7fb6e7ae0640 1 Processor -- start 2023-12-08T08:20:39.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.923+0000 7fb6e7ae0640 1 -- start start 2023-12-08T08:20:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e7ae0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e00b4150 0x7fb6e00ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e7ae0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00cfa30 0x7fb6e00cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e7ae0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e00cfe10 0x7fb6e01e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e7ae0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00cb5a0 con 0x7fb6e00b4150 2023-12-08T08:20:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e7ae0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00ca6a0 con 0x7fb6e00cfe10 2023-12-08T08:20:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e7ae0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00ca920 con 0x7fb6e00cfa30 2023-12-08T08:20:39.927 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e00b4150 0x7fb6e00ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e00b4150 0x7fb6e00ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51146/0 (socket says 172.21.15.50:51146) 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 -- 172.21.15.50:0/1676396767 learned_addr learned my addr 172.21.15.50:0/1676396767 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e507b640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00cfa30 0x7fb6e00cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e607d640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e00cfe10 0x7fb6e01e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 -- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00cfa30 msgr2=0x7fb6e00cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00cfa30 0x7fb6e00cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 -- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e00cfe10 msgr2=0x7fb6e01e30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e00cfe10 0x7fb6e01e30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 -- 172.21.15.50:0/1676396767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009400 con 0x7fb6e00b4150 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6e587c640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e00b4150 0x7fb6e00ca160 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c4b0 tx=0x7fb6dc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6d67fc640 1 -- 172.21.15.50:0/1676396767 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc005480 con 0x7fb6e00b4150 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.924+0000 7fb6d67fc640 1 -- 172.21.15.50:0/1676396767 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc0035f0 con 0x7fb6e00b4150 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.925+0000 7fb6d67fc640 1 -- 172.21.15.50:0/1676396767 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc0039a0 con 0x7fb6e00b4150 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.925+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e00cac00 con 0x7fb6e00b4150 2023-12-08T08:20:39.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.925+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e00cb1c0 con 0x7fb6e00b4150 2023-12-08T08:20:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.926+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e0067430 con 0x7fb6e00b4150 2023-12-08T08:20:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.926+0000 7fb6d67fc640 1 -- 172.21.15.50:0/1676396767 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6dc003b00 con 0x7fb6e00b4150 2023-12-08T08:20:39.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.927+0000 7fb6d67fc640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6c406ae40 0x7fb6c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.927+0000 7fb6d67fc640 1 -- 172.21.15.50:0/1676396767 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb6dc088bd0 con 0x7fb6e00b4150 2023-12-08T08:20:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.927+0000 7fb6e507b640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6c406ae40 0x7fb6c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:39.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.927+0000 7fb6e507b640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6c406ae40 0x7fb6c406d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0036000 tx=0x7fb6d003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:39.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:39.931+0000 7fb6d67fc640 1 -- 172.21.15.50:0/1676396767 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6dc053c80 con 0x7fb6e00b4150 2023-12-08T08:20:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.109+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6e00743e0 con 0x7fb6e00b4150 2023-12-08T08:20:40.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.109+0000 7fb6d67fc640 1 -- 172.21.15.50:0/1676396767 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6dc017020 con 0x7fb6e00b4150 2023-12-08T08:20:40.112 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6c406ae40 msgr2=0x7fb6c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6c406ae40 0x7fb6c406d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0036000 tx=0x7fb6d003c040 comp rx=0 tx=0).stop 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e00b4150 msgr2=0x7fb6e00ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e00b4150 0x7fb6e00ca160 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c4b0 tx=0x7fb6dc00c970 comp rx=0 tx=0).stop 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 shutdown_connections 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb6c406ae40 0x7fb6c406d300 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6e00cfe10 0x7fb6e01e30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6e00cfa30 0x7fb6e00cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 --2- 172.21.15.50:0/1676396767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e00b4150 0x7fb6e00ca160 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 >> 172.21.15.50:0/1676396767 conn(0x7fb6e00d3090 msgr2=0x7fb6e01e43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 shutdown_connections 2023-12-08T08:20:40.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.111+0000 7fb6e7ae0640 1 -- 172.21.15.50:0/1676396767 wait complete. 2023-12-08T08:20:40.124 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:40.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.231+0000 7f133e1be640 1 Processor -- start 2023-12-08T08:20:40.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.231+0000 7f133e1be640 1 -- start start 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f133e1be640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f133806c7c0 0x7f13380cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f133e1be640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1338162b00 0x7f1338164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f133e1be640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13380705b0 con 0x7f13380c9660 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f133e1be640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133815b480 con 0x7f1338162b00 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f133e1be640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13380ac6f0 con 0x7f133806c7c0 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f1337fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1338162b00 0x7f1338164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f1337fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1338162b00 0x7f1338164ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51156/0 (socket says 172.21.15.50:51156) 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f1337fff640 1 -- 172.21.15.50:0/2301714927 learned_addr learned my addr 172.21.15.50:0/2301714927 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.232+0000 7f13377fe640 1 --2- 172.21.15.50:0/2301714927 >> v2:172.21.15.170:3300/0 conn(0x7f133806c7c0 0x7f13380cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f1337fff640 1 -- 172.21.15.50:0/2301714927 >> v2:172.21.15.170:3300/0 conn(0x7f133806c7c0 msgr2=0x7f13380cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f1337fff640 1 --2- 172.21.15.50:0/2301714927 >> v2:172.21.15.170:3300/0 conn(0x7f133806c7c0 0x7f13380cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f1337fff640 1 -- 172.21.15.50:0/2301714927 >> v1:172.21.15.50:6789/0 conn(0x7f13380c9660 legacy=0x7f133806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f1337fff640 1 -- 172.21.15.50:0/2301714927 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380cb680 con 0x7f1338162b00 2023-12-08T08:20:40.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f13377fe640 1 --2- 172.21.15.50:0/2301714927 >> v2:172.21.15.170:3300/0 conn(0x7f133806c7c0 0x7f13380cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:40.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f1337fff640 1 --2- 172.21.15.50:0/2301714927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1338162b00 0x7f1338164ef0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f13380ccb30 tx=0x7f133002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a972c752b7367ce server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f13367fc640 1 -- 172.21.15.50:0/2301714927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133002cb20 con 0x7f1338162b00 2023-12-08T08:20:40.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f13367fc640 1 -- 172.21.15.50:0/2301714927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133002cc80 con 0x7f1338162b00 2023-12-08T08:20:40.237 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.233+0000 7f13367fc640 1 -- 172.21.15.50:0/2301714927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300343f0 con 0x7f1338162b00 2023-12-08T08:20:40.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 -- 172.21.15.50:0/2301714927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1338162b00 msgr2=0x7f1338164ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 --2- 172.21.15.50:0/2301714927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1338162b00 0x7f1338164ef0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f13380ccb30 tx=0x7f133002bf80 comp rx=0 tx=0).stop 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 -- 172.21.15.50:0/2301714927 shutdown_connections 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 --2- 172.21.15.50:0/2301714927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1338162b00 0x7f1338164ef0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 --2- 172.21.15.50:0/2301714927 >> v2:172.21.15.170:3300/0 conn(0x7f133806c7c0 0x7f13380cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 -- 172.21.15.50:0/2301714927 >> 172.21.15.50:0/2301714927 conn(0x7f13380cf010 msgr2=0x7f13380cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 -- 172.21.15.50:0/2301714927 shutdown_connections 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.234+0000 7f133e1be640 1 -- 172.21.15.50:0/2301714927 wait complete. 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.235+0000 7f133e1be640 1 Processor -- start 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.235+0000 7f133e1be640 1 -- start start 2023-12-08T08:20:40.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f133e1be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133806c7c0 0x7f133815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f133e1be640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13380c9660 0x7f13381575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f133e1be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1338162b00 0x7f13380b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f133e1be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13380c4950 con 0x7f133806c7c0 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f133e1be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338157b10 con 0x7f1338162b00 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f133e1be640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1338158490 con 0x7f13380c9660 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f13377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133806c7c0 0x7f133815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f13377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133806c7c0 0x7f133815f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51170/0 (socket says 172.21.15.50:51170) 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f13377fe640 1 -- 172.21.15.50:0/1086072117 learned_addr learned my addr 172.21.15.50:0/1086072117 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f13377fe640 1 -- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13380c9660 msgr2=0x7f13381575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f1337fff640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1338162b00 0x7f13380b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.236+0000 7f1336ffd640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13380c9660 0x7f13381575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f13377fe640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13380c9660 0x7f13381575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f13377fe640 1 -- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1338162b00 msgr2=0x7f13380b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f13377fe640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1338162b00 0x7f13380b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f13377fe640 1 -- 172.21.15.50:0/1086072117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009b30 con 0x7f133806c7c0 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f1336ffd640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13380c9660 0x7f13381575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f1337fff640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1338162b00 0x7f13380b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f13377fe640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133806c7c0 0x7f133815f9d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f132800c7f0 tx=0x7f132800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f131ffff640 1 -- 172.21.15.50:0/1086072117 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328007820 con 0x7f133806c7c0 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f131ffff640 1 -- 172.21.15.50:0/1086072117 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1328007980 con 0x7f133806c7c0 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13380c4390 con 0x7f133806c7c0 2023-12-08T08:20:40.243 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f131ffff640 1 -- 172.21.15.50:0/1086072117 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328007cf0 con 0x7f133806c7c0 2023-12-08T08:20:40.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.237+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13380c72d0 con 0x7f133806c7c0 2023-12-08T08:20:40.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.238+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13380c7130 con 0x7f133806c7c0 2023-12-08T08:20:40.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.238+0000 7f131ffff640 1 -- 172.21.15.50:0/1086072117 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13280113f0 con 0x7f133806c7c0 2023-12-08T08:20:40.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.239+0000 7f131ffff640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f132406ae40 0x7f132406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.239+0000 7f131ffff640 1 -- 172.21.15.50:0/1086072117 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1328089820 con 0x7f133806c7c0 2023-12-08T08:20:40.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.239+0000 7f1336ffd640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f132406ae40 0x7f132406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.240+0000 7f1336ffd640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f132406ae40 0x7f132406d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f133815ff10 tx=0x7f132c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.243+0000 7f131ffff640 1 -- 172.21.15.50:0/1086072117 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13380c7130 con 0x7f133806c7c0 2023-12-08T08:20:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.419+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13380c7130 con 0x7f133806c7c0 2023-12-08T08:20:40.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.420+0000 7f131ffff640 1 -- 172.21.15.50:0/1086072117 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13380c7130 con 0x7f133806c7c0 2023-12-08T08:20:40.422 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:40.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f132406ae40 msgr2=0x7f132406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.424 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f132406ae40 0x7f132406d300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f133815ff10 tx=0x7f132c009040 comp rx=0 tx=0).stop 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133806c7c0 msgr2=0x7f133815f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133806c7c0 0x7f133815f9d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f132800c7f0 tx=0x7f132800ccb0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 shutdown_connections 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f132406ae40 0x7f132406d300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1338162b00 0x7f13380b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13380c9660 0x7f13381575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 --2- 172.21.15.50:0/1086072117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f133806c7c0 0x7f133815f9d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 >> 172.21.15.50:0/1086072117 conn(0x7f13380cf010 msgr2=0x7f13380ade90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 shutdown_connections 2023-12-08T08:20:40.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.422+0000 7f133e1be640 1 -- 172.21.15.50:0/1086072117 wait complete. 2023-12-08T08:20:40.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:40.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.540+0000 7fbc8fa2b640 1 Processor -- start 2023-12-08T08:20:40.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.540+0000 7fbc8fa2b640 1 -- start start 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8fa2b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc880d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8fa2b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc880b1d70 0x7fbc880d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8fa2b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc880d20b0 con 0x7fbc880afce0 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8fa2b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc880d0620 con 0x7fbc880b1d70 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8fa2b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880d1dd0 con 0x7fbc881608a0 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8cfc6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fbc880b1d70 0x7fbc880d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8dfc8640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fbc880afce0 0x7fbc880b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38130/0 (socket says 172.21.15.50:38130) 2023-12-08T08:20:40.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.541+0000 7fbc8dfc8640 1 -- 172.21.15.50:0/2187251004 learned_addr learned my addr 172.21.15.50:0/2187251004 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.542+0000 7fbc8d7c7640 1 --2- 172.21.15.50:0/2187251004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc880d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.542+0000 7fbc8cfc6640 1 -- 172.21.15.50:0/2187251004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 msgr2=0x7fbc880d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.542+0000 7fbc8cfc6640 1 --2- 172.21.15.50:0/2187251004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc880d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.542+0000 7fbc8cfc6640 1 -- 172.21.15.50:0/2187251004 >> v1:172.21.15.50:6789/0 conn(0x7fbc880afce0 legacy=0x7fbc880b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.542+0000 7fbc8cfc6640 1 -- 172.21.15.50:0/2187251004 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880cff60 con 0x7fbc880b1d70 2023-12-08T08:20:40.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.542+0000 7fbc87fff640 1 -- 172.21.15.50:0/2187251004 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659212361 0 0) 0x7fbc880d20b0 con 0x7fbc880afce0 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8cfc6640 1 --2- 172.21.15.50:0/2187251004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc880d1470 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0097a0 tx=0x7fbc7c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3590c2688f88f7f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc87fff640 1 -- 172.21.15.50:0/2187251004 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c02e070 con 0x7fbc880b1d70 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc87fff640 1 -- 172.21.15.50:0/2187251004 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0315a0 con 0x7fbc880b1d70 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc87fff640 1 -- 172.21.15.50:0/2187251004 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c031930 con 0x7fbc880b1d70 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2187251004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 msgr2=0x7fbc880d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2187251004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc880d1470 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0097a0 tx=0x7fbc7c02b840 comp rx=0 tx=0).stop 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2187251004 shutdown_connections 2023-12-08T08:20:40.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2187251004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc880d1470 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2187251004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc880d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2187251004 >> 172.21.15.50:0/2187251004 conn(0x7fbc880d3030 msgr2=0x7fbc880d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2187251004 shutdown_connections 2023-12-08T08:20:40.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.543+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2187251004 wait complete. 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.544+0000 7fbc8fa2b640 1 Processor -- start 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.544+0000 7fbc8fa2b640 1 -- start start 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8fa2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc880afce0 0x7fbc881f6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8fa2b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc881f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8fa2b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc881f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8fa2b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880cce10 con 0x7fbc880b1d70 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8fa2b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880ca6c0 con 0x7fbc880afce0 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8fa2b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880ca100 con 0x7fbc881608a0 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8cfc6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc881f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8cfc6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc881f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51194/0 (socket says 172.21.15.50:51194) 2023-12-08T08:20:40.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8cfc6640 1 -- 172.21.15.50:0/2574194735 learned_addr learned my addr 172.21.15.50:0/2574194735 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.545+0000 7fbc8dfc8640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc881f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8d7c7640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc880afce0 0x7fbc881f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8cfc6640 1 -- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 msgr2=0x7fbc881f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8cfc6640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc881f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8cfc6640 1 -- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc880afce0 msgr2=0x7fbc881f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8cfc6640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc880afce0 0x7fbc881f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8cfc6640 1 -- 172.21.15.50:0/2574194735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c009400 con 0x7fbc880b1d70 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8cfc6640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc881f67b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c034040 tx=0x7fbc7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc85ffb640 1 -- 172.21.15.50:0/2574194735 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c032900 con 0x7fbc880b1d70 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc85ffb640 1 -- 172.21.15.50:0/2574194735 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c032a80 con 0x7fbc880b1d70 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc880ca3e0 con 0x7fbc880b1d70 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc85ffb640 1 -- 172.21.15.50:0/2574194735 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c032e30 con 0x7fbc880b1d70 2023-12-08T08:20:40.550 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.546+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc880ccaa0 con 0x7fbc880b1d70 2023-12-08T08:20:40.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.547+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc880cc620 con 0x7fbc880b1d70 2023-12-08T08:20:40.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.548+0000 7fbc85ffb640 1 -- 172.21.15.50:0/2574194735 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc7c04e430 con 0x7fbc880b1d70 2023-12-08T08:20:40.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.548+0000 7fbc85ffb640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc7406ae40 0x7fbc7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.548+0000 7fbc85ffb640 1 -- 172.21.15.50:0/2574194735 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc7c0ab7e0 con 0x7fbc880b1d70 2023-12-08T08:20:40.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.548+0000 7fbc8d7c7640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc7406ae40 0x7fbc7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.549+0000 7fbc8d7c7640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc7406ae40 0x7fbc7406d300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbc800099c0 tx=0x7fbc80003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.552+0000 7fbc85ffb640 1 -- 172.21.15.50:0/2574194735 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc880cc620 con 0x7fbc880b1d70 2023-12-08T08:20:40.746 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.744+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc880cc620 con 0x7fbc880b1d70 2023-12-08T08:20:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.744+0000 7fbc85ffb640 1 -- 172.21.15.50:0/2574194735 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc880cc620 con 0x7fbc880b1d70 2023-12-08T08:20:40.747 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:20:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc7406ae40 msgr2=0x7fbc7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc7406ae40 0x7fbc7406d300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbc800099c0 tx=0x7fbc80003990 comp rx=0 tx=0).stop 2023-12-08T08:20:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 msgr2=0x7fbc881f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc881f67b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c034040 tx=0x7fbc7c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 shutdown_connections 2023-12-08T08:20:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fbc7406ae40 0x7fbc7406d300 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.749 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc880b1d70 0x7fbc881f67b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc881608a0 0x7fbc881f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 --2- 172.21.15.50:0/2574194735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc880afce0 0x7fbc881f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 >> 172.21.15.50:0/2574194735 conn(0x7fbc880d3030 msgr2=0x7fbc880d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 shutdown_connections 2023-12-08T08:20:40.750 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.747+0000 7fbc8fa2b640 1 -- 172.21.15.50:0/2574194735 wait complete. 2023-12-08T08:20:40.759 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:40.759 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:40.775 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:40.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.919+0000 7f87393fc640 1 Processor -- start 2023-12-08T08:20:40.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.919+0000 7f87393fc640 1 -- start start 2023-12-08T08:20:40.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87393fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f87340cd240 0x7f87340cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87393fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f873415f4e0 0x7f873415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87393fc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340cfb90 con 0x7f87340cf730 2023-12-08T08:20:40.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87393fc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340cd620 con 0x7f87340cd240 2023-12-08T08:20:40.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87393fc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873415c150 con 0x7f873415f4e0 2023-12-08T08:20:40.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87337fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f873415f4e0 0x7f873415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f8732ffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f87340cd240 0x7f87340cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f8732ffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f87340cd240 0x7f87340cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:60212/0 (socket says 172.21.15.50:60212) 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87337fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f873415f4e0 0x7f873415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:44224/0 (socket says 172.21.15.50:44224) 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f8732ffd640 1 -- 172.21.15.50:0/2599956502 learned_addr learned my addr 172.21.15.50:0/2599956502 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.920+0000 7f87327fc640 1 --1- 172.21.15.50:0/2599956502 >> v1:172.21.15.170:6789/0 conn(0x7f87340cf730 0x7f873415edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:41138/0 (socket says 172.21.15.50:41138) 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.921+0000 7f8732ffd640 1 -- 172.21.15.50:0/2599956502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f873415f4e0 msgr2=0x7f873415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.921+0000 7f8732ffd640 1 --2- 172.21.15.50:0/2599956502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f873415f4e0 0x7f873415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.921+0000 7f8732ffd640 1 -- 172.21.15.50:0/2599956502 >> v1:172.21.15.170:6789/0 conn(0x7f87340cf730 legacy=0x7f873415edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.921+0000 7f8732ffd640 1 -- 172.21.15.50:0/2599956502 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873415fb00 con 0x7f87340cd240 2023-12-08T08:20:40.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.921+0000 7f8732ffd640 1 --2- 172.21.15.50:0/2599956502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87340cd240 0x7f87340cf1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8724009870 tx=0x7f872402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90096e5e766af27 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f8731ffb640 1 -- 172.21.15.50:0/2599956502 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724030840 con 0x7f87340cd240 2023-12-08T08:20:40.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f8731ffb640 1 -- 172.21.15.50:0/2599956502 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87240309a0 con 0x7f87340cd240 2023-12-08T08:20:40.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f8731ffb640 1 -- 172.21.15.50:0/2599956502 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724030d30 con 0x7f87340cd240 2023-12-08T08:20:40.928 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 -- 172.21.15.50:0/2599956502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87340cd240 msgr2=0x7f87340cf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 --2- 172.21.15.50:0/2599956502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87340cd240 0x7f87340cf1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8724009870 tx=0x7f872402b980 comp rx=0 tx=0).stop 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 -- 172.21.15.50:0/2599956502 shutdown_connections 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 --2- 172.21.15.50:0/2599956502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f873415f4e0 0x7f873415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 --2- 172.21.15.50:0/2599956502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87340cd240 0x7f87340cf1f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 -- 172.21.15.50:0/2599956502 >> 172.21.15.50:0/2599956502 conn(0x7f8734099a10 msgr2=0x7f8734099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 -- 172.21.15.50:0/2599956502 shutdown_connections 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.922+0000 7f87393fc640 1 -- 172.21.15.50:0/2599956502 wait complete. 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.923+0000 7f87393fc640 1 Processor -- start 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.923+0000 7f87393fc640 1 -- start start 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f87393fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340cd240 0x7f873414ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.929 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f87393fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340cf730 0x7f87340b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f87393fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f873415f4e0 0x7f873406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f87393fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340b48a0 con 0x7f87340cd240 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f87393fc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341504b0 con 0x7f873415f4e0 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f87393fc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87340b3c90 con 0x7f87340cf730 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f8732ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340cd240 0x7f873414ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f8732ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340cd240 0x7f873414ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51202/0 (socket says 172.21.15.50:51202) 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.924+0000 7f8732ffd640 1 -- 172.21.15.50:0/3883309814 learned_addr learned my addr 172.21.15.50:0/3883309814 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f87327fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340cf730 0x7f87340b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f87337fe640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f873415f4e0 0x7f873406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f8732ffd640 1 -- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340cf730 msgr2=0x7f87340b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f8732ffd640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340cf730 0x7f87340b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f8732ffd640 1 -- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f873415f4e0 msgr2=0x7f873406f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:40.930 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f8732ffd640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f873415f4e0 0x7f873406f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f8732ffd640 1 -- 172.21.15.50:0/3883309814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240094d0 con 0x7f87340cd240 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f8732ffd640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340cd240 0x7f873414ff70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8724000c00 tx=0x7f8724004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f871b7fe640 1 -- 172.21.15.50:0/3883309814 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724039c90 con 0x7f87340cd240 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f871b7fe640 1 -- 172.21.15.50:0/3883309814 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724039df0 con 0x7f87340cd240 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340b3f70 con 0x7f87340cd240 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f871b7fe640 1 -- 172.21.15.50:0/3883309814 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724043640 con 0x7f87340cd240 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.925+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87340b4530 con 0x7f87340cd240 2023-12-08T08:20:40.931 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.926+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734067ad0 con 0x7f87340cd240 2023-12-08T08:20:40.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.927+0000 7f871b7fe640 1 -- 172.21.15.50:0/3883309814 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87240437a0 con 0x7f87340cd240 2023-12-08T08:20:40.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.927+0000 7f871b7fe640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f872006ae40 0x7f872006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:40.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.927+0000 7f871b7fe640 1 -- 172.21.15.50:0/3883309814 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f872403e070 con 0x7f87340cd240 2023-12-08T08:20:40.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.927+0000 7f87327fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f872006ae40 0x7f872006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:40.932 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.928+0000 7f87327fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f872006ae40 0x7f872006d300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f87341577b0 tx=0x7f8728007c80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:40.933 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:40.931+0000 7f871b7fe640 1 -- 172.21.15.50:0/3883309814 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8724077690 con 0x7f87340cd240 2023-12-08T08:20:41.112 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.110+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87340cedc0 con 0x7f87340cd240 2023-12-08T08:20:41.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.111+0000 7f871b7fe640 1 -- 172.21.15.50:0/3883309814 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7f872407acb0 con 0x7f87340cd240 2023-12-08T08:20:41.113 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:41.114 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:41.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f872006ae40 msgr2=0x7f872006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f872006ae40 0x7f872006d300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f87341577b0 tx=0x7f8728007c80 comp rx=0 tx=0).stop 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340cd240 msgr2=0x7f873414ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340cd240 0x7f873414ff70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8724000c00 tx=0x7f8724004730 comp rx=0 tx=0).stop 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 shutdown_connections 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f872006ae40 0x7f872006d300 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f873415f4e0 0x7f873406f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340cf730 0x7f87340b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 --2- 172.21.15.50:0/3883309814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87340cd240 0x7f873414ff70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 >> 172.21.15.50:0/3883309814 conn(0x7f8734099a10 msgr2=0x7f87340aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 shutdown_connections 2023-12-08T08:20:41.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.113+0000 7f87393fc640 1 -- 172.21.15.50:0/3883309814 wait complete. 2023-12-08T08:20:41.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:24.505729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:25.407648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:41.127 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.234+0000 7f8d7fb1d640 1 Processor -- start 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.234+0000 7f8d7fb1d640 1 -- start start 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7fb1d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d7815d4f0 0x7f8d780b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7fb1d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8d780b0920 0x7f8d780b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7fb1d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780b2280 con 0x7f8d780adb50 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7fb1d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7806bb40 con 0x7f8d7815d4f0 2023-12-08T08:20:41.240 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7fb1d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780b2710 con 0x7f8d780b0920 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7d8b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d7815d4f0 0x7f8d780b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7d8b9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8d7815d4f0 0x7f8d780b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51208/0 (socket says 172.21.15.50:51208) 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7d8b9640 1 -- 172.21.15.50:0/1734097164 learned_addr learned my addr 172.21.15.50:0/1734097164 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7d8b9640 1 -- 172.21.15.50:0/1734097164 >> v2:172.21.15.170:3300/0 conn(0x7f8d780b0920 msgr2=0x7f8d780b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7d8b9640 1 --2- 172.21.15.50:0/1734097164 >> v2:172.21.15.170:3300/0 conn(0x7f8d780b0920 0x7f8d780b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7d8b9640 1 -- 172.21.15.50:0/1734097164 >> v1:172.21.15.170:6789/0 conn(0x7f8d780adb50 legacy=0x7f8d780adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.235+0000 7f8d7d8b9640 1 -- 172.21.15.50:0/1734097164 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780b1690 con 0x7f8d7815d4f0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.236+0000 7f8d7d8b9640 1 --2- 172.21.15.50:0/1734097164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7815d4f0 0x7f8d780b03e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8d78071250 tx=0x7f8d7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0513cb5e98f1e99 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.236+0000 7f8d7c8b7640 1 -- 172.21.15.50:0/1734097164 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74031870 con 0x7f8d7815d4f0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.236+0000 7f8d7c8b7640 1 -- 172.21.15.50:0/1734097164 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d740319d0 con 0x7f8d7815d4f0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.236+0000 7f8d7c8b7640 1 -- 172.21.15.50:0/1734097164 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74031d60 con 0x7f8d7815d4f0 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.236+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1734097164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7815d4f0 msgr2=0x7f8d780b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.237+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1734097164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7815d4f0 0x7f8d780b03e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8d78071250 tx=0x7f8d7402b910 comp rx=0 tx=0).stop 2023-12-08T08:20:41.241 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.237+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1734097164 shutdown_connections 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.237+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1734097164 >> v2:172.21.15.170:3300/0 conn(0x7f8d780b0920 0x7f8d780b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.237+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1734097164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d7815d4f0 0x7f8d780b03e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.237+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1734097164 >> 172.21.15.50:0/1734097164 conn(0x7f8d780d0e00 msgr2=0x7f8d780d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.237+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1734097164 shutdown_connections 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.237+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1734097164 wait complete. 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.238+0000 7f8d7fb1d640 1 Processor -- start 2023-12-08T08:20:41.242 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.238+0000 7f8d7fb1d640 1 -- start start 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.238+0000 7f8d7fb1d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d780adb50 0x7f8d78159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7fb1d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d780b0920 0x7f8d780c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.244 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7fb1d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7815d4f0 0x7f8d7806f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7fb1d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780cd370 con 0x7f8d780b0920 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7fb1d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d780c8730 con 0x7f8d7815d4f0 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7fb1d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7809e960 con 0x7f8d780adb50 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d780b0920 0x7f8d780c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d780b0920 0x7f8d780c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51210/0 (socket says 172.21.15.50:51210) 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 -- 172.21.15.50:0/1740541368 learned_addr learned my addr 172.21.15.50:0/1740541368 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d8b9640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d780adb50 0x7f8d78159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7e0ba640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7815d4f0 0x7f8d7806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 -- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d780adb50 msgr2=0x7f8d78159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d780adb50 0x7f8d78159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 -- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7815d4f0 msgr2=0x7f8d7806f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7815d4f0 0x7f8d7806f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 -- 172.21.15.50:0/1740541368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d740094d0 con 0x7f8d780b0920 2023-12-08T08:20:41.245 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d8b9640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d780adb50 0x7f8d78159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7e0ba640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7815d4f0 0x7f8d7806f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7d0b8640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d780b0920 0x7f8d780c8b50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800b4a0 tx=0x7f8d6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d6e7fc640 1 -- 172.21.15.50:0/1740541368 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68010610 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d6e7fc640 1 -- 172.21.15.50:0/1740541368 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68010770 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d780cd090 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d6e7fc640 1 -- 172.21.15.50:0/1740541368 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68010b20 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.239+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d780c8350 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.240+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d780ce820 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.241+0000 7f8d6e7fc640 1 -- 172.21.15.50:0/1740541368 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d68010ca0 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.241+0000 7f8d6e7fc640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d5c06ae40 0x7f8d5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.241+0000 7f8d6e7fc640 1 -- 172.21.15.50:0/1740541368 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8d680893b0 con 0x7f8d780b0920 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.241+0000 7f8d7d8b9640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d5c06ae40 0x7f8d5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.246 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.242+0000 7f8d7d8b9640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d5c06ae40 0x7f8d5c06d300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d74036000 tx=0x7f8d7403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.247 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.245+0000 7f8d6e7fc640 1 -- 172.21.15.50:0/1740541368 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d68054310 con 0x7f8d780b0920 2023-12-08T08:20:41.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.420+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d780c8870 con 0x7f8d780b0920 2023-12-08T08:20:41.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.420+0000 7f8d6e7fc640 1 -- 172.21.15.50:0/1740541368 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d780c8870 con 0x7f8d780b0920 2023-12-08T08:20:41.423 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d5c06ae40 msgr2=0x7f8d5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d5c06ae40 0x7f8d5c06d300 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d74036000 tx=0x7f8d7403c040 comp rx=0 tx=0).stop 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d780b0920 msgr2=0x7f8d780c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d780b0920 0x7f8d780c8b50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800b4a0 tx=0x7f8d6800b960 comp rx=0 tx=0).stop 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 shutdown_connections 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8d5c06ae40 0x7f8d5c06d300 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8d780b0920 0x7f8d780c8b50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d7815d4f0 0x7f8d7806f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 --2- 172.21.15.50:0/1740541368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d780adb50 0x7f8d78159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 >> 172.21.15.50:0/1740541368 conn(0x7f8d780d0e00 msgr2=0x7f8d7806e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 shutdown_connections 2023-12-08T08:20:41.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.422+0000 7f8d7fb1d640 1 -- 172.21.15.50:0/1740541368 wait complete. 2023-12-08T08:20:41.435 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:41.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.542+0000 7ff524ba9640 1 Processor -- start 2023-12-08T08:20:41.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.542+0000 7ff524ba9640 1 -- start start 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.543+0000 7ff524ba9640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff52006a4d0 0x7ff52006a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.543+0000 7ff524ba9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52006ae60 con 0x7ff5200b4920 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.543+0000 7ff524ba9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5200721f0 con 0x7ff520145d80 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.543+0000 7ff524ba9640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5200b4e00 con 0x7ff52006a4d0 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.543+0000 7ff51ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff52006a4d0 0x7ff52006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.543+0000 7ff51dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff5200b4920 0x7ff5200acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38132/0 (socket says 172.21.15.50:38132) 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.543+0000 7ff51dd9b640 1 -- 172.21.15.50:0/1200312358 learned_addr learned my addr 172.21.15.50:0/1200312358 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.544+0000 7ff51ed9d640 1 -- 172.21.15.50:0/1200312358 >> v1:172.21.15.170:6789/0 conn(0x7ff520145d80 legacy=0x7ff520071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.544+0000 7ff51ed9d640 1 -- 172.21.15.50:0/1200312358 >> v1:172.21.15.50:6789/0 conn(0x7ff5200b4920 legacy=0x7ff5200acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.544+0000 7ff51ed9d640 1 -- 172.21.15.50:0/1200312358 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200b50e0 con 0x7ff52006a4d0 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.544+0000 7ff51ed9d640 1 --2- 172.21.15.50:0/1200312358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52006a4d0 0x7ff52006a920 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff510009d90 tx=0x7ff51002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a4e80cb06bec9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff51d59a640 1 -- 172.21.15.50:0/1200312358 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51002cc60 con 0x7ff52006a4d0 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff51d59a640 1 -- 172.21.15.50:0/1200312358 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51002cdc0 con 0x7ff52006a4d0 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff51d59a640 1 -- 172.21.15.50:0/1200312358 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510034660 con 0x7ff52006a4d0 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff524ba9640 1 -- 172.21.15.50:0/1200312358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52006a4d0 msgr2=0x7ff52006a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff524ba9640 1 --2- 172.21.15.50:0/1200312358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52006a4d0 0x7ff52006a920 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff510009d90 tx=0x7ff51002beb0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff524ba9640 1 -- 172.21.15.50:0/1200312358 shutdown_connections 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff524ba9640 1 --2- 172.21.15.50:0/1200312358 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff52006a4d0 0x7ff52006a920 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff524ba9640 1 -- 172.21.15.50:0/1200312358 >> 172.21.15.50:0/1200312358 conn(0x7ff52006b7c0 msgr2=0x7ff52006bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff524ba9640 1 -- 172.21.15.50:0/1200312358 shutdown_connections 2023-12-08T08:20:41.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.545+0000 7ff524ba9640 1 -- 172.21.15.50:0/1200312358 wait complete. 2023-12-08T08:20:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.546+0000 7ff524ba9640 1 Processor -- start 2023-12-08T08:20:41.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff524ba9640 1 -- start start 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff524ba9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff52006a4d0 0x7ff52014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff524ba9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5200b4920 0x7ff5200acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff524ba9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff520145d80 0x7ff5200ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff524ba9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5201506c0 con 0x7ff5200b4920 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff524ba9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52014d820 con 0x7ff520145d80 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff524ba9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52014db00 con 0x7ff52006a4d0 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff51dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5200b4920 0x7ff5200acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff51dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5200b4920 0x7ff5200acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51220/0 (socket says 172.21.15.50:51220) 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.547+0000 7ff51dd9b640 1 -- 172.21.15.50:0/2578745986 learned_addr learned my addr 172.21.15.50:0/2578745986 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51e59c640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff52006a4d0 0x7ff52014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51ed9d640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff520145d80 0x7ff5200ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51dd9b640 1 -- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff52006a4d0 msgr2=0x7ff52014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51dd9b640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff52006a4d0 0x7ff52014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51dd9b640 1 -- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff520145d80 msgr2=0x7ff5200ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51dd9b640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff520145d80 0x7ff5200ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51dd9b640 1 -- 172.21.15.50:0/2578745986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510009a70 con 0x7ff5200b4920 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff51dd9b640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5200b4920 0x7ff5200acd50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c500 tx=0x7ff50800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff516ffd640 1 -- 172.21.15.50:0/2578745986 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508005ce0 con 0x7ff5200b4920 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff516ffd640 1 -- 172.21.15.50:0/2578745986 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508005e40 con 0x7ff5200b4920 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff516ffd640 1 -- 172.21.15.50:0/2578745986 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080072f0 con 0x7ff5200b4920 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52014dde0 con 0x7ff5200b4920 2023-12-08T08:20:41.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.548+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52014e3a0 con 0x7ff5200b4920 2023-12-08T08:20:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.549+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff520071460 con 0x7ff5200b4920 2023-12-08T08:20:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.550+0000 7ff516ffd640 1 -- 172.21.15.50:0/2578745986 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff508007510 con 0x7ff5200b4920 2023-12-08T08:20:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.550+0000 7ff516ffd640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.550+0000 7ff516ffd640 1 -- 172.21.15.50:0/2578745986 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff5080889b0 con 0x7ff5200b4920 2023-12-08T08:20:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.550+0000 7ff51e59c640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.551+0000 7ff51e59c640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff50006ae40 0x7ff50006d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff518006fd0 tx=0x7ff518008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.554+0000 7ff516ffd640 1 -- 172.21.15.50:0/2578745986 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff508053a60 con 0x7ff5200b4920 2023-12-08T08:20:41.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.728+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff52006ae60 con 0x7ff5200b4920 2023-12-08T08:20:41.731 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.729+0000 7ff516ffd640 1 -- 172.21.15.50:0/2578745986 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff52006ae60 con 0x7ff5200b4920 2023-12-08T08:20:41.731 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff50006ae40 msgr2=0x7ff50006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff50006ae40 0x7ff50006d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff518006fd0 tx=0x7ff518008040 comp rx=0 tx=0).stop 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5200b4920 msgr2=0x7ff5200acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5200b4920 0x7ff5200acd50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff50800c500 tx=0x7ff50800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 shutdown_connections 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5200b4920 0x7ff5200acd50 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.733 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff520145d80 0x7ff5200ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 --2- 172.21.15.50:0/2578745986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff52006a4d0 0x7ff52014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 >> 172.21.15.50:0/2578745986 conn(0x7ff52006b7c0 msgr2=0x7ff52006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.730+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 shutdown_connections 2023-12-08T08:20:41.734 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.731+0000 7ff524ba9640 1 -- 172.21.15.50:0/2578745986 wait complete. 2023-12-08T08:20:41.743 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.850+0000 7f1e95f78640 1 Processor -- start 2023-12-08T08:20:41.853 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e95f78640 1 -- start start 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e95f78640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e9015d4f0 0x7f1e900b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e95f78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e95f78640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e900b2280 con 0x7f1e900adb50 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e95f78640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9006bb40 con 0x7f1e9015d4f0 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e95f78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900b2710 con 0x7f1e900b0920 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e8f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e9015d4f0 0x7f1e900b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e8f7fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1e9015d4f0 0x7f1e900b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51234/0 (socket says 172.21.15.50:51234) 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.851+0000 7f1e8ffff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1e900adb50 0x7f1e900adfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38138/0 (socket says 172.21.15.50:38138) 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.852+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/2946022623 learned_addr learned my addr 172.21.15.50:0/2946022623 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:41.855 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.852+0000 7f1e8effd640 1 --2- 172.21.15.50:0/2946022623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.852+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/2946022623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 msgr2=0x7f1e900b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.852+0000 7f1e8f7fe640 1 --2- 172.21.15.50:0/2946022623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.852+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/2946022623 >> v1:172.21.15.50:6789/0 conn(0x7f1e900adb50 legacy=0x7f1e900adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.852+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/2946022623 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e900b1690 con 0x7f1e9015d4f0 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.852+0000 7f1e8effd640 1 --2- 172.21.15.50:0/2946022623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e8f7fe640 1 --2- 172.21.15.50:0/2946022623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9015d4f0 0x7f1e900b03e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009870 tx=0x7f1e8002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace41f52b5fbc8e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e8e7fc640 1 -- 172.21.15.50:0/2946022623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80030840 con 0x7f1e9015d4f0 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e8e7fc640 1 -- 172.21.15.50:0/2946022623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e800309a0 con 0x7f1e9015d4f0 2023-12-08T08:20:41.856 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e8e7fc640 1 -- 172.21.15.50:0/2946022623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80030d30 con 0x7f1e9015d4f0 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 -- 172.21.15.50:0/2946022623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9015d4f0 msgr2=0x7f1e900b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 --2- 172.21.15.50:0/2946022623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9015d4f0 0x7f1e900b03e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009870 tx=0x7f1e8002b980 comp rx=0 tx=0).stop 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 -- 172.21.15.50:0/2946022623 shutdown_connections 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 --2- 172.21.15.50:0/2946022623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 --2- 172.21.15.50:0/2946022623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e9015d4f0 0x7f1e900b03e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 -- 172.21.15.50:0/2946022623 >> 172.21.15.50:0/2946022623 conn(0x7f1e900d0e00 msgr2=0x7f1e900d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 -- 172.21.15.50:0/2946022623 shutdown_connections 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.853+0000 7f1e95f78640 1 -- 172.21.15.50:0/2946022623 wait complete. 2023-12-08T08:20:41.859 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.854+0000 7f1e95f78640 1 Processor -- start 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.855+0000 7f1e95f78640 1 -- start start 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.855+0000 7f1e95f78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e900adb50 0x7f1e901512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.855+0000 7f1e95f78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.855+0000 7f1e95f78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e9015d4f0 0x7f1e900ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.855+0000 7f1e95f78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e901517e0 con 0x7f1e900adb50 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.855+0000 7f1e95f78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900c8d50 con 0x7f1e9015d4f0 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.855+0000 7f1e95f78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900c9030 con 0x7f1e900b0920 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e900adb50 0x7f1e901512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e900adb50 0x7f1e901512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51240/0 (socket says 172.21.15.50:51240) 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/1577458311 learned_addr learned my addr 172.21.15.50:0/1577458311 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 msgr2=0x7f1e900c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8effd640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.860 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e9015d4f0 msgr2=0x7f1e900ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8ffff640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e9015d4f0 0x7f1e900ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e9015d4f0 0x7f1e900ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 -- 172.21.15.50:0/1577458311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800094d0 con 0x7f1e900adb50 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e8f7fe640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e900adb50 0x7f1e901512a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009870 tx=0x7f1e80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e77fff640 1 -- 172.21.15.50:0/1577458311 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800307f0 con 0x7f1e900adb50 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e77fff640 1 -- 172.21.15.50:0/1577458311 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80043400 con 0x7f1e900adb50 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e77fff640 1 -- 172.21.15.50:0/1577458311 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800437b0 con 0x7f1e900adb50 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e900c9310 con 0x7f1e900adb50 2023-12-08T08:20:41.861 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.856+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e900c98d0 con 0x7f1e900adb50 2023-12-08T08:20:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.857+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e90067430 con 0x7f1e900adb50 2023-12-08T08:20:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.858+0000 7f1e77fff640 1 -- 172.21.15.50:0/1577458311 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e80043910 con 0x7f1e900adb50 2023-12-08T08:20:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.858+0000 7f1e77fff640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1e7c06ae40 0x7f1e7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.858+0000 7f1e77fff640 1 -- 172.21.15.50:0/1577458311 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e8003e070 con 0x7f1e900adb50 2023-12-08T08:20:41.862 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.858+0000 7f1e8effd640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1e7c06ae40 0x7f1e7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:41.863 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.859+0000 7f1e8effd640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1e7c06ae40 0x7f1e7c06d300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1e900c7e40 tx=0x7f1e84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:41.864 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:41.862+0000 7f1e77fff640 1 -- 172.21.15.50:0/1577458311 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e80077a80 con 0x7f1e900adb50 2023-12-08T08:20:42.041 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.039+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e900ae7c0 con 0x7f1e900adb50 2023-12-08T08:20:42.042 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.039+0000 7f1e77fff640 1 -- 172.21.15.50:0/1577458311 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e800ac0a0 con 0x7f1e900adb50 2023-12-08T08:20:42.042 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:42.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1e7c06ae40 msgr2=0x7f1e7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1e7c06ae40 0x7f1e7c06d300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1e900c7e40 tx=0x7f1e84008040 comp rx=0 tx=0).stop 2023-12-08T08:20:42.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e900adb50 msgr2=0x7f1e901512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e900adb50 0x7f1e901512a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009870 tx=0x7f1e80004730 comp rx=0 tx=0).stop 2023-12-08T08:20:42.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 shutdown_connections 2023-12-08T08:20:42.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1e7c06ae40 0x7f1e7c06d300 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e9015d4f0 0x7f1e900ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e900b0920 0x7f1e900c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 --2- 172.21.15.50:0/1577458311 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1e900adb50 0x7f1e901512a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.041+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 >> 172.21.15.50:0/1577458311 conn(0x7f1e900d0e00 msgr2=0x7f1e900d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.042+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 shutdown_connections 2023-12-08T08:20:42.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.042+0000 7f1e95f78640 1 -- 172.21.15.50:0/1577458311 wait complete. 2023-12-08T08:20:42.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:42.162 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.160+0000 7f28d52e0640 1 Processor -- start 2023-12-08T08:20:42.163 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.160+0000 7f28d52e0640 1 -- start start 2023-12-08T08:20:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28d52e0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d01608a0 0x7f28d00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28d52e0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f28d00b1d70 0x7f28d00d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28d52e0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d00d20b0 con 0x7f28d00afce0 2023-12-08T08:20:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28d52e0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d00d0620 con 0x7f28d00b1d70 2023-12-08T08:20:42.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28d52e0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00d1dd0 con 0x7f28d01608a0 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28cf7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28d00afce0 0x7f28d00b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38144/0 (socket says 172.21.15.50:38144) 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28cf7fe640 1 -- 172.21.15.50:0/4195609081 learned_addr learned my addr 172.21.15.50:0/4195609081 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28ceffd640 1 --2- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d01608a0 0x7f28d00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28ce7fc640 1 --2- 172.21.15.50:0/4195609081 >> v2:172.21.15.170:3300/0 conn(0x7f28d00b1d70 0x7f28d00d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.161+0000 7f28cdffb640 1 -- 172.21.15.50:0/4195609081 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011491764 0 0) 0x7f28d00d20b0 con 0x7f28d00afce0 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.162+0000 7f28cdffb640 1 -- 172.21.15.50:0/4195609081 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28bc003520 con 0x7f28d00afce0 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.162+0000 7f28ce7fc640 1 -- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d01608a0 msgr2=0x7f28d00d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.162+0000 7f28ce7fc640 1 --2- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d01608a0 0x7f28d00d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.162+0000 7f28cdffb640 1 -- 172.21.15.50:0/4195609081 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736788887 0 0) 0x7f28bc003520 con 0x7f28d00afce0 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.162+0000 7f28ce7fc640 1 -- 172.21.15.50:0/4195609081 >> v1:172.21.15.50:6789/0 conn(0x7f28d00afce0 legacy=0x7f28d00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.162+0000 7f28ce7fc640 1 -- 172.21.15.50:0/4195609081 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00cff60 con 0x7f28d00b1d70 2023-12-08T08:20:42.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.162+0000 7f28ceffd640 1 --2- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d01608a0 0x7f28d00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28ce7fc640 1 --2- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d00b1d70 0x7f28d00d1470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f28b80097a0 tx=0x7f28b802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64db26744c08293a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.166 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28cdffb640 1 -- 172.21.15.50:0/4195609081 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00019f0 con 0x7f28d00b1d70 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28cdffb640 1 -- 172.21.15.50:0/4195609081 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b802e050 con 0x7f28d00b1d70 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28cdffb640 1 -- 172.21.15.50:0/4195609081 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8030710 con 0x7f28d00b1d70 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 -- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d00b1d70 msgr2=0x7f28d00d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 --2- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d00b1d70 0x7f28d00d1470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f28b80097a0 tx=0x7f28b802b710 comp rx=0 tx=0).stop 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 -- 172.21.15.50:0/4195609081 shutdown_connections 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 --2- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d00b1d70 0x7f28d00d1470 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 --2- 172.21.15.50:0/4195609081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d01608a0 0x7f28d00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 -- 172.21.15.50:0/4195609081 >> 172.21.15.50:0/4195609081 conn(0x7f28d00d3030 msgr2=0x7f28d00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 -- 172.21.15.50:0/4195609081 shutdown_connections 2023-12-08T08:20:42.167 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.163+0000 7f28d52e0640 1 -- 172.21.15.50:0/4195609081 wait complete. 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 Processor -- start 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 -- start start 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d00afce0 0x7f28d00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d00b1d70 0x7f28d01f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d01608a0 0x7f28d014f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d014cf40 con 0x7f28d00afce0 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00c7c00 con 0x7f28d01608a0 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.165+0000 7f28d52e0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d00b6190 con 0x7f28d00b1d70 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d00afce0 0x7f28d00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.169 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d00afce0 0x7f28d00b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51246/0 (socket says 172.21.15.50:51246) 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 -- 172.21.15.50:0/2403748100 learned_addr learned my addr 172.21.15.50:0/2403748100 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 -- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d00b1d70 msgr2=0x7f28d01f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d00b1d70 0x7f28d01f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 -- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d01608a0 msgr2=0x7f28d014f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28cf7fe640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d01608a0 0x7f28d014f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d01608a0 0x7f28d014f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 -- 172.21.15.50:0/2403748100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8009400 con 0x7f28d00afce0 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28ceffd640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d00afce0 0x7f28d00b5c50 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f28c800e990 tx=0x7f28c800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28c77fe640 1 -- 172.21.15.50:0/2403748100 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800c9e0 con 0x7f28d00afce0 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28c77fe640 1 -- 172.21.15.50:0/2403748100 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800cb40 con 0x7f28d00afce0 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28c77fe640 1 -- 172.21.15.50:0/2403748100 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800ced0 con 0x7f28d00afce0 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b8009400 con 0x7f28d00afce0 2023-12-08T08:20:42.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.166+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d00b8b40 con 0x7f28d00afce0 2023-12-08T08:20:42.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.167+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d0067430 con 0x7f28d00afce0 2023-12-08T08:20:42.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.168+0000 7f28c77fe640 1 -- 172.21.15.50:0/2403748100 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28c8013470 con 0x7f28d00afce0 2023-12-08T08:20:42.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.168+0000 7f28c77fe640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f28b006ae40 0x7f28b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:42.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.168+0000 7f28c77fe640 1 -- 172.21.15.50:0/2403748100 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f28c8089a50 con 0x7f28d00afce0 2023-12-08T08:20:42.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.168+0000 7f28ce7fc640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f28b006ae40 0x7f28b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:42.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.169+0000 7f28ce7fc640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f28b006ae40 0x7f28b006d300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f28b8034000 tx=0x7f28b802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:42.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.172+0000 7f28c77fe640 1 -- 172.21.15.50:0/2403748100 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28c80549c0 con 0x7f28d00afce0 2023-12-08T08:20:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.364+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28d015d930 con 0x7f28d00afce0 2023-12-08T08:20:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.364+0000 7f28c77fe640 1 -- 172.21.15.50:0/2403748100 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28c8017080 con 0x7f28d00afce0 2023-12-08T08:20:42.366 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:20:42.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f28b006ae40 msgr2=0x7f28b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f28b006ae40 0x7f28b006d300 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f28b8034000 tx=0x7f28b802f000 comp rx=0 tx=0).stop 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d00afce0 msgr2=0x7f28d00b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d00afce0 0x7f28d00b5c50 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f28c800e990 tx=0x7f28c800ee50 comp rx=0 tx=0).stop 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 shutdown_connections 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f28b006ae40 0x7f28b006d300 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28d01608a0 0x7f28d014f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28d00b1d70 0x7f28d01f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 --2- 172.21.15.50:0/2403748100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28d00afce0 0x7f28d00b5c50 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 >> 172.21.15.50:0/2403748100 conn(0x7f28d00d3030 msgr2=0x7f28d00cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 shutdown_connections 2023-12-08T08:20:42.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:42.366+0000 7f28d52e0640 1 -- 172.21.15.50:0/2403748100 wait complete. 2023-12-08T08:20:42.379 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:20:42.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:42.379 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:42.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[111964]: fuse finished with error 0 and tester_r 0 2023-12-08T08:20:42.410 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:20:48.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:20:48.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:48.512 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:20:48.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-08T08:20:48.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.687+0000 7f33bd0d3640 1 Processor -- start 2023-12-08T08:20:48.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.687+0000 7f33bd0d3640 1 -- start start 2023-12-08T08:20:48.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.688+0000 7f33bd0d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33b80b0cf0 0x7f33b80d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.688+0000 7f33bd0d3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b80d20b0 con 0x7f33b81608a0 2023-12-08T08:20:48.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.688+0000 7f33bd0d3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b80d1b80 con 0x7f33b80b1d70 2023-12-08T08:20:48.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.688+0000 7f33bd0d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b80d0620 con 0x7f33b80b0cf0 2023-12-08T08:20:48.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.688+0000 7f33b659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f33b80b0cf0 0x7f33b80d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.688+0000 7f33b6d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f33b81608a0 0x7f33b80d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:38152/0 (socket says 172.21.15.50:38152) 2023-12-08T08:20:48.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.688+0000 7f33b6d9d640 1 -- 172.21.15.50:0/1787468379 learned_addr learned my addr 172.21.15.50:0/1787468379 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:48.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.689+0000 7f33b5d9b640 1 -- 172.21.15.50:0/1787468379 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188729477 0 0) 0x7f33b80d20b0 con 0x7f33b81608a0 2023-12-08T08:20:48.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.689+0000 7f33b5d9b640 1 -- 172.21.15.50:0/1787468379 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a4003520 con 0x7f33b81608a0 2023-12-08T08:20:48.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.689+0000 7f33b659c640 1 -- 172.21.15.50:0/1787468379 >> v1:172.21.15.170:6789/0 conn(0x7f33b80b1d70 legacy=0x7f33b80cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:48.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.689+0000 7f33b659c640 1 -- 172.21.15.50:0/1787468379 >> v1:172.21.15.50:6789/0 conn(0x7f33b81608a0 legacy=0x7f33b80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.689+0000 7f33b659c640 1 -- 172.21.15.50:0/1787468379 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80d1dd0 con 0x7f33b80b0cf0 2023-12-08T08:20:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.689+0000 7f33b659c640 1 --2- 172.21.15.50:0/1787468379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b0cf0 0x7f33b80d1640 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f33a00097a0 tx=0x7f33a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5314203d523bb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33b5d9b640 1 -- 172.21.15.50:0/1787468379 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a002e070 con 0x7f33b80b0cf0 2023-12-08T08:20:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33b5d9b640 1 -- 172.21.15.50:0/1787468379 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a00315a0 con 0x7f33b80b0cf0 2023-12-08T08:20:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33b5d9b640 1 -- 172.21.15.50:0/1787468379 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0031930 con 0x7f33b80b0cf0 2023-12-08T08:20:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33bd0d3640 1 -- 172.21.15.50:0/1787468379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b0cf0 msgr2=0x7f33b80d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/1787468379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b0cf0 0x7f33b80d1640 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f33a00097a0 tx=0x7f33a002b840 comp rx=0 tx=0).stop 2023-12-08T08:20:48.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33bd0d3640 1 -- 172.21.15.50:0/1787468379 shutdown_connections 2023-12-08T08:20:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/1787468379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b0cf0 0x7f33b80d1640 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33bd0d3640 1 -- 172.21.15.50:0/1787468379 >> 172.21.15.50:0/1787468379 conn(0x7f33b80d3030 msgr2=0x7f33b80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33bd0d3640 1 -- 172.21.15.50:0/1787468379 shutdown_connections 2023-12-08T08:20:48.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.690+0000 7f33bd0d3640 1 -- 172.21.15.50:0/1787468379 wait complete. 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.692+0000 7f33bd0d3640 1 Processor -- start 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.692+0000 7f33bd0d3640 1 -- start start 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33bd0d3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33b80b0cf0 0x7f33b80b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33bd0d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b1d70 0x7f33b814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33bd0d3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33b81608a0 0x7f33b80ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33bd0d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80cd640 con 0x7f33b80b1d70 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33bd0d3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80cd090 con 0x7f33b81608a0 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33bd0d3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80cd360 con 0x7f33b80b0cf0 2023-12-08T08:20:48.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b1d70 0x7f33b814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b1d70 0x7f33b814d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:51264/0 (socket says 172.21.15.50:51264) 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 -- 172.21.15.50:0/4067541974 learned_addr learned my addr 172.21.15.50:0/4067541974 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b759e640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33b81608a0 0x7f33b80ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b6d9d640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33b80b0cf0 0x7f33b80b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 -- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33b80b0cf0 msgr2=0x7f33b80b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33b80b0cf0 0x7f33b80b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 -- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33b81608a0 msgr2=0x7f33b80ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33b81608a0 0x7f33b80ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 -- 172.21.15.50:0/4067541974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009400 con 0x7f33b80b1d70 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33b659c640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b1d70 0x7f33b814d420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f33a0000c00 tx=0x7f33a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.693+0000 7f33af7fe640 1 -- 172.21.15.50:0/4067541974 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0032840 con 0x7f33b80b1d70 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.694+0000 7f33af7fe640 1 -- 172.21.15.50:0/4067541974 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a00329a0 con 0x7f33b80b1d70 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.694+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b80c7d00 con 0x7f33b80b1d70 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.694+0000 7f33af7fe640 1 -- 172.21.15.50:0/4067541974 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0032d50 con 0x7f33b80b1d70 2023-12-08T08:20:48.697 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.694+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b80c82c0 con 0x7f33b80b1d70 2023-12-08T08:20:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.695+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b80c7b60 con 0x7f33b80b1d70 2023-12-08T08:20:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.695+0000 7f33af7fe640 1 -- 172.21.15.50:0/4067541974 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33a004d3f0 con 0x7f33b80b1d70 2023-12-08T08:20:48.698 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.695+0000 7f33af7fe640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f339806ae40 0x7f339806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.696+0000 7f33af7fe640 1 -- 172.21.15.50:0/4067541974 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f33a00ab130 con 0x7f33b80b1d70 2023-12-08T08:20:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.696+0000 7f33b6d9d640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f339806ae40 0x7f339806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:48.699 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.696+0000 7f33b6d9d640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f339806ae40 0x7f339806d300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33b00011e0 tx=0x7f33b0007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:48.702 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.700+0000 7f33af7fe640 1 -- 172.21.15.50:0/4067541974 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33b80c7b60 con 0x7f33b80b1d70 2023-12-08T08:20:48.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.913+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33b80c7b60 con 0x7f33b80b1d70 2023-12-08T08:20:48.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.913+0000 7f33af7fe640 1 -- 172.21.15.50:0/4067541974 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f33b80c7b60 con 0x7f33b80b1d70 2023-12-08T08:20:48.916 INFO:teuthology.orchestra.run.smithi050.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-08T08:20:48.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f339806ae40 msgr2=0x7f339806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f339806ae40 0x7f339806d300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33b00011e0 tx=0x7f33b0007d30 comp rx=0 tx=0).stop 2023-12-08T08:20:48.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b1d70 msgr2=0x7f33b814d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b1d70 0x7f33b814d420 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f33a0000c00 tx=0x7f33a00046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 shutdown_connections 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f339806ae40 0x7f339806d300 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33b80b1d70 0x7f33b814d420 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33b81608a0 0x7f33b80ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 --2- 172.21.15.50:0/4067541974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f33b80b0cf0 0x7f33b80b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 >> 172.21.15.50:0/4067541974 conn(0x7f33b80d3030 msgr2=0x7f33b80d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 shutdown_connections 2023-12-08T08:20:48.919 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:48.916+0000 7f33bd0d3640 1 -- 172.21.15.50:0/4067541974 wait complete. 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi050.front.sepia.ceph.com 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-08T08:20:48.929 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:48.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:48.930 DEBUG:teuthology.orchestra.run.smithi050:> ip addr 2023-12-08T08:20:48.945 INFO:teuthology.orchestra.run.smithi050.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: inet 127.0.0.1/8 scope host lo 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 ::1/128 scope host 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f8 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f0 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:6b:fd:f9 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp7s0f1 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:84 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f0 2023-12-08T08:20:48.946 INFO:teuthology.orchestra.run.smithi050.stdout: inet 172.21.15.50/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::ec4:7aff:febd:1584/64 scope link noprefixroute 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 0c:c4:7a:bd:15:85 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: altname enp1s0f1 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::c008:83ff:fe50:e6c0/64 scope link 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:20:48.947 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 42:3f:3f:e6:f2:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::403f:3fff:fee6:f2fc/64 scope link 2023-12-08T08:20:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:48.948 INFO:teuthology.orchestra.run.smithi050.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-08T08:20:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: link/ether 2a:80:6d:2e:b5:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: inet6 fe80::2880:6dff:fe2e:b579/64 scope link 2023-12-08T08:20:48.948 INFO:teuthology.orchestra.run.smithi050.stdout: valid_lft forever preferred_lft forever 2023-12-08T08:20:48.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:48.948 DEBUG:teuthology.orchestra.run.smithi050:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-08T08:20:49.016 INFO:teuthology.orchestra.run.smithi050.stdout:1 2023-12-08T08:20:49.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.017 DEBUG:teuthology.orchestra.run.smithi050:> route 2023-12-08T08:20:49.074 INFO:teuthology.orchestra.run.smithi050.stdout:Kernel IP routing table 2023-12-08T08:20:49.074 INFO:teuthology.orchestra.run.smithi050.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-08T08:20:49.074 INFO:teuthology.orchestra.run.smithi050.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-08T08:20:49.074 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-08T08:20:49.074 INFO:teuthology.orchestra.run.smithi050.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-08T08:20:49.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.075 DEBUG:teuthology.orchestra.run.smithi050:> (cd / && exec bash -c ' 2023-12-08T08:20:49.075 DEBUG:teuthology.orchestra.run.smithi050:> set -e 2023-12-08T08:20:49.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-08T08:20:49.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-08T08:20:49.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-08T08:20:49.075 DEBUG:teuthology.orchestra.run.smithi050:> ') 2023-12-08T08:20:49.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.180 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:20:49.195 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-08T08:20:49.195 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:20:49.195 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:49.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link set brx.0 up 2023-12-08T08:20:49.266 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-08T08:20:49.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:49.267 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:49.321 INFO:teuthology.orchestra.run.smithi050.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-08T08:20:49.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-08T08:20:49.322 DEBUG:teuthology.orchestra.run.smithi050:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:49.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:20:49.449 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:20:49.505 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:20:49.505 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:20:49.506 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:20:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:20:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:20:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:20:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:20:49.507 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:49.508 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:49.509 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:49.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.509 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:20:49.561 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-08T08:20:49.561 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-08T08:20:49.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo modprobe fuse 2023-12-08T08:20:49.634 DEBUG:teuthology.orchestra.run.smithi050:> cat /proc/self/mounts | awk '{print $2}' 2023-12-08T08:20:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:/proc 2023-12-08T08:20:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:/sys 2023-12-08T08:20:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:/dev 2023-12-08T08:20:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/security 2023-12-08T08:20:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/shm 2023-12-08T08:20:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/pts 2023-12-08T08:20:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:/run 2023-12-08T08:20:49.691 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/cgroup 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/pstore 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/bpf 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/ 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/selinux 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/proc/sys/fs/binfmt_misc 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/hugepages 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/dev/mqueue 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/debug 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/tracing 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/fs/fuse/connections 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/sys/kernel/config 2023-12-08T08:20:49.692 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-sysctl.service 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/nfs/rpc_pipefs 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/run/user/1000 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-0 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-1 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-2 2023-12-08T08:20:49.693 INFO:teuthology.orchestra.run.smithi050.stdout:/var/lib/ceph/osd/ceph-3 2023-12-08T08:20:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns 2023-12-08T08:20:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:20:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:49.694 INFO:teuthology.orchestra.run.smithi050.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:20:49.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.694 DEBUG:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2023-12-08T08:20:49.696 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:2023-12-08T08:20:49.694+0000 7f073146f480 -1 init, newargv = 0x561d6a0271b0 newargc=15 2023-12-08T08:20:49.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[112925]: starting ceph client 2023-12-08T08:20:49.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[112925]: starting fuse 2023-12-08T08:20:49.712 INFO:teuthology.orchestra.run.smithi050.stdout:43 2023-12-08T08:20:49.712 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-08T08:20:49.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo stdin-killer -- python3 -c ' 2023-12-08T08:20:49.712 DEBUG:teuthology.orchestra.run.smithi050:> import glob 2023-12-08T08:20:49.712 DEBUG:teuthology.orchestra.run.smithi050:> import re 2023-12-08T08:20:49.712 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:20:49.712 DEBUG:teuthology.orchestra.run.smithi050:> import subprocess 2023-12-08T08:20:49.712 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:49.712 DEBUG:teuthology.orchestra.run.smithi050:> def _find_admin_socket(client_name): 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> return files[0] 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> for f in files: 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> contents = proc_f.read() 2023-12-08T08:20:49.713 DEBUG:teuthology.orchestra.run.smithi050:> if mountpoint in contents: 2023-12-08T08:20:49.714 DEBUG:teuthology.orchestra.run.smithi050:> return f 2023-12-08T08:20:49.714 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-08T08:20:49.714 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:49.714 DEBUG:teuthology.orchestra.run.smithi050:> print(_find_admin_socket("client.0")) 2023-12-08T08:20:49.714 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:20:49.837 INFO:teuthology.orchestra.run.smithi050.stdout:/var/run/ceph/ceph-client.0.112925.asok 2023-12-08T08:20:49.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-08T08:20:49.847 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112925.asok 2023-12-08T08:20:49.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112925.asok status 2023-12-08T08:20:49.988 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "metadata": { 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "entity_id": "0", 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "hostname": "smithi050", 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "pid": "112925", 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "root": "/" 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_count": 0, 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "dentry_pinned_count": 0, 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 6576, 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "inst": { 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "name": { 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "client", 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "num": 6576 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:20:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 626783684 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: } 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": { 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "192.168.0.1:0", 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 626783684 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "inst_str": "client.6576 192.168.0.1:0/626783684", 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "addr_str": "192.168.0.1:0/626783684", 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "inode_count": 1, 2023-12-08T08:20:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_epoch": 23, 2023-12-08T08:20:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch": 56, 2023-12-08T08:20:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_epoch_barrier": 0, 2023-12-08T08:20:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklisted": false, 2023-12-08T08:20:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "fs_name": "cephfs" 2023-12-08T08:20:49.992 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:20:49.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:49.997 DEBUG:teuthology.orchestra.run.smithi050:> stat --file-system '--printf=%T 2023-12-08T08:20:49.997 DEBUG:teuthology.orchestra.run.smithi050:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:50.013 INFO:teuthology.orchestra.run.smithi050.stdout:fuseblk 2023-12-08T08:20:50.013 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:50.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:50.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:50.087 DEBUG:teuthology.orchestra.run.smithi050:> stdin-killer -- python3 -c ' 2023-12-08T08:20:50.087 DEBUG:teuthology.orchestra.run.smithi050:> import os 2023-12-08T08:20:50.087 DEBUG:teuthology.orchestra.run.smithi050:> import errno 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> try: 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> if True: 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> ret = os.read(fd, 1024) 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> os.write(fd, b'"'"'content'"'"') 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> except OSError as e: 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> if e.errno != errno.EPERM: 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> raise 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> else: 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> raise RuntimeError("client does not check permission of data pool") 2023-12-08T08:20:50.088 DEBUG:teuthology.orchestra.run.smithi050:> ' 2023-12-08T08:20:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:Traceback (most recent call last): 2023-12-08T08:20:50.195 INFO:teuthology.orchestra.run.smithi050.stderr: File "", line 15, in 2023-12-08T08:20:50.195 INFO:teuthology.orchestra.run.smithi050.stderr:RuntimeError: client does not check permission of data pool 2023-12-08T08:20:50.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-12-08T08:20:50.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:50.204 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-12-08T08:20:50.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.355+0000 7fd33c8d3640 1 Processor -- start 2023-12-08T08:20:50.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.355+0000 7fd33c8d3640 1 -- start start 2023-12-08T08:20:50.358 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd33c8d3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd3380d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd33c8d3640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3380cffb0 0x7fd3380d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd33c8d3640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380c6af0 con 0x7fd3381608a0 2023-12-08T08:20:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd33c8d3640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380d0500 con 0x7fd3380cffb0 2023-12-08T08:20:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd33c8d3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380d07e0 con 0x7fd338160c80 2023-12-08T08:20:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd33659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd3381608a0 0x7fd3380d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49152/0 (socket says 172.21.15.50:49152) 2023-12-08T08:20:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd336d9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd3380cffb0 0x7fd3380d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.356+0000 7fd33659c640 1 -- 172.21.15.50:0/720565374 learned_addr learned my addr 172.21.15.50:0/720565374 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:50.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.357+0000 7fd335d9b640 1 --2- 172.21.15.50:0/720565374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd3380d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.357+0000 7fd336d9d640 1 -- 172.21.15.50:0/720565374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 msgr2=0x7fd3380d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.357+0000 7fd336d9d640 1 --2- 172.21.15.50:0/720565374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd3380d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.357+0000 7fd336d9d640 1 -- 172.21.15.50:0/720565374 >> v1:172.21.15.50:6789/0 conn(0x7fd3381608a0 legacy=0x7fd3380d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.357+0000 7fd33559a640 1 -- 172.21.15.50:0/720565374 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226924448 0 0) 0x7fd3380c6af0 con 0x7fd3381608a0 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.357+0000 7fd336d9d640 1 -- 172.21.15.50:0/720565374 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380c6d40 con 0x7fd3380cffb0 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd336d9d640 1 --2- 172.21.15.50:0/720565374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3380cffb0 0x7fd3380d1ac0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd3300097a0 tx=0x7fd33002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df214e980adc36f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33559a640 1 -- 172.21.15.50:0/720565374 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33002f050 con 0x7fd3380cffb0 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33559a640 1 -- 172.21.15.50:0/720565374 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330031700 con 0x7fd3380cffb0 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33559a640 1 -- 172.21.15.50:0/720565374 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330031a90 con 0x7fd3380cffb0 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 -- 172.21.15.50:0/720565374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3380cffb0 msgr2=0x7fd3380d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/720565374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3380cffb0 0x7fd3380d1ac0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd3300097a0 tx=0x7fd33002b7a0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 -- 172.21.15.50:0/720565374 shutdown_connections 2023-12-08T08:20:50.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/720565374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3380cffb0 0x7fd3380d1ac0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/720565374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd3380d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 -- 172.21.15.50:0/720565374 >> 172.21.15.50:0/720565374 conn(0x7fd3380d2fa0 msgr2=0x7fd3380d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 -- 172.21.15.50:0/720565374 shutdown_connections 2023-12-08T08:20:50.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.358+0000 7fd33c8d3640 1 -- 172.21.15.50:0/720565374 wait complete. 2023-12-08T08:20:50.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.360+0000 7fd33c8d3640 1 Processor -- start 2023-12-08T08:20:50.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.360+0000 7fd33c8d3640 1 -- start start 2023-12-08T08:20:50.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.360+0000 7fd33c8d3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3380cffb0 0x7fd3380cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33c8d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3381608a0 0x7fd3380c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33c8d3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd338149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33c8d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380c9920 con 0x7fd3381608a0 2023-12-08T08:20:50.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33c8d3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338149970 con 0x7fd3380cffb0 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33c8d3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd338152f00 con 0x7fd338160c80 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3381608a0 0x7fd3380c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3381608a0 0x7fd3380c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35532/0 (socket says 172.21.15.50:35532) 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 -- 172.21.15.50:0/3926135474 learned_addr learned my addr 172.21.15.50:0/3926135474 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd336d9d640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd338149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33659c640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3380cffb0 0x7fd3380cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 -- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 msgr2=0x7fd338149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd338149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 -- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3380cffb0 msgr2=0x7fd3380cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3380cffb0 0x7fd3380cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 -- 172.21.15.50:0/3926135474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330009400 con 0x7fd3381608a0 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd336d9d640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd338149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd335d9b640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3381608a0 0x7fd3380c93e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd32000d5f0 tx=0x7fd32000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd32effd640 1 -- 172.21.15.50:0/3926135474 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3200125f0 con 0x7fd3381608a0 2023-12-08T08:20:50.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd32effd640 1 -- 172.21.15.50:0/3926135474 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320012750 con 0x7fd3381608a0 2023-12-08T08:20:50.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd32effd640 1 -- 172.21.15.50:0/3926135474 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320012b00 con 0x7fd3381608a0 2023-12-08T08:20:50.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3380c9b10 con 0x7fd3381608a0 2023-12-08T08:20:50.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.361+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3380ca480 con 0x7fd3381608a0 2023-12-08T08:20:50.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.362+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3381530b0 con 0x7fd3381608a0 2023-12-08T08:20:50.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.363+0000 7fd32effd640 1 -- 172.21.15.50:0/3926135474 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd320012c60 con 0x7fd3381608a0 2023-12-08T08:20:50.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.363+0000 7fd32effd640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd31806ae40 0x7fd31806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.363+0000 7fd32effd640 1 -- 172.21.15.50:0/3926135474 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd320089b20 con 0x7fd3381608a0 2023-12-08T08:20:50.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.364+0000 7fd33659c640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd31806ae40 0x7fd31806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.364+0000 7fd33659c640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd31806ae40 0x7fd31806d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd3280012e0 tx=0x7fd328007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.368+0000 7fd32effd640 1 -- 172.21.15.50:0/3926135474 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3381530b0 con 0x7fd3381608a0 2023-12-08T08:20:50.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.612+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd338153070 con 0x7fd3381608a0 2023-12-08T08:20:50.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.614+0000 7fd32effd640 1 -- 172.21.15.50:0/3926135474 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+141 (secure 0 0 0) 0x7fd320054b20 con 0x7fd3381608a0 2023-12-08T08:20:50.617 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2023-12-08T08:20:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQD50HJliLgBDxAAA4opqYgsDRBz0pDz1GIsnw== 2023-12-08T08:20:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: caps mds = "allow" 2023-12-08T08:20:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: caps mon = "allow r" 2023-12-08T08:20:50.617 INFO:teuthology.orchestra.run.smithi050.stdout: caps osd = "allow rw pool=cephfs_data" 2023-12-08T08:20:50.617 INFO:teuthology.orchestra.run.smithi050.stderr:updated caps for client.0 2023-12-08T08:20:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.616+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd31806ae40 msgr2=0x7fd31806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.616+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd31806ae40 0x7fd31806d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd3280012e0 tx=0x7fd328007ed0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.616+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3381608a0 msgr2=0x7fd3380c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.616+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3381608a0 0x7fd3380c93e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd32000d5f0 tx=0x7fd32000dab0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 shutdown_connections 2023-12-08T08:20:50.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd31806ae40 0x7fd31806d300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd3381608a0 0x7fd3380c93e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd338160c80 0x7fd338149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 --2- 172.21.15.50:0/3926135474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3380cffb0 0x7fd3380cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 >> 172.21.15.50:0/3926135474 conn(0x7fd3380d2fa0 msgr2=0x7fd338156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 shutdown_connections 2023-12-08T08:20:50.620 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.617+0000 7fd33c8d3640 1 -- 172.21.15.50:0/3926135474 wait complete. 2023-12-08T08:20:50.630 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-08T08:20:50.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:50.684 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-08T08:20:50.733 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-08T08:20:50.733 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:50.733 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:50.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.895+0000 7f5df5248640 1 Processor -- start 2023-12-08T08:20:50.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.895+0000 7f5df5248640 1 -- start start 2023-12-08T08:20:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.896+0000 7f5df5248640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 0x7f5df00d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.900 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.896+0000 7f5df5248640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00d20b0 con 0x7f5df00b1d70 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.896+0000 7f5df5248640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00d1b80 con 0x7f5df01608a0 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.896+0000 7f5df5248640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00d0620 con 0x7f5df00b0cf0 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.896+0000 7f5def59e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5df00b1d70 0x7f5df00cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49156/0 (socket says 172.21.15.50:49156) 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.896+0000 7f5def59e640 1 -- 172.21.15.50:0/85872631 learned_addr learned my addr 172.21.15.50:0/85872631 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dee59c640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 0x7f5df00d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010356953 0 0) 0x7f5df00d20b0 con 0x7f5df00b1d70 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ddc003520 con 0x7f5df00b1d70 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450227004 0 0) 0x7f5ddc003520 con 0x7f5df00b1d70 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 msgr2=0x7f5df00d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 0x7f5df00d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 >> v1:172.21.15.170:6789/0 conn(0x7f5df01608a0 legacy=0x7f5df00d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00d1dd0 con 0x7f5df00b1d70 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f5de00019f0 con 0x7f5df00b1d70 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 >> v1:172.21.15.50:6789/0 conn(0x7f5df00b1d70 legacy=0x7f5df00cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.901 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 0x7f5ddc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc003fd0 0x7f5ddc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ddc004d00 0x7f5ddc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00d0620 con 0x7f5ddc003fd0 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc00bbc0 con 0x7f5ddc004d00 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc00bd80 con 0x7f5df00b0cf0 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dee59c640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc003fd0 0x7f5ddc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5deed9d640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 0x7f5ddc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5def59e640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ddc004d00 0x7f5ddc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dee59c640 1 -- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 msgr2=0x7f5ddc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dee59c640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b0cf0 0x7f5ddc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dee59c640 1 -- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ddc004d00 msgr2=0x7f5ddc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dee59c640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ddc004d00 0x7f5ddc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.897+0000 7f5dee59c640 1 -- 172.21.15.50:0/85872631 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc003520 con 0x7f5ddc003fd0 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.898+0000 7f5dee59c640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc003fd0 0x7f5ddc0047c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ba30 tx=0x7f5ddc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19e2855865ed0b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.902 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.898+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8032640 con 0x7f5ddc003fd0 2023-12-08T08:20:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.898+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd80327a0 con 0x7f5ddc003fd0 2023-12-08T08:20:50.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.898+0000 7f5dedd9b640 1 -- 172.21.15.50:0/85872631 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8032b30 con 0x7f5ddc003fd0 2023-12-08T08:20:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.899+0000 7f5df5248640 1 -- 172.21.15.50:0/85872631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc003fd0 msgr2=0x7f5ddc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.899+0000 7f5df5248640 1 --2- 172.21.15.50:0/85872631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ddc003fd0 0x7f5ddc0047c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ba30 tx=0x7f5ddc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.899+0000 7f5def59e640 1 -- 172.21.15.50:0/85872631 reap_dead start 2023-12-08T08:20:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.899+0000 7f5df5248640 1 -- 172.21.15.50:0/85872631 shutdown_connections 2023-12-08T08:20:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.899+0000 7f5df5248640 1 -- 172.21.15.50:0/85872631 >> 172.21.15.50:0/85872631 conn(0x7f5df00d3030 msgr2=0x7f5df00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:50.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.899+0000 7f5df5248640 1 -- 172.21.15.50:0/85872631 shutdown_connections 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.899+0000 7f5df5248640 1 -- 172.21.15.50:0/85872631 wait complete. 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.900+0000 7f5df5248640 1 Processor -- start 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.900+0000 7f5df5248640 1 -- start start 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5df5248640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5df00b2a80 0x7f5df00b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5df5248640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b2e60 0x7f5df00cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5df5248640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5df00cb690 0x7f5df00c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5df5248640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00cc060 con 0x7f5df00b2a80 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5df5248640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00cbb20 con 0x7f5df00cb690 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5df5248640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00cbd80 con 0x7f5df00b2e60 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5deed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5df00b2a80 0x7f5df00b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5deed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5df00b2a80 0x7f5df00b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35546/0 (socket says 172.21.15.50:35546) 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5deed9d640 1 -- 172.21.15.50:0/3131969573 learned_addr learned my addr 172.21.15.50:0/3131969573 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5dee59c640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b2e60 0x7f5df00cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.901+0000 7f5def59e640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5df00cb690 0x7f5df00c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5deed9d640 1 -- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b2e60 msgr2=0x7f5df00cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5deed9d640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b2e60 0x7f5df00cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5deed9d640 1 -- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5df00cb690 msgr2=0x7f5df00c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5deed9d640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5df00cb690 0x7f5df00c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5deed9d640 1 -- 172.21.15.50:0/3131969573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00b5d50 con 0x7f5df00b2a80 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5def59e640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5df00cb690 0x7f5df00c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5deed9d640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5df00b2a80 0x7f5df00b6810 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5de800f5f0 tx=0x7f5de800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5de77fe640 1 -- 172.21.15.50:0/3131969573 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80052e0 con 0x7f5df00b2a80 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5de77fe640 1 -- 172.21.15.50:0/3131969573 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8005440 con 0x7f5df00b2a80 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df00b6030 con 0x7f5df00b2a80 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5de77fe640 1 -- 172.21.15.50:0/3131969573 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8003810 con 0x7f5df00b2a80 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.902+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df00c7fe0 con 0x7f5df00b2a80 2023-12-08T08:20:50.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.903+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0067430 con 0x7f5df00b2a80 2023-12-08T08:20:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.903+0000 7f5de77fe640 1 -- 172.21.15.50:0/3131969573 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5de8003970 con 0x7f5df00b2a80 2023-12-08T08:20:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.904+0000 7f5de77fe640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5dd006ae40 0x7f5dd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.904+0000 7f5de77fe640 1 -- 172.21.15.50:0/3131969573 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5de80895a0 con 0x7f5df00b2a80 2023-12-08T08:20:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.904+0000 7f5dee59c640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5dd006ae40 0x7f5dd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:50.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.905+0000 7f5dee59c640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5dd006ae40 0x7f5dd006d300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ba00 tx=0x7f5dd803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:50.910 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:50.908+0000 7f5de77fe640 1 -- 172.21.15.50:0/3131969573 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5de80545a0 con 0x7f5df00b2a80 2023-12-08T08:20:51.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.085+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5df00d3ac0 con 0x7f5df00b2a80 2023-12-08T08:20:51.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.086+0000 7f5de77fe640 1 -- 172.21.15.50:0/3131969573 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7f5de8057bc0 con 0x7f5df00b2a80 2023-12-08T08:20:51.089 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:51.089 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5dd006ae40 msgr2=0x7f5dd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5dd006ae40 0x7f5dd006d300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ba00 tx=0x7f5dd803d040 comp rx=0 tx=0).stop 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5df00b2a80 msgr2=0x7f5df00b6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5df00b2a80 0x7f5df00b6810 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5de800f5f0 tx=0x7f5de800fab0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 shutdown_connections 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f5dd006ae40 0x7f5dd006d300 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5df00cb690 0x7f5df00c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5df00b2e60 0x7f5df00cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.091 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 --2- 172.21.15.50:0/3131969573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5df00b2a80 0x7f5df00b6810 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 >> 172.21.15.50:0/3131969573 conn(0x7f5df00d3030 msgr2=0x7f5df00b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.088+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 shutdown_connections 2023-12-08T08:20:51.092 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.089+0000 7f5df5248640 1 -- 172.21.15.50:0/3131969573 wait complete. 2023-12-08T08:20:51.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:24.505729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:25.407648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:51.102 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.209+0000 7f89ca597640 1 Processor -- start 2023-12-08T08:20:51.211 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.209+0000 7f89ca597640 1 -- start start 2023-12-08T08:20:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89ca597640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89c406bbf0 0x7f89c40ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.212 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89ca597640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89ca597640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c415d500 con 0x7f89c415d120 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89ca597640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c40ad7c0 con 0x7f89c406bbf0 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89ca597640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40b2f80 con 0x7f89c40ad290 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89c406bbf0 0x7f89c40ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89c406bbf0 0x7f89c40ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35558/0 (socket says 172.21.15.50:35558) 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c37fe640 1 -- 172.21.15.50:0/150279206 learned_addr learned my addr 172.21.15.50:0/150279206 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c8b34640 1 --2- 172.21.15.50:0/150279206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c37fe640 1 -- 172.21.15.50:0/150279206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 msgr2=0x7f89c406ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c37fe640 1 --2- 172.21.15.50:0/150279206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c37fe640 1 -- 172.21.15.50:0/150279206 >> v1:172.21.15.170:6789/0 conn(0x7f89c415d120 legacy=0x7f89c406b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.213 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.210+0000 7f89c37fe640 1 -- 172.21.15.50:0/150279206 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40b3260 con 0x7f89c406bbf0 2023-12-08T08:20:51.214 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.211+0000 7f89c37fe640 1 --2- 172.21.15.50:0/150279206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c406bbf0 0x7f89c40ac880 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009870 tx=0x7f89b402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c374850f21c03 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.211+0000 7f89c2ffd640 1 -- 172.21.15.50:0/150279206 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4030840 con 0x7f89c406bbf0 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.211+0000 7f89c2ffd640 1 -- 172.21.15.50:0/150279206 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b40309a0 con 0x7f89c406bbf0 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.211+0000 7f89c2ffd640 1 -- 172.21.15.50:0/150279206 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4030d30 con 0x7f89c406bbf0 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 -- 172.21.15.50:0/150279206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c406bbf0 msgr2=0x7f89c40ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 --2- 172.21.15.50:0/150279206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c406bbf0 0x7f89c40ac880 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009870 tx=0x7f89b402b980 comp rx=0 tx=0).stop 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 -- 172.21.15.50:0/150279206 shutdown_connections 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 --2- 172.21.15.50:0/150279206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 --2- 172.21.15.50:0/150279206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c406bbf0 0x7f89c40ac880 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 -- 172.21.15.50:0/150279206 >> 172.21.15.50:0/150279206 conn(0x7f89c4070960 msgr2=0x7f89c4070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 -- 172.21.15.50:0/150279206 shutdown_connections 2023-12-08T08:20:51.215 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.212+0000 7f89ca597640 1 -- 172.21.15.50:0/150279206 wait complete. 2023-12-08T08:20:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.213+0000 7f89ca597640 1 Processor -- start 2023-12-08T08:20:51.217 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.213+0000 7f89ca597640 1 -- start start 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89ca597640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89c406bbf0 0x7f89c4143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89ca597640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89ca597640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c415d120 0x7f89c40b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89ca597640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c414d5e0 con 0x7f89c415d120 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89ca597640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4144130 con 0x7f89c406bbf0 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89ca597640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c41503a0 con 0x7f89c40ad290 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c415d120 0x7f89c40b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c415d120 0x7f89c40b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35562/0 (socket says 172.21.15.50:35562) 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 -- 172.21.15.50:0/2819196238 learned_addr learned my addr 172.21.15.50:0/2819196238 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c37fe640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c3fff640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89c406bbf0 0x7f89c4143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 -- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 msgr2=0x7f89c406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 -- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89c406bbf0 msgr2=0x7f89c4143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.218 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89c406bbf0 0x7f89c4143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c8b34640 1 -- 172.21.15.50:0/2819196238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40094d0 con 0x7f89c415d120 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c3fff640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89c406bbf0 0x7f89c4143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.214+0000 7f89c37fe640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.215+0000 7f89c8b34640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c415d120 0x7f89c40b04e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f89bc007e30 tx=0x7f89bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.215+0000 7f89c0ff9640 1 -- 172.21.15.50:0/2819196238 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc014620 con 0x7f89c415d120 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.215+0000 7f89c0ff9640 1 -- 172.21.15.50:0/2819196238 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc00ee90 con 0x7f89c415d120 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.215+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c4150680 con 0x7f89c415d120 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.215+0000 7f89c0ff9640 1 -- 172.21.15.50:0/2819196238 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0149c0 con 0x7f89c415d120 2023-12-08T08:20:51.219 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.215+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c415f230 con 0x7f89c415d120 2023-12-08T08:20:51.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.216+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c4067430 con 0x7f89c415d120 2023-12-08T08:20:51.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.216+0000 7f89c0ff9640 1 -- 172.21.15.50:0/2819196238 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89bc014b20 con 0x7f89c415d120 2023-12-08T08:20:51.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.217+0000 7f89c0ff9640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89b006ae70 0x7f89b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.217+0000 7f89c0ff9640 1 -- 172.21.15.50:0/2819196238 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f89bc08a0b0 con 0x7f89c415d120 2023-12-08T08:20:51.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.217+0000 7f89c3fff640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89b006ae70 0x7f89b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.218+0000 7f89c3fff640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89b006ae70 0x7f89b006d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f89b8000f60 tx=0x7f89b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.223 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.221+0000 7f89c0ff9640 1 -- 172.21.15.50:0/2819196238 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89bc054f80 con 0x7f89c415d120 2023-12-08T08:20:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.397+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89c40affc0 con 0x7f89c415d120 2023-12-08T08:20:51.400 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.397+0000 7f89c0ff9640 1 -- 172.21.15.50:0/2819196238 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89bc0585a0 con 0x7f89c415d120 2023-12-08T08:20:51.400 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89b006ae70 msgr2=0x7f89b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89b006ae70 0x7f89b006d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f89b8000f60 tx=0x7f89b8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c415d120 msgr2=0x7f89c40b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c415d120 0x7f89c40b04e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f89bc007e30 tx=0x7f89bc00e4b0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 shutdown_connections 2023-12-08T08:20:51.402 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f89b006ae70 0x7f89b006d330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89c415d120 0x7f89c40b04e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89c40ad290 0x7f89c406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 --2- 172.21.15.50:0/2819196238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89c406bbf0 0x7f89c4143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.399+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 >> 172.21.15.50:0/2819196238 conn(0x7f89c4070960 msgr2=0x7f89c415aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.400+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 shutdown_connections 2023-12-08T08:20:51.403 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.400+0000 7f89ca597640 1 -- 172.21.15.50:0/2819196238 wait complete. 2023-12-08T08:20:51.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:51.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.519+0000 7fdff4941640 1 Processor -- start 2023-12-08T08:20:51.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.519+0000 7fdff4941640 1 -- start start 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdff4941640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdff015d4f0 0x7fdff00b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdff4941640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdff00b0920 0x7fdff00b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdff4941640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00b2280 con 0x7fdff00adb50 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdff4941640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff006bb40 con 0x7fdff015d4f0 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdff4941640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00b2710 con 0x7fdff00b0920 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdfee59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdff015d4f0 0x7fdff00b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdfee59c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdff015d4f0 0x7fdff00b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35566/0 (socket says 172.21.15.50:35566) 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdfee59c640 1 -- 172.21.15.50:0/2860792516 learned_addr learned my addr 172.21.15.50:0/2860792516 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:51.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.520+0000 7fdfedd9b640 1 --2- 172.21.15.50:0/2860792516 >> v2:172.21.15.170:3300/0 conn(0x7fdff00b0920 0x7fdff00b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfee59c640 1 -- 172.21.15.50:0/2860792516 >> v2:172.21.15.170:3300/0 conn(0x7fdff00b0920 msgr2=0x7fdff00b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfee59c640 1 --2- 172.21.15.50:0/2860792516 >> v2:172.21.15.170:3300/0 conn(0x7fdff00b0920 0x7fdff00b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfee59c640 1 -- 172.21.15.50:0/2860792516 >> v1:172.21.15.170:6789/0 conn(0x7fdff00adb50 legacy=0x7fdff00adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfee59c640 1 -- 172.21.15.50:0/2860792516 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00b1690 con 0x7fdff015d4f0 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfee59c640 1 --2- 172.21.15.50:0/2860792516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff015d4f0 0x7fdff00b03e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdff0071250 tx=0x7fdfe802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e25b440025956f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfed59a640 1 -- 172.21.15.50:0/2860792516 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8031870 con 0x7fdff015d4f0 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfed59a640 1 -- 172.21.15.50:0/2860792516 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80319d0 con 0x7fdff015d4f0 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.521+0000 7fdfed59a640 1 -- 172.21.15.50:0/2860792516 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8031d60 con 0x7fdff015d4f0 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 -- 172.21.15.50:0/2860792516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff015d4f0 msgr2=0x7fdff00b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 --2- 172.21.15.50:0/2860792516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff015d4f0 0x7fdff00b03e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdff0071250 tx=0x7fdfe802b910 comp rx=0 tx=0).stop 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 -- 172.21.15.50:0/2860792516 shutdown_connections 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 --2- 172.21.15.50:0/2860792516 >> v2:172.21.15.170:3300/0 conn(0x7fdff00b0920 0x7fdff00b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 --2- 172.21.15.50:0/2860792516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff015d4f0 0x7fdff00b03e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 -- 172.21.15.50:0/2860792516 >> 172.21.15.50:0/2860792516 conn(0x7fdff00d0e00 msgr2=0x7fdff00d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 -- 172.21.15.50:0/2860792516 shutdown_connections 2023-12-08T08:20:51.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.522+0000 7fdff4941640 1 -- 172.21.15.50:0/2860792516 wait complete. 2023-12-08T08:20:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.523+0000 7fdff4941640 1 Processor -- start 2023-12-08T08:20:51.527 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.523+0000 7fdff4941640 1 -- start start 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdff4941640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff00adb50 0x7fdff00b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdff4941640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdff00b0920 0x7fdff00af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdff4941640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdff015d4f0 0x7fdff00b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdff4941640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b6750 con 0x7fdff00adb50 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdff4941640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b4ed0 con 0x7fdff015d4f0 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdff4941640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b5170 con 0x7fdff00b0920 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdfee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff00adb50 0x7fdff00b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdfee59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff00adb50 0x7fdff00b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35580/0 (socket says 172.21.15.50:35580) 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.524+0000 7fdfee59c640 1 -- 172.21.15.50:0/2925142221 learned_addr learned my addr 172.21.15.50:0/2925142221 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfee59c640 1 -- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdff00b0920 msgr2=0x7fdff00af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfee59c640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdff00b0920 0x7fdff00af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfee59c640 1 -- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdff015d4f0 msgr2=0x7fdff00b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfeed9d640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdff015d4f0 0x7fdff00b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfee59c640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdff015d4f0 0x7fdff00b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.528 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfee59c640 1 -- 172.21.15.50:0/2925142221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80094d0 con 0x7fdff00adb50 2023-12-08T08:20:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfee59c640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff00adb50 0x7fdff00b6210 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdfe802b950 tx=0x7fdfe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfe6ffd640 1 -- 172.21.15.50:0/2925142221 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe803ad30 con 0x7fdff00adb50 2023-12-08T08:20:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfe6ffd640 1 -- 172.21.15.50:0/2925142221 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe80443f0 con 0x7fdff00adb50 2023-12-08T08:20:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff00b5450 con 0x7fdff00adb50 2023-12-08T08:20:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdfe6ffd640 1 -- 172.21.15.50:0/2925142221 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80447a0 con 0x7fdff00adb50 2023-12-08T08:20:51.529 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.525+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff00b5a10 con 0x7fdff00adb50 2023-12-08T08:20:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.526+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0067430 con 0x7fdff00adb50 2023-12-08T08:20:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.527+0000 7fdfe6ffd640 1 -- 172.21.15.50:0/2925142221 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfe804d450 con 0x7fdff00adb50 2023-12-08T08:20:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.527+0000 7fdfe6ffd640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdfd006ae40 0x7fdfd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.527+0000 7fdfe6ffd640 1 -- 172.21.15.50:0/2925142221 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdfe802d040 con 0x7fdff00adb50 2023-12-08T08:20:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.527+0000 7fdfedd9b640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdfd006ae40 0x7fdfd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.530 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.528+0000 7fdfedd9b640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdfd006ae40 0x7fdfd006d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdff015c300 tx=0x7fdfd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.534 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.531+0000 7fdfe6ffd640 1 -- 172.21.15.50:0/2925142221 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdfe8076cd0 con 0x7fdff00adb50 2023-12-08T08:20:51.709 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.707+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdff006bdd0 con 0x7fdff00adb50 2023-12-08T08:20:51.710 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.707+0000 7fdfe6ffd640 1 -- 172.21.15.50:0/2925142221 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfe8035020 con 0x7fdff00adb50 2023-12-08T08:20:51.710 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:51.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdfd006ae40 msgr2=0x7fdfd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdfd006ae40 0x7fdfd006d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdff015c300 tx=0x7fdfd8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff00adb50 msgr2=0x7fdff00b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff00adb50 0x7fdff00b6210 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fdfe802b950 tx=0x7fdfe80046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 shutdown_connections 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdfd006ae40 0x7fdfd006d300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdff015d4f0 0x7fdff00b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdff00b0920 0x7fdff00af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 --2- 172.21.15.50:0/2925142221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdff00adb50 0x7fdff00b6210 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 >> 172.21.15.50:0/2925142221 conn(0x7fdff00d0e00 msgr2=0x7fdff015f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 shutdown_connections 2023-12-08T08:20:51.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.709+0000 7fdff4941640 1 -- 172.21.15.50:0/2925142221 wait complete. 2023-12-08T08:20:51.722 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.831+0000 7f8039953640 1 Processor -- start 2023-12-08T08:20:51.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.831+0000 7f8039953640 1 -- start start 2023-12-08T08:20:51.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.831+0000 7f8039953640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 0x7f80340ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.831+0000 7f8039953640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f80340afeb0 0x7f80340cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f8039953640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803406d650 con 0x7f80340cf790 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f8039953640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80340adbe0 con 0x7f80340afeb0 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f8039953640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803415d970 con 0x7f803415d590 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80337fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f80340cf790 0x7f8034161070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49160/0 (socket says 172.21.15.50:49160) 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80337fe640 1 -- 172.21.15.50:0/2562683842 learned_addr learned my addr 172.21.15.50:0/2562683842 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f802bfff640 1 --2- 172.21.15.50:0/2562683842 >> v2:172.21.15.170:3300/0 conn(0x7f80340afeb0 0x7f80340cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f8032ffd640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 0x7f80340ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405225721 0 0) 0x7f802c001490 con 0x7f80340cf790 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8020003520 con 0x7f80340cf790 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287087650 0 0) 0x7f8020003520 con 0x7f80340cf790 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 msgr2=0x7f80340ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 0x7f80340ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 >> v2:172.21.15.170:3300/0 conn(0x7f80340afeb0 msgr2=0x7f80340cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 --2- 172.21.15.50:0/2562683842 >> v2:172.21.15.170:3300/0 conn(0x7f80340afeb0 0x7f80340cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803406c810 con 0x7f80340cf790 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f802c001b80 con 0x7f80340cf790 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 >> v1:172.21.15.50:6789/0 conn(0x7f80340cf790 legacy=0x7f8034161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020003970 0x7f8020003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 0x7f80200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020004d00 0x7f8020005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340adbe0 con 0x7f8020004d00 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803415d970 con 0x7f8020003970 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.832+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802000b980 con 0x7f803415d590 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f80337fe640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020004d00 0x7f8020005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f8032ffd640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020003970 0x7f8020003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f802bfff640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 0x7f80200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f80337fe640 1 -- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 msgr2=0x7f80200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f80337fe640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803415d590 0x7f80200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f80337fe640 1 -- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020003970 msgr2=0x7f8020003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f80337fe640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020003970 0x7f8020003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.833+0000 7f80337fe640 1 -- 172.21.15.50:0/2562683842 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020003520 con 0x7f8020004d00 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f80337fe640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020004d00 0x7f8020005180 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f802c00a830 tx=0x7f80200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46efd4733b0b919a server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c034630 con 0x7f8020004d00 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c02f070 con 0x7f8020004d00 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f80327fc640 1 -- 172.21.15.50:0/2562683842 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0349f0 con 0x7f8020004d00 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f8039953640 1 -- 172.21.15.50:0/2562683842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020004d00 msgr2=0x7f8020005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f8039953640 1 --2- 172.21.15.50:0/2562683842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8020004d00 0x7f8020005180 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f802c00a830 tx=0x7f80200057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f80337fe640 1 -- 172.21.15.50:0/2562683842 reap_dead start 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f8039953640 1 -- 172.21.15.50:0/2562683842 shutdown_connections 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f8039953640 1 -- 172.21.15.50:0/2562683842 >> 172.21.15.50:0/2562683842 conn(0x7f80340d0e10 msgr2=0x7f80340d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:51.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f8039953640 1 -- 172.21.15.50:0/2562683842 shutdown_connections 2023-12-08T08:20:51.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.834+0000 7f8039953640 1 -- 172.21.15.50:0/2562683842 wait complete. 2023-12-08T08:20:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.835+0000 7f8039953640 1 Processor -- start 2023-12-08T08:20:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f8039953640 1 -- start start 2023-12-08T08:20:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f8039953640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020004d00 0x7f803414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f8039953640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803414ded0 0x7f80341504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f8039953640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8034150a20 0x7f80340c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f8039953640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8034150eb0 con 0x7f8034150a20 2023-12-08T08:20:51.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f8039953640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803414e450 con 0x7f8020004d00 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f8039953640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8034151940 con 0x7f803414ded0 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f80337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8034150a20 0x7f80340c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f80337fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8034150a20 0x7f80340c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35596/0 (socket says 172.21.15.50:35596) 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.836+0000 7f80337fe640 1 -- 172.21.15.50:0/2257331224 learned_addr learned my addr 172.21.15.50:0/2257331224 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f802bfff640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803414ded0 0x7f80341504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f8032ffd640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020004d00 0x7f803414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f80337fe640 1 -- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803414ded0 msgr2=0x7f80341504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f80337fe640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803414ded0 0x7f80341504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f80337fe640 1 -- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020004d00 msgr2=0x7f803414d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f80337fe640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020004d00 0x7f803414d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f80337fe640 1 -- 172.21.15.50:0/2257331224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340c9e20 con 0x7f8034150a20 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f80337fe640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8034150a20 0x7f80340c8f90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f802c02cb80 tx=0x7f802c001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f8030ff9640 1 -- 172.21.15.50:0/2257331224 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c034630 con 0x7f8034150a20 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f8030ff9640 1 -- 172.21.15.50:0/2257331224 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c034790 con 0x7f8034150a20 2023-12-08T08:20:51.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803414e6a0 con 0x7f8034150a20 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f8030ff9640 1 -- 172.21.15.50:0/2257331224 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c034b20 con 0x7f8034150a20 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.837+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803414ec60 con 0x7f8034150a20 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.838+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8034067430 con 0x7f8034150a20 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.839+0000 7f8030ff9640 1 -- 172.21.15.50:0/2257331224 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f802c031030 con 0x7f8034150a20 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.839+0000 7f8030ff9640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f801406ae70 0x7f801406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.839+0000 7f8030ff9640 1 -- 172.21.15.50:0/2257331224 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f802c0ab150 con 0x7f8034150a20 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.840+0000 7f8032ffd640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f801406ae70 0x7f801406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:51.844 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.840+0000 7f8032ffd640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f801406ae70 0x7f801406d330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8024009bc0 tx=0x7f8024009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:51.846 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:51.844+0000 7f8030ff9640 1 -- 172.21.15.50:0/2257331224 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f802c076330 con 0x7f8034150a20 2023-12-08T08:20:52.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.019+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8034067430 con 0x7f8034150a20 2023-12-08T08:20:52.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.019+0000 7f8030ff9640 1 -- 172.21.15.50:0/2257331224 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f802c079950 con 0x7f8034150a20 2023-12-08T08:20:52.022 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f801406ae70 msgr2=0x7f801406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f801406ae70 0x7f801406d330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8024009bc0 tx=0x7f8024009190 comp rx=0 tx=0).stop 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8034150a20 msgr2=0x7f80340c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8034150a20 0x7f80340c8f90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f802c02cb80 tx=0x7f802c001f10 comp rx=0 tx=0).stop 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 shutdown_connections 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f801406ae70 0x7f801406d330 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8034150a20 0x7f80340c8f90 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f803414ded0 0x7f80341504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.024 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 --2- 172.21.15.50:0/2257331224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8020004d00 0x7f803414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.021+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 >> 172.21.15.50:0/2257331224 conn(0x7f80340d0e10 msgr2=0x7f80340b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.022+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 shutdown_connections 2023-12-08T08:20:52.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.022+0000 7f8039953640 1 -- 172.21.15.50:0/2257331224 wait complete. 2023-12-08T08:20:52.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-08T08:20:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.140+0000 7fc75af33640 1 Processor -- start 2023-12-08T08:20:52.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.140+0000 7fc75af33640 1 -- start start 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc75af33640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc7540ccd70 0x7fc7540ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc75af33640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc75406c650 0x7fc75415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc75af33640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7540cf9c0 con 0x7fc7540cf1e0 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc75af33640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540d0a60 con 0x7fc75406c650 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc75af33640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7540ce7b0 con 0x7fc7540ccd70 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc7594d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc75406c650 0x7fc75415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc7594d0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc75406c650 0x7fc75415ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35600/0 (socket says 172.21.15.50:35600) 2023-12-08T08:20:52.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc7594d0640 1 -- 172.21.15.50:0/1191035983 learned_addr learned my addr 172.21.15.50:0/1191035983 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.141+0000 7fc758ccf640 1 --2- 172.21.15.50:0/1191035983 >> v2:172.21.15.170:3300/0 conn(0x7fc7540ccd70 0x7fc7540ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.142+0000 7fc7594d0640 1 -- 172.21.15.50:0/1191035983 >> v2:172.21.15.170:3300/0 conn(0x7fc7540ccd70 msgr2=0x7fc7540ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.142+0000 7fc7594d0640 1 --2- 172.21.15.50:0/1191035983 >> v2:172.21.15.170:3300/0 conn(0x7fc7540ccd70 0x7fc7540ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.142+0000 7fc7594d0640 1 -- 172.21.15.50:0/1191035983 >> v1:172.21.15.170:6789/0 conn(0x7fc7540cf1e0 legacy=0x7fc75406bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.142+0000 7fc7594d0640 1 -- 172.21.15.50:0/1191035983 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540cfca0 con 0x7fc75406c650 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.142+0000 7fc7594d0640 1 --2- 172.21.15.50:0/1191035983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75406c650 0x7fc75415ca50 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc754071080 tx=0x7fc74c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65abd358510d063 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.142+0000 7fc7537fe640 1 -- 172.21.15.50:0/1191035983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c02ca80 con 0x7fc75406c650 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc7537fe640 1 -- 172.21.15.50:0/1191035983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c02cbe0 con 0x7fc75406c650 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc7537fe640 1 -- 172.21.15.50:0/1191035983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0343f0 con 0x7fc75406c650 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 -- 172.21.15.50:0/1191035983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75406c650 msgr2=0x7fc75415ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 --2- 172.21.15.50:0/1191035983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75406c650 0x7fc75415ca50 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc754071080 tx=0x7fc74c02bee0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 -- 172.21.15.50:0/1191035983 shutdown_connections 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 --2- 172.21.15.50:0/1191035983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc75406c650 0x7fc75415ca50 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.146 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 --2- 172.21.15.50:0/1191035983 >> v2:172.21.15.170:3300/0 conn(0x7fc7540ccd70 0x7fc7540ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 -- 172.21.15.50:0/1191035983 >> 172.21.15.50:0/1191035983 conn(0x7fc7540d0de0 msgr2=0x7fc7540d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 -- 172.21.15.50:0/1191035983 shutdown_connections 2023-12-08T08:20:52.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.143+0000 7fc75af33640 1 -- 172.21.15.50:0/1191035983 wait complete. 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.144+0000 7fc75af33640 1 Processor -- start 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.144+0000 7fc75af33640 1 -- start start 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc75af33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75406c650 0x7fc7540c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc75af33640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7540ccd70 0x7fc7541f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc75af33640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7540cf1e0 0x7fc754152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc75af33640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540c6740 con 0x7fc7540ccd70 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc75af33640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541f7430 con 0x7fc75406c650 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc75af33640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540c8490 con 0x7fc7540cf1e0 2023-12-08T08:20:52.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc753fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7540ccd70 0x7fc7541f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc753fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7540ccd70 0x7fc7541f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35614/0 (socket says 172.21.15.50:35614) 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc753fff640 1 -- 172.21.15.50:0/2511229741 learned_addr learned my addr 172.21.15.50:0/2511229741 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc758ccf640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75406c650 0x7fc7540c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.145+0000 7fc7594d0640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7540cf1e0 0x7fc754152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc753fff640 1 -- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7540cf1e0 msgr2=0x7fc754152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc753fff640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7540cf1e0 0x7fc754152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc753fff640 1 -- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75406c650 msgr2=0x7fc7540c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc753fff640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75406c650 0x7fc7540c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc753fff640 1 -- 172.21.15.50:0/2511229741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c009b30 con 0x7fc7540ccd70 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc753fff640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7540ccd70 0x7fc7541f6ef0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c430 tx=0x7fc74800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc7517fa640 1 -- 172.21.15.50:0/2511229741 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011790 con 0x7fc7540ccd70 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc7517fa640 1 -- 172.21.15.50:0/2511229741 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480118f0 con 0x7fc7540ccd70 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc7517fa640 1 -- 172.21.15.50:0/2511229741 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011ce0 con 0x7fc7540ccd70 2023-12-08T08:20:52.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7540c8770 con 0x7fc7540ccd70 2023-12-08T08:20:52.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.146+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7540c8d30 con 0x7fc7540ccd70 2023-12-08T08:20:52.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.147+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc754067430 con 0x7fc7540ccd70 2023-12-08T08:20:52.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.147+0000 7fc7517fa640 1 -- 172.21.15.50:0/2511229741 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc74801c460 con 0x7fc7540ccd70 2023-12-08T08:20:52.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.148+0000 7fc7517fa640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc74006ae70 0x7fc74006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.148+0000 7fc7517fa640 1 -- 172.21.15.50:0/2511229741 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc7480894e0 con 0x7fc7540ccd70 2023-12-08T08:20:52.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.148+0000 7fc758ccf640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc74006ae70 0x7fc74006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.149+0000 7fc758ccf640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc74006ae70 0x7fc74006d330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc744006fd0 tx=0x7fc744008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.152+0000 7fc7517fa640 1 -- 172.21.15.50:0/2511229741 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc748054590 con 0x7fc7540ccd70 2023-12-08T08:20:52.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.344+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc754072520 con 0x7fc7540ccd70 2023-12-08T08:20:52.347 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.344+0000 7fc7517fa640 1 -- 172.21.15.50:0/2511229741 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc748057bb0 con 0x7fc7540ccd70 2023-12-08T08:20:52.347 INFO:teuthology.orchestra.run.smithi050.stderr:listed 0 entries 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc74006ae70 msgr2=0x7fc74006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc74006ae70 0x7fc74006d330 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc744006fd0 tx=0x7fc744008040 comp rx=0 tx=0).stop 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7540ccd70 msgr2=0x7fc7541f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7540ccd70 0x7fc7541f6ef0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c430 tx=0x7fc74800c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 shutdown_connections 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fc74006ae70 0x7fc74006d330 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7540ccd70 0x7fc7541f6ef0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7540cf1e0 0x7fc754152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 --2- 172.21.15.50:0/2511229741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75406c650 0x7fc7540c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.349 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 >> 172.21.15.50:0/2511229741 conn(0x7fc7540d0de0 msgr2=0x7fc75406be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 shutdown_connections 2023-12-08T08:20:52.350 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.346+0000 7fc75af33640 1 -- 172.21.15.50:0/2511229741 wait complete. 2023-12-08T08:20:52.359 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi050.front.sepia.ceph.com... 2023-12-08T08:20:52.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:52.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-08T08:20:52.389 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi050.stderr:ceph-fuse[112925]: fuse finished with error 0 and tester_r 0 2023-12-08T08:20:52.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:20:52.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:52.390 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-08T08:20:52.488 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:20:52.488 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:52.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:20:52.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:20:52.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:52.511 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-08T08:20:52.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:52.569 INFO:teuthology.orchestra.run.smithi170.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-08T08:20:52.569 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:20:52.569 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:52.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2474 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-08T08:20:52.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:20:52.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:52.586 DEBUG:teuthology.orchestra.run.smithi050:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-08T08:20:52.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:52.643 INFO:teuthology.orchestra.run.smithi050.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-08T08:20:52.643 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:20:52.643 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:20:52.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:20:52.661 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:20:52.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:20:52.662 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-08T08:20:52.718 INFO:teuthology.orchestra.run.smithi170.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-08T08:20:52.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:20:52.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.824+0000 7f444b075640 1 Processor -- start 2023-12-08T08:20:52.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.824+0000 7f444b075640 1 -- start start 2023-12-08T08:20:52.827 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.824+0000 7f444b075640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44440b0cf0 0x7f44440d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.824+0000 7f444b075640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f44440b1d70 0x7f44440cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.824+0000 7f444b075640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44440d20b0 con 0x7f44441608a0 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.824+0000 7f444b075640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44440d0620 con 0x7f44440b1d70 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.824+0000 7f444b075640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44440d1b80 con 0x7f44440b0cf0 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4449612640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f44440b1d70 0x7f44440cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4443fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44440b0cf0 0x7f44440d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4443fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44440b0cf0 0x7f44440d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:50548/0 (socket says 172.21.15.50:50548) 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4443fff640 1 -- 172.21.15.50:0/2523992196 learned_addr learned my addr 172.21.15.50:0/2523992196 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f44437fe640 1 -- 172.21.15.50:0/2523992196 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202749335 0 0) 0x7f44440d20b0 con 0x7f44441608a0 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f44437fe640 1 -- 172.21.15.50:0/2523992196 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4434003520 con 0x7f44441608a0 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4443fff640 1 -- 172.21.15.50:0/2523992196 >> v2:172.21.15.170:3300/0 conn(0x7f44440b1d70 msgr2=0x7f44440cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4443fff640 1 --2- 172.21.15.50:0/2523992196 >> v2:172.21.15.170:3300/0 conn(0x7f44440b1d70 0x7f44440cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4443fff640 1 -- 172.21.15.50:0/2523992196 >> v1:172.21.15.170:6789/0 conn(0x7f44441608a0 legacy=0x7f44440d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.828 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4443fff640 1 -- 172.21.15.50:0/2523992196 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44440d1dd0 con 0x7f44440b0cf0 2023-12-08T08:20:52.829 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.825+0000 7f4449612640 1 --2- 172.21.15.50:0/2523992196 >> v2:172.21.15.170:3300/0 conn(0x7f44440b1d70 0x7f44440cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.826+0000 7f4443fff640 1 --2- 172.21.15.50:0/2523992196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44440b0cf0 0x7f44440d1640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4430009870 tx=0x7f443002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc86d5ec9e753e25 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.826+0000 7f44437fe640 1 -- 172.21.15.50:0/2523992196 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430031640 con 0x7f44440b0cf0 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.826+0000 7f44437fe640 1 -- 172.21.15.50:0/2523992196 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44300317a0 con 0x7f44440b0cf0 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.826+0000 7f44437fe640 1 -- 172.21.15.50:0/2523992196 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430031b30 con 0x7f44440b0cf0 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 -- 172.21.15.50:0/2523992196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44440b0cf0 msgr2=0x7f44440d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 --2- 172.21.15.50:0/2523992196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44440b0cf0 0x7f44440d1640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4430009870 tx=0x7f443002b8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 -- 172.21.15.50:0/2523992196 shutdown_connections 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 --2- 172.21.15.50:0/2523992196 >> v2:172.21.15.170:3300/0 conn(0x7f44440b1d70 0x7f44440cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 --2- 172.21.15.50:0/2523992196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44440b0cf0 0x7f44440d1640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 -- 172.21.15.50:0/2523992196 >> 172.21.15.50:0/2523992196 conn(0x7f44440d3030 msgr2=0x7f44440d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 -- 172.21.15.50:0/2523992196 shutdown_connections 2023-12-08T08:20:52.830 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.827+0000 7f444b075640 1 -- 172.21.15.50:0/2523992196 wait complete. 2023-12-08T08:20:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.828+0000 7f444b075640 1 Processor -- start 2023-12-08T08:20:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.828+0000 7f444b075640 1 -- start start 2023-12-08T08:20:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f444b075640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44440b0cf0 0x7f44440cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f444b075640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440b1d70 0x7f44440b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f444b075640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44441608a0 0x7f44440b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f444b075640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44440b5d80 con 0x7f44440b1d70 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f444b075640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44440b6020 con 0x7f44440b0cf0 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f444b075640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44440b6300 con 0x7f44441608a0 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440b1d70 0x7f44440b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440b1d70 0x7f44440b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35622/0 (socket says 172.21.15.50:35622) 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 -- 172.21.15.50:0/3122244014 learned_addr learned my addr 172.21.15.50:0/3122244014 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4449612640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44441608a0 0x7f44440b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4448e11640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44440b0cf0 0x7f44440cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 -- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44441608a0 msgr2=0x7f44440b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44441608a0 0x7f44440b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 -- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44440b0cf0 msgr2=0x7f44440cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44440b0cf0 0x7f44440cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4443fff640 1 -- 172.21.15.50:0/3122244014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009a70 con 0x7f44440b1d70 2023-12-08T08:20:52.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4448e11640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44440b0cf0 0x7f44440cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.829+0000 7f4449612640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44441608a0 0x7f44440b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.830+0000 7f4443fff640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440b1d70 0x7f44440b7360 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4430000c00 tx=0x7f44300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.830+0000 7f44417fa640 1 -- 172.21.15.50:0/3122244014 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443003a8b0 con 0x7f44440b1d70 2023-12-08T08:20:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.830+0000 7f44417fa640 1 -- 172.21.15.50:0/3122244014 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443003aa10 con 0x7f44440b1d70 2023-12-08T08:20:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.830+0000 7f44417fa640 1 -- 172.21.15.50:0/3122244014 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443003adc0 con 0x7f44440b1d70 2023-12-08T08:20:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.830+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44300094d0 con 0x7f44440b1d70 2023-12-08T08:20:52.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.830+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44440b68c0 con 0x7f44440b1d70 2023-12-08T08:20:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.831+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4444067430 con 0x7f44440b1d70 2023-12-08T08:20:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.831+0000 7f44417fa640 1 -- 172.21.15.50:0/3122244014 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f443002f050 con 0x7f44440b1d70 2023-12-08T08:20:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.832+0000 7f44417fa640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f442806ae40 0x7f442806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.832+0000 7f44417fa640 1 -- 172.21.15.50:0/3122244014 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f44300ab6d0 con 0x7f44440b1d70 2023-12-08T08:20:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.832+0000 7f4448e11640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f442806ae40 0x7f442806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:52.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.833+0000 7f4448e11640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f442806ae40 0x7f442806d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f444415d140 tx=0x7f4438009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:52.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:52.836+0000 7f44417fa640 1 -- 172.21.15.50:0/3122244014 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44300765b0 con 0x7f44440b1d70 2023-12-08T08:20:53.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.048+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44440b2280 con 0x7f44440b1d70 2023-12-08T08:20:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.048+0000 7f44417fa640 1 -- 172.21.15.50:0/3122244014 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f4430079bd0 con 0x7f44440b1d70 2023-12-08T08:20:53.051 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:53.051 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/3932110318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":3932110318},{"type":"v1","addr":"172.21.15.170:6836","nonce":3932110318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/1019645291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":1019645291},{"type":"v1","addr":"172.21.15.170:6837","nonce":1019645291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3216810814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3216810814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3216810814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:26.368189+0000","modified":"2023-12-08T08:20:28.353010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4199554410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4199554410},{"type":"v1","addr":"172.21.15.50:6835","nonce":4199554410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:20:53.051 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-12-08T08:20:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.050+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f442806ae40 msgr2=0x7f442806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.050+0000 7f444b075640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f442806ae40 0x7f442806d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f444415d140 tx=0x7f4438009040 comp rx=0 tx=0).stop 2023-12-08T08:20:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.050+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440b1d70 msgr2=0x7f44440b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.050+0000 7f444b075640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440b1d70 0x7f44440b7360 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4430000c00 tx=0x7f44300046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 shutdown_connections 2023-12-08T08:20:53.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f442806ae40 0x7f442806d300 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f44440b1d70 0x7f44440b7360 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44441608a0 0x7f44440b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 --2- 172.21.15.50:0/3122244014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44440b0cf0 0x7f44440cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 >> 172.21.15.50:0/3122244014 conn(0x7f44440d3030 msgr2=0x7f44440d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 shutdown_connections 2023-12-08T08:20:53.054 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.051+0000 7f444b075640 1 -- 172.21.15.50:0/3122244014 wait complete. 2023-12-08T08:20:53.064 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:53.170 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.168+0000 7fe63ae9b640 1 Processor -- start 2023-12-08T08:20:53.171 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.168+0000 7fe63ae9b640 1 -- start start 2023-12-08T08:20:53.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe63ae9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe6340c9600 0x7fe6340704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe63ae9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe634070a10 0x7fe634070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe63ae9b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340c4910 con 0x7fe6340b0c20 2023-12-08T08:20:53.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe63ae9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe634072340 con 0x7fe634070a10 2023-12-08T08:20:53.172 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe63ae9b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6340c5cf0 con 0x7fe6340c9600 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe639438640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe634070a10 0x7fe634070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe639438640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe634070a10 0x7fe634070ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35626/0 (socket says 172.21.15.50:35626) 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe639438640 1 -- 172.21.15.50:0/1064906388 learned_addr learned my addr 172.21.15.50:0/1064906388 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe633fff640 1 --2- 172.21.15.50:0/1064906388 >> v2:172.21.15.170:3300/0 conn(0x7fe6340c9600 0x7fe6340704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe639438640 1 -- 172.21.15.50:0/1064906388 >> v2:172.21.15.170:3300/0 conn(0x7fe6340c9600 msgr2=0x7fe6340704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe639438640 1 --2- 172.21.15.50:0/1064906388 >> v2:172.21.15.170:3300/0 conn(0x7fe6340c9600 0x7fe6340704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe639438640 1 -- 172.21.15.50:0/1064906388 >> v1:172.21.15.170:6789/0 conn(0x7fe6340b0c20 legacy=0x7fe6340b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe639438640 1 -- 172.21.15.50:0/1064906388 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340c4b60 con 0x7fe634070a10 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.169+0000 7fe633fff640 1 --2- 172.21.15.50:0/1064906388 >> v2:172.21.15.170:3300/0 conn(0x7fe6340c9600 0x7fe6340704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.170+0000 7fe639438640 1 --2- 172.21.15.50:0/1064906388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe634070a10 0x7fe634070ea0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe6340b51e0 tx=0x7fe62c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275cd88c63a729ca server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.170+0000 7fe6337fe640 1 -- 172.21.15.50:0/1064906388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c02c9f0 con 0x7fe634070a10 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.170+0000 7fe6337fe640 1 -- 172.21.15.50:0/1064906388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c02cb50 con 0x7fe634070a10 2023-12-08T08:20:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.170+0000 7fe6337fe640 1 -- 172.21.15.50:0/1064906388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0343f0 con 0x7fe634070a10 2023-12-08T08:20:53.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 -- 172.21.15.50:0/1064906388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe634070a10 msgr2=0x7fe634070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.174 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/1064906388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe634070a10 0x7fe634070ea0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe6340b51e0 tx=0x7fe62c02be50 comp rx=0 tx=0).stop 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 -- 172.21.15.50:0/1064906388 shutdown_connections 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/1064906388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe634070a10 0x7fe634070ea0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/1064906388 >> v2:172.21.15.170:3300/0 conn(0x7fe6340c9600 0x7fe6340704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 -- 172.21.15.50:0/1064906388 >> 172.21.15.50:0/1064906388 conn(0x7fe6340cf040 msgr2=0x7fe6340cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 -- 172.21.15.50:0/1064906388 shutdown_connections 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.171+0000 7fe63ae9b640 1 -- 172.21.15.50:0/1064906388 wait complete. 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.172+0000 7fe63ae9b640 1 Processor -- start 2023-12-08T08:20:53.175 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.172+0000 7fe63ae9b640 1 -- start start 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe63ae9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe634070a10 0x7fe634157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe63ae9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6340b0c20 0x7fe6340b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe63ae9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6340c9600 0x7fe6340b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe63ae9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b3d00 con 0x7fe6340c9600 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe63ae9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b3080 con 0x7fe634070a10 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe63ae9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b3360 con 0x7fe6340b0c20 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6340c9600 0x7fe6340b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.177 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6340c9600 0x7fe6340b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35640/0 (socket says 172.21.15.50:35640) 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 -- 172.21.15.50:0/2411735411 learned_addr learned my addr 172.21.15.50:0/2411735411 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe633fff640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6340b0c20 0x7fe6340b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe638c37640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe634070a10 0x7fe634157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 -- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6340b0c20 msgr2=0x7fe6340b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6340b0c20 0x7fe6340b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 -- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe634070a10 msgr2=0x7fe634157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe634070a10 0x7fe634157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe639438640 1 -- 172.21.15.50:0/2411735411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c009b30 con 0x7fe6340c9600 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe638c37640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe634070a10 0x7fe634157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.173+0000 7fe633fff640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6340b0c20 0x7fe6340b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.174+0000 7fe639438640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6340c9600 0x7fe6340b1d30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe62c036040 tx=0x7fe62c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.174+0000 7fe6317fa640 1 -- 172.21.15.50:0/2411735411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c009510 con 0x7fe6340c9600 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.174+0000 7fe6317fa640 1 -- 172.21.15.50:0/2411735411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c03e450 con 0x7fe6340c9600 2023-12-08T08:20:53.178 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.174+0000 7fe6317fa640 1 -- 172.21.15.50:0/2411735411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c03e800 con 0x7fe6340c9600 2023-12-08T08:20:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.174+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6340b3640 con 0x7fe6340c9600 2023-12-08T08:20:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.174+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe634157980 con 0x7fe6340c9600 2023-12-08T08:20:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.175+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6340b3e40 con 0x7fe6340c9600 2023-12-08T08:20:53.179 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.175+0000 7fe6317fa640 1 -- 172.21.15.50:0/2411735411 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe62c03e960 con 0x7fe6340c9600 2023-12-08T08:20:53.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.176+0000 7fe6317fa640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe61806ae40 0x7fe61806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.176+0000 7fe6317fa640 1 -- 172.21.15.50:0/2411735411 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe62c0ac580 con 0x7fe6340c9600 2023-12-08T08:20:53.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.176+0000 7fe638c37640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe61806ae40 0x7fe61806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.180 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.176+0000 7fe638c37640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe61806ae40 0x7fe61806d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe628006fd0 tx=0x7fe628008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.182 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.180+0000 7fe6317fa640 1 -- 172.21.15.50:0/2411735411 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6340b3e40 con 0x7fe6340c9600 2023-12-08T08:20:53.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.359+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6340b3e40 con 0x7fe6340c9600 2023-12-08T08:20:53.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.360+0000 7fe6317fa640 1 -- 172.21.15.50:0/2411735411 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fe6340b3e40 con 0x7fe6340c9600 2023-12-08T08:20:53.362 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:53.362 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe61806ae40 msgr2=0x7fe61806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe61806ae40 0x7fe61806d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe628006fd0 tx=0x7fe628008040 comp rx=0 tx=0).stop 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6340c9600 msgr2=0x7fe6340b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6340c9600 0x7fe6340b1d30 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe62c036040 tx=0x7fe62c004a40 comp rx=0 tx=0).stop 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 shutdown_connections 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe61806ae40 0x7fe61806d300 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6340c9600 0x7fe6340b1d30 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6340b0c20 0x7fe6340b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 --2- 172.21.15.50:0/2411735411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe634070a10 0x7fe634157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 >> 172.21.15.50:0/2411735411 conn(0x7fe6340cf040 msgr2=0x7fe6340c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 shutdown_connections 2023-12-08T08:20:53.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.362+0000 7fe63ae9b640 1 -- 172.21.15.50:0/2411735411 wait complete. 2023-12-08T08:20:53.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-08T08:17:44.165976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-08T08:20:24.505729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-08T08:20:25.407648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-08T08:20:53.376 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-08T08:20:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.483+0000 7fd0168c9640 1 Processor -- start 2023-12-08T08:20:53.486 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.483+0000 7fd0168c9640 1 -- start start 2023-12-08T08:20:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd0168c9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd01015d4f0 0x7fd0100b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd0168c9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0100b2280 con 0x7fd0100b0920 2023-12-08T08:20:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd0168c9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0100b1430 con 0x7fd0100cef90 2023-12-08T08:20:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd0168c9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01006bb40 con 0x7fd01015d4f0 2023-12-08T08:20:53.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd00f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fd0100b0920 0x7fd0100b0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49162/0 (socket says 172.21.15.50:49162) 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd00f7fe640 1 -- 172.21.15.50:0/2254594089 learned_addr learned my addr 172.21.15.50:0/2254594089 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd00ffff640 1 --2- 172.21.15.50:0/2254594089 >> v2:172.21.15.170:3300/0 conn(0x7fd01015d4f0 0x7fd0100b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.484+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509095548 0 0) 0x7fd0100b2280 con 0x7fd0100b0920 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcffc003520 con 0x7fd0100b0920 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1315326590 0 0) 0x7fcffc003520 con 0x7fd0100b0920 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 >> v2:172.21.15.170:3300/0 conn(0x7fd01015d4f0 msgr2=0x7fd0100b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 --2- 172.21.15.50:0/2254594089 >> v2:172.21.15.170:3300/0 conn(0x7fd01015d4f0 0x7fd0100b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 >> v1:172.21.15.170:6789/0 conn(0x7fd0100cef90 legacy=0x7fd0100cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0100b2710 con 0x7fd0100b0920 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fd000001670 con 0x7fd0100b0920 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 >> v1:172.21.15.50:6789/0 conn(0x7fd0100b0920 legacy=0x7fd0100b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcffc003970 0x7fcffc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcffc0047c0 0x7fcffc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc005180 0x7fcffc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01006bb40 con 0x7fcffc0047c0 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc00c020 con 0x7fcffc003970 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc00c1e0 con 0x7fcffc005180 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00f7fe640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcffc0047c0 0x7fcffc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00ffff640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcffc003970 0x7fcffc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd014e66640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc005180 0x7fcffc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00f7fe640 1 -- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc005180 msgr2=0x7fcffc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00f7fe640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc005180 0x7fcffc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00f7fe640 1 -- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcffc003970 msgr2=0x7fcffc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00f7fe640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcffc003970 0x7fcffc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd00f7fe640 1 -- 172.21.15.50:0/2254594089 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc003520 con 0x7fcffc0047c0 2023-12-08T08:20:53.491 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.485+0000 7fd014e66640 1 -- 172.21.15.50:0/2254594089 reap_dead start 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.486+0000 7fd00f7fe640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcffc0047c0 0x7fcffc004c40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd00000c240 tx=0x7fcffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b101c66093097c26 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.486+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000005ad0 con 0x7fcffc0047c0 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.486+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000005c30 con 0x7fcffc0047c0 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.486+0000 7fd00effd640 1 -- 172.21.15.50:0/2254594089 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00002cab0 con 0x7fcffc0047c0 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.487+0000 7fd0168c9640 1 -- 172.21.15.50:0/2254594089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcffc0047c0 msgr2=0x7fcffc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.487+0000 7fd0168c9640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcffc0047c0 0x7fcffc004c40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd00000c240 tx=0x7fcffc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.487+0000 7fd0168c9640 1 -- 172.21.15.50:0/2254594089 shutdown_connections 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.487+0000 7fd0168c9640 1 --2- 172.21.15.50:0/2254594089 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcffc0047c0 0x7fcffc004c40 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.487+0000 7fd0168c9640 1 -- 172.21.15.50:0/2254594089 >> 172.21.15.50:0/2254594089 conn(0x7fd0100d0e00 msgr2=0x7fd0100d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.487+0000 7fd0168c9640 1 -- 172.21.15.50:0/2254594089 shutdown_connections 2023-12-08T08:20:53.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.487+0000 7fd0168c9640 1 -- 172.21.15.50:0/2254594089 wait complete. 2023-12-08T08:20:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.488+0000 7fd0168c9640 1 Processor -- start 2023-12-08T08:20:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.488+0000 7fd0168c9640 1 -- start start 2023-12-08T08:20:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd0168c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc0047c0 0x7fd0101f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd0168c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01015f1d0 0x7fd0101f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd0168c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01015e270 0x7fd01015e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd0168c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100c5090 con 0x7fd01015e270 2023-12-08T08:20:53.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd0168c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01015ec60 con 0x7fd01015f1d0 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd0168c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01015f9d0 con 0x7fcffc0047c0 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01015e270 0x7fd01015e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01015e270 0x7fd01015e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35658/0 (socket says 172.21.15.50:35658) 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 -- 172.21.15.50:0/1559510948 learned_addr learned my addr 172.21.15.50:0/1559510948 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd00ffff640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc0047c0 0x7fd0101f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd00f7fe640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01015f1d0 0x7fd0101f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 -- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc0047c0 msgr2=0x7fd0101f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc0047c0 0x7fd0101f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 -- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01015f1d0 msgr2=0x7fd0101f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01015f1d0 0x7fd0101f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 -- 172.21.15.50:0/1559510948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0101f38a0 con 0x7fd01015e270 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd00f7fe640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01015f1d0 0x7fd0101f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.489+0000 7fd014e66640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01015e270 0x7fd01015e720 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd010071ba0 tx=0x7fd00800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.490+0000 7fd00cff9640 1 -- 172.21.15.50:0/1559510948 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008003970 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.490+0000 7fd00cff9640 1 -- 172.21.15.50:0/1559510948 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd008003af0 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.490+0000 7fd00cff9640 1 -- 172.21.15.50:0/1559510948 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd008003ea0 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.490+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0101f2ae0 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.490+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0101f30a0 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.491+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd010067430 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.491+0000 7fd00cff9640 1 -- 172.21.15.50:0/1559510948 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0080050d0 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.491+0000 7fd00cff9640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcff006ae70 0x7fcff006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.492+0000 7fd00cff9640 1 -- 172.21.15.50:0/1559510948 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd008089560 con 0x7fd01015e270 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.492+0000 7fd00ffff640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcff006ae70 0x7fcff006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.492+0000 7fd00ffff640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcff006ae70 0x7fcff006d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd01006cd30 tx=0x7fcff8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.496+0000 7fd00cff9640 1 -- 172.21.15.50:0/1559510948 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd008054560 con 0x7fd01015e270 2023-12-08T08:20:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.672+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd01006bdd0 con 0x7fd01015e270 2023-12-08T08:20:53.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.673+0000 7fd00cff9640 1 -- 172.21.15.50:0/1559510948 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd008057b80 con 0x7fd01015e270 2023-12-08T08:20:53.675 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 1 2023-12-08T08:20:53.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcff006ae70 msgr2=0x7fcff006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcff006ae70 0x7fcff006d330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd01006cd30 tx=0x7fcff8009190 comp rx=0 tx=0).stop 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01015e270 msgr2=0x7fd01015e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01015e270 0x7fd01015e720 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd010071ba0 tx=0x7fd00800fbb0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 shutdown_connections 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcff006ae70 0x7fcff006d330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01015e270 0x7fd01015e720 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd01015f1d0 0x7fd0101f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 --2- 172.21.15.50:0/1559510948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcffc0047c0 0x7fd0101f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 >> 172.21.15.50:0/1559510948 conn(0x7fd0100d0e00 msgr2=0x7fd010160270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 shutdown_connections 2023-12-08T08:20:53.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.675+0000 7fd0168c9640 1 -- 172.21.15.50:0/1559510948 wait complete. 2023-12-08T08:20:53.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-08T08:20:53.797 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.795+0000 7f6376d53640 1 Processor -- start 2023-12-08T08:20:53.798 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.795+0000 7f6376d53640 1 -- start start 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6376d53640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63700b4150 0x7f63700b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6376d53640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63700c6be0 con 0x7f63700cfe10 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6376d53640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63700d3ff0 con 0x7f63700cfa30 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6376d53640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700b4860 con 0x7f63700b4150 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6367fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f63700b4150 0x7f63700b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f63752f0640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f63700cfe10 0x7f63700cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49164/0 (socket says 172.21.15.50:49164) 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f63752f0640 1 -- 172.21.15.50:0/1043665702 learned_addr learned my addr 172.21.15.50:0/1043665702 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6367fff640 1 -- 172.21.15.50:0/1043665702 >> v1:172.21.15.170:6789/0 conn(0x7f63700cfa30 legacy=0x7f63700b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6367fff640 1 -- 172.21.15.50:0/1043665702 >> v1:172.21.15.50:6789/0 conn(0x7f63700cfe10 legacy=0x7f63700cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f63677fe640 1 -- 172.21.15.50:0/1043665702 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158370943 0 0) 0x7f63700c6be0 con 0x7f63700cfe10 2023-12-08T08:20:53.799 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.796+0000 7f6367fff640 1 -- 172.21.15.50:0/1043665702 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700d3d50 con 0x7f63700b4150 2023-12-08T08:20:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.797+0000 7f6367fff640 1 --2- 172.21.15.50:0/1043665702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b4150 0x7f63700b3630 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f63600097a0 tx=0x7f636002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472e9e88ee9b3e37 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.797+0000 7f63677fe640 1 -- 172.21.15.50:0/1043665702 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360031830 con 0x7f63700b4150 2023-12-08T08:20:53.800 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.797+0000 7f63677fe640 1 -- 172.21.15.50:0/1043665702 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360031990 con 0x7f63700b4150 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.797+0000 7f63677fe640 1 -- 172.21.15.50:0/1043665702 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360031d20 con 0x7f63700b4150 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.798+0000 7f6376d53640 1 -- 172.21.15.50:0/1043665702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b4150 msgr2=0x7f63700b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.798+0000 7f6376d53640 1 --2- 172.21.15.50:0/1043665702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b4150 0x7f63700b3630 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f63600097a0 tx=0x7f636002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.798+0000 7f6376d53640 1 -- 172.21.15.50:0/1043665702 shutdown_connections 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.798+0000 7f6376d53640 1 --2- 172.21.15.50:0/1043665702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700b4150 0x7f63700b3630 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.798+0000 7f6376d53640 1 -- 172.21.15.50:0/1043665702 >> 172.21.15.50:0/1043665702 conn(0x7f63700d3090 msgr2=0x7f63700d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.798+0000 7f6376d53640 1 -- 172.21.15.50:0/1043665702 shutdown_connections 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.798+0000 7f6376d53640 1 -- 172.21.15.50:0/1043665702 wait complete. 2023-12-08T08:20:53.801 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.799+0000 7f6376d53640 1 Processor -- start 2023-12-08T08:20:53.802 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.799+0000 7f6376d53640 1 -- start start 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6376d53640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63700b4150 0x7f637015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6376d53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700cfa30 0x7f6370160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6376d53640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63700cfe10 0x7f6370152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6376d53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637015f290 con 0x7f63700cfa30 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6376d53640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637015f570 con 0x7f63700b4150 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6376d53640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637015f850 con 0x7f63700cfe10 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700cfa30 0x7f6370160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700cfa30 0x7f6370160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35676/0 (socket says 172.21.15.50:35676) 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 -- 172.21.15.50:0/1100381124 learned_addr learned my addr 172.21.15.50:0/1100381124 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f63752f0640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63700cfe10 0x7f6370152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.804 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6374aef640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63700b4150 0x7f637015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 -- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63700cfe10 msgr2=0x7f6370152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63700cfe10 0x7f6370152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 -- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63700b4150 msgr2=0x7f637015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63700b4150 0x7f637015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.800+0000 7f6367fff640 1 -- 172.21.15.50:0/1100381124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360009400 con 0x7f63700cfa30 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.801+0000 7f6367fff640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700cfa30 0x7f6370160330 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6360000c00 tx=0x7f63600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.801+0000 7f63657fa640 1 -- 172.21.15.50:0/1100381124 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636003aa60 con 0x7f63700cfa30 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.801+0000 7f63657fa640 1 -- 172.21.15.50:0/1100381124 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636003abc0 con 0x7f63700cfa30 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.801+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637015fb30 con 0x7f63700cfa30 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.801+0000 7f63657fa640 1 -- 172.21.15.50:0/1100381124 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63600443f0 con 0x7f63700cfa30 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.801+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637015ef40 con 0x7f63700cfa30 2023-12-08T08:20:53.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.802+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6370160050 con 0x7f63700cfa30 2023-12-08T08:20:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.802+0000 7f63657fa640 1 -- 172.21.15.50:0/1100381124 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f636004d450 con 0x7f63700cfa30 2023-12-08T08:20:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.803+0000 7f63657fa640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f635c06ae40 0x7f635c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.803+0000 7f63657fa640 1 -- 172.21.15.50:0/1100381124 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f63600ab8f0 con 0x7f63700cfa30 2023-12-08T08:20:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.803+0000 7f6374aef640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f635c06ae40 0x7f635c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:53.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.804+0000 7f6374aef640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f635c06ae40 0x7f635c06d300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f636c000f60 tx=0x7f636c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:53.809 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.807+0000 7f63657fa640 1 -- 172.21.15.50:0/1100381124 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6370160050 con 0x7f63700cfa30 2023-12-08T08:20:53.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.982+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6370160050 con 0x7f63700cfa30 2023-12-08T08:20:53.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.982+0000 7f63657fa640 1 -- 172.21.15.50:0/1100381124 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6370160050 con 0x7f63700cfa30 2023-12-08T08:20:53.985 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 32 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f635c06ae40 msgr2=0x7f635c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f635c06ae40 0x7f635c06d300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f636c000f60 tx=0x7f636c009040 comp rx=0 tx=0).stop 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700cfa30 msgr2=0x7f6370160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700cfa30 0x7f6370160330 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6360000c00 tx=0x7f63600046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 shutdown_connections 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f635c06ae40 0x7f635c06d300 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63700cfa30 0x7f6370160330 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63700cfe10 0x7f6370152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 --2- 172.21.15.50:0/1100381124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63700b4150 0x7f637015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 >> 172.21.15.50:0/1100381124 conn(0x7f63700d3090 msgr2=0x7f63700ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:53.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 shutdown_connections 2023-12-08T08:20:53.988 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:53.984+0000 7f6376d53640 1 -- 172.21.15.50:0/1100381124 wait complete. 2023-12-08T08:20:53.998 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-08T08:20:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.105+0000 7f55232e5640 1 Processor -- start 2023-12-08T08:20:54.107 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.105+0000 7f55232e5640 1 -- start start 2023-12-08T08:20:54.108 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f55232e5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f551c15d4f0 0x7f551c0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f55232e5640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f551c0b0920 0x7f551c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f55232e5640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c0b2280 con 0x7f551c0adb50 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f55232e5640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c06bb40 con 0x7f551c0b0920 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f55232e5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c0b2710 con 0x7f551c15d4f0 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5520880640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f551c0b0920 0x7f551c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5521882640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f551c0adb50 0x7f551c0adfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49166/0 (socket says 172.21.15.50:49166) 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5520880640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f551c0b0920 0x7f551c0b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35688/0 (socket says 172.21.15.50:35688) 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5521882640 1 -- 172.21.15.50:0/3236054116 learned_addr learned my addr 172.21.15.50:0/3236054116 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5521081640 1 --2- 172.21.15.50:0/3236054116 >> v2:172.21.15.170:3300/0 conn(0x7f551c15d4f0 0x7f551c0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5520880640 1 -- 172.21.15.50:0/3236054116 >> v2:172.21.15.170:3300/0 conn(0x7f551c15d4f0 msgr2=0x7f551c0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5520880640 1 --2- 172.21.15.50:0/3236054116 >> v2:172.21.15.170:3300/0 conn(0x7f551c15d4f0 0x7f551c0b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5520880640 1 -- 172.21.15.50:0/3236054116 >> v1:172.21.15.50:6789/0 conn(0x7f551c0adb50 legacy=0x7f551c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5520880640 1 -- 172.21.15.50:0/3236054116 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0b1690 con 0x7f551c0b0920 2023-12-08T08:20:54.109 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.106+0000 7f5521081640 1 --2- 172.21.15.50:0/3236054116 >> v2:172.21.15.170:3300/0 conn(0x7f551c15d4f0 0x7f551c0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.107+0000 7f5520880640 1 --2- 172.21.15.50:0/3236054116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c0b0d20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f551c071970 tx=0x7f550c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdea0ec54b3ab94c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.107+0000 7f5513fff640 1 -- 172.21.15.50:0/3236054116 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c031830 con 0x7f551c0b0920 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.107+0000 7f5513fff640 1 -- 172.21.15.50:0/3236054116 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c031990 con 0x7f551c0b0920 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.107+0000 7f5513fff640 1 -- 172.21.15.50:0/3236054116 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c031d20 con 0x7f551c0b0920 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 -- 172.21.15.50:0/3236054116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 msgr2=0x7f551c0b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 --2- 172.21.15.50:0/3236054116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c0b0d20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f551c071970 tx=0x7f550c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 -- 172.21.15.50:0/3236054116 shutdown_connections 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 --2- 172.21.15.50:0/3236054116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c0b0d20 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 --2- 172.21.15.50:0/3236054116 >> v2:172.21.15.170:3300/0 conn(0x7f551c15d4f0 0x7f551c0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 -- 172.21.15.50:0/3236054116 >> 172.21.15.50:0/3236054116 conn(0x7f551c0d0e00 msgr2=0x7f551c0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 -- 172.21.15.50:0/3236054116 shutdown_connections 2023-12-08T08:20:54.111 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.108+0000 7f55232e5640 1 -- 172.21.15.50:0/3236054116 wait complete. 2023-12-08T08:20:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.109+0000 7f55232e5640 1 Processor -- start 2023-12-08T08:20:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.109+0000 7f55232e5640 1 -- start start 2023-12-08T08:20:54.113 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f55232e5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f551c0adb50 0x7f551c146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f55232e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f55232e5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f551c15d4f0 0x7f551c146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f55232e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c1471d0 con 0x7f551c0b0920 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f55232e5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c1f2e30 con 0x7f551c15d4f0 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f55232e5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c144870 con 0x7f551c0adb50 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35692/0 (socket says 172.21.15.50:35692) 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 -- 172.21.15.50:0/4114365764 learned_addr learned my addr 172.21.15.50:0/4114365764 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5521081640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f551c0adb50 0x7f551c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5521882640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f551c15d4f0 0x7f551c146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 -- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f551c0adb50 msgr2=0x7f551c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f551c0adb50 0x7f551c146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 -- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f551c15d4f0 msgr2=0x7f551c146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f551c15d4f0 0x7f551c146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 -- 172.21.15.50:0/4114365764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009400 con 0x7f551c0b0920 2023-12-08T08:20:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.110+0000 7f5520880640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c146750 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f550c02bee0 tx=0x7f550c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.111+0000 7f5511ffb640 1 -- 172.21.15.50:0/4114365764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c03ba70 con 0x7f551c0b0920 2023-12-08T08:20:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.111+0000 7f5511ffb640 1 -- 172.21.15.50:0/4114365764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c03bbf0 con 0x7f551c0b0920 2023-12-08T08:20:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.111+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c0c67c0 con 0x7f551c0b0920 2023-12-08T08:20:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.111+0000 7f5511ffb640 1 -- 172.21.15.50:0/4114365764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0433f0 con 0x7f551c0b0920 2023-12-08T08:20:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.111+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c144220 con 0x7f551c0b0920 2023-12-08T08:20:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.112+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c0d0450 con 0x7f551c0b0920 2023-12-08T08:20:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.112+0000 7f5511ffb640 1 -- 172.21.15.50:0/4114365764 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f550c043550 con 0x7f551c0b0920 2023-12-08T08:20:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.113+0000 7f5511ffb640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f550006ae70 0x7f550006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.113+0000 7f5511ffb640 1 -- 172.21.15.50:0/4114365764 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f550c0ab650 con 0x7f551c0b0920 2023-12-08T08:20:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.113+0000 7f5521081640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f550006ae70 0x7f550006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.113+0000 7f5521081640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f550006ae70 0x7f550006d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f551c09ec70 tx=0x7f5518008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.119 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.117+0000 7f5511ffb640 1 -- 172.21.15.50:0/4114365764 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f550c076770 con 0x7f551c0b0920 2023-12-08T08:20:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.296+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f551c067430 con 0x7f551c0b0920 2023-12-08T08:20:54.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.296+0000 7f5511ffb640 1 -- 172.21.15.50:0/4114365764 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f550c0a9e60 con 0x7f551c0b0920 2023-12-08T08:20:54.299 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 64 2023-12-08T08:20:54.300 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f550006ae70 msgr2=0x7f550006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f550006ae70 0x7f550006d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f551c09ec70 tx=0x7f5518008040 comp rx=0 tx=0).stop 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 msgr2=0x7f551c146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c146750 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f550c02bee0 tx=0x7f550c0046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 shutdown_connections 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f550006ae70 0x7f550006d330 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f551c0b0920 0x7f551c146750 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f551c15d4f0 0x7f551c146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 --2- 172.21.15.50:0/4114365764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f551c0adb50 0x7f551c146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 >> 172.21.15.50:0/4114365764 conn(0x7f551c0d0e00 msgr2=0x7f551c06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 shutdown_connections 2023-12-08T08:20:54.301 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.298+0000 7f55232e5640 1 -- 172.21.15.50:0/4114365764 wait complete. 2023-12-08T08:20:54.311 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:54.417 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.415+0000 7fb65d39e640 1 Processor -- start 2023-12-08T08:20:54.418 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.415+0000 7fb65d39e640 1 -- start start 2023-12-08T08:20:54.420 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb65d39e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb65815d120 0x7fb6580d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb65d39e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6580d0bf0 0x7fb6580d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb65d39e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb6580d1930 0x7fb6580b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb65d39e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6580d1dc0 con 0x7fb65815d120 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb65d39e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6580d0230 con 0x7fb6580d1930 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb65d39e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b69d0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb65815d120 0x7fb6580d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb65815d120 0x7fb6580d3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35700/0 (socket says 172.21.15.50:35700) 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 -- 172.21.15.50:0/3093279977 learned_addr learned my addr 172.21.15.50:0/3093279977 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 -- 172.21.15.50:0/3093279977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6580d0bf0 msgr2=0x7fb6580d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 --2- 172.21.15.50:0/3093279977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6580d0bf0 0x7fb6580d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 -- 172.21.15.50:0/3093279977 >> v2:172.21.15.170:3300/0 conn(0x7fb6580d1930 msgr2=0x7fb6580b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.421 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 --2- 172.21.15.50:0/3093279977 >> v2:172.21.15.170:3300/0 conn(0x7fb6580d1930 0x7fb6580b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.416+0000 7fb657fff640 1 -- 172.21.15.50:0/3093279977 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580b5e00 con 0x7fb65815d120 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.417+0000 7fb657fff640 1 --2- 172.21.15.50:0/3093279977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb65815d120 0x7fb6580d3930 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb65808c2b0 tx=0x7fb64802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babf119a413ff2e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.417+0000 7fb656ffd640 1 -- 172.21.15.50:0/3093279977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648030860 con 0x7fb65815d120 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.417+0000 7fb656ffd640 1 -- 172.21.15.50:0/3093279977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6480309c0 con 0x7fb65815d120 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.417+0000 7fb656ffd640 1 -- 172.21.15.50:0/3093279977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648030d50 con 0x7fb65815d120 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 -- 172.21.15.50:0/3093279977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb65815d120 msgr2=0x7fb6580d3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 --2- 172.21.15.50:0/3093279977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb65815d120 0x7fb6580d3930 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb65808c2b0 tx=0x7fb64802b9a0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 -- 172.21.15.50:0/3093279977 shutdown_connections 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 --2- 172.21.15.50:0/3093279977 >> v2:172.21.15.170:3300/0 conn(0x7fb6580d1930 0x7fb6580b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.422 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 --2- 172.21.15.50:0/3093279977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6580d0bf0 0x7fb6580d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 --2- 172.21.15.50:0/3093279977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb65815d120 0x7fb6580d3930 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 -- 172.21.15.50:0/3093279977 >> 172.21.15.50:0/3093279977 conn(0x7fb6580d2e10 msgr2=0x7fb6580d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 -- 172.21.15.50:0/3093279977 shutdown_connections 2023-12-08T08:20:54.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.418+0000 7fb65d39e640 1 -- 172.21.15.50:0/3093279977 wait complete. 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.419+0000 7fb65d39e640 1 Processor -- start 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.419+0000 7fb65d39e640 1 -- start start 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb65d39e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6580d0bf0 0x7fb65815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb65d39e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6580d1930 0x7fb65809d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb65d39e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb65815d120 0x7fb6580cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb65d39e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65815ad20 con 0x7fb6580d0bf0 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb65d39e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65809ffd0 con 0x7fb6580d1930 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb65d39e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580a02b0 con 0x7fb65815d120 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb657fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6580d0bf0 0x7fb65815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb657fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6580d0bf0 0x7fb65815a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35708/0 (socket says 172.21.15.50:35708) 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.420+0000 7fb657fff640 1 -- 172.21.15.50:0/797345048 learned_addr learned my addr 172.21.15.50:0/797345048 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb657fff640 1 -- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb65815d120 msgr2=0x7fb6580cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb657fff640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb65815d120 0x7fb6580cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb657fff640 1 -- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6580d1930 msgr2=0x7fb65809d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb657fff640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6580d1930 0x7fb65809d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb657fff640 1 -- 172.21.15.50:0/797345048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6480094d0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb657fff640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6580d0bf0 0x7fb65815a7e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb648000c00 tx=0x7fb648004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb654ff9640 1 -- 172.21.15.50:0/797345048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648030830 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb654ff9640 1 -- 172.21.15.50:0/797345048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb648043400 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb654ff9640 1 -- 172.21.15.50:0/797345048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6480437d0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6580a0590 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.421+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65809fcc0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.422+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6580a0ab0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.422+0000 7fb654ff9640 1 -- 172.21.15.50:0/797345048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb648043930 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.423+0000 7fb654ff9640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb63806ae40 0x7fb63806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.423+0000 7fb654ff9640 1 -- 172.21.15.50:0/797345048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb64803e070 con 0x7fb6580d0bf0 2023-12-08T08:20:54.428 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.423+0000 7fb6577fe640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb63806ae40 0x7fb63806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.423+0000 7fb6577fe640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb63806ae40 0x7fb63806d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb65815f960 tx=0x7fb640006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.429 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.427+0000 7fb654ff9640 1 -- 172.21.15.50:0/797345048 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6580a0ab0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.642+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6580a0ab0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.645 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.643+0000 7fb654ff9640 1 -- 172.21.15.50:0/797345048 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fb6580a0ab0 con 0x7fb6580d0bf0 2023-12-08T08:20:54.645 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:54.646 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/3932110318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":3932110318},{"type":"v1","addr":"172.21.15.170:6836","nonce":3932110318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/1019645291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":1019645291},{"type":"v1","addr":"172.21.15.170:6837","nonce":1019645291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3216810814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3216810814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3216810814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:26.368189+0000","modified":"2023-12-08T08:20:28.353010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4199554410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4199554410},{"type":"v1","addr":"172.21.15.50:6835","nonce":4199554410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:20:54.646 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb63806ae40 msgr2=0x7fb63806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb63806ae40 0x7fb63806d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb65815f960 tx=0x7fb640006bf0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6580d0bf0 msgr2=0x7fb65815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6580d0bf0 0x7fb65815a7e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb648000c00 tx=0x7fb648004730 comp rx=0 tx=0).stop 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 shutdown_connections 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb63806ae40 0x7fb63806d300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb65815d120 0x7fb6580cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6580d1930 0x7fb65809d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 --2- 172.21.15.50:0/797345048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6580d0bf0 0x7fb65815a7e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 >> 172.21.15.50:0/797345048 conn(0x7fb6580d2e10 msgr2=0x7fb65815e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.648 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 shutdown_connections 2023-12-08T08:20:54.649 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.645+0000 7fb65d39e640 1 -- 172.21.15.50:0/797345048 wait complete. 2023-12-08T08:20:54.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:54.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.763+0000 7fa154b41640 1 Processor -- start 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.763+0000 7fa154b41640 1 -- start start 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.763+0000 7fa154b41640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1500b0cf0 0x7fa1500d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.763+0000 7fa154b41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.763+0000 7fa154b41640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500d20b0 con 0x7fa1501608a0 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.763+0000 7fa154b41640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500d0620 con 0x7fa1500b0cf0 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.763+0000 7fa154b41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500d1b80 con 0x7fa1500b1d70 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1500b0cf0 0x7fa1500d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14dd9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa1500b0cf0 0x7fa1500d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35722/0 (socket says 172.21.15.50:35722) 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14dd9b640 1 -- 172.21.15.50:0/687481201 learned_addr learned my addr 172.21.15.50:0/687481201 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14ed9d640 1 --2- 172.21.15.50:0/687481201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14dd9b640 1 -- 172.21.15.50:0/687481201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 msgr2=0x7fa1500cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14dd9b640 1 --2- 172.21.15.50:0/687481201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14dd9b640 1 -- 172.21.15.50:0/687481201 >> v1:172.21.15.170:6789/0 conn(0x7fa1501608a0 legacy=0x7fa1500d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:54.767 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.764+0000 7fa14dd9b640 1 -- 172.21.15.50:0/687481201 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500d1dd0 con 0x7fa1500b0cf0 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa14dd9b640 1 --2- 172.21.15.50:0/687481201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500b0cf0 0x7fa1500d1640 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa138009870 tx=0x7fa13802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25bc1c302af8f82 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa14d59a640 1 -- 172.21.15.50:0/687481201 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380317c0 con 0x7fa1500b0cf0 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa14d59a640 1 -- 172.21.15.50:0/687481201 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa138031920 con 0x7fa1500b0cf0 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa14d59a640 1 -- 172.21.15.50:0/687481201 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138031cb0 con 0x7fa1500b0cf0 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa154b41640 1 -- 172.21.15.50:0/687481201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500b0cf0 msgr2=0x7fa1500d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa154b41640 1 --2- 172.21.15.50:0/687481201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500b0cf0 0x7fa1500d1640 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa138009870 tx=0x7fa13802b860 comp rx=0 tx=0).stop 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa154b41640 1 -- 172.21.15.50:0/687481201 shutdown_connections 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa154b41640 1 --2- 172.21.15.50:0/687481201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa154b41640 1 --2- 172.21.15.50:0/687481201 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1500b0cf0 0x7fa1500d1640 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.765+0000 7fa154b41640 1 -- 172.21.15.50:0/687481201 >> 172.21.15.50:0/687481201 conn(0x7fa1500d3030 msgr2=0x7fa1500d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.766+0000 7fa154b41640 1 -- 172.21.15.50:0/687481201 shutdown_connections 2023-12-08T08:20:54.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.766+0000 7fa154b41640 1 -- 172.21.15.50:0/687481201 wait complete. 2023-12-08T08:20:54.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.767+0000 7fa154b41640 1 Processor -- start 2023-12-08T08:20:54.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.767+0000 7fa154b41640 1 -- start start 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa154b41640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1500b0cf0 0x7fa1500c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa154b41640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa154b41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1501608a0 0x7fa1500cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa154b41640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500c8060 con 0x7fa1501608a0 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa154b41640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500c8340 con 0x7fa1500b0cf0 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa154b41640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500c8620 con 0x7fa1500b1d70 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1501608a0 0x7fa1500cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1501608a0 0x7fa1500cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35730/0 (socket says 172.21.15.50:35730) 2023-12-08T08:20:54.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 -- 172.21.15.50:0/4023144733 learned_addr learned my addr 172.21.15.50:0/4023144733 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14dd9b640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14e59c640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1500b0cf0 0x7fa1500c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 -- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 msgr2=0x7fa1500c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 -- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1500b0cf0 msgr2=0x7fa1500c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1500b0cf0 0x7fa1500c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 -- 172.21.15.50:0/4023144733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1380094d0 con 0x7fa1501608a0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa14ed9d640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1501608a0 0x7fa1500cc9e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa14800c7f0 tx=0x7fa14800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa146ffd640 1 -- 172.21.15.50:0/4023144733 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148004220 con 0x7fa1501608a0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa146ffd640 1 -- 172.21.15.50:0/4023144733 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148004380 con 0x7fa1501608a0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa146ffd640 1 -- 172.21.15.50:0/4023144733 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148007860 con 0x7fa1501608a0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.768+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1500c8900 con 0x7fa1501608a0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.769+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1500ccf20 con 0x7fa1501608a0 2023-12-08T08:20:54.773 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.769+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150067430 con 0x7fa1501608a0 2023-12-08T08:20:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.770+0000 7fa146ffd640 1 -- 172.21.15.50:0/4023144733 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa148007bd0 con 0x7fa1501608a0 2023-12-08T08:20:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.770+0000 7fa146ffd640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa13006ae40 0x7fa13006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.771+0000 7fa146ffd640 1 -- 172.21.15.50:0/4023144733 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa148089570 con 0x7fa1501608a0 2023-12-08T08:20:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.771+0000 7fa14e59c640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa13006ae40 0x7fa13006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:54.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.771+0000 7fa14e59c640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa13006ae40 0x7fa13006d300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa1500b2700 tx=0x7fa14000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:54.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.775+0000 7fa146ffd640 1 -- 172.21.15.50:0/4023144733 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa148054620 con 0x7fa1501608a0 2023-12-08T08:20:54.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:54.940 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:20:54.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.951+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1500b2450 con 0x7fa1501608a0 2023-12-08T08:20:54.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.952+0000 7fa146ffd640 1 -- 172.21.15.50:0/4023144733 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fa148057c40 con 0x7fa1501608a0 2023-12-08T08:20:54.955 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:54.955 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa13006ae40 msgr2=0x7fa13006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa13006ae40 0x7fa13006d300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa1500b2700 tx=0x7fa14000d040 comp rx=0 tx=0).stop 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1501608a0 msgr2=0x7fa1500cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1501608a0 0x7fa1500cc9e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa14800c7f0 tx=0x7fa14800ccb0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 shutdown_connections 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa13006ae40 0x7fa13006d300 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1501608a0 0x7fa1500cc9e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa1500b1d70 0x7fa1500c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 --2- 172.21.15.50:0/4023144733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1500b0cf0 0x7fa1500c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:54.957 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 >> 172.21.15.50:0/4023144733 conn(0x7fa1500d3030 msgr2=0x7fa15006b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:54.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 shutdown_connections 2023-12-08T08:20:54.958 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:54.954+0000 7fa154b41640 1 -- 172.21.15.50:0/4023144733 wait complete. 2023-12-08T08:20:54.968 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:20:54.968 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:55.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.141+0000 7f98d4a87640 1 Processor -- start 2023-12-08T08:20:55.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.142+0000 7f98d4a87640 1 -- start start 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.142+0000 7f98d4a87640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f98d01608a0 0x7f98d00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.142+0000 7f98d4a87640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98d00b1d70 0x7f98d00d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.142+0000 7f98d4a87640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d00d20b0 con 0x7f98d00afce0 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.142+0000 7f98d4a87640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d00d0620 con 0x7f98d00b1d70 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.142+0000 7f98d4a87640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d00d1dd0 con 0x7f98d01608a0 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98c7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98d00b1d70 0x7f98d00d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98c7fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f98d00b1d70 0x7f98d00d1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35732/0 (socket says 172.21.15.50:35732) 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98c7fff640 1 -- 172.21.15.50:0/3434240247 learned_addr learned my addr 172.21.15.50:0/3434240247 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:55.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98ce59c640 1 --2- 172.21.15.50:0/3434240247 >> v2:172.21.15.170:3300/0 conn(0x7f98d01608a0 0x7f98d00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98c7fff640 1 -- 172.21.15.50:0/3434240247 >> v2:172.21.15.170:3300/0 conn(0x7f98d01608a0 msgr2=0x7f98d00d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98c7fff640 1 --2- 172.21.15.50:0/3434240247 >> v2:172.21.15.170:3300/0 conn(0x7f98d01608a0 0x7f98d00d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98c7fff640 1 -- 172.21.15.50:0/3434240247 >> v1:172.21.15.170:6789/0 conn(0x7f98d00afce0 legacy=0x7f98d00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.143+0000 7f98c7fff640 1 -- 172.21.15.50:0/3434240247 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00cff60 con 0x7f98d00b1d70 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98c7fff640 1 --2- 172.21.15.50:0/3434240247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00b1d70 0x7f98d00d1470 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f98d008b770 tx=0x7f98b802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac798dfe0f041a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98cdd9b640 1 -- 172.21.15.50:0/3434240247 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80317e0 con 0x7f98d00b1d70 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98cdd9b640 1 -- 172.21.15.50:0/3434240247 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8031940 con 0x7f98d00b1d70 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98cdd9b640 1 -- 172.21.15.50:0/3434240247 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8031cd0 con 0x7f98d00b1d70 2023-12-08T08:20:55.149 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 -- 172.21.15.50:0/3434240247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00b1d70 msgr2=0x7f98d00d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 --2- 172.21.15.50:0/3434240247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00b1d70 0x7f98d00d1470 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f98d008b770 tx=0x7f98b802b880 comp rx=0 tx=0).stop 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 -- 172.21.15.50:0/3434240247 shutdown_connections 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 --2- 172.21.15.50:0/3434240247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00b1d70 0x7f98d00d1470 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 --2- 172.21.15.50:0/3434240247 >> v2:172.21.15.170:3300/0 conn(0x7f98d01608a0 0x7f98d00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 -- 172.21.15.50:0/3434240247 >> 172.21.15.50:0/3434240247 conn(0x7f98d00d3030 msgr2=0x7f98d00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 -- 172.21.15.50:0/3434240247 shutdown_connections 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.144+0000 7f98d4a87640 1 -- 172.21.15.50:0/3434240247 wait complete. 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 Processor -- start 2023-12-08T08:20:55.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 -- start start 2023-12-08T08:20:55.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00afce0 0x7f98d014bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98d00b1d70 0x7f98d00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98d01608a0 0x7f98d00b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00ca8e0 con 0x7f98d00afce0 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00cbd70 con 0x7f98d01608a0 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.146+0000 7f98d4a87640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00ca640 con 0x7f98d00b1d70 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00afce0 0x7f98d014bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00afce0 0x7f98d014bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35742/0 (socket says 172.21.15.50:35742) 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 -- 172.21.15.50:0/4285315782 learned_addr learned my addr 172.21.15.50:0/4285315782 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 -- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98d00b1d70 msgr2=0x7f98d00ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ced9d640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98d01608a0 0x7f98d00b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98c7fff640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98d00b1d70 0x7f98d00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98d00b1d70 0x7f98d00ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 -- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98d01608a0 msgr2=0x7f98d00b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98d01608a0 0x7f98d00b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 -- 172.21.15.50:0/4285315782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b80094d0 con 0x7f98d00afce0 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98ce59c640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00afce0 0x7f98d014bcc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f98c000d5f0 tx=0x7f98c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98c6ffd640 1 -- 172.21.15.50:0/4285315782 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c00125f0 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98c6ffd640 1 -- 172.21.15.50:0/4285315782 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0012750 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d00cc010 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98c6ffd640 1 -- 172.21.15.50:0/4285315782 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0012b00 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.147+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d00cc5d0 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.148+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d0067430 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.149+0000 7f98c6ffd640 1 -- 172.21.15.50:0/4285315782 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98c0012c60 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.149+0000 7f98c6ffd640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f98b006ae40 0x7f98b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.149+0000 7f98c6ffd640 1 -- 172.21.15.50:0/4285315782 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f98c0089c30 con 0x7f98d00afce0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.149+0000 7f98c7fff640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f98b006ae40 0x7f98b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.154 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.150+0000 7f98c7fff640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f98b006ae40 0x7f98b006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98b8036000 tx=0x7f98b803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.156 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.154+0000 7f98c6ffd640 1 -- 172.21.15.50:0/4285315782 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98c0054ba0 con 0x7f98d00afce0 2023-12-08T08:20:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.365+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98d0160050 con 0x7f98d00afce0 2023-12-08T08:20:55.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.366+0000 7f98c6ffd640 1 -- 172.21.15.50:0/4285315782 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f98c00581c0 con 0x7f98d00afce0 2023-12-08T08:20:55.369 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:55.371 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/3932110318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":3932110318},{"type":"v1","addr":"172.21.15.170:6836","nonce":3932110318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/1019645291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":1019645291},{"type":"v1","addr":"172.21.15.170:6837","nonce":1019645291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3216810814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3216810814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3216810814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:26.368189+0000","modified":"2023-12-08T08:20:28.353010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4199554410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4199554410},{"type":"v1","addr":"172.21.15.50:6835","nonce":4199554410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:20:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-12-08T08:20:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.367+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f98b006ae40 msgr2=0x7f98b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.367+0000 7f98d4a87640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f98b006ae40 0x7f98b006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98b8036000 tx=0x7f98b803d040 comp rx=0 tx=0).stop 2023-12-08T08:20:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.367+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00afce0 msgr2=0x7f98d014bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.367+0000 7f98d4a87640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00afce0 0x7f98d014bcc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f98c000d5f0 tx=0x7f98c000dab0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 shutdown_connections 2023-12-08T08:20:55.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f98b006ae40 0x7f98b006d300 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98d01608a0 0x7f98d00b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98d00b1d70 0x7f98d00ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 --2- 172.21.15.50:0/4285315782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f98d00afce0 0x7f98d014bcc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 >> 172.21.15.50:0/4285315782 conn(0x7f98d00d3030 msgr2=0x7f98d015dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 shutdown_connections 2023-12-08T08:20:55.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.368+0000 7f98d4a87640 1 -- 172.21.15.50:0/4285315782 wait complete. 2023-12-08T08:20:55.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:20:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.485+0000 7f07eff9e640 1 Processor -- start 2023-12-08T08:20:55.488 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.486+0000 7f07eff9e640 1 -- start start 2023-12-08T08:20:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.486+0000 7f07eff9e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f07e80b0cf0 0x7f07e80d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.486+0000 7f07eff9e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07e80b1d70 0x7f07e80cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.489 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.486+0000 7f07eff9e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e80d20b0 con 0x7f07e81608a0 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.486+0000 7f07eff9e640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80d0620 con 0x7f07e80b1d70 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.486+0000 7f07eff9e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80d1b80 con 0x7f07e80b0cf0 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07ee53b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f07e80b1d70 0x7f07e80cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07edd3a640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f07e81608a0 0x7f07e80d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49170/0 (socket says 172.21.15.50:49170) 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07edd3a640 1 -- 172.21.15.50:0/3419707434 learned_addr learned my addr 172.21.15.50:0/3419707434 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07ed539640 1 --2- 172.21.15.50:0/3419707434 >> v2:172.21.15.170:3300/0 conn(0x7f07e80b0cf0 0x7f07e80d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07ee53b640 1 -- 172.21.15.50:0/3419707434 >> v2:172.21.15.170:3300/0 conn(0x7f07e80b0cf0 msgr2=0x7f07e80d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07ee53b640 1 --2- 172.21.15.50:0/3419707434 >> v2:172.21.15.170:3300/0 conn(0x7f07e80b0cf0 0x7f07e80d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07ee53b640 1 -- 172.21.15.50:0/3419707434 >> v1:172.21.15.50:6789/0 conn(0x7f07e81608a0 legacy=0x7f07e80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07ee53b640 1 -- 172.21.15.50:0/3419707434 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80d1dd0 con 0x7f07e80b1d70 2023-12-08T08:20:55.490 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.487+0000 7f07ecd38640 1 -- 172.21.15.50:0/3419707434 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866488112 0 0) 0x7f07e80d20b0 con 0x7f07e81608a0 2023-12-08T08:20:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07ee53b640 1 --2- 172.21.15.50:0/3419707434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b1d70 0x7f07e80cdc40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f07e80d4130 tx=0x7f07e002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74c483e45084ae6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07ecd38640 1 -- 172.21.15.50:0/3419707434 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e002cbf0 con 0x7f07e80b1d70 2023-12-08T08:20:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07ecd38640 1 -- 172.21.15.50:0/3419707434 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e002cd50 con 0x7f07e80b1d70 2023-12-08T08:20:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07ecd38640 1 -- 172.21.15.50:0/3419707434 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0034660 con 0x7f07e80b1d70 2023-12-08T08:20:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 -- 172.21.15.50:0/3419707434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b1d70 msgr2=0x7f07e80cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 --2- 172.21.15.50:0/3419707434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b1d70 0x7f07e80cdc40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f07e80d4130 tx=0x7f07e002be40 comp rx=0 tx=0).stop 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 -- 172.21.15.50:0/3419707434 shutdown_connections 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 --2- 172.21.15.50:0/3419707434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b1d70 0x7f07e80cdc40 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 --2- 172.21.15.50:0/3419707434 >> v2:172.21.15.170:3300/0 conn(0x7f07e80b0cf0 0x7f07e80d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 -- 172.21.15.50:0/3419707434 >> 172.21.15.50:0/3419707434 conn(0x7f07e80d3030 msgr2=0x7f07e80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 -- 172.21.15.50:0/3419707434 shutdown_connections 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.488+0000 7f07eff9e640 1 -- 172.21.15.50:0/3419707434 wait complete. 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 Processor -- start 2023-12-08T08:20:55.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 -- start start 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b0cf0 0x7f07e80c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07e80b1d70 0x7f07e81582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07e81608a0 0x7f07e8158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80caeb0 con 0x7f07e80b0cf0 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80ca2a0 con 0x7f07e81608a0 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07eff9e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80ca580 con 0x7f07e80b1d70 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07edd3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b0cf0 0x7f07e80c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07edd3a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b0cf0 0x7f07e80c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35760/0 (socket says 172.21.15.50:35760) 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.490+0000 7f07edd3a640 1 -- 172.21.15.50:0/458497120 learned_addr learned my addr 172.21.15.50:0/458497120 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07ee53b640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07e81608a0 0x7f07e8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.496 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07ed539640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07e80b1d70 0x7f07e81582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07edd3a640 1 -- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07e80b1d70 msgr2=0x7f07e81582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07edd3a640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07e80b1d70 0x7f07e81582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07edd3a640 1 -- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07e81608a0 msgr2=0x7f07e8158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07edd3a640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07e81608a0 0x7f07e8158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07edd3a640 1 -- 172.21.15.50:0/458497120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0009a70 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07edd3a640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b0cf0 0x7f07e80c5d10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c430 tx=0x7f07e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07de7fc640 1 -- 172.21.15.50:0/458497120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40074e0 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07de7fc640 1 -- 172.21.15.50:0/458497120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4007660 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e80ca860 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07de7fc640 1 -- 172.21.15.50:0/458497120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4004a20 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.491+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e80c6250 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.492+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e8067430 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.493+0000 7f07de7fc640 1 -- 172.21.15.50:0/458497120 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07e4004b80 con 0x7f07e80b0cf0 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.493+0000 7f07de7fc640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f07cc06ae70 0x7f07cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.497 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.493+0000 7f07de7fc640 1 -- 172.21.15.50:0/458497120 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f07e40894d0 con 0x7f07e80b0cf0 2023-12-08T08:20:55.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.493+0000 7f07ed539640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f07cc06ae70 0x7f07cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.494+0000 7f07ed539640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f07cc06ae70 0x7f07cc06d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f07e8156fd0 tx=0x7f07d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.497+0000 7f07de7fc640 1 -- 172.21.15.50:0/458497120 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07e40544d0 con 0x7f07e80b0cf0 2023-12-08T08:20:55.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.709+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07e815fb00 con 0x7f07e80b0cf0 2023-12-08T08:20:55.712 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.710+0000 7f07de7fc640 1 -- 172.21.15.50:0/458497120 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f07e4057af0 con 0x7f07e80b0cf0 2023-12-08T08:20:55.713 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:55.713 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/3932110318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":3932110318},{"type":"v1","addr":"172.21.15.170:6836","nonce":3932110318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/1019645291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":1019645291},{"type":"v1","addr":"172.21.15.170:6837","nonce":1019645291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3216810814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3216810814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3216810814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-08T08:20:26.368189+0000","modified":"2023-12-08T08:20:28.353010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6222},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6222":{"gid":6222,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.50:6835/4199554410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4199554410},{"type":"v1","addr":"172.21.15.50:6835","nonce":4199554410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-08T08:20:55.713 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 23 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f07cc06ae70 msgr2=0x7f07cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f07cc06ae70 0x7f07cc06d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f07e8156fd0 tx=0x7f07d8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b0cf0 msgr2=0x7f07e80c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b0cf0 0x7f07e80c5d10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c430 tx=0x7f07e400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 shutdown_connections 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f07cc06ae70 0x7f07cc06d330 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07e81608a0 0x7f07e8158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07e80b1d70 0x7f07e81582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 --2- 172.21.15.50:0/458497120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07e80b0cf0 0x7f07e80c5d10 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 >> 172.21.15.50:0/458497120 conn(0x7f07e80d3030 msgr2=0x7f07e80cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 shutdown_connections 2023-12-08T08:20:55.715 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.712+0000 7f07eff9e640 1 -- 172.21.15.50:0/458497120 wait complete. 2023-12-08T08:20:55.725 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:20:55.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.829+0000 7fa040e56640 1 Processor -- start 2023-12-08T08:20:55.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.829+0000 7fa040e56640 1 -- start start 2023-12-08T08:20:55.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa040e56640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c06e330 0x7fa03c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa040e56640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa03c0d0ce0 0x7fa03c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa040e56640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c0d1690 con 0x7fa03c15d490 2023-12-08T08:20:55.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa040e56640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c06ecd0 con 0x7fa03c0d0ce0 2023-12-08T08:20:55.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa040e56640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0ce270 con 0x7fa03c06e330 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa03ad9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa03c0d0ce0 0x7fa03c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa03a59c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa03c15d490 0x7fa03c06c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49174/0 (socket says 172.21.15.50:49174) 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.830+0000 7fa03a59c640 1 -- 172.21.15.50:0/893193298 learned_addr learned my addr 172.21.15.50:0/893193298 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa039d9b640 1 --2- 172.21.15.50:0/893193298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c06e330 0x7fa03c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa03ad9d640 1 -- 172.21.15.50:0/893193298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c06e330 msgr2=0x7fa03c06e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/893193298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c06e330 0x7fa03c06e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa03ad9d640 1 -- 172.21.15.50:0/893193298 >> v1:172.21.15.50:6789/0 conn(0x7fa03c15d490 legacy=0x7fa03c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa03ad9d640 1 -- 172.21.15.50:0/893193298 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0ce550 con 0x7fa03c0d0ce0 2023-12-08T08:20:55.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa03959a640 1 -- 172.21.15.50:0/893193298 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272124059 0 0) 0x7fa03c0d1690 con 0x7fa03c15d490 2023-12-08T08:20:55.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa039d9b640 1 --2- 172.21.15.50:0/893193298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c06e330 0x7fa03c06e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.831+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/893193298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0d0ce0 0x7fa03c0d1150 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa0340097a0 tx=0x7fa03402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3511dcdcfb2fa89e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa03959a640 1 -- 172.21.15.50:0/893193298 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03402d040 con 0x7fa03c0d0ce0 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa03959a640 1 -- 172.21.15.50:0/893193298 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa034031810 con 0x7fa03c0d0ce0 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa03959a640 1 -- 172.21.15.50:0/893193298 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034031ba0 con 0x7fa03c0d0ce0 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 -- 172.21.15.50:0/893193298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0d0ce0 msgr2=0x7fa03c0d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 --2- 172.21.15.50:0/893193298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0d0ce0 0x7fa03c0d1150 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa0340097a0 tx=0x7fa03402b8b0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 -- 172.21.15.50:0/893193298 shutdown_connections 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 --2- 172.21.15.50:0/893193298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0d0ce0 0x7fa03c0d1150 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 --2- 172.21.15.50:0/893193298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c06e330 0x7fa03c06e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 -- 172.21.15.50:0/893193298 >> 172.21.15.50:0/893193298 conn(0x7fa03c099a10 msgr2=0x7fa03c099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 -- 172.21.15.50:0/893193298 shutdown_connections 2023-12-08T08:20:55.838 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.832+0000 7fa040e56640 1 -- 172.21.15.50:0/893193298 wait complete. 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 Processor -- start 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 -- start start 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa03c06e330 0x7fa03c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c0d0ce0 0x7fa03c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0b5a30 0x7fa03c15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0b5fb0 con 0x7fa03c0b5a30 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c7f10 con 0x7fa03c06e330 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa040e56640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c81f0 con 0x7fa03c0d0ce0 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa03ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0b5a30 0x7fa03c15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa03ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0b5a30 0x7fa03c15bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35776/0 (socket says 172.21.15.50:35776) 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.834+0000 7fa03ad9d640 1 -- 172.21.15.50:0/347207540 learned_addr learned my addr 172.21.15.50:0/347207540 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa039d9b640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c0d0ce0 0x7fa03c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa03a59c640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa03c06e330 0x7fa03c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa03ad9d640 1 -- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c0d0ce0 msgr2=0x7fa03c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.839 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c0d0ce0 0x7fa03c0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa03ad9d640 1 -- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa03c06e330 msgr2=0x7fa03c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa03c06e330 0x7fa03c152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa03ad9d640 1 -- 172.21.15.50:0/347207540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034009400 con 0x7fa03c0b5a30 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa03ad9d640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0b5a30 0x7fa03c15bd30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa03402b8f0 tx=0x7fa0340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa032ffd640 1 -- 172.21.15.50:0/347207540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03403ace0 con 0x7fa03c0b5a30 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa032ffd640 1 -- 172.21.15.50:0/347207540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03403ae60 con 0x7fa03c0b5a30 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c0c84d0 con 0x7fa03c0b5a30 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa032ffd640 1 -- 172.21.15.50:0/347207540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034044630 con 0x7fa03c0b5a30 2023-12-08T08:20:55.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.835+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c1529b0 con 0x7fa03c0b5a30 2023-12-08T08:20:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.836+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c067ad0 con 0x7fa03c0b5a30 2023-12-08T08:20:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.836+0000 7fa032ffd640 1 -- 172.21.15.50:0/347207540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa034044790 con 0x7fa03c0b5a30 2023-12-08T08:20:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.837+0000 7fa032ffd640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa01c06ae40 0x7fa01c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.837+0000 7fa032ffd640 1 -- 172.21.15.50:0/347207540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa0340abae0 con 0x7fa03c0b5a30 2023-12-08T08:20:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.837+0000 7fa03a59c640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa01c06ae40 0x7fa01c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:55.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.838+0000 7fa03a59c640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa01c06ae40 0x7fa01c06d300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0012e0 tx=0x7fa02c005eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:55.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:55.841+0000 7fa032ffd640 1 -- 172.21.15.50:0/347207540 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa034076ae0 con 0x7fa03c0b5a30 2023-12-08T08:20:56.021 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.019+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa03c06b700 con 0x7fa03c0b5a30 2023-12-08T08:20:56.023 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.020+0000 7fa032ffd640 1 -- 172.21.15.50:0/347207540 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16770 (secure 0 0 0) 0x7fa03407a100 con 0x7fa03c0b5a30 2023-12-08T08:20:56.023 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:20:56.023 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":56,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:27.836613+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-08T08:20:24.505729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-08T08:20:25.407648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa01c06ae40 msgr2=0x7fa01c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa01c06ae40 0x7fa01c06d300 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0012e0 tx=0x7fa02c005eb0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0b5a30 msgr2=0x7fa03c15bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0b5a30 0x7fa03c15bd30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa03402b8f0 tx=0x7fa0340046c0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 shutdown_connections 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa01c06ae40 0x7fa01c06d300 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa03c0b5a30 0x7fa03c15bd30 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa03c0d0ce0 0x7fa03c0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 --2- 172.21.15.50:0/347207540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa03c06e330 0x7fa03c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 >> 172.21.15.50:0/347207540 conn(0x7fa03c099a10 msgr2=0x7fa03c06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 shutdown_connections 2023-12-08T08:20:56.025 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.022+0000 7fa040e56640 1 -- 172.21.15.50:0/347207540 wait complete. 2023-12-08T08:20:56.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-08T08:20:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.141+0000 7f81ccb05640 1 Processor -- start 2023-12-08T08:20:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.141+0000 7f81ccb05640 1 -- start start 2023-12-08T08:20:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.142+0000 7f81ccb05640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f81c80cd760 0x7f81c80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.142+0000 7f81ccb05640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80cf380 con 0x7f81c815b0f0 2023-12-08T08:20:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.142+0000 7f81ccb05640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80ce0d0 con 0x7f81c80d1900 2023-12-08T08:20:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.142+0000 7f81ccb05640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80cff20 con 0x7f81c80cd760 2023-12-08T08:20:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.142+0000 7f81c659c640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f81c815b0f0 0x7f81c80cc5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49176/0 (socket says 172.21.15.50:49176) 2023-12-08T08:20:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.142+0000 7f81c659c640 1 -- 172.21.15.50:0/3349226099 learned_addr learned my addr 172.21.15.50:0/3349226099 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:56.145 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.142+0000 7f81c6d9d640 1 --2- 172.21.15.50:0/3349226099 >> v2:172.21.15.50:3300/0 conn(0x7f81c80cd760 0x7f81c80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.143+0000 7f81c6d9d640 1 -- 172.21.15.50:0/3349226099 >> v1:172.21.15.170:6789/0 conn(0x7f81c80d1900 legacy=0x7f81c80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.143+0000 7f81c6d9d640 1 -- 172.21.15.50:0/3349226099 >> v1:172.21.15.50:6789/0 conn(0x7f81c815b0f0 legacy=0x7f81c80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.143+0000 7f81c559a640 1 -- 172.21.15.50:0/3349226099 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614991583 0 0) 0x7f81c80cf380 con 0x7f81c815b0f0 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.143+0000 7f81c6d9d640 1 -- 172.21.15.50:0/3349226099 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80cce00 con 0x7f81c80cd760 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.143+0000 7f81c6d9d640 1 --2- 172.21.15.50:0/3349226099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80cdb90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009d90 tx=0x7f81b802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e54b5c6dd8223c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81c559a640 1 -- 172.21.15.50:0/3349226099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b802cc60 con 0x7f81c80cd760 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81c559a640 1 -- 172.21.15.50:0/3349226099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b802cdc0 con 0x7f81c80cd760 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81c559a640 1 -- 172.21.15.50:0/3349226099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8034660 con 0x7f81c80cd760 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81ccb05640 1 -- 172.21.15.50:0/3349226099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 msgr2=0x7f81c80cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3349226099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80cdb90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009d90 tx=0x7f81b802beb0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81ccb05640 1 -- 172.21.15.50:0/3349226099 shutdown_connections 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3349226099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80cdb90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.147 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81ccb05640 1 -- 172.21.15.50:0/3349226099 >> 172.21.15.50:0/3349226099 conn(0x7f81c80d0de0 msgr2=0x7f81c80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81ccb05640 1 -- 172.21.15.50:0/3349226099 shutdown_connections 2023-12-08T08:20:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.144+0000 7f81ccb05640 1 -- 172.21.15.50:0/3349226099 wait complete. 2023-12-08T08:20:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.146+0000 7f81ccb05640 1 Processor -- start 2023-12-08T08:20:56.148 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.146+0000 7f81ccb05640 1 -- start start 2023-12-08T08:20:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.146+0000 7f81ccb05640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.146+0000 7f81ccb05640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81c80d1900 0x7f81c806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.146+0000 7f81ccb05640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c815b0f0 0x7f81c8152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.146+0000 7f81ccb05640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c806cab0 con 0x7f81c80cd760 2023-12-08T08:20:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.146+0000 7f81ccb05640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80b4c80 con 0x7f81c815b0f0 2023-12-08T08:20:56.150 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81ccb05640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c806be30 con 0x7f81c80d1900 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35790/0 (socket says 172.21.15.50:35790) 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 -- 172.21.15.50:0/3423232120 learned_addr learned my addr 172.21.15.50:0/3423232120 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c6d9d640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c815b0f0 0x7f81c8152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c5d9b640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81c80d1900 0x7f81c806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 -- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81c80d1900 msgr2=0x7f81c806b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81c80d1900 0x7f81c806b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 -- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c815b0f0 msgr2=0x7f81c8152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c815b0f0 0x7f81c8152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 -- 172.21.15.50:0/3423232120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b8009a70 con 0x7f81c80cd760 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81c659c640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80b6360 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c3f0 tx=0x7f81c000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81b6ffd640 1 -- 172.21.15.50:0/3423232120 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00074e0 con 0x7f81c80cd760 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81b6ffd640 1 -- 172.21.15.50:0/3423232120 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0007640 con 0x7f81c80cd760 2023-12-08T08:20:56.151 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c806c110 con 0x7f81c80cd760 2023-12-08T08:20:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81b6ffd640 1 -- 172.21.15.50:0/3423232120 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0004a00 con 0x7f81c80cd760 2023-12-08T08:20:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.147+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c806c6d0 con 0x7f81c80cd760 2023-12-08T08:20:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.148+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c806cbf0 con 0x7f81c80cd760 2023-12-08T08:20:56.152 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.149+0000 7f81b6ffd640 1 -- 172.21.15.50:0/3423232120 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81c0004b60 con 0x7f81c80cd760 2023-12-08T08:20:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.149+0000 7f81b6ffd640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81a806ae40 0x7f81a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.149+0000 7f81b6ffd640 1 -- 172.21.15.50:0/3423232120 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f81c0089550 con 0x7f81c80cd760 2023-12-08T08:20:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.149+0000 7f81c5d9b640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81a806ae40 0x7f81a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.153 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.150+0000 7f81c5d9b640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81a806ae40 0x7f81a806d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f81c80cde30 tx=0x7f81bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.155 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.153+0000 7f81b6ffd640 1 -- 172.21.15.50:0/3423232120 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81c806cbf0 con 0x7f81c80cd760 2023-12-08T08:20:56.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.366+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f81c806cbf0 con 0x7f81c80cd760 2023-12-08T08:20:56.369 INFO:tasks.ceph.mon.a.smithi050.stderr:2023-12-08T08:20:56.367+0000 7fd76af52640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-08T08:20:56.370 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.368+0000 7f81b6ffd640 1 -- 172.21.15.50:0/3423232120 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f81c806cbf0 con 0x7f81c80cd760 2023-12-08T08:20:56.370 INFO:teuthology.orchestra.run.smithi050.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-08T08:20:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81a806ae40 msgr2=0x7f81a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81a806ae40 0x7f81a806d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f81c80cde30 tx=0x7f81bc009040 comp rx=0 tx=0).stop 2023-12-08T08:20:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 msgr2=0x7f81c80b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80b6360 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c3f0 tx=0x7f81c000c8b0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 shutdown_connections 2023-12-08T08:20:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f81a806ae40 0x7f81a806d300 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c815b0f0 0x7f81c8152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81c80d1900 0x7f81c806b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 --2- 172.21.15.50:0/3423232120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f81c80cd760 0x7f81c80b6360 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 >> 172.21.15.50:0/3423232120 conn(0x7f81c80d0de0 msgr2=0x7f81c80cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 shutdown_connections 2023-12-08T08:20:56.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.371+0000 7f81ccb05640 1 -- 172.21.15.50:0/3423232120 wait complete. 2023-12-08T08:20:56.375 INFO:tasks.ceph.mds.c.smithi050.stderr: -2582> 2023-12-08T08:20:31.984+0000 7f6543d3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-08T08:20:56.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-08T08:20:56.403 INFO:tasks.ceph.mds.c.smithi050.stdout:starting mds.c at 2023-12-08T08:20:56.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.492+0000 7f568cc7c640 1 Processor -- start 2023-12-08T08:20:56.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.492+0000 7f568cc7c640 1 -- start start 2023-12-08T08:20:56.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f568cc7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 0x7f56880acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f568cc7c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56880721f0 con 0x7f56880ad290 2023-12-08T08:20:56.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f568cc7c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56880b4e00 con 0x7f5688145d80 2023-12-08T08:20:56.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f568cc7c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56880b50e0 con 0x7f56880b4920 2023-12-08T08:20:56.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f5686d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f56880ad290 0x7f568806a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49196/0 (socket says 172.21.15.50:49196) 2023-12-08T08:20:56.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f5686d9d640 1 -- 172.21.15.50:0/1528573880 learned_addr learned my addr 172.21.15.50:0/1528573880 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 0x7f56880acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316726186 0 0) 0x7f56880721f0 con 0x7f56880ad290 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5670003520 con 0x7f56880ad290 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.493+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174125450 0 0) 0x7f56880b4e00 con 0x7f5688145d80 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56880721f0 con 0x7f5688145d80 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177341502 0 0) 0x7f5670003520 con 0x7f56880ad290 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 msgr2=0x7f56880acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 0x7f56880acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 >> v1:172.21.15.170:6789/0 conn(0x7f5688145d80 legacy=0x7f5688071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568806cfb0 con 0x7f56880ad290 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f5680001970 con 0x7f56880ad290 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 >> v1:172.21.15.50:6789/0 conn(0x7f56880ad290 legacy=0x7f568806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 0x7f5670003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700040e0 0x7f56700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5670004d00 0x7f5670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56880b50e0 con 0x7f56700040e0 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567000bac0 con 0x7f5670004d00 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567000bc80 con 0x7f56880b4920 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700040e0 0x7f56700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f568659c640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 0x7f5670003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5686d9d640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5670004d00 0x7f5670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5685d9b640 1 -- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 msgr2=0x7f5670003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56880b4920 0x7f5670003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5685d9b640 1 -- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5670004d00 msgr2=0x7f5670005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5670004d00 0x7f5670005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5685d9b640 1 -- 172.21.15.50:0/1528573880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670003520 con 0x7f56700040e0 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.494+0000 7f5686d9d640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5670004d00 0x7f5670005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.495+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700040e0 0x7f56700047c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f567c009ac0 tx=0x7f56700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ab82ecdf937349 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.495+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c02c600 con 0x7f56700040e0 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.495+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c02c760 con 0x7f56700040e0 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.495+0000 7f568559a640 1 -- 172.21.15.50:0/1528573880 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c02caf0 con 0x7f56700040e0 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.495+0000 7f568cc7c640 1 -- 172.21.15.50:0/1528573880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700040e0 msgr2=0x7f56700047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.495+0000 7f568cc7c640 1 --2- 172.21.15.50:0/1528573880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56700040e0 0x7f56700047c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f567c009ac0 tx=0x7f56700057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.495+0000 7f5686d9d640 1 -- 172.21.15.50:0/1528573880 reap_dead start 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.496+0000 7f568cc7c640 1 -- 172.21.15.50:0/1528573880 shutdown_connections 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.496+0000 7f568cc7c640 1 -- 172.21.15.50:0/1528573880 >> 172.21.15.50:0/1528573880 conn(0x7f568806b7c0 msgr2=0x7f568806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.496+0000 7f568cc7c640 1 -- 172.21.15.50:0/1528573880 shutdown_connections 2023-12-08T08:20:56.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.496+0000 7f568cc7c640 1 -- 172.21.15.50:0/1528573880 wait complete. 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.497+0000 7f568cc7c640 1 Processor -- start 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.497+0000 7f568cc7c640 1 -- start start 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f568cc7c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56700040e0 0x7f5688153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f568cc7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56881541d0 0x7f5688140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f568cc7c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5688156600 0x7f5688156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f568cc7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688150e80 con 0x7f56881541d0 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f568cc7c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5688151160 con 0x7f56700040e0 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f568cc7c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5688151440 con 0x7f5688156600 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56881541d0 0x7f5688140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56881541d0 0x7f5688140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35820/0 (socket says 172.21.15.50:35820) 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 -- 172.21.15.50:0/1636881251 learned_addr learned my addr 172.21.15.50:0/1636881251 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:56.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f568659c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56700040e0 0x7f5688153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5686d9d640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5688156600 0x7f5688156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 -- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5688156600 msgr2=0x7f5688156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5688156600 0x7f5688156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 -- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56700040e0 msgr2=0x7f5688153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56700040e0 0x7f5688153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 -- 172.21.15.50:0/1636881251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688151720 con 0x7f56881541d0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5685d9b640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56881541d0 0x7f5688140150 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f567c02c1a0 tx=0x7f567c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.498+0000 7f5676ffd640 1 -- 172.21.15.50:0/1636881251 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c02dea0 con 0x7f56881541d0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.499+0000 7f5676ffd640 1 -- 172.21.15.50:0/1636881251 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c003810 con 0x7f56881541d0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.499+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56881539c0 con 0x7f56881541d0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.499+0000 7f5676ffd640 1 -- 172.21.15.50:0/1636881251 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c003b80 con 0x7f56881541d0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.499+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5688140870 con 0x7f56881541d0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.500+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5688071460 con 0x7f56881541d0 2023-12-08T08:20:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.500+0000 7f5676ffd640 1 -- 172.21.15.50:0/1636881251 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f567c003ce0 con 0x7f56881541d0 2023-12-08T08:20:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.500+0000 7f5676ffd640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f566806ae40 0x7f566806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.500+0000 7f5676ffd640 1 -- 172.21.15.50:0/1636881251 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f567c0ab350 con 0x7f56881541d0 2023-12-08T08:20:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.501+0000 7f568659c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f566806ae40 0x7f566806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:56.506 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.501+0000 7f568659c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f566806ae40 0x7f566806d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5678001940 tx=0x7f5678009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:56.507 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.505+0000 7f5676ffd640 1 -- 172.21.15.50:0/1636881251 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f567c076430 con 0x7f56881541d0 2023-12-08T08:20:56.718 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:56.716+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5688140870 con 0x7f56881541d0 2023-12-08T08:20:57.372 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.370+0000 7f5676ffd640 1 -- 172.21.15.50:0/1636881251 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5688140870 con 0x7f56881541d0 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f566806ae40 msgr2=0x7f566806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f566806ae40 0x7f566806d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5678001940 tx=0x7f5678009040 comp rx=0 tx=0).stop 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56881541d0 msgr2=0x7f5688140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56881541d0 0x7f5688140150 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f567c02c1a0 tx=0x7f567c004730 comp rx=0 tx=0).stop 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 shutdown_connections 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f566806ae40 0x7f566806d300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56881541d0 0x7f5688140150 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5688156600 0x7f5688156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.373+0000 7f568cc7c640 1 --2- 172.21.15.50:0/1636881251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56700040e0 0x7f5688153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.374+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 >> 172.21.15.50:0/1636881251 conn(0x7f568806b7c0 msgr2=0x7f56880cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.374+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 shutdown_connections 2023-12-08T08:20:57.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.374+0000 7f568cc7c640 1 -- 172.21.15.50:0/1636881251 wait complete. 2023-12-08T08:20:57.390 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-08T08:20:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.549+0000 7ff9e9ce0640 1 Processor -- start 2023-12-08T08:20:57.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.549+0000 7ff9e9ce0640 1 -- start start 2023-12-08T08:20:57.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.550+0000 7ff9e9ce0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff9e40cf950 0x7ff9e40d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.550+0000 7ff9e9ce0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40cfd30 0x7ff9e415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.550+0000 7ff9e9ce0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40ce900 con 0x7ff9e40d1d00 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.550+0000 7ff9e9ce0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e40cdae0 con 0x7ff9e40cf950 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.550+0000 7ff9e9ce0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e406bfd0 con 0x7ff9e40cfd30 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e3fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40cfd30 0x7ff9e415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e3fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40cfd30 0x7ff9e415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:50780/0 (socket says 172.21.15.50:50780) 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e3fff640 1 -- 172.21.15.50:0/4063996321 learned_addr learned my addr 172.21.15.50:0/4063996321 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e37fe640 1 --2- 172.21.15.50:0/4063996321 >> v2:172.21.15.170:3300/0 conn(0x7ff9e40cf950 0x7ff9e40d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e3fff640 1 -- 172.21.15.50:0/4063996321 >> v2:172.21.15.170:3300/0 conn(0x7ff9e40cf950 msgr2=0x7ff9e40d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e3fff640 1 --2- 172.21.15.50:0/4063996321 >> v2:172.21.15.170:3300/0 conn(0x7ff9e40cf950 0x7ff9e40d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e3fff640 1 -- 172.21.15.50:0/4063996321 >> v1:172.21.15.170:6789/0 conn(0x7ff9e40d1d00 legacy=0x7ff9e406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.551+0000 7ff9e3fff640 1 -- 172.21.15.50:0/4063996321 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40cdcf0 con 0x7ff9e40cfd30 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.552+0000 7ff9e3fff640 1 --2- 172.21.15.50:0/4063996321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40cfd30 0x7ff9e415cc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009e50 tx=0x7ff9dc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7a7acec641dbf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.552+0000 7ff9e27fc640 1 -- 172.21.15.50:0/4063996321 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc02cb00 con 0x7ff9e40cfd30 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.552+0000 7ff9e27fc640 1 -- 172.21.15.50:0/4063996321 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc02cc60 con 0x7ff9e40cfd30 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.552+0000 7ff9e27fc640 1 -- 172.21.15.50:0/4063996321 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0343f0 con 0x7ff9e40cfd30 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/4063996321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40cfd30 msgr2=0x7ff9e415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/4063996321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40cfd30 0x7ff9e415cc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009e50 tx=0x7ff9dc02bf60 comp rx=0 tx=0).stop 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/4063996321 shutdown_connections 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/4063996321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40cfd30 0x7ff9e415cc20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/4063996321 >> v2:172.21.15.170:3300/0 conn(0x7ff9e40cf950 0x7ff9e40d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/4063996321 >> 172.21.15.50:0/4063996321 conn(0x7ff9e409c2f0 msgr2=0x7ff9e40d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/4063996321 shutdown_connections 2023-12-08T08:20:57.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.553+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/4063996321 wait complete. 2023-12-08T08:20:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.554+0000 7ff9e9ce0640 1 Processor -- start 2023-12-08T08:20:57.557 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.554+0000 7ff9e9ce0640 1 -- start start 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.555+0000 7ff9e9ce0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9e40cf950 0x7ff9e40c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.555+0000 7ff9e9ce0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40cfd30 0x7ff9e4156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.555+0000 7ff9e9ce0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40d1d00 0x7ff9e40c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.555+0000 7ff9e9ce0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40cb300 con 0x7ff9e40cf950 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.555+0000 7ff9e9ce0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c9ea0 con 0x7ff9e40cfd30 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.555+0000 7ff9e9ce0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40b8580 con 0x7ff9e40d1d00 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.555+0000 7ff9e37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9e40cf950 0x7ff9e40c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9e40cf950 0x7ff9e40c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35834/0 (socket says 172.21.15.50:35834) 2023-12-08T08:20:57.559 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 -- 172.21.15.50:0/2136752130 learned_addr learned my addr 172.21.15.50:0/2136752130 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e3fff640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40d1d00 0x7ff9e40c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e2ffd640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40cfd30 0x7ff9e4156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 -- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40d1d00 msgr2=0x7ff9e40c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40d1d00 0x7ff9e40c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 -- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40cfd30 msgr2=0x7ff9e4156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40cfd30 0x7ff9e4156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 -- 172.21.15.50:0/2136752130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc009b30 con 0x7ff9e40cf950 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e37fe640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9e40cf950 0x7ff9e40c9960 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400e870 tx=0x7ff9d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9cbfff640 1 -- 172.21.15.50:0/2136752130 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40094f0 con 0x7ff9e40cf950 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9cbfff640 1 -- 172.21.15.50:0/2136752130 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d400c940 con 0x7ff9e40cf950 2023-12-08T08:20:57.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e40b82a0 con 0x7ff9e40cf950 2023-12-08T08:20:57.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9cbfff640 1 -- 172.21.15.50:0/2136752130 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400ccf0 con 0x7ff9e40cf950 2023-12-08T08:20:57.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.556+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e40caf20 con 0x7ff9e40cf950 2023-12-08T08:20:57.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.557+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e4067540 con 0x7ff9e40cf950 2023-12-08T08:20:57.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.558+0000 7ff9cbfff640 1 -- 172.21.15.50:0/2136752130 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9d4013470 con 0x7ff9e40cf950 2023-12-08T08:20:57.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.558+0000 7ff9cbfff640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff9d006ae40 0x7ff9d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:57.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.558+0000 7ff9cbfff640 1 -- 172.21.15.50:0/2136752130 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6115+0+0 (secure 0 0 0) 0x7ff9d4089870 con 0x7ff9e40cf950 2023-12-08T08:20:57.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.559+0000 7ff9e2ffd640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff9d006ae40 0x7ff9d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:57.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.559+0000 7ff9e2ffd640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff9d006ae40 0x7ff9d006d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40b8870 tx=0x7ff9d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:57.565 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.563+0000 7ff9cbfff640 1 -- 172.21.15.50:0/2136752130 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9d4054770 con 0x7ff9e40cf950 2023-12-08T08:20:57.742 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:57.739+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff9e40d0760 con 0x7ff9e40cf950 2023-12-08T08:20:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.371+0000 7ff9cbfff640 1 -- 172.21.15.50:0/2136752130 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff9d4057d90 con 0x7ff9e40cf950 2023-12-08T08:20:58.374 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' removed 2023-12-08T08:20:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff9d006ae40 msgr2=0x7ff9d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff9d006ae40 0x7ff9d006d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40b8870 tx=0x7ff9d8009040 comp rx=0 tx=0).stop 2023-12-08T08:20:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9e40cf950 msgr2=0x7ff9e40c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9e40cf950 0x7ff9e40c9960 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400e870 tx=0x7ff9d400ed30 comp rx=0 tx=0).stop 2023-12-08T08:20:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 shutdown_connections 2023-12-08T08:20:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff9d006ae40 0x7ff9d006d300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.377 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9e40d1d00 0x7ff9e40c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9e40cfd30 0x7ff9e4156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 --2- 172.21.15.50:0/2136752130 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff9e40cf950 0x7ff9e40c9960 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.374+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 >> 172.21.15.50:0/2136752130 conn(0x7ff9e409c2f0 msgr2=0x7ff9e406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.375+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 shutdown_connections 2023-12-08T08:20:58.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.375+0000 7ff9e9ce0640 1 -- 172.21.15.50:0/2136752130 wait complete. 2023-12-08T08:20:58.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-08T08:20:58.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.509+0000 7f1b0383d640 1 Processor -- start 2023-12-08T08:20:58.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.509+0000 7f1b0383d640 1 -- start start 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b0383d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc06f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b0383d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1afc15d600 0x7f1afc0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b0383d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1afc0cfa20 0x7f1afc0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b0383d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc06f610 con 0x7f1afc15d600 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b0383d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc0cff90 con 0x7f1afc0cfa20 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b0383d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0d0270 con 0x7f1afc06ecf0 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1afc15d600 0x7f1afc0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1afc15d600 0x7f1afc0cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35844/0 (socket says 172.21.15.50:35844) 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 -- 172.21.15.50:0/3044300428 learned_addr learned my addr 172.21.15.50:0/3044300428 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:58.513 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 -- 172.21.15.50:0/3044300428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 msgr2=0x7f1afc06f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:58.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b015d9640 1 --2- 172.21.15.50:0/3044300428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc06f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b01dda640 1 --2- 172.21.15.50:0/3044300428 >> v2:172.21.15.170:3300/0 conn(0x7f1afc0cfa20 0x7f1afc0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 --2- 172.21.15.50:0/3044300428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc06f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 -- 172.21.15.50:0/3044300428 >> v2:172.21.15.170:3300/0 conn(0x7f1afc0cfa20 msgr2=0x7f1afc0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:58.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 --2- 172.21.15.50:0/3044300428 >> v2:172.21.15.170:3300/0 conn(0x7f1afc0cfa20 0x7f1afc0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.514 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.510+0000 7f1b00dd8640 1 -- 172.21.15.50:0/3044300428 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0d0550 con 0x7f1afc15d600 2023-12-08T08:20:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.511+0000 7f1b00dd8640 1 --2- 172.21.15.50:0/3044300428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc0cd600 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1afc072500 tx=0x7f1aec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8fe62fb067c27 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:58.515 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.511+0000 7f1af3fff640 1 -- 172.21.15.50:0/3044300428 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec031870 con 0x7f1afc15d600 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.511+0000 7f1af3fff640 1 -- 172.21.15.50:0/3044300428 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0319d0 con 0x7f1afc15d600 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.511+0000 7f1af3fff640 1 -- 172.21.15.50:0/3044300428 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec031d60 con 0x7f1afc15d600 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 -- 172.21.15.50:0/3044300428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 msgr2=0x7f1afc0cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3044300428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc0cd600 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1afc072500 tx=0x7f1aec02b910 comp rx=0 tx=0).stop 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 -- 172.21.15.50:0/3044300428 shutdown_connections 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3044300428 >> v2:172.21.15.170:3300/0 conn(0x7f1afc0cfa20 0x7f1afc0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3044300428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc0cd600 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3044300428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc06f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 -- 172.21.15.50:0/3044300428 >> 172.21.15.50:0/3044300428 conn(0x7f1afc0d0d80 msgr2=0x7f1afc0d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 -- 172.21.15.50:0/3044300428 shutdown_connections 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.512+0000 7f1b0383d640 1 -- 172.21.15.50:0/3044300428 wait complete. 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.513+0000 7f1b0383d640 1 Processor -- start 2023-12-08T08:20:58.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.513+0000 7f1b0383d640 1 -- start start 2023-12-08T08:20:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b0383d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b0383d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1afc0cfa20 0x7f1afc0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b0383d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b0383d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c8390 con 0x7f1afc15d600 2023-12-08T08:20:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b0383d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c64b0 con 0x7f1afc0cfa20 2023-12-08T08:20:58.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b0383d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c8580 con 0x7f1afc06ecf0 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35846/0 (socket says 172.21.15.50:35846) 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 -- 172.21.15.50:0/3104743844 learned_addr learned my addr 172.21.15.50:0/3104743844 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b00dd8640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1afc0cfa20 0x7f1afc0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b015d9640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 -- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 msgr2=0x7f1afc0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 -- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1afc0cfa20 msgr2=0x7f1afc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1afc0cfa20 0x7f1afc0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.514+0000 7f1b01dda640 1 -- 172.21.15.50:0/3104743844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0094d0 con 0x7f1afc15d600 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.515+0000 7f1b01dda640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc150380 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1af400cc30 tx=0x7f1af400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:58.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.515+0000 7f1af1ffb640 1 -- 172.21.15.50:0/3104743844 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400ce40 con 0x7f1afc15d600 2023-12-08T08:20:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.515+0000 7f1af1ffb640 1 -- 172.21.15.50:0/3104743844 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4003990 con 0x7f1afc15d600 2023-12-08T08:20:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.515+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc0c8860 con 0x7f1afc15d600 2023-12-08T08:20:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.515+0000 7f1af1ffb640 1 -- 172.21.15.50:0/3104743844 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4003d20 con 0x7f1afc15d600 2023-12-08T08:20:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.515+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc0c8e20 con 0x7f1afc15d600 2023-12-08T08:20:58.520 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.516+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc067540 con 0x7f1afc15d600 2023-12-08T08:20:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.516+0000 7f1af1ffb640 1 -- 172.21.15.50:0/3104743844 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1af4003e80 con 0x7f1afc15d600 2023-12-08T08:20:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.517+0000 7f1af1ffb640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ae006ae40 0x7f1ae006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.517+0000 7f1af1ffb640 1 -- 172.21.15.50:0/3104743844 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5677+0+0 (secure 0 0 0) 0x7f1af4089930 con 0x7f1afc15d600 2023-12-08T08:20:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.517+0000 7f1b015d9640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ae006ae40 0x7f1ae006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:58.521 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.518+0000 7f1b015d9640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ae006ae40 0x7f1ae006d300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1af8006fd0 tx=0x7f1af8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:58.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.521+0000 7f1af1ffb640 1 -- 172.21.15.50:0/3104743844 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1af4054a90 con 0x7f1afc15d600 2023-12-08T08:20:58.701 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:58.699+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1afc0d0b60 con 0x7f1afc15d600 2023-12-08T08:20:59.378 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.376+0000 7f1af1ffb640 1 -- 172.21.15.50:0/3104743844 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1af401d070 con 0x7f1afc15d600 2023-12-08T08:20:59.379 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' removed 2023-12-08T08:20:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ae006ae40 msgr2=0x7f1ae006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ae006ae40 0x7f1ae006d300 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1af8006fd0 tx=0x7f1af8008040 comp rx=0 tx=0).stop 2023-12-08T08:20:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 msgr2=0x7f1afc150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc150380 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1af400cc30 tx=0x7f1af400a5c0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 shutdown_connections 2023-12-08T08:20:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f1ae006ae40 0x7f1ae006d300 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1afc15d600 0x7f1afc150380 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1afc0cfa20 0x7f1afc0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 --2- 172.21.15.50:0/3104743844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1afc06ecf0 0x7f1afc0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 >> 172.21.15.50:0/3104743844 conn(0x7f1afc0d0d80 msgr2=0x7f1afc0ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 shutdown_connections 2023-12-08T08:20:59.384 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.380+0000 7f1b0383d640 1 -- 172.21.15.50:0/3104743844 wait complete. 2023-12-08T08:20:59.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-08T08:20:59.511 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.509+0000 7feccf409640 1 Processor -- start 2023-12-08T08:20:59.512 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.510+0000 7feccf409640 1 -- start start 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.510+0000 7feccf409640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 0x7fecc80b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.510+0000 7feccf409640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc80c6be0 con 0x7fecc80b4150 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.510+0000 7feccf409640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc80d3ff0 con 0x7fecc80cfa30 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.510+0000 7feccf409640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80b4860 con 0x7fecc80cfe10 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7feccc9a4640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fecc80b4150 0x7fecc80cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:49204/0 (socket says 172.21.15.50:49204) 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7feccc9a4640 1 -- 172.21.15.50:0/1156967388 learned_addr learned my addr 172.21.15.50:0/1156967388 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7feccd9a6640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 0x7fecc80b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352546700 0 0) 0x7fecc80c6be0 con 0x7fecc80b4150 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb0003520 con 0x7fecc80b4150 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795696136 0 0) 0x7fecc80d3ff0 con 0x7fecc80cfa30 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc80c6be0 con 0x7fecc80cfa30 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 182649008 0 0) 0x7fecb0003520 con 0x7fecc80b4150 2023-12-08T08:20:59.516 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 msgr2=0x7fecc80b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 0x7fecc80b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 >> v1:172.21.15.170:6789/0 conn(0x7fecc80cfa30 legacy=0x7fecc80b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc80d3d50 con 0x7fecc80b4150 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fecbc001690 con 0x7fecc80b4150 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 >> v1:172.21.15.50:6789/0 conn(0x7fecc80b4150 legacy=0x7fecc80cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 0x7fecb0003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb00040e0 0x7fecb00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb0004d00 0x7fecb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80b4860 con 0x7fecb0004d00 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb000bbe0 con 0x7fecb00040e0 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb000bda0 con 0x7fecc80cfe10 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7feccd1a5640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 0x7fecb0003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.517 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7feccc9a4640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb00040e0 0x7fecb00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.511+0000 7feccd9a6640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb0004d00 0x7fecb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.512+0000 7feccd9a6640 1 -- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 msgr2=0x7fecb0003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.512+0000 7feccd9a6640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc80cfe10 0x7fecb0003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.512+0000 7feccd9a6640 1 -- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb00040e0 msgr2=0x7fecb00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.512+0000 7feccd9a6640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecb00040e0 0x7fecb00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.512+0000 7feccd9a6640 1 -- 172.21.15.50:0/1156967388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0003520 con 0x7fecb0004d00 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccd9a6640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb0004d00 0x7fecb0005180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009ac0 tx=0x7fecb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768bcdf44ecf6805 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc002c6b0 con 0x7fecb0004d00 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc002c810 con 0x7fecb0004d00 2023-12-08T08:20:59.518 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7fecc7fff640 1 -- 172.21.15.50:0/1156967388 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc002cba0 con 0x7fecb0004d00 2023-12-08T08:20:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccf409640 1 -- 172.21.15.50:0/1156967388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb0004d00 msgr2=0x7fecb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccf409640 1 --2- 172.21.15.50:0/1156967388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb0004d00 0x7fecb0005180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009ac0 tx=0x7fecb00057f0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccd9a6640 1 -- 172.21.15.50:0/1156967388 reap_dead start 2023-12-08T08:20:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccf409640 1 -- 172.21.15.50:0/1156967388 shutdown_connections 2023-12-08T08:20:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccf409640 1 -- 172.21.15.50:0/1156967388 >> 172.21.15.50:0/1156967388 conn(0x7fecc80d3090 msgr2=0x7fecc80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccf409640 1 -- 172.21.15.50:0/1156967388 shutdown_connections 2023-12-08T08:20:59.519 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.513+0000 7feccf409640 1 -- 172.21.15.50:0/1156967388 wait complete. 2023-12-08T08:20:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.514+0000 7feccf409640 1 Processor -- start 2023-12-08T08:20:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccf409640 1 -- start start 2023-12-08T08:20:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccf409640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc81f5bd0 0x7fecc81f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccf409640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecc81f5fb0 0x7fecc81f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.522 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccf409640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc81f69c0 0x7fecc80c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccf409640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80cb8f0 con 0x7fecc81f5bd0 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccf409640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80cbe70 con 0x7fecc81f5fb0 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccf409640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc81f6f40 con 0x7fecc81f69c0 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccd1a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc81f5bd0 0x7fecc81f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccd1a5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc81f5bd0 0x7fecc81f2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35866/0 (socket says 172.21.15.50:35866) 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccd1a5640 1 -- 172.21.15.50:0/3007360820 learned_addr learned my addr 172.21.15.50:0/3007360820 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.515+0000 7feccc9a4640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecc81f5fb0 0x7fecc81f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd9a6640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc81f69c0 0x7fecc80c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.523 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd1a5640 1 -- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc81f69c0 msgr2=0x7fecc80c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd1a5640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc81f69c0 0x7fecc80c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd1a5640 1 -- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecc81f5fb0 msgr2=0x7fecc81f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd1a5640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecc81f5fb0 0x7fecc81f6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd1a5640 1 -- 172.21.15.50:0/3007360820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc81f7220 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd9a6640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc81f69c0 0x7fecc80c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccd1a5640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc81f5bd0 0x7fecc81f2f10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fecb800fb50 tx=0x7fecb800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7fecc5ffb640 1 -- 172.21.15.50:0/3007360820 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb800dbd0 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7fecc5ffb640 1 -- 172.21.15.50:0/3007360820 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb800dd30 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc80cbb00 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7fecc5ffb640 1 -- 172.21.15.50:0/3007360820 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb8003bb0 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.516+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc80c7850 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.517+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc8067430 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.518+0000 7fecc5ffb640 1 -- 172.21.15.50:0/3007360820 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecb8003d10 con 0x7fecc81f5bd0 2023-12-08T08:20:59.524 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.518+0000 7fecc5ffb640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecb406ae70 0x7fecb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.518+0000 7fecc5ffb640 1 -- 172.21.15.50:0/3007360820 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fecb8089750 con 0x7fecc81f5bd0 2023-12-08T08:20:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.518+0000 7feccc9a4640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecb406ae70 0x7fecb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.519+0000 7feccc9a4640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecb406ae70 0x7fecb406d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fecc81609d0 tx=0x7fecbc0015a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.525 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.522+0000 7fecc5ffb640 1 -- 172.21.15.50:0/3007360820 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecb80549c0 con 0x7fecc81f5bd0 2023-12-08T08:20:59.711 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.709+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fecc81f73b0 con 0x7fecc81f5bd0 2023-12-08T08:20:59.714 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.711+0000 7fecc5ffb640 1 -- 172.21.15.50:0/3007360820 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fecb800dea0 con 0x7fecc81f5bd0 2023-12-08T08:20:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.713+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecb406ae70 msgr2=0x7fecb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.716 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.713+0000 7feccf409640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecb406ae70 0x7fecb406d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fecc81609d0 tx=0x7fecbc0015a0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.713+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc81f5bd0 msgr2=0x7fecc81f2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.713+0000 7feccf409640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc81f5bd0 0x7fecc81f2f10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fecb800fb50 tx=0x7fecb800d520 comp rx=0 tx=0).stop 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 shutdown_connections 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecb406ae70 0x7fecb406d330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fecc81f69c0 0x7fecc80c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecc81f5fb0 0x7fecc81f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 --2- 172.21.15.50:0/3007360820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecc81f5bd0 0x7fecc81f2f10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 >> 172.21.15.50:0/3007360820 conn(0x7fecc80d3090 msgr2=0x7fecc806c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 shutdown_connections 2023-12-08T08:20:59.717 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.714+0000 7feccf409640 1 -- 172.21.15.50:0/3007360820 wait complete. 2023-12-08T08:20:59.727 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-12-08T08:20:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.830+0000 7fb42c143640 1 Processor -- start 2023-12-08T08:20:59.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.831+0000 7fb42c143640 1 -- start start 2023-12-08T08:20:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.831+0000 7fb42c143640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.831+0000 7fb42c143640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb4240b0cf0 0x7fb4240cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.831+0000 7fb42c143640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240d20b0 con 0x7fb4240b1d70 2023-12-08T08:20:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.831+0000 7fb42c143640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240d0620 con 0x7fb4240b0cf0 2023-12-08T08:20:59.834 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.831+0000 7fb42c143640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240d1b80 con 0x7fb4241608a0 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb42a6e0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb4240b0cf0 0x7fb4240cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb429edf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb4296de640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb4240b1d70 0x7fb4240d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:40958/0 (socket says 172.21.15.50:40958) 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb4296de640 1 -- 172.21.15.50:0/1735054527 learned_addr learned my addr 172.21.15.50:0/1735054527 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb428edd640 1 -- 172.21.15.50:0/1735054527 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561560226 0 0) 0x7fb4240d20b0 con 0x7fb4240b1d70 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb428edd640 1 -- 172.21.15.50:0/1735054527 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb40c003520 con 0x7fb4240b1d70 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb42a6e0640 1 -- 172.21.15.50:0/1735054527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 msgr2=0x7fb4240d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb42a6e0640 1 --2- 172.21.15.50:0/1735054527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.835 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb42a6e0640 1 -- 172.21.15.50:0/1735054527 >> v1:172.21.15.170:6789/0 conn(0x7fb4240b1d70 legacy=0x7fb4240d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.836 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.832+0000 7fb42a6e0640 1 -- 172.21.15.50:0/1735054527 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240d1dd0 con 0x7fb4240b0cf0 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.833+0000 7fb42a6e0640 1 --2- 172.21.15.50:0/1735054527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 0x7fb4240cdc40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb414009d90 tx=0x7fb41402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf09f421f0f8da9 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.833+0000 7fb428edd640 1 -- 172.21.15.50:0/1735054527 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41402cbc0 con 0x7fb4240b0cf0 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.833+0000 7fb428edd640 1 -- 172.21.15.50:0/1735054527 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41402cd20 con 0x7fb4240b0cf0 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.833+0000 7fb428edd640 1 -- 172.21.15.50:0/1735054527 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414034660 con 0x7fb4240b0cf0 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 -- 172.21.15.50:0/1735054527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 msgr2=0x7fb4240cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 --2- 172.21.15.50:0/1735054527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 0x7fb4240cdc40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb414009d90 tx=0x7fb41402be10 comp rx=0 tx=0).stop 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 -- 172.21.15.50:0/1735054527 shutdown_connections 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 --2- 172.21.15.50:0/1735054527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 0x7fb4240cdc40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 --2- 172.21.15.50:0/1735054527 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 -- 172.21.15.50:0/1735054527 >> 172.21.15.50:0/1735054527 conn(0x7fb4240d3030 msgr2=0x7fb4240d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 -- 172.21.15.50:0/1735054527 shutdown_connections 2023-12-08T08:20:59.837 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.834+0000 7fb42c143640 1 -- 172.21.15.50:0/1735054527 wait complete. 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.835+0000 7fb42c143640 1 Processor -- start 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.835+0000 7fb42c143640 1 -- start start 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb42c143640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 0x7fb424152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb42c143640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4240b1d70 0x7fb4240ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb42c143640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb42c143640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424152990 con 0x7fb4240b1d70 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb42c143640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240c73b0 con 0x7fb4240b0cf0 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb42c143640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240cabc0 con 0x7fb4241608a0 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4240b1d70 0x7fb4240ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4240b1d70 0x7fb4240ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53524/0 (socket says 172.21.15.50:53524) 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 -- 172.21.15.50:0/3506776406 learned_addr learned my addr 172.21.15.50:0/3506776406 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb429edf640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 0x7fb424152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.840 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb42a6e0640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 -- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 msgr2=0x7fb4240cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 -- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 msgr2=0x7fb424152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 0x7fb424152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.836+0000 7fb4296de640 1 -- 172.21.15.50:0/3506776406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb414009a70 con 0x7fb4240b1d70 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.837+0000 7fb4296de640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4240b1d70 0x7fb4240ca100 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c500 tx=0x7fb41800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.837+0000 7fb4227fc640 1 -- 172.21.15.50:0/3506776406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418005ce0 con 0x7fb4240b1d70 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.837+0000 7fb4227fc640 1 -- 172.21.15.50:0/3506776406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418005e40 con 0x7fb4240b1d70 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.837+0000 7fb4227fc640 1 -- 172.21.15.50:0/3506776406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418007330 con 0x7fb4240b1d70 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.837+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4240caea0 con 0x7fb4240b1d70 2023-12-08T08:20:59.841 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.837+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4240b5c50 con 0x7fb4240b1d70 2023-12-08T08:20:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.838+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb424067430 con 0x7fb4240b1d70 2023-12-08T08:20:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.838+0000 7fb4227fc640 1 -- 172.21.15.50:0/3506776406 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb418007550 con 0x7fb4240b1d70 2023-12-08T08:20:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.839+0000 7fb4227fc640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb41006ae40 0x7fb41006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:20:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.839+0000 7fb4227fc640 1 -- 172.21.15.50:0/3506776406 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb418088b00 con 0x7fb4240b1d70 2023-12-08T08:20:59.842 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.839+0000 7fb429edf640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb41006ae40 0x7fb41006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:20:59.843 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.840+0000 7fb429edf640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb41006ae40 0x7fb41006d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009a30 tx=0x7fb41c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:20:59.845 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:20:59.843+0000 7fb4227fc640 1 -- 172.21.15.50:0/3506776406 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb41808ae60 con 0x7fb4240b1d70 2023-12-08T08:21:00.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.085+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fb4240c64b0 con 0x7fb4240b1d70 2023-12-08T08:21:00.380 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.377+0000 7fb4227fc640 1 -- 172.21.15.50:0/3506776406 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v189) v1 ==== 134+0+0 (secure 0 0 0) 0x7fb4180170c0 con 0x7fb4240b1d70 2023-12-08T08:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb41006ae40 msgr2=0x7fb41006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb41006ae40 0x7fb41006d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009a30 tx=0x7fb41c008040 comp rx=0 tx=0).stop 2023-12-08T08:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4240b1d70 msgr2=0x7fb4240ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4240b1d70 0x7fb4240ca100 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c500 tx=0x7fb41800c9c0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 shutdown_connections 2023-12-08T08:21:00.382 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fb41006ae40 0x7fb41006d300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb4240b1d70 0x7fb4240ca100 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb4241608a0 0x7fb4240cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 --2- 172.21.15.50:0/3506776406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4240b0cf0 0x7fb424152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 >> 172.21.15.50:0/3506776406 conn(0x7fb4240d3030 msgr2=0x7fb4240d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.379+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 shutdown_connections 2023-12-08T08:21:00.383 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:00.380+0000 7fb42c143640 1 -- 172.21.15.50:0/3506776406 wait complete. 2023-12-08T08:21:00.394 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2023-12-08T08:21:00.394 INFO:tasks.cephfs_test_runner: 2023-12-08T08:21:00.394 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: p.wait() 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner:Ran 2 tests in 133.830s 2023-12-08T08:21:00.395 INFO:tasks.cephfs_test_runner: 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: p.wait() 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi050 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-12-08T08:21:00.396 INFO:tasks.cephfs_test_runner: 2023-12-08T08:21:00.397 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-08T08:21:00.475 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bb17a37669d5489f8794574f53a66528 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-08T08:21:00.477 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-08T08:21:00.491 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-08T08:21:00.514 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-08T08:21:00.515 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:21:00.515 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:00.536 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2474 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-08T08:21:00.536 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2023-12-08T08:21:00.536 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:00.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057149,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2474 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249480k,nr_inodes=812370,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498964k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-08T08:21:00.594 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:21:00.594 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:00.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:21:00.614 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-12-08T08:21:00.614 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-08T08:21:00.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=282 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-08T08:21:00.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:00.673 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2023-12-08T08:21:00.730 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-08T08:21:00.730 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-08T08:21:00.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:00.730 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-08T08:21:00.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:00.801 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-08T08:21:00.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:00.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2023-12-08T08:21:00.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:00.965 DEBUG:teuthology.orchestra.run.smithi050:> ip netns list 2023-12-08T08:21:00.984 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-08T08:21:00.985 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-08T08:21:00.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:00.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-08T08:21:01.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:01.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-08T08:21:01.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-08T08:21:01.137 DEBUG:teuthology.orchestra.run.smithi050:> sudo ip link delete ceph-brx 2023-12-08T08:21:01.236 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-08T08:21:01.246 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-08T08:21:01.247 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.354+0000 7fecedfce640 1 Processor -- start 2023-12-08T08:21:01.357 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.354+0000 7fecedfce640 1 -- start start 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.355+0000 7fecedfce640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fece80cbd10 0x7fece8070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.355+0000 7fecedfce640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece80720d0 con 0x7fece815b750 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.355+0000 7fecedfce640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece80cc890 con 0x7fece8158ee0 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.355+0000 7fecedfce640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece80714c0 con 0x7fece80cbd10 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece7fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fece815b750 0x7fece806c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53790/0 (socket says 172.21.15.50:53790) 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece7fff640 1 -- 172.21.15.50:0/2007022765 learned_addr learned my addr 172.21.15.50:0/2007022765 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece6ffd640 1 --2- 172.21.15.50:0/2007022765 >> v2:172.21.15.170:3300/0 conn(0x7fece80cbd10 0x7fece8070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.359 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece67fc640 1 -- 172.21.15.50:0/2007022765 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256950003 0 0) 0x7fece80720d0 con 0x7fece815b750 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece67fc640 1 -- 172.21.15.50:0/2007022765 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd0003520 con 0x7fece815b750 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece67fc640 1 -- 172.21.15.50:0/2007022765 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3000132789 0 0) 0x7fecd0003520 con 0x7fece815b750 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece6ffd640 1 -- 172.21.15.50:0/2007022765 >> v1:172.21.15.170:6789/0 conn(0x7fece8158ee0 legacy=0x7fece80cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece6ffd640 1 -- 172.21.15.50:0/2007022765 >> v1:172.21.15.50:6789/0 conn(0x7fece815b750 legacy=0x7fece806c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.356+0000 7fece6ffd640 1 -- 172.21.15.50:0/2007022765 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece80717a0 con 0x7fece80cbd10 2023-12-08T08:21:01.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.357+0000 7fece6ffd640 1 --2- 172.21.15.50:0/2007022765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece80cbd10 0x7fece8070e30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0097a0 tx=0x7fecdc02b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=703f59265cf03403 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.357+0000 7fece67fc640 1 -- 172.21.15.50:0/2007022765 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00019f0 con 0x7fece80cbd10 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.357+0000 7fece67fc640 1 -- 172.21.15.50:0/2007022765 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc02e050 con 0x7fece80cbd10 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.357+0000 7fece67fc640 1 -- 172.21.15.50:0/2007022765 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc030510 con 0x7fece80cbd10 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.358+0000 7fecedfce640 1 -- 172.21.15.50:0/2007022765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece80cbd10 msgr2=0x7fece8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.358+0000 7fecedfce640 1 --2- 172.21.15.50:0/2007022765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece80cbd10 0x7fece8070e30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0097a0 tx=0x7fecdc02b600 comp rx=0 tx=0).stop 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.358+0000 7fecedfce640 1 -- 172.21.15.50:0/2007022765 shutdown_connections 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.358+0000 7fecedfce640 1 --2- 172.21.15.50:0/2007022765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece80cbd10 0x7fece8070e30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.358+0000 7fecedfce640 1 -- 172.21.15.50:0/2007022765 >> 172.21.15.50:0/2007022765 conn(0x7fece80b09f0 msgr2=0x7fece80b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.358+0000 7fecedfce640 1 -- 172.21.15.50:0/2007022765 shutdown_connections 2023-12-08T08:21:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.358+0000 7fecedfce640 1 -- 172.21.15.50:0/2007022765 wait complete. 2023-12-08T08:21:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.359+0000 7fecedfce640 1 Processor -- start 2023-12-08T08:21:01.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.359+0000 7fecedfce640 1 -- start start 2023-12-08T08:21:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fecedfce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80cbd10 0x7fece809c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fecedfce640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fece8158ee0 0x7fece8156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fecedfce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece815b750 0x7fece8156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fecedfce640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8157e60 con 0x7fece80cbd10 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fecedfce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece809cba0 con 0x7fece815b750 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fecedfce640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80cce60 con 0x7fece8158ee0 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80cbd10 0x7fece809c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80cbd10 0x7fece809c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53526/0 (socket says 172.21.15.50:53526) 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 -- 172.21.15.50:0/1017138431 learned_addr learned my addr 172.21.15.50:0/1017138431 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece7fff640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece815b750 0x7fece8156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece6ffd640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fece8158ee0 0x7fece8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 -- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fece8158ee0 msgr2=0x7fece8156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.366 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fece8158ee0 0x7fece8156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 -- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece815b750 msgr2=0x7fece8156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece815b750 0x7fece8156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.360+0000 7fece77fe640 1 -- 172.21.15.50:0/1017138431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc009400 con 0x7fece80cbd10 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.361+0000 7fece77fe640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80cbd10 0x7fece809c660 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fecd800c780 tx=0x7fecd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.361+0000 7feccffff640 1 -- 172.21.15.50:0/1017138431 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8005270 con 0x7fece80cbd10 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.361+0000 7feccffff640 1 -- 172.21.15.50:0/1017138431 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd80053f0 con 0x7fece80cbd10 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.361+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece8156dc0 con 0x7fece80cbd10 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.361+0000 7feccffff640 1 -- 172.21.15.50:0/1017138431 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800a880 con 0x7fece80cbd10 2023-12-08T08:21:01.367 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.361+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece8157380 con 0x7fece80cbd10 2023-12-08T08:21:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.362+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece8070e30 con 0x7fece80cbd10 2023-12-08T08:21:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.362+0000 7feccffff640 1 -- 172.21.15.50:0/1017138431 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fecd800a9e0 con 0x7fece80cbd10 2023-12-08T08:21:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.363+0000 7feccffff640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecd406ae40 0x7fecd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.363+0000 7feccffff640 1 -- 172.21.15.50:0/1017138431 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fecd8088bc0 con 0x7fece80cbd10 2023-12-08T08:21:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.363+0000 7fece6ffd640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecd406ae40 0x7fecd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.368 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.363+0000 7fece6ffd640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecd406ae40 0x7fecd406d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecdc034000 tx=0x7fecdc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.369 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.367+0000 7feccffff640 1 -- 172.21.15.50:0/1017138431 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecd8053e50 con 0x7fece80cbd10 2023-12-08T08:21:01.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.541+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fece8072430 con 0x7fecd406ae40 2023-12-08T08:21:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.544+0000 7feccffff640 1 -- 172.21.15.50:0/1017138431 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51174 (secure 0 0 0) 0x7fece8072430 con 0x7fecd406ae40 2023-12-08T08:21:01.547 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:21:01.547 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:21:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecd406ae40 msgr2=0x7fecd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.548 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecd406ae40 0x7fecd406d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fecdc034000 tx=0x7fecdc008030 comp rx=0 tx=0).stop 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80cbd10 msgr2=0x7fece809c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80cbd10 0x7fece809c660 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fecd800c780 tx=0x7fecd800cc40 comp rx=0 tx=0).stop 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 shutdown_connections 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fecd406ae40 0x7fecd406d300 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece815b750 0x7fece8156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fece8158ee0 0x7fece8156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 --2- 172.21.15.50:0/1017138431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fece80cbd10 0x7fece809c660 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 >> 172.21.15.50:0/1017138431 conn(0x7fece80b09f0 msgr2=0x7fece815e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 shutdown_connections 2023-12-08T08:21:01.549 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.546+0000 7fecedfce640 1 -- 172.21.15.50:0/1017138431 wait complete. 2023-12-08T08:21:01.559 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-12-08T08:21:00.160035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256060,"kb_used_data":6620,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718660,"statfs":{"total":773094113280,"available":772831907840,"internally_reserved":0,"allocated":6778880,"data_stored":3703786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14927,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001403"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-08T08:20:56.372602+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:20:56.372602+0000","last_peered":"2023-12-08T08:20:56.372602+0000","last_clean":"2023-12-08T08:20:56.372602+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:20:56.372602+0000","last_undegraded":"2023-12-08T08:20:56.372602+0000","last_fullsized":"2023-12-08T08:20:56.372602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":905583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70599999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.44700000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.76600000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.48399999999999999,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63400000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64000000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.435}]},{"osd":6,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":315215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66900000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70799999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74399999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.64900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68500000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66700000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":309544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.39300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.498},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71099999999999997,"5min":0.745,"15min":0.745},"last":0.623},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.41699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.442,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":0.88,"15min":0.88},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":325184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.441}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80400000000000005,"5min":1.022,"15min":1.022},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67000000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.622}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76800000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":308948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.499,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.316},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":0.623,"15min":0.623},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63600000000000001,"5min":0.751,"15min":0.751},"last":0.37}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":315215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.33700000000000002},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.247,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.313},{"interface":"front","average":{"1min":0.38,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58999999999999997,"5min":0.623,"15min":0.623},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.48899999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88700000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.876,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":308982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.502,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.375},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.434}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.437,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.378,"15min":0.377},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.379},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1302528,"data_stored":915115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.223,"5min":0.217,"15min":0.217},"max":{"1min":0.50800000000000001,"5min":0.628,"15min":0.628},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.48799999999999999,"15min":0.53100000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56899999999999995,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.622,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.89900000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.95499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:01.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:01.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.665+0000 7f8a77a48640 1 Processor -- start 2023-12-08T08:21:01.667 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.665+0000 7f8a77a48640 1 -- start start 2023-12-08T08:21:01.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a77a48640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a700ccd70 0x7f8a700ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a77a48640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700cf1e0 0x7f8a7006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a77a48640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700cf9c0 con 0x7f8a7006c480 2023-12-08T08:21:01.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a77a48640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700d0a60 con 0x7f8a700ccd70 2023-12-08T08:21:01.669 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a77a48640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700ce7b0 con 0x7f8a700cf1e0 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a757e4640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8a700ccd70 0x7f8a700ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a75fe5640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8a7006c480 0x7f8a7015ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53802/0 (socket says 172.21.15.50:53802) 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.666+0000 7f8a75fe5640 1 -- 172.21.15.50:0/1528880109 learned_addr learned my addr 172.21.15.50:0/1528880109 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a757e4640 1 -- 172.21.15.50:0/1528880109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700cf1e0 msgr2=0x7f8a7006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a74fe3640 1 --2- 172.21.15.50:0/1528880109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700cf1e0 0x7f8a7006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a757e4640 1 --2- 172.21.15.50:0/1528880109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700cf1e0 0x7f8a7006bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a757e4640 1 -- 172.21.15.50:0/1528880109 >> v1:172.21.15.50:6789/0 conn(0x7f8a7006c480 legacy=0x7f8a7015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a6ffff640 1 -- 172.21.15.50:0/1528880109 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755205962 0 0) 0x7f8a700cf9c0 con 0x7f8a7006c480 2023-12-08T08:21:01.670 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a757e4640 1 -- 172.21.15.50:0/1528880109 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700cfca0 con 0x7f8a700ccd70 2023-12-08T08:21:01.671 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a74fe3640 1 --2- 172.21.15.50:0/1528880109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700cf1e0 0x7f8a7006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a757e4640 1 --2- 172.21.15.50:0/1528880109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a700ccd70 0x7f8a700ce270 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097a0 tx=0x7f8a6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d84e2276825f2a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a6ffff640 1 -- 172.21.15.50:0/1528880109 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68031830 con 0x7f8a700ccd70 2023-12-08T08:21:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.667+0000 7f8a6ffff640 1 -- 172.21.15.50:0/1528880109 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68031990 con 0x7f8a700ccd70 2023-12-08T08:21:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a6ffff640 1 -- 172.21.15.50:0/1528880109 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68031d20 con 0x7f8a700ccd70 2023-12-08T08:21:01.674 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 -- 172.21.15.50:0/1528880109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a700ccd70 msgr2=0x7f8a700ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1528880109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a700ccd70 0x7f8a700ce270 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097a0 tx=0x7f8a6802b8d0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 -- 172.21.15.50:0/1528880109 shutdown_connections 2023-12-08T08:21:01.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1528880109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700cf1e0 0x7f8a7006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.675 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1528880109 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a700ccd70 0x7f8a700ce270 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 -- 172.21.15.50:0/1528880109 >> 172.21.15.50:0/1528880109 conn(0x7f8a700d0de0 msgr2=0x7f8a700d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 -- 172.21.15.50:0/1528880109 shutdown_connections 2023-12-08T08:21:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.668+0000 7f8a77a48640 1 -- 172.21.15.50:0/1528880109 wait complete. 2023-12-08T08:21:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.669+0000 7f8a77a48640 1 Processor -- start 2023-12-08T08:21:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.669+0000 7f8a77a48640 1 -- start start 2023-12-08T08:21:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a77a48640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7006c480 0x7f8a70156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.676 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a77a48640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700ccd70 0x7f8a700c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a77a48640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a700cf1e0 0x7f8a700c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a77a48640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a70156ac0 con 0x7f8a7006c480 2023-12-08T08:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a77a48640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700c5be0 con 0x7f8a700cf1e0 2023-12-08T08:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a77a48640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700c5ec0 con 0x7f8a700ccd70 2023-12-08T08:21:01.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a757e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7006c480 0x7f8a70156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a757e4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7006c480 0x7f8a70156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53552/0 (socket says 172.21.15.50:53552) 2023-12-08T08:21:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a757e4640 1 -- 172.21.15.50:0/1294754828 learned_addr learned my addr 172.21.15.50:0/1294754828 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a75fe5640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a700cf1e0 0x7f8a700c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.670+0000 7f8a74fe3640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700ccd70 0x7f8a700c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a757e4640 1 -- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700ccd70 msgr2=0x7f8a700c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a757e4640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700ccd70 0x7f8a700c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a757e4640 1 -- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a700cf1e0 msgr2=0x7f8a700c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a757e4640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a700cf1e0 0x7f8a700c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a757e4640 1 -- 172.21.15.50:0/1294754828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009400 con 0x7f8a7006c480 2023-12-08T08:21:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a75fe5640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a700cf1e0 0x7f8a700c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:01.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a757e4640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7006c480 0x7f8a70156580 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000c00 tx=0x7f8a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a6dffb640 1 -- 172.21.15.50:0/1294754828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68004230 con 0x7f8a7006c480 2023-12-08T08:21:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a6dffb640 1 -- 172.21.15.50:0/1294754828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68004390 con 0x7f8a7006c480 2023-12-08T08:21:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a700c61a0 con 0x7f8a7006c480 2023-12-08T08:21:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a6dffb640 1 -- 172.21.15.50:0/1294754828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803a920 con 0x7f8a7006c480 2023-12-08T08:21:01.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.671+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a700c5810 con 0x7f8a7006c480 2023-12-08T08:21:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.672+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7015b0a0 con 0x7f8a7006c480 2023-12-08T08:21:01.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.673+0000 7f8a6dffb640 1 -- 172.21.15.50:0/1294754828 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a6803aa80 con 0x7f8a7006c480 2023-12-08T08:21:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.673+0000 7f8a6dffb640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8a5c06ae40 0x7f8a5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.673+0000 7f8a6dffb640 1 -- 172.21.15.50:0/1294754828 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8a680aba90 con 0x7f8a7006c480 2023-12-08T08:21:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.673+0000 7f8a74fe3640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8a5c06ae40 0x7f8a5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.674+0000 7f8a74fe3640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8a5c06ae40 0x7f8a5c06d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8a7015a620 tx=0x7f8a64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.677+0000 7f8a6dffb640 1 -- 172.21.15.50:0/1294754828 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a7015b0a0 con 0x7f8a7006c480 2023-12-08T08:21:01.852 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.849+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a7006bd90 con 0x7f8a5c06ae40 2023-12-08T08:21:01.854 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.852+0000 7f8a6dffb640 1 -- 172.21.15.50:0/1294754828 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51174 (secure 0 0 0) 0x7f8a7006bd90 con 0x7f8a5c06ae40 2023-12-08T08:21:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:21:01.855 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:21:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8a5c06ae40 msgr2=0x7f8a5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8a5c06ae40 0x7f8a5c06d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8a7015a620 tx=0x7f8a64008040 comp rx=0 tx=0).stop 2023-12-08T08:21:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7006c480 msgr2=0x7f8a70156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7006c480 0x7f8a70156580 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8a68000c00 tx=0x7f8a680046c0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.857 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 shutdown_connections 2023-12-08T08:21:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8a5c06ae40 0x7f8a5c06d300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a700cf1e0 0x7f8a700c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a700ccd70 0x7f8a700c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 --2- 172.21.15.50:0/1294754828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7006c480 0x7f8a70156580 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 >> 172.21.15.50:0/1294754828 conn(0x7f8a700d0de0 msgr2=0x7f8a701606b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 shutdown_connections 2023-12-08T08:21:01.858 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.854+0000 7f8a77a48640 1 -- 172.21.15.50:0/1294754828 wait complete. 2023-12-08T08:21:01.867 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-12-08T08:21:00.160035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256060,"kb_used_data":6620,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718660,"statfs":{"total":773094113280,"available":772831907840,"internally_reserved":0,"allocated":6778880,"data_stored":3703786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14927,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001403"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-08T08:20:56.372602+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:20:56.372602+0000","last_peered":"2023-12-08T08:20:56.372602+0000","last_clean":"2023-12-08T08:20:56.372602+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:20:56.372602+0000","last_undegraded":"2023-12-08T08:20:56.372602+0000","last_fullsized":"2023-12-08T08:20:56.372602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":905583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70599999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.44700000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.76600000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.48399999999999999,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63400000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64000000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.435}]},{"osd":6,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":315215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66900000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70799999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74399999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.64900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68500000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66700000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":309544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.39300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.498},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71099999999999997,"5min":0.745,"15min":0.745},"last":0.623},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.41699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.442,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":0.88,"15min":0.88},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":325184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.441}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80400000000000005,"5min":1.022,"15min":1.022},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67000000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.622}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76800000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":308948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.499,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.316},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":0.623,"15min":0.623},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63600000000000001,"5min":0.751,"15min":0.751},"last":0.37}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":315215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.33700000000000002},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.247,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.313},{"interface":"front","average":{"1min":0.38,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58999999999999997,"5min":0.623,"15min":0.623},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.48899999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88700000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.876,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":308982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.502,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.375},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.434}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.437,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.378,"15min":0.377},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.379},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1302528,"data_stored":915115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.223,"5min":0.217,"15min":0.217},"max":{"1min":0.50800000000000001,"5min":0.628,"15min":0.628},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.48799999999999999,"15min":0.53100000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56899999999999995,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.622,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.89900000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.95499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:01.868 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-08T08:21:01.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.972+0000 7f734cd43640 1 Processor -- start 2023-12-08T08:21:01.975 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.972+0000 7f734cd43640 1 -- start start 2023-12-08T08:21:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f734cd43640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f734815d580 0x7f73480d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f734cd43640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f734815f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f734cd43640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734815ee90 con 0x7f734815f6c0 2023-12-08T08:21:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f734cd43640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480d0fe0 con 0x7f734815d580 2023-12-08T08:21:01.976 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f734cd43640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480d1280 con 0x7f73480d3ad0 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f734659c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f734815d580 0x7f73480d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f7346d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f734815f6c0 0x7f73480b23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53810/0 (socket says 172.21.15.50:53810) 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.973+0000 7f7346d9d640 1 -- 172.21.15.50:0/3002078406 learned_addr learned my addr 172.21.15.50:0/3002078406 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f7345d9b640 1 --2- 172.21.15.50:0/3002078406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f734815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f734659c640 1 -- 172.21.15.50:0/3002078406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 msgr2=0x7f734815f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f734659c640 1 --2- 172.21.15.50:0/3002078406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f734815f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f734659c640 1 -- 172.21.15.50:0/3002078406 >> v1:172.21.15.50:6789/0 conn(0x7f734815f6c0 legacy=0x7f73480b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.977 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f734559a640 1 -- 172.21.15.50:0/3002078406 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422925281 0 0) 0x7f734815ee90 con 0x7f734815f6c0 2023-12-08T08:21:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f734659c640 1 -- 172.21.15.50:0/3002078406 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480d1560 con 0x7f734815d580 2023-12-08T08:21:01.978 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f7345d9b640 1 --2- 172.21.15.50:0/3002078406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f734815f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:01.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.974+0000 7f734659c640 1 --2- 172.21.15.50:0/3002078406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815d580 0x7f73480d1d60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7338009d90 tx=0x7f733802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c34495e48e0c66 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734559a640 1 -- 172.21.15.50:0/3002078406 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733802cbc0 con 0x7f734815d580 2023-12-08T08:21:01.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734559a640 1 -- 172.21.15.50:0/3002078406 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733802cd20 con 0x7f734815d580 2023-12-08T08:21:01.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734559a640 1 -- 172.21.15.50:0/3002078406 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338034660 con 0x7f734815d580 2023-12-08T08:21:01.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 -- 172.21.15.50:0/3002078406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815d580 msgr2=0x7f73480d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 --2- 172.21.15.50:0/3002078406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815d580 0x7f73480d1d60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7338009d90 tx=0x7f733802be10 comp rx=0 tx=0).stop 2023-12-08T08:21:01.981 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 -- 172.21.15.50:0/3002078406 shutdown_connections 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 --2- 172.21.15.50:0/3002078406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f734815f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 --2- 172.21.15.50:0/3002078406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815d580 0x7f73480d1d60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 -- 172.21.15.50:0/3002078406 >> 172.21.15.50:0/3002078406 conn(0x7f73480d2fb0 msgr2=0x7f73480d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 -- 172.21.15.50:0/3002078406 shutdown_connections 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.975+0000 7f734cd43640 1 -- 172.21.15.50:0/3002078406 wait complete. 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 Processor -- start 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 -- start start 2023-12-08T08:21:01.982 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f73480c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734815d580 0x7f73480c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815f6c0 0x7f73480c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c7020 con 0x7f734815f6c0 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c7e20 con 0x7f734815d580 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f734cd43640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c82b0 con 0x7f73480d3ad0 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f7346d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815f6c0 0x7f73480c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f7346d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815f6c0 0x7f73480c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53568/0 (socket says 172.21.15.50:53568) 2023-12-08T08:21:01.983 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.977+0000 7f7346d9d640 1 -- 172.21.15.50:0/3622267699 learned_addr learned my addr 172.21.15.50:0/3622267699 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7345d9b640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734815d580 0x7f73480c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f734659c640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f73480c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7346d9d640 1 -- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 msgr2=0x7f73480c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7346d9d640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f73480c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7346d9d640 1 -- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734815d580 msgr2=0x7f73480c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7346d9d640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734815d580 0x7f73480c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7346d9d640 1 -- 172.21.15.50:0/3622267699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338009a70 con 0x7f734815f6c0 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7345d9b640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734815d580 0x7f73480c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7346d9d640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815f6c0 0x7f73480c93b0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7340001eb0 tx=0x7f734000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.984 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7336ffd640 1 -- 172.21.15.50:0/3622267699 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400074e0 con 0x7f734815f6c0 2023-12-08T08:21:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7336ffd640 1 -- 172.21.15.50:0/3622267699 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7340007640 con 0x7f734815f6c0 2023-12-08T08:21:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73480c7210 con 0x7f734815f6c0 2023-12-08T08:21:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f7336ffd640 1 -- 172.21.15.50:0/3622267699 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340004a00 con 0x7f734815f6c0 2023-12-08T08:21:01.985 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.978+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73480c77d0 con 0x7f734815f6c0 2023-12-08T08:21:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.979+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480d09d0 con 0x7f734815f6c0 2023-12-08T08:21:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.980+0000 7f7336ffd640 1 -- 172.21.15.50:0/3622267699 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7340004b60 con 0x7f734815f6c0 2023-12-08T08:21:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.980+0000 7f7336ffd640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f732806ae40 0x7f732806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.980+0000 7f7336ffd640 1 -- 172.21.15.50:0/3622267699 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7340089250 con 0x7f734815f6c0 2023-12-08T08:21:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.980+0000 7f734659c640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f732806ae40 0x7f732806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:01.986 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.981+0000 7f734659c640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f732806ae40 0x7f732806d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7338036000 tx=0x7f7338030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:01.987 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:01.984+0000 7f7336ffd640 1 -- 172.21.15.50:0/3622267699 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7340057f50 con 0x7f734815f6c0 2023-12-08T08:21:02.159 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.157+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73480c7f90 con 0x7f732806ae40 2023-12-08T08:21:02.161 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.159+0000 7f7336ffd640 1 -- 172.21.15.50:0/3622267699 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51174 (secure 0 0 0) 0x7f73480c7f90 con 0x7f732806ae40 2023-12-08T08:21:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:21:02.162 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f732806ae40 msgr2=0x7f732806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f732806ae40 0x7f732806d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7338036000 tx=0x7f7338030000 comp rx=0 tx=0).stop 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815f6c0 msgr2=0x7f73480c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815f6c0 0x7f73480c93b0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7340001eb0 tx=0x7f734000c870 comp rx=0 tx=0).stop 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 shutdown_connections 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f732806ae40 0x7f732806d300 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f734815f6c0 0x7f73480c93b0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.164 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734815d580 0x7f73480c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 --2- 172.21.15.50:0/3622267699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73480d3ad0 0x7f73480c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 >> 172.21.15.50:0/3622267699 conn(0x7f73480d2fb0 msgr2=0x7f734815b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 shutdown_connections 2023-12-08T08:21:02.165 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.161+0000 7f734cd43640 1 -- 172.21.15.50:0/3622267699 wait complete. 2023-12-08T08:21:02.175 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-12-08T08:21:00.160035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256060,"kb_used_data":6620,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718660,"statfs":{"total":773094113280,"available":772831907840,"internally_reserved":0,"allocated":6778880,"data_stored":3703786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14927,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001403"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-08T08:20:56.372602+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:20:56.372602+0000","last_peered":"2023-12-08T08:20:56.372602+0000","last_clean":"2023-12-08T08:20:56.372602+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:20:56.372602+0000","last_undegraded":"2023-12-08T08:20:56.372602+0000","last_fullsized":"2023-12-08T08:20:56.372602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":905583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70599999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.44700000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.76600000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.48399999999999999,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63400000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64000000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.435}]},{"osd":6,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":315215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66900000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70799999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74399999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.64900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68500000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66700000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":309544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.39300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.498},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71099999999999997,"5min":0.745,"15min":0.745},"last":0.623},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.41699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.442,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":0.88,"15min":0.88},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":325184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.441}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80400000000000005,"5min":1.022,"15min":1.022},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67000000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52200000000000002}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.622}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76800000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":308948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.499,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.316},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29299999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":0.623,"15min":0.623},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63600000000000001,"5min":0.751,"15min":0.751},"last":0.37}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.58599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":315215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.33700000000000002},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.247,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.313},{"interface":"front","average":{"1min":0.38,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58999999999999997,"5min":0.623,"15min":0.623},"last":0.29499999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.48899999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.32900000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.44},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88700000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.876,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.41899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":688128,"data_stored":308982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.502,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.375},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.434}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.437,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.378,"15min":0.377},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42099999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.379},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1302528,"data_stored":915115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.223,"5min":0.217,"15min":0.217},"max":{"1min":0.50800000000000001,"5min":0.628,"15min":0.628},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.31900000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.48799999999999999,"15min":0.53100000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56899999999999995,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.622,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.89900000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.95499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:02.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-08T08:21:02.283 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.281+0000 7fe933210640 1 Processor -- start 2023-12-08T08:21:02.284 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.281+0000 7fe933210640 1 -- start start 2023-12-08T08:21:02.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe933210640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe92c06a4d0 0x7fe92c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe933210640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c06b070 con 0x7fe92c0cf760 2023-12-08T08:21:02.287 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe933210640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c06aab0 con 0x7fe92c0cf380 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe933210640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c072290 con 0x7fe92c06a4d0 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92bfff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe92c0cf760 0x7fe92c0acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53812/0 (socket says 172.21.15.50:53812) 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92bfff640 1 -- 172.21.15.50:0/951267958 learned_addr learned my addr 172.21.15.50:0/951267958 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe9317ad640 1 --2- 172.21.15.50:0/951267958 >> v2:172.21.15.170:3300/0 conn(0x7fe92c06a4d0 0x7fe92c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776933722 0 0) 0x7fe92c06b070 con 0x7fe92c0cf760 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe91c003520 con 0x7fe92c0cf760 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026285361 0 0) 0x7fe91c003520 con 0x7fe92c0cf760 2023-12-08T08:21:02.288 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 >> v2:172.21.15.170:3300/0 conn(0x7fe92c06a4d0 msgr2=0x7fe92c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 --2- 172.21.15.50:0/951267958 >> v2:172.21.15.170:3300/0 conn(0x7fe92c06a4d0 0x7fe92c0ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 >> v1:172.21.15.170:6789/0 conn(0x7fe92c0cf380 legacy=0x7fe92c071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c06ad90 con 0x7fe92c0cf760 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.282+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7fe918001670 con 0x7fe92c0cf760 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 >> v1:172.21.15.50:6789/0 conn(0x7fe92c0cf760 legacy=0x7fe92c0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92b7fe640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c003970 0x7fe91c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92b7fe640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe91c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.289 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92b7fe640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c005180 0x7fe91c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c072290 con 0x7fe91c0047c0 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c00c120 con 0x7fe91c005180 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c00c2e0 con 0x7fe91c003970 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92bfff640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe91c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe930fac640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c003970 0x7fe91c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe9317ad640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c005180 0x7fe91c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92bfff640 1 -- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c003970 msgr2=0x7fe91c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92bfff640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe91c003970 0x7fe91c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.290 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92bfff640 1 -- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c005180 msgr2=0x7fe91c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92bfff640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe91c005180 0x7fe91c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe92bfff640 1 -- 172.21.15.50:0/951267958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c003520 con 0x7fe91c0047c0 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.283+0000 7fe9317ad640 1 -- 172.21.15.50:0/951267958 reap_dead start 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe92bfff640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe91c004c40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe918001050 tx=0x7fe91c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9b1d5eaedfe38c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918005ad0 con 0x7fe91c0047c0 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918005c30 con 0x7fe91c0047c0 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe92b7fe640 1 -- 172.21.15.50:0/951267958 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91802ca50 con 0x7fe91c0047c0 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe933210640 1 -- 172.21.15.50:0/951267958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 msgr2=0x7fe91c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.291 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe933210640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe91c004c40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe918001050 tx=0x7fe91c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe933210640 1 -- 172.21.15.50:0/951267958 shutdown_connections 2023-12-08T08:21:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe933210640 1 --2- 172.21.15.50:0/951267958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe91c004c40 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe933210640 1 -- 172.21.15.50:0/951267958 >> 172.21.15.50:0/951267958 conn(0x7fe92c0cfda0 msgr2=0x7fe92c0d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.284+0000 7fe933210640 1 -- 172.21.15.50:0/951267958 shutdown_connections 2023-12-08T08:21:02.292 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.285+0000 7fe933210640 1 -- 172.21.15.50:0/951267958 wait complete. 2023-12-08T08:21:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.286+0000 7fe933210640 1 Processor -- start 2023-12-08T08:21:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.286+0000 7fe933210640 1 -- start start 2023-12-08T08:21:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe92c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe92c1f61b0 0x7fe92c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe92c06e070 0x7fe92c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.295 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0ca4b0 con 0x7fe91c0047c0 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c06ea30 con 0x7fe92c06e070 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c1f6720 con 0x7fe92c1f61b0 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe92c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe92c155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53582/0 (socket says 172.21.15.50:53582) 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 -- 172.21.15.50:0/306652110 learned_addr learned my addr 172.21.15.50:0/306652110 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe9317ad640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe92c06e070 0x7fe92c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe92bfff640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe92c1f61b0 0x7fe92c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 -- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe92c1f61b0 msgr2=0x7fe92c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.296 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe92c1f61b0 0x7fe92c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 -- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe92c06e070 msgr2=0x7fe92c06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe92c06e070 0x7fe92c06e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 -- 172.21.15.50:0/306652110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c1f6a00 con 0x7fe91c0047c0 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe92bfff640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe92c1f61b0 0x7fe92c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe930fac640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe92c155aa0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe92000f5f0 tx=0x7fe92000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe9297fa640 1 -- 172.21.15.50:0/306652110 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200052e0 con 0x7fe91c0047c0 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe9297fa640 1 -- 172.21.15.50:0/306652110 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920005440 con 0x7fe91c0047c0 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c1f6ce0 con 0x7fe91c0047c0 2023-12-08T08:21:02.297 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe9297fa640 1 -- 172.21.15.50:0/306652110 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920003810 con 0x7fe91c0047c0 2023-12-08T08:21:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.287+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c155fe0 con 0x7fe91c0047c0 2023-12-08T08:21:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.288+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c067430 con 0x7fe91c0047c0 2023-12-08T08:21:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.289+0000 7fe9297fa640 1 -- 172.21.15.50:0/306652110 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe920003970 con 0x7fe91c0047c0 2023-12-08T08:21:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.289+0000 7fe9297fa640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe91006ae40 0x7fe91006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.289+0000 7fe9297fa640 1 -- 172.21.15.50:0/306652110 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe920089200 con 0x7fe91c0047c0 2023-12-08T08:21:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.289+0000 7fe92bfff640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe91006ae40 0x7fe91006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:02.298 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.290+0000 7fe92bfff640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe91006ae40 0x7fe91006d300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe918034000 tx=0x7fe918007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:02.299 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.294+0000 7fe9297fa640 1 -- 172.21.15.50:0/306652110 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe920054500 con 0x7fe91c0047c0 2023-12-08T08:21:02.475 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.472+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe92c1610c0 con 0x7fe91c0047c0 2023-12-08T08:21:02.476 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.473+0000 7fe9297fa640 1 -- 172.21.15.50:0/306652110 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13191 (secure 0 0 0) 0x7fe920057b20 con 0x7fe91c0047c0 2023-12-08T08:21:02.476 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:21:02.476 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":59,"fsid":"e65cfade-ffb6-4f9a-b644-0a4f3f758761","created":"2023-12-08T08:17:32.017974+0000","modified":"2023-12-08T08:20:59.372715+0000","last_up_change":"2023-12-08T08:17:43.570747+0000","last_in_change":"2023-12-08T08:17:35.015710+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-08T08:17:44.165976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d501454-1f27-48d6-b0bb-fe0f8a8717a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6825","nonce":1917445946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6827","nonce":1917445946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6831","nonce":1917445946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1917445946},{"type":"v1","addr":"172.21.15.50:6829","nonce":1917445946}]},"public_addr":"172.21.15.50:6825/1917445946","cluster_addr":"172.21.15.50:6827/1917445946","heartbeat_back_addr":"172.21.15.50:6831/1917445946","heartbeat_front_addr":"172.21.15.50:6829/1917445946","state":["exists","up"]},{"osd":1,"uuid":"d57b1030-3522-4270-ae79-7225554985e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6810","nonce":1632731687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6813","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6815","nonce":1632731687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6823","nonce":1632731687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6817","nonce":1632731687},{"type":"v1","addr":"172.21.15.50:6819","nonce":1632731687}]},"public_addr":"172.21.15.50:6810/1632731687","cluster_addr":"172.21.15.50:6815/1632731687","heartbeat_back_addr":"172.21.15.50:6823/1632731687","heartbeat_front_addr":"172.21.15.50:6819/1632731687","state":["exists","up"]},{"osd":2,"uuid":"a29fd39c-a6e9-43ff-bc20-ed4bd9fbb4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6801","nonce":2829123200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6803","nonce":2829123200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6807","nonce":2829123200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2829123200},{"type":"v1","addr":"172.21.15.50:6805","nonce":2829123200}]},"public_addr":"172.21.15.50:6801/2829123200","cluster_addr":"172.21.15.50:6803/2829123200","heartbeat_back_addr":"172.21.15.50:6807/2829123200","heartbeat_front_addr":"172.21.15.50:6805/2829123200","state":["exists","up"]},{"osd":3,"uuid":"40ed428f-1158-4103-aab8-c4a1709d2706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6811","nonce":3350672246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6814","nonce":3350672246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6821","nonce":3350672246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":3350672246},{"type":"v1","addr":"172.21.15.50:6818","nonce":3350672246}]},"public_addr":"172.21.15.50:6811/3350672246","cluster_addr":"172.21.15.50:6814/3350672246","heartbeat_back_addr":"172.21.15.50:6821/3350672246","heartbeat_front_addr":"172.21.15.50:6818/3350672246","state":["exists","up"]},{"osd":4,"uuid":"99449a45-1d66-4c48-9b62-42e7a416c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6825","nonce":3545378016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6827","nonce":3545378016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6831","nonce":3545378016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3545378016},{"type":"v1","addr":"172.21.15.170:6829","nonce":3545378016}]},"public_addr":"172.21.15.170:6825/3545378016","cluster_addr":"172.21.15.170:6827/3545378016","heartbeat_back_addr":"172.21.15.170:6831/3545378016","heartbeat_front_addr":"172.21.15.170:6829/3545378016","state":["exists","up"]},{"osd":5,"uuid":"47d14850-5181-422b-9083-72df560b4ee7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6817","nonce":1598851740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6819","nonce":1598851740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6823","nonce":1598851740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1598851740},{"type":"v1","addr":"172.21.15.170:6821","nonce":1598851740}]},"public_addr":"172.21.15.170:6817/1598851740","cluster_addr":"172.21.15.170:6819/1598851740","heartbeat_back_addr":"172.21.15.170:6823/1598851740","heartbeat_front_addr":"172.21.15.170:6821/1598851740","state":["exists","up"]},{"osd":6,"uuid":"f5abb5c0-7321-4390-b67c-88b4c4b6e44c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6801","nonce":116888421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6803","nonce":116888421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6807","nonce":116888421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":116888421},{"type":"v1","addr":"172.21.15.170:6805","nonce":116888421}]},"public_addr":"172.21.15.170:6801/116888421","cluster_addr":"172.21.15.170:6803/116888421","heartbeat_back_addr":"172.21.15.170:6807/116888421","heartbeat_front_addr":"172.21.15.170:6805/116888421","state":["exists","up"]},{"osd":7,"uuid":"65eeaf4d-6b8e-4be9-90a5-2336250556df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6809","nonce":2618727353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6811","nonce":2618727353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6815","nonce":2618727353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2618727353},{"type":"v1","addr":"172.21.15.170:6813","nonce":2618727353}]},"public_addr":"172.21.15.170:6809/2618727353","cluster_addr":"172.21.15.170:6811/2618727353","heartbeat_back_addr":"172.21.15.170:6815/2618727353","heartbeat_front_addr":"172.21.15.170:6813/2618727353","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.139450+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.183459+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.136515+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.103437+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.203868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.146074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.071216+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-08T08:17:40.191109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.50:6835/4199554410":"2023-12-09T08:20:56.367878+0000","172.21.15.50:6833/4199554410":"2023-12-09T08:20:56.367878+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-08T08:21:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe91006ae40 msgr2=0x7fe91006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe91006ae40 0x7fe91006d300 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe918034000 tx=0x7fe918007000 comp rx=0 tx=0).stop 2023-12-08T08:21:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 msgr2=0x7fe92c155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe92c155aa0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe92000f5f0 tx=0x7fe92000fab0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.478 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 shutdown_connections 2023-12-08T08:21:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fe91006ae40 0x7fe91006d300 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe92c06e070 0x7fe92c06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe92c1f61b0 0x7fe92c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 --2- 172.21.15.50:0/306652110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe91c0047c0 0x7fe92c155aa0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 >> 172.21.15.50:0/306652110 conn(0x7fe92c0cfda0 msgr2=0x7fe92c0acd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 shutdown_connections 2023-12-08T08:21:02.479 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:02.475+0000 7fe933210640 1 -- 172.21.15.50:0/306652110 wait complete. 2023-12-08T08:21:03.489 INFO:tasks.ceph:Scrubbing osd.0 2023-12-08T08:21:03.490 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:03.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.611+0000 7f21d287c640 1 Processor -- start 2023-12-08T08:21:03.614 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.611+0000 7f21d287c640 1 -- start start 2023-12-08T08:21:03.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.612+0000 7f21d287c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21cc0cf6d0 0x7f21cc0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.612+0000 7f21d287c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc06c440 con 0x7f21cc0ce900 2023-12-08T08:21:03.615 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.612+0000 7f21d287c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc15d670 con 0x7f21cc15d290 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.612+0000 7f21d287c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0ce560 con 0x7f21cc0cf6d0 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.612+0000 7f21d0e19640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21cc0cf6d0 0x7f21cc0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.612+0000 7f21cb7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f21cc0ce900 0x7f21cc0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53814/0 (socket says 172.21.15.50:53814) 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.612+0000 7f21cb7fe640 1 -- 172.21.15.50:0/399280044 learned_addr learned my addr 172.21.15.50:0/399280044 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.613+0000 7f21d0e19640 1 -- 172.21.15.50:0/399280044 >> v1:172.21.15.170:6789/0 conn(0x7f21cc15d290 legacy=0x7f21cc06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.613+0000 7f21d0e19640 1 -- 172.21.15.50:0/399280044 >> v1:172.21.15.50:6789/0 conn(0x7f21cc0ce900 legacy=0x7f21cc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.613+0000 7f21caffd640 1 -- 172.21.15.50:0/399280044 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260072825 0 0) 0x7f21cc06c440 con 0x7f21cc0ce900 2023-12-08T08:21:03.616 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.613+0000 7f21d0e19640 1 -- 172.21.15.50:0/399280044 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc06bdf0 con 0x7f21cc0cf6d0 2023-12-08T08:21:03.617 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.614+0000 7f21d0e19640 1 --2- 172.21.15.50:0/399280044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0cf6d0 0x7f21cc0cb380 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009d90 tx=0x7f21c402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53071a03225e69a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.614+0000 7f21caffd640 1 -- 172.21.15.50:0/399280044 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c402cc60 con 0x7f21cc0cf6d0 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.614+0000 7f21caffd640 1 -- 172.21.15.50:0/399280044 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c402cdc0 con 0x7f21cc0cf6d0 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.614+0000 7f21caffd640 1 -- 172.21.15.50:0/399280044 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4034660 con 0x7f21cc0cf6d0 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.614+0000 7f21d287c640 1 -- 172.21.15.50:0/399280044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0cf6d0 msgr2=0x7f21cc0cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.614+0000 7f21d287c640 1 --2- 172.21.15.50:0/399280044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0cf6d0 0x7f21cc0cb380 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009d90 tx=0x7f21c402beb0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.615+0000 7f21d287c640 1 -- 172.21.15.50:0/399280044 shutdown_connections 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.615+0000 7f21d287c640 1 --2- 172.21.15.50:0/399280044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc0cf6d0 0x7f21cc0cb380 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.618 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.615+0000 7f21d287c640 1 -- 172.21.15.50:0/399280044 >> 172.21.15.50:0/399280044 conn(0x7f21cc0d0d30 msgr2=0x7f21cc0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.615+0000 7f21d287c640 1 -- 172.21.15.50:0/399280044 shutdown_connections 2023-12-08T08:21:03.619 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.615+0000 7f21d287c640 1 -- 172.21.15.50:0/399280044 wait complete. 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.616+0000 7f21d287c640 1 Processor -- start 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.616+0000 7f21d287c640 1 -- start start 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d287c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21cc0ce900 0x7f21cc156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d287c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21cc0cf6d0 0x7f21cc0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d287c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15d290 0x7f21cc1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d287c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0ae3f0 con 0x7f21cc15d290 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d287c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0adae0 con 0x7f21cc0ce900 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d287c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc157740 con 0x7f21cc0cf6d0 2023-12-08T08:21:03.621 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15d290 0x7f21cc1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15d290 0x7f21cc1542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53592/0 (socket says 172.21.15.50:53592) 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 -- 172.21.15.50:0/3252665571 learned_addr learned my addr 172.21.15.50:0/3252665571 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21cbfff640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21cc0ce900 0x7f21cc156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21cb7fe640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21cc0cf6d0 0x7f21cc0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 -- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21cc0cf6d0 msgr2=0x7f21cc0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f21cc0cf6d0 0x7f21cc0b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 -- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21cc0ce900 msgr2=0x7f21cc156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.622 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21cc0ce900 0x7f21cc156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.617+0000 7f21d0e19640 1 -- 172.21.15.50:0/3252665571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009a70 con 0x7f21cc15d290 2023-12-08T08:21:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.618+0000 7f21d0e19640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15d290 0x7f21cc1542b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009d90 tx=0x7f21c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.618+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4003b90 con 0x7f21cc15d290 2023-12-08T08:21:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.618+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c4003cf0 con 0x7f21cc15d290 2023-12-08T08:21:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.618+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc0adda0 con 0x7f21cc15d290 2023-12-08T08:21:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.618+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4004250 con 0x7f21cc15d290 2023-12-08T08:21:03.623 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.618+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc0ae880 con 0x7f21cc15d290 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.619+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21cc0aead0 con 0x7f21cc15d290 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.619+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21c403b050 con 0x7f21cc15d290 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.620+0000 7f21c8ff9640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f21b806ae40 0x7f21b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.620+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f21c40ab950 con 0x7f21cc15d290 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.620+0000 7f21c8ff9640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7f21b8071140 0x7f21b8073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.620+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 --> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21b8073c50 con 0x7f21b8071140 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.620+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21c40b02c0 con 0x7f21cc15d290 2023-12-08T08:21:03.625 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.620+0000 7f21cb7fe640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7f21b8071140 0x7f21b8073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.620+0000 7f21cbfff640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f21b806ae40 0x7f21b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.621+0000 7f21cb7fe640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7f21b8071140 0x7f21b8073580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.621+0000 7f21cbfff640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f21b806ae40 0x7f21b806d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f21c0000f60 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.626 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.622+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== osd.0 v2:172.21.15.50:6824/1917445946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f21b8073c50 con 0x7f21b8071140 2023-12-08T08:21:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 --> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f21cc067540 con 0x7f21b8071140 2023-12-08T08:21:03.637 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21c8ff9640 1 -- 172.21.15.50:0/3252665571 <== osd.0 v2:172.21.15.50:6824/1917445946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f21cc067540 con 0x7f21b8071140 2023-12-08T08:21:03.638 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:03.638 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:03.638 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7f21b8071140 msgr2=0x7f21b8073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d287c640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:6824/1917445946,v1:172.21.15.50:6825/1917445946] conn(0x7f21b8071140 0x7f21b8073580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f21b806ae40 msgr2=0x7f21b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d287c640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f21b806ae40 0x7f21b806d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f21c0000f60 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2023-12-08T08:21:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15d290 msgr2=0x7f21cc1542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d287c640 1 --2- 172.21.15.50:0/3252665571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21cc15d290 0x7f21cc1542b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009d90 tx=0x7f21c4004a40 comp rx=0 tx=0).stop 2023-12-08T08:21:03.639 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.635+0000 7f21d0e19640 1 -- 172.21.15.50:0/3252665571 reap_dead start 2023-12-08T08:21:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.636+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 shutdown_connections 2023-12-08T08:21:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.636+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 >> 172.21.15.50:0/3252665571 conn(0x7f21cc0d0d30 msgr2=0x7f21cc06f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.636+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 shutdown_connections 2023-12-08T08:21:03.640 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.636+0000 7f21d287c640 1 -- 172.21.15.50:0/3252665571 wait complete. 2023-12-08T08:21:03.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-08T08:21:03.757 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.755+0000 7fd38dbb6640 1 Processor -- start 2023-12-08T08:21:03.758 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.755+0000 7fd38dbb6640 1 -- start start 2023-12-08T08:21:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd38dbb6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd388070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd38dbb6640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd38815b750 0x7fd38806c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd38dbb6640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880720d0 con 0x7fd388158ee0 2023-12-08T08:21:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd38dbb6640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880cc890 con 0x7fd38815b750 2023-12-08T08:21:03.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd38dbb6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880714c0 con 0x7fd3880cbd10 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd387fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd38815b750 0x7fd38806c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd387fff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fd38815b750 0x7fd38806c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53602/0 (socket says 172.21.15.50:53602) 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.756+0000 7fd387fff640 1 -- 172.21.15.50:0/1526890977 learned_addr learned my addr 172.21.15.50:0/1526890977 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.757+0000 7fd386ffd640 1 --2- 172.21.15.50:0/1526890977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd388070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.757+0000 7fd387fff640 1 -- 172.21.15.50:0/1526890977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 msgr2=0x7fd388070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.757+0000 7fd387fff640 1 --2- 172.21.15.50:0/1526890977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd388070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.757+0000 7fd387fff640 1 -- 172.21.15.50:0/1526890977 >> v1:172.21.15.170:6789/0 conn(0x7fd388158ee0 legacy=0x7fd3880cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:03.760 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.757+0000 7fd387fff640 1 -- 172.21.15.50:0/1526890977 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880717a0 con 0x7fd38815b750 2023-12-08T08:21:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.757+0000 7fd387fff640 1 --2- 172.21.15.50:0/1526890977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38815b750 0x7fd38806c480 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd380009e50 tx=0x7fd38002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38cfc750bf4a4c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd3867fc640 1 -- 172.21.15.50:0/1526890977 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38002c9e0 con 0x7fd38815b750 2023-12-08T08:21:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd3867fc640 1 -- 172.21.15.50:0/1526890977 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38002cb40 con 0x7fd38815b750 2023-12-08T08:21:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd3867fc640 1 -- 172.21.15.50:0/1526890977 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3800343f0 con 0x7fd38815b750 2023-12-08T08:21:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 -- 172.21.15.50:0/1526890977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38815b750 msgr2=0x7fd38806c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.762 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/1526890977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38815b750 0x7fd38806c480 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd380009e50 tx=0x7fd38002be40 comp rx=0 tx=0).stop 2023-12-08T08:21:03.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 -- 172.21.15.50:0/1526890977 shutdown_connections 2023-12-08T08:21:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/1526890977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd38815b750 0x7fd38806c480 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/1526890977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd388070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 -- 172.21.15.50:0/1526890977 >> 172.21.15.50:0/1526890977 conn(0x7fd3880b09f0 msgr2=0x7fd3880b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 -- 172.21.15.50:0/1526890977 shutdown_connections 2023-12-08T08:21:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.758+0000 7fd38dbb6640 1 -- 172.21.15.50:0/1526890977 wait complete. 2023-12-08T08:21:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 Processor -- start 2023-12-08T08:21:03.766 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 -- start start 2023-12-08T08:21:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd3881537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd388158ee0 0x7fd38815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd38815b750 0x7fd38814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b1df0 con 0x7fd388158ee0 2023-12-08T08:21:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b2040 con 0x7fd38815b750 2023-12-08T08:21:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.760+0000 7fd38dbb6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b2320 con 0x7fd3880cbd10 2023-12-08T08:21:03.769 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd388158ee0 0x7fd38815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd388158ee0 0x7fd38815ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53606/0 (socket says 172.21.15.50:53606) 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 -- 172.21.15.50:0/2830782113 learned_addr learned my addr 172.21.15.50:0/2830782113 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd3877fe640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd3881537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd387fff640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd38815b750 0x7fd38814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 -- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 msgr2=0x7fd3881537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd3881537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 -- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd38815b750 msgr2=0x7fd38814d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd38815b750 0x7fd38814d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.770 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 -- 172.21.15.50:0/2830782113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009b30 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd386ffd640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd388158ee0 0x7fd38815ac90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd37800d800 tx=0x7fd37800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd36ffff640 1 -- 172.21.15.50:0/2830782113 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800b6c0 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd36ffff640 1 -- 172.21.15.50:0/2830782113 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37800b820 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd36ffff640 1 -- 172.21.15.50:0/2830782113 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800bbb0 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3880b2600 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.761+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3880ccbc0 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.762+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38806e1a0 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.763+0000 7fd36ffff640 1 -- 172.21.15.50:0/2830782113 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd37800bd10 con 0x7fd388158ee0 2023-12-08T08:21:03.771 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.763+0000 7fd36ffff640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd37406ae40 0x7fd37406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:03.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.763+0000 7fd36ffff640 1 -- 172.21.15.50:0/2830782113 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd3780897e0 con 0x7fd388158ee0 2023-12-08T08:21:03.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.763+0000 7fd3877fe640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd37406ae40 0x7fd37406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:03.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.764+0000 7fd3877fe640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd37406ae40 0x7fd37406d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd3880af100 tx=0x7fd37c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:03.772 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.768+0000 7fd36ffff640 1 -- 172.21.15.50:0/2830782113 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd378054b90 con 0x7fd388158ee0 2023-12-08T08:21:03.949 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.947+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd388067430 con 0x7fd37406ae40 2023-12-08T08:21:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.947+0000 7fd36ffff640 1 -- 172.21.15.50:0/2830782113 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd388067430 con 0x7fd37406ae40 2023-12-08T08:21:03.950 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2023-12-08T08:21:03.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd37406ae40 msgr2=0x7fd37406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd37406ae40 0x7fd37406d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd3880af100 tx=0x7fd37c007e30 comp rx=0 tx=0).stop 2023-12-08T08:21:03.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd388158ee0 msgr2=0x7fd38815ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd388158ee0 0x7fd38815ac90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd37800d800 tx=0x7fd37800dcc0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 shutdown_connections 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fd37406ae40 0x7fd37406d300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd388158ee0 0x7fd38815ac90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd38815b750 0x7fd38814d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 --2- 172.21.15.50:0/2830782113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3880cbd10 0x7fd3881537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 >> 172.21.15.50:0/2830782113 conn(0x7fd3880b09f0 msgr2=0x7fd3880b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:03.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 shutdown_connections 2023-12-08T08:21:03.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:03.950+0000 7fd38dbb6640 1 -- 172.21.15.50:0/2830782113 wait complete. 2023-12-08T08:21:03.964 INFO:tasks.ceph:Scrubbing osd.1 2023-12-08T08:21:03.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.073+0000 7ff44fd68640 1 Processor -- start 2023-12-08T08:21:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.074+0000 7ff44fd68640 1 -- start start 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.074+0000 7ff44fd68640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff44806a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.074+0000 7ff44fd68640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4480b2f80 0x7ff44806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.074+0000 7ff44fd68640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff4480abd40 0x7ff4480b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.074+0000 7ff44fd68640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480b4210 con 0x7ff4480b2f80 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.074+0000 7ff44fd68640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44815c3d0 con 0x7ff4480abd40 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.074+0000 7ff44fd68640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44815b850 con 0x7ff4480b3e30 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4480b2f80 0x7ff44806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff4480b2f80 0x7ff44806ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53608/0 (socket says 172.21.15.50:53608) 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 -- 172.21.15.50:0/1126019423 learned_addr learned my addr 172.21.15.50:0/1126019423 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44e305640 1 --2- 172.21.15.50:0/1126019423 >> v2:172.21.15.170:3300/0 conn(0x7ff4480abd40 0x7ff4480b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44db04640 1 --2- 172.21.15.50:0/1126019423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff44806a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 -- 172.21.15.50:0/1126019423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 msgr2=0x7ff44806a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 --2- 172.21.15.50:0/1126019423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff44806a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 -- 172.21.15.50:0/1126019423 >> v2:172.21.15.170:3300/0 conn(0x7ff4480abd40 msgr2=0x7ff4480b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 --2- 172.21.15.50:0/1126019423 >> v2:172.21.15.170:3300/0 conn(0x7ff4480abd40 0x7ff4480b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44d303640 1 -- 172.21.15.50:0/1126019423 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44815bb30 con 0x7ff4480b2f80 2023-12-08T08:21:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.075+0000 7ff44e305640 1 --2- 172.21.15.50:0/1126019423 >> v2:172.21.15.170:3300/0 conn(0x7ff4480abd40 0x7ff4480b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.076+0000 7ff44d303640 1 --2- 172.21.15.50:0/1126019423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff44806ae30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff448159010 tx=0x7ff44402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e09396ec70f7c15 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.076+0000 7ff44cb02640 1 -- 172.21.15.50:0/1126019423 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4440317e0 con 0x7ff4480b2f80 2023-12-08T08:21:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.076+0000 7ff44cb02640 1 -- 172.21.15.50:0/1126019423 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444031940 con 0x7ff4480b2f80 2023-12-08T08:21:04.081 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.076+0000 7ff44cb02640 1 -- 172.21.15.50:0/1126019423 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444031cd0 con 0x7ff4480b2f80 2023-12-08T08:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 -- 172.21.15.50:0/1126019423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 msgr2=0x7ff44806ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 --2- 172.21.15.50:0/1126019423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff44806ae30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff448159010 tx=0x7ff44402b880 comp rx=0 tx=0).stop 2023-12-08T08:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 -- 172.21.15.50:0/1126019423 shutdown_connections 2023-12-08T08:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 --2- 172.21.15.50:0/1126019423 >> v2:172.21.15.170:3300/0 conn(0x7ff4480abd40 0x7ff4480b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.084 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 --2- 172.21.15.50:0/1126019423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff44806ae30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 --2- 172.21.15.50:0/1126019423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff44806a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 -- 172.21.15.50:0/1126019423 >> 172.21.15.50:0/1126019423 conn(0x7ff4480b0d80 msgr2=0x7ff4480b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 -- 172.21.15.50:0/1126019423 shutdown_connections 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.077+0000 7ff44fd68640 1 -- 172.21.15.50:0/1126019423 wait complete. 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.078+0000 7ff44fd68640 1 Processor -- start 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.078+0000 7ff44fd68640 1 -- start start 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44fd68640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4480abd40 0x7ff448070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44fd68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff448099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.085 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44fd68640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff4480ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44fd68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480ceab0 con 0x7ff4480b2f80 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44fd68640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44809a720 con 0x7ff4480abd40 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44fd68640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480711f0 con 0x7ff4480b3e30 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff448099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff448099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53618/0 (socket says 172.21.15.50:53618) 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 -- 172.21.15.50:0/768213288 learned_addr learned my addr 172.21.15.50:0/768213288 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44db04640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4480abd40 0x7ff448070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44e305640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff4480ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.086 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 -- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 msgr2=0x7ff4480ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff4480ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 -- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4480abd40 msgr2=0x7ff448070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4480abd40 0x7ff448070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44d303640 1 -- 172.21.15.50:0/768213288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440094d0 con 0x7ff4480b2f80 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44db04640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff4480abd40 0x7ff448070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.079+0000 7ff44e305640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4480b3e30 0x7ff4480ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.080+0000 7ff44d303640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff448099eb0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff444000c00 tx=0x7ff4440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.080+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444032880 con 0x7ff4480b2f80 2023-12-08T08:21:04.087 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.080+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4480714d0 con 0x7ff4480b2f80 2023-12-08T08:21:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.080+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444032a20 con 0x7ff4480b2f80 2023-12-08T08:21:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.080+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444032dd0 con 0x7ff4480b2f80 2023-12-08T08:21:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.080+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff448071a90 con 0x7ff4480b2f80 2023-12-08T08:21:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.081+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff44815c0f0 con 0x7ff4480b2f80 2023-12-08T08:21:04.088 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.082+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4440453f0 con 0x7ff4480b2f80 2023-12-08T08:21:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.082+0000 7ff43e7fc640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff42c06ae40 0x7ff42c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.089 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.082+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff4440abe30 con 0x7ff4480b2f80 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.082+0000 7ff43e7fc640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7ff42c071140 0x7ff42c073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.083+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 --> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff42c073c50 con 0x7ff42c071140 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.083+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4440ac280 con 0x7ff4480b2f80 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.083+0000 7ff44db04640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff42c06ae40 0x7ff42c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.083+0000 7ff44e305640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7ff42c071140 0x7ff42c073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.083+0000 7ff44e305640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7ff42c071140 0x7ff42c073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.083+0000 7ff44db04640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff42c06ae40 0x7ff42c06d300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff438006fd0 tx=0x7ff438008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.090 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.084+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== osd.1 v2:172.21.15.50:6808/1632731687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff42c073c50 con 0x7ff42c071140 2023-12-08T08:21:04.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 --> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff448067540 con 0x7ff42c071140 2023-12-08T08:21:04.099 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff43e7fc640 1 -- 172.21.15.50:0/768213288 <== osd.1 v2:172.21.15.50:6808/1632731687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff448067540 con 0x7ff42c071140 2023-12-08T08:21:04.099 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:04.100 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:04.100 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:04.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7ff42c071140 msgr2=0x7ff42c073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:6808/1632731687,v1:172.21.15.50:6810/1632731687] conn(0x7ff42c071140 0x7ff42c073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff42c06ae40 msgr2=0x7ff42c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.101 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ff42c06ae40 0x7ff42c06d300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff438006fd0 tx=0x7ff438008040 comp rx=0 tx=0).stop 2023-12-08T08:21:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 msgr2=0x7ff448099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 --2- 172.21.15.50:0/768213288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4480b2f80 0x7ff448099eb0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff444000c00 tx=0x7ff4440046c0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44e305640 1 -- 172.21.15.50:0/768213288 reap_dead start 2023-12-08T08:21:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 shutdown_connections 2023-12-08T08:21:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 >> 172.21.15.50:0/768213288 conn(0x7ff4480b0d80 msgr2=0x7ff448158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 shutdown_connections 2023-12-08T08:21:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.097+0000 7ff44fd68640 1 -- 172.21.15.50:0/768213288 wait complete. 2023-12-08T08:21:04.111 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-08T08:21:04.220 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.218+0000 7fafa59a0640 1 Processor -- start 2023-12-08T08:21:04.221 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.218+0000 7fafa59a0640 1 -- start start 2023-12-08T08:21:04.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7fafa59a0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 0x7fafa006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7fafa59a0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00caaa0 con 0x7fafa0142be0 2023-12-08T08:21:04.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7fafa59a0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00cad80 con 0x7fafa0143240 2023-12-08T08:21:04.225 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7fafa59a0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00cb720 con 0x7fafa0143790 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7fafa499e640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fafa0142be0 0x7fafa00cbb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53830/0 (socket says 172.21.15.50:53830) 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7fafa499e640 1 -- 172.21.15.50:0/4105954364 learned_addr learned my addr 172.21.15.50:0/4105954364 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9ffff640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 0x7fafa006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201657258 0 0) 0x7fafa00caaa0 con 0x7fafa0142be0 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf90003520 con 0x7fafa0142be0 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829526611 0 0) 0x7fafa00cad80 con 0x7fafa0143240 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa00caaa0 con 0x7fafa0143240 2023-12-08T08:21:04.226 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296013959 0 0) 0x7faf90003520 con 0x7fafa0142be0 2023-12-08T08:21:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 msgr2=0x7fafa006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 0x7fafa006ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 >> v1:172.21.15.170:6789/0 conn(0x7fafa0143240 legacy=0x7fafa0071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00cb060 con 0x7fafa0142be0 2023-12-08T08:21:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7faf94001670 con 0x7fafa0142be0 2023-12-08T08:21:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 >> v1:172.21.15.50:6789/0 conn(0x7fafa0142be0 legacy=0x7fafa00cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 0x7faf90003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf90004090 0x7faf900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.219+0000 7faf9f7fe640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00cb720 con 0x7faf90004d00 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000bb10 con 0x7faf90004090 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000bca0 con 0x7fafa0143790 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7fafa519f640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7faf9ffff640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf90004090 0x7faf900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7fafa499e640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 0x7faf90003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7fafa519f640 1 -- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 msgr2=0x7faf90003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7fafa519f640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa0143790 0x7faf90003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7fafa519f640 1 -- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf90004090 msgr2=0x7faf900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7fafa519f640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf90004090 0x7faf900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.220+0000 7fafa519f640 1 -- 172.21.15.50:0/4105954364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90003520 con 0x7faf90004d00 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.221+0000 7fafa519f640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf90004d00 0x7faf90005180 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7faf98001fd0 tx=0x7faf900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5746d9bc7be7c61c server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.221+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98003b70 con 0x7faf90004d00 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.221+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98003cd0 con 0x7faf90004d00 2023-12-08T08:21:04.229 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.221+0000 7faf9f7fe640 1 -- 172.21.15.50:0/4105954364 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf980052f0 con 0x7faf90004d00 2023-12-08T08:21:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.222+0000 7fafa59a0640 1 -- 172.21.15.50:0/4105954364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf90004d00 msgr2=0x7faf90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.222+0000 7fafa59a0640 1 --2- 172.21.15.50:0/4105954364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faf90004d00 0x7faf90005180 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7faf98001fd0 tx=0x7faf900057f0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.222+0000 7fafa519f640 1 -- 172.21.15.50:0/4105954364 reap_dead start 2023-12-08T08:21:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.222+0000 7fafa59a0640 1 -- 172.21.15.50:0/4105954364 shutdown_connections 2023-12-08T08:21:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.222+0000 7fafa59a0640 1 -- 172.21.15.50:0/4105954364 >> 172.21.15.50:0/4105954364 conn(0x7fafa00cfbb0 msgr2=0x7fafa00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.222+0000 7fafa59a0640 1 -- 172.21.15.50:0/4105954364 shutdown_connections 2023-12-08T08:21:04.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.222+0000 7fafa59a0640 1 -- 172.21.15.50:0/4105954364 wait complete. 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.224+0000 7fafa59a0640 1 Processor -- start 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.224+0000 7fafa59a0640 1 -- start start 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa59a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa01e0bd0 0x7fafa00b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa59a0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa00b0f40 0x7fafa00c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa59a0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa00c9590 0x7fafa006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa59a0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00b13c0 con 0x7fafa01e0bd0 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa59a0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa01f3d70 con 0x7fafa00c9590 2023-12-08T08:21:04.233 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa59a0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa01f48f0 con 0x7fafa00b0f40 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa01e0bd0 0x7fafa00b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa01e0bd0 0x7fafa00b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53626/0 (socket says 172.21.15.50:53626) 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 -- 172.21.15.50:0/3997555366 learned_addr learned my addr 172.21.15.50:0/3997555366 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa519f640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa00c9590 0x7fafa006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7faf9ffff640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa00b0f40 0x7fafa00c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 -- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa00b0f40 msgr2=0x7fafa00c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa00b0f40 0x7fafa00c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.234 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 -- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa00c9590 msgr2=0x7fafa006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa00c9590 0x7fafa006a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa499e640 1 -- 172.21.15.50:0/3997555366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa01f3fc0 con 0x7fafa01e0bd0 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.225+0000 7fafa519f640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa00c9590 0x7fafa006a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.226+0000 7faf9ffff640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa00b0f40 0x7fafa00c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.226+0000 7fafa499e640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa01e0bd0 0x7fafa00b0a00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faf94001c20 tx=0x7faf94007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.226+0000 7faf9d7fa640 1 -- 172.21.15.50:0/3997555366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400f960 con 0x7fafa01e0bd0 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.226+0000 7faf9d7fa640 1 -- 172.21.15.50:0/3997555366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9400fae0 con 0x7fafa01e0bd0 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.226+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa01f42a0 con 0x7fafa01e0bd0 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.226+0000 7faf9d7fa640 1 -- 172.21.15.50:0/3997555366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400fe90 con 0x7fafa01e0bd0 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.226+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa00c7b60 con 0x7fafa01e0bd0 2023-12-08T08:21:04.235 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.227+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa0067ad0 con 0x7fafa01e0bd0 2023-12-08T08:21:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.227+0000 7faf9d7fa640 1 -- 172.21.15.50:0/3997555366 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf9401d460 con 0x7fafa01e0bd0 2023-12-08T08:21:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.228+0000 7faf9d7fa640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf8406ae40 0x7faf8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.228+0000 7faf9d7fa640 1 -- 172.21.15.50:0/3997555366 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7faf94089610 con 0x7fafa01e0bd0 2023-12-08T08:21:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.228+0000 7faf9ffff640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf8406ae40 0x7faf8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.229+0000 7faf9ffff640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf8406ae40 0x7faf8406d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fafa0142160 tx=0x7faf8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.236 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.232+0000 7faf9d7fa640 1 -- 172.21.15.50:0/3997555366 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf94054880 con 0x7fafa01e0bd0 2023-12-08T08:21:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.409+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fafa00cc250 con 0x7faf8406ae40 2023-12-08T08:21:04.411 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.409+0000 7faf9d7fa640 1 -- 172.21.15.50:0/3997555366 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faf8c009830 con 0x7faf8406ae40 2023-12-08T08:21:04.412 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2023-12-08T08:21:04.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf8406ae40 msgr2=0x7faf8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf8406ae40 0x7faf8406d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fafa0142160 tx=0x7faf8c008040 comp rx=0 tx=0).stop 2023-12-08T08:21:04.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa01e0bd0 msgr2=0x7fafa00b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa01e0bd0 0x7fafa00b0a00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faf94001c20 tx=0x7faf94007720 comp rx=0 tx=0).stop 2023-12-08T08:21:04.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 shutdown_connections 2023-12-08T08:21:04.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7faf8406ae40 0x7faf8406d300 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.414 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa00c9590 0x7fafa006a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa00b0f40 0x7fafa00c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 --2- 172.21.15.50:0/3997555366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafa01e0bd0 0x7fafa00b0a00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 >> 172.21.15.50:0/3997555366 conn(0x7fafa00cfbb0 msgr2=0x7fafa0141450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 shutdown_connections 2023-12-08T08:21:04.415 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.411+0000 7fafa59a0640 1 -- 172.21.15.50:0/3997555366 wait complete. 2023-12-08T08:21:04.424 INFO:tasks.ceph:Scrubbing osd.2 2023-12-08T08:21:04.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:04.535 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.533+0000 7f8c6d41e640 1 Processor -- start 2023-12-08T08:21:04.536 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.533+0000 7f8c6d41e640 1 -- start start 2023-12-08T08:21:04.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c6d41e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8c6815e580 0x7f8c680ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.539 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c6d41e640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c68072400 con 0x7f8c6806a8f0 2023-12-08T08:21:04.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c6d41e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680ac690 con 0x7f8c68159cc0 2023-12-08T08:21:04.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c6d41e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c68072210 con 0x7f8c6815e580 2023-12-08T08:21:04.540 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c677fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8c6806a8f0 0x7f8c680b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53846/0 (socket says 172.21.15.50:53846) 2023-12-08T08:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c677fe640 1 -- 172.21.15.50:0/1106093170 learned_addr learned my addr 172.21.15.50:0/1106093170 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c667fc640 1 --2- 172.21.15.50:0/1106093170 >> v2:172.21.15.170:3300/0 conn(0x7f8c6815e580 0x7f8c680ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214195433 0 0) 0x7f8c68072400 con 0x7f8c6806a8f0 2023-12-08T08:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.534+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c50003520 con 0x7f8c6806a8f0 2023-12-08T08:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1839390052 0 0) 0x7f8c50003520 con 0x7f8c6806a8f0 2023-12-08T08:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 >> v2:172.21.15.170:3300/0 conn(0x7f8c6815e580 msgr2=0x7f8c680ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.541 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 --2- 172.21.15.50:0/1106093170 >> v2:172.21.15.170:3300/0 conn(0x7f8c6815e580 0x7f8c680ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 >> v1:172.21.15.170:6789/0 conn(0x7f8c68159cc0 legacy=0x7f8c68071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680ac930 con 0x7f8c6806a8f0 2023-12-08T08:21:04.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f8c600019f0 con 0x7f8c6806a8f0 2023-12-08T08:21:04.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 >> v1:172.21.15.50:6789/0 conn(0x7f8c6806a8f0 legacy=0x7f8c680b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c500039a0 0x7f8c50003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.542 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c500047c0 0x7f8c50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c50005180 0x7f8c5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5000c050 con 0x7f8c50005180 2023-12-08T08:21:04.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5000e3a0 con 0x7f8c500039a0 2023-12-08T08:21:04.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5000e560 con 0x7f8c500047c0 2023-12-08T08:21:04.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c677fe640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c50005180 0x7f8c5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.543 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c66ffd640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c500039a0 0x7f8c50003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c667fc640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c500047c0 0x7f8c50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c677fe640 1 -- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c500047c0 msgr2=0x7f8c50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c677fe640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c500047c0 0x7f8c50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c677fe640 1 -- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c500039a0 msgr2=0x7f8c50003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c677fe640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c500039a0 0x7f8c50003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.544 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.535+0000 7f8c677fe640 1 -- 172.21.15.50:0/1106093170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50003520 con 0x7f8c50005180 2023-12-08T08:21:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.536+0000 7f8c677fe640 1 -- 172.21.15.50:0/1106093170 reap_dead start 2023-12-08T08:21:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.536+0000 7f8c677fe640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c50005180 0x7f8c5000b980 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000a820 tx=0x7f8c500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c8ca7801a8b551 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.536+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600072d0 con 0x7f8c50005180 2023-12-08T08:21:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.536+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6002f070 con 0x7f8c50005180 2023-12-08T08:21:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.536+0000 7f8c65ffb640 1 -- 172.21.15.50:0/1106093170 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600076b0 con 0x7f8c50005180 2023-12-08T08:21:04.545 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.537+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1106093170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c50005180 msgr2=0x7f8c5000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.537+0000 7f8c6d41e640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c50005180 0x7f8c5000b980 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000a820 tx=0x7f8c500057f0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.537+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1106093170 shutdown_connections 2023-12-08T08:21:04.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.537+0000 7f8c6d41e640 1 --2- 172.21.15.50:0/1106093170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c50005180 0x7f8c5000b980 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.537+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1106093170 >> 172.21.15.50:0/1106093170 conn(0x7f8c680b0d80 msgr2=0x7f8c680b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.546 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.537+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1106093170 shutdown_connections 2023-12-08T08:21:04.547 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.537+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1106093170 wait complete. 2023-12-08T08:21:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.538+0000 7f8c6d41e640 1 Processor -- start 2023-12-08T08:21:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.538+0000 7f8c6d41e640 1 -- start start 2023-12-08T08:21:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c6d41e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c50005180 0x7f8c68151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.551 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c6d41e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c681524e0 0x7f8c68152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c6d41e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c68155850 0x7f8c68155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c6d41e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6809c4d0 con 0x7f8c681524e0 2023-12-08T08:21:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c6d41e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68156210 con 0x7f8c50005180 2023-12-08T08:21:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c6d41e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68158dc0 con 0x7f8c68155850 2023-12-08T08:21:04.552 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c681524e0 0x7f8c68152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c681524e0 0x7f8c68152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53644/0 (socket says 172.21.15.50:53644) 2023-12-08T08:21:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 -- 172.21.15.50:0/1206764967 learned_addr learned my addr 172.21.15.50:0/1206764967 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c66ffd640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c50005180 0x7f8c68151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c677fe640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c68155850 0x7f8c68155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 -- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c68155850 msgr2=0x7f8c68155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c68155850 0x7f8c68155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.553 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 -- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c50005180 msgr2=0x7f8c68151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c50005180 0x7f8c68151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 -- 172.21.15.50:0/1206764967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c681522a0 con 0x7f8c681524e0 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.539+0000 7f8c667fc640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c681524e0 0x7f8c68152960 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8c58011540 tx=0x7f8c58011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.540+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58015930 con 0x7f8c681524e0 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.540+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58015a90 con 0x7f8c681524e0 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.540+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6809b850 con 0x7f8c681524e0 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.540+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58015e20 con 0x7f8c681524e0 2023-12-08T08:21:04.554 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.540+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6809be10 con 0x7f8c681524e0 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.541+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c680ad1d0 con 0x7f8c681524e0 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.541+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c5800f460 con 0x7f8c681524e0 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c4f7fe640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8c5406ae70 0x7f8c5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8c58089a40 con 0x7f8c681524e0 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c66ffd640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8c5406ae70 0x7f8c5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c4f7fe640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f8c54071170 0x7f8c540735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 --> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c54073c80 con 0x7f8c54071170 2023-12-08T08:21:04.555 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c5808e2c0 con 0x7f8c681524e0 2023-12-08T08:21:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c677fe640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f8c54071170 0x7f8c540735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c66ffd640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8c5406ae70 0x7f8c5406d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.542+0000 7f8c677fe640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f8c54071170 0x7f8c540735b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.556 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.543+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== osd.2 v2:172.21.15.50:6800/2829123200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8c54073c80 con 0x7f8c54071170 2023-12-08T08:21:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.556+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 --> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c680acef0 con 0x7f8c54071170 2023-12-08T08:21:04.558 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.556+0000 7f8c4f7fe640 1 -- 172.21.15.50:0/1206764967 <== osd.2 v2:172.21.15.50:6800/2829123200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8c600017b0 con 0x7f8c54071170 2023-12-08T08:21:04.559 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:04.559 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:04.559 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:04.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f8c54071170 msgr2=0x7f8c540735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.560 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:6800/2829123200,v1:172.21.15.50:6801/2829123200] conn(0x7f8c54071170 0x7f8c540735b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8c5406ae70 msgr2=0x7f8c5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8c5406ae70 0x7f8c5406d330 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c009040 comp rx=0 tx=0).stop 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c681524e0 msgr2=0x7f8c68152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 --2- 172.21.15.50:0/1206764967 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c681524e0 0x7f8c68152960 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8c58011540 tx=0x7f8c58011a00 comp rx=0 tx=0).stop 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c677fe640 1 -- 172.21.15.50:0/1206764967 reap_dead start 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 shutdown_connections 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 >> 172.21.15.50:0/1206764967 conn(0x7f8c680b0d80 msgr2=0x7f8c680aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.561 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 shutdown_connections 2023-12-08T08:21:04.562 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.557+0000 7f8c6d41e640 1 -- 172.21.15.50:0/1206764967 wait complete. 2023-12-08T08:21:04.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-08T08:21:04.677 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.675+0000 7f7c959a9640 1 Processor -- start 2023-12-08T08:21:04.678 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.675+0000 7f7c959a9640 1 -- start start 2023-12-08T08:21:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.676+0000 7f7c959a9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7c900b3340 0x7f7c900d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.676+0000 7f7c959a9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c900cdc20 con 0x7f7c900d1d00 2023-12-08T08:21:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.676+0000 7f7c959a9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c900d11d0 con 0x7f7c900b3bf0 2023-12-08T08:21:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.676+0000 7f7c959a9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c900d3a60 con 0x7f7c900b3340 2023-12-08T08:21:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.676+0000 7f7c8f7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7c900d1d00 0x7f7c900ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53850/0 (socket says 172.21.15.50:53850) 2023-12-08T08:21:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.676+0000 7f7c8f7fe640 1 -- 172.21.15.50:0/570752695 learned_addr learned my addr 172.21.15.50:0/570752695 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:04.681 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8effd640 1 --2- 172.21.15.50:0/570752695 >> v2:172.21.15.170:3300/0 conn(0x7f7c900b3340 0x7f7c900d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962276972 0 0) 0x7f7c900cdc20 con 0x7f7c900d1d00 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7c003520 con 0x7f7c900d1d00 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853279941 0 0) 0x7f7c7c003520 con 0x7f7c900d1d00 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 >> v2:172.21.15.170:3300/0 conn(0x7f7c900b3340 msgr2=0x7f7c900d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 --2- 172.21.15.50:0/570752695 >> v2:172.21.15.170:3300/0 conn(0x7f7c900b3340 0x7f7c900d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 >> v1:172.21.15.170:6789/0 conn(0x7f7c900b3bf0 legacy=0x7f7c900d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900d3d40 con 0x7f7c900d1d00 2023-12-08T08:21:04.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f7c880019f0 con 0x7f7c900d1d00 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 >> v1:172.21.15.50:6789/0 conn(0x7f7c900d1d00 legacy=0x7f7c900ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c003970 0x7f7c7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900d3a60 con 0x7f7c7c0047c0 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c00c120 con 0x7f7c7c005180 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c00c2e0 con 0x7f7c7c003970 2023-12-08T08:21:04.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8e7fc640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8effd640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c003970 0x7f7c7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.677+0000 7f7c8f7fe640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8e7fc640 1 -- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c003970 msgr2=0x7f7c7c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8e7fc640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c003970 0x7f7c7c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8e7fc640 1 -- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c7c005180 msgr2=0x7f7c7c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8e7fc640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c7c005180 0x7f7c7c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8e7fc640 1 -- 172.21.15.50:0/570752695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c003520 con 0x7f7c7c0047c0 2023-12-08T08:21:04.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8f7fe640 1 -- 172.21.15.50:0/570752695 reap_dead start 2023-12-08T08:21:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8e7fc640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7c78001750 tx=0x7f7c7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae974139de1c490b server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c780052d0 con 0x7f7c7c0047c0 2023-12-08T08:21:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7802e050 con 0x7f7c7c0047c0 2023-12-08T08:21:04.685 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.678+0000 7f7c8dffb640 1 -- 172.21.15.50:0/570752695 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78003830 con 0x7f7c7c0047c0 2023-12-08T08:21:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.679+0000 7f7c959a9640 1 -- 172.21.15.50:0/570752695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0047c0 msgr2=0x7f7c7c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.679+0000 7f7c959a9640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7c78001750 tx=0x7f7c7c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.689 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.679+0000 7f7c959a9640 1 -- 172.21.15.50:0/570752695 shutdown_connections 2023-12-08T08:21:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.679+0000 7f7c959a9640 1 --2- 172.21.15.50:0/570752695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c7c0047c0 0x7f7c7c004c40 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.679+0000 7f7c959a9640 1 -- 172.21.15.50:0/570752695 >> 172.21.15.50:0/570752695 conn(0x7f7c9009c2f0 msgr2=0x7f7c900d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.679+0000 7f7c959a9640 1 -- 172.21.15.50:0/570752695 shutdown_connections 2023-12-08T08:21:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.679+0000 7f7c959a9640 1 -- 172.21.15.50:0/570752695 wait complete. 2023-12-08T08:21:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.680+0000 7f7c959a9640 1 Processor -- start 2023-12-08T08:21:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c959a9640 1 -- start start 2023-12-08T08:21:04.690 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c959a9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c0047c0 0x7f7c901532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c959a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c9009f8c0 0x7f7c900b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c959a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9009cd80 0x7f7c9009d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c959a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9009d740 con 0x7f7c9009f8c0 2023-12-08T08:21:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c959a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9009fdf0 con 0x7f7c9009cd80 2023-12-08T08:21:04.691 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c959a9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900a00d0 con 0x7f7c7c0047c0 2023-12-08T08:21:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c8e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c9009f8c0 0x7f7c900b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c8e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c9009f8c0 0x7f7c900b7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53656/0 (socket says 172.21.15.50:53656) 2023-12-08T08:21:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.681+0000 7f7c8e7fc640 1 -- 172.21.15.50:0/3623878630 learned_addr learned my addr 172.21.15.50:0/3623878630 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8effd640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c0047c0 0x7f7c901532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8f7fe640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9009cd80 0x7f7c9009d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.692 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8e7fc640 1 -- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c0047c0 msgr2=0x7f7c901532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8e7fc640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c0047c0 0x7f7c901532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8e7fc640 1 -- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9009cd80 msgr2=0x7f7c9009d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8e7fc640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9009cd80 0x7f7c9009d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8e7fc640 1 -- 172.21.15.50:0/3623878630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900a03b0 con 0x7f7c9009f8c0 2023-12-08T08:21:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c8e7fc640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c9009f8c0 0x7f7c900b7f20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7c7802bc00 tx=0x7f7c78001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.693 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c87fff640 1 -- 172.21.15.50:0/3623878630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c780076c0 con 0x7f7c9009f8c0 2023-12-08T08:21:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c87fff640 1 -- 172.21.15.50:0/3623878630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78007a30 con 0x7f7c9009f8c0 2023-12-08T08:21:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c900a0690 con 0x7f7c9009f8c0 2023-12-08T08:21:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c87fff640 1 -- 172.21.15.50:0/3623878630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78006be0 con 0x7f7c9009f8c0 2023-12-08T08:21:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.682+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c90153830 con 0x7f7c9009f8c0 2023-12-08T08:21:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.683+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c900a0210 con 0x7f7c9009f8c0 2023-12-08T08:21:04.694 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.684+0000 7f7c87fff640 1 -- 172.21.15.50:0/3623878630 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c78006d40 con 0x7f7c9009f8c0 2023-12-08T08:21:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.684+0000 7f7c87fff640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7c7006ae70 0x7f7c7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.684+0000 7f7c87fff640 1 -- 172.21.15.50:0/3623878630 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7c780aaf10 con 0x7f7c9009f8c0 2023-12-08T08:21:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.684+0000 7f7c8effd640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7c7006ae70 0x7f7c7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.695 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.685+0000 7f7c8effd640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7c7006ae70 0x7f7c7006d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009bc0 tx=0x7f7c80009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.696 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.688+0000 7f7c87fff640 1 -- 172.21.15.50:0/3623878630 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c900a0210 con 0x7f7c9009f8c0 2023-12-08T08:21:04.868 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.866+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c900b3720 con 0x7f7c7006ae70 2023-12-08T08:21:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.866+0000 7f7c87fff640 1 -- 172.21.15.50:0/3623878630 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c80019070 con 0x7f7c7006ae70 2023-12-08T08:21:04.869 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2023-12-08T08:21:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7c7006ae70 msgr2=0x7f7c7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7c7006ae70 0x7f7c7006d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009bc0 tx=0x7f7c80009190 comp rx=0 tx=0).stop 2023-12-08T08:21:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c9009f8c0 msgr2=0x7f7c900b7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.871 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c9009f8c0 0x7f7c900b7f20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7c7802bc00 tx=0x7f7c78001120 comp rx=0 tx=0).stop 2023-12-08T08:21:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 shutdown_connections 2023-12-08T08:21:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f7c7006ae70 0x7f7c7006d330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c9009f8c0 0x7f7c900b7f20 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c9009cd80 0x7f7c9009d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 --2- 172.21.15.50:0/3623878630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7c7c0047c0 0x7f7c901532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.872 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 >> 172.21.15.50:0/3623878630 conn(0x7f7c9009c2f0 msgr2=0x7f7c900cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 shutdown_connections 2023-12-08T08:21:04.873 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.868+0000 7f7c959a9640 1 -- 172.21.15.50:0/3623878630 wait complete. 2023-12-08T08:21:04.881 INFO:tasks.ceph:Scrubbing osd.3 2023-12-08T08:21:04.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:04.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.989+0000 7f750b11d640 1 Processor -- start 2023-12-08T08:21:04.992 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.989+0000 7f750b11d640 1 -- start start 2023-12-08T08:21:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.990+0000 7f750b11d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7504159cc0 0x7f7504071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.990+0000 7f750b11d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f750415e580 0x7f75040ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:04.993 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.990+0000 7f750b11d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7504072400 con 0x7f750406a8f0 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.990+0000 7f750b11d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75040ac690 con 0x7f7504159cc0 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.990+0000 7f750b11d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75040ac930 con 0x7f750415e580 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.990+0000 7f7503fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f750415e580 0x7f75040ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.990+0000 7f7508eb9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7504159cc0 0x7f7504071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f75096ba640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f750406a8f0 0x7f75040b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:41034/0 (socket says 172.21.15.50:41034) 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f75096ba640 1 -- 172.21.15.50:0/1325455397 learned_addr learned my addr 172.21.15.50:0/1325455397 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f7508eb9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7504159cc0 0x7f7504071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:46996/0 (socket says 172.21.15.50:46996) 2023-12-08T08:21:04.994 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f7503fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f750415e580 0x7f75040ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:57210/0 (socket says 172.21.15.50:57210) 2023-12-08T08:21:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f7503fff640 1 -- 172.21.15.50:0/1325455397 >> v2:172.21.15.170:3300/0 conn(0x7f7504159cc0 msgr2=0x7f7504071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f7503fff640 1 --2- 172.21.15.50:0/1325455397 >> v2:172.21.15.170:3300/0 conn(0x7f7504159cc0 0x7f7504071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f7503fff640 1 -- 172.21.15.50:0/1325455397 >> v1:172.21.15.170:6789/0 conn(0x7f750406a8f0 legacy=0x7f75040b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f7503fff640 1 -- 172.21.15.50:0/1325455397 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75040acc10 con 0x7f750415e580 2023-12-08T08:21:04.995 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.991+0000 7f7508eb9640 1 --2- 172.21.15.50:0/1325455397 >> v2:172.21.15.170:3300/0 conn(0x7f7504159cc0 0x7f7504071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-08T08:21:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f7503fff640 1 --2- 172.21.15.50:0/1325455397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f750415e580 0x7f75040ad6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0097d0 tx=0x7f74ec02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac112f208817fe95 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:04.998 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f75037fe640 1 -- 172.21.15.50:0/1325455397 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec031800 con 0x7f750415e580 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f75037fe640 1 -- 172.21.15.50:0/1325455397 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec031960 con 0x7f750415e580 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f75037fe640 1 -- 172.21.15.50:0/1325455397 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec031cf0 con 0x7f750415e580 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 -- 172.21.15.50:0/1325455397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f750415e580 msgr2=0x7f75040ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 --2- 172.21.15.50:0/1325455397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f750415e580 0x7f75040ad6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0097d0 tx=0x7f74ec02b8a0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 -- 172.21.15.50:0/1325455397 shutdown_connections 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 --2- 172.21.15.50:0/1325455397 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f750415e580 0x7f75040ad6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 --2- 172.21.15.50:0/1325455397 >> v2:172.21.15.170:3300/0 conn(0x7f7504159cc0 0x7f7504071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:04.999 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 -- 172.21.15.50:0/1325455397 >> 172.21.15.50:0/1325455397 conn(0x7f75040b0d80 msgr2=0x7f75040b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 -- 172.21.15.50:0/1325455397 shutdown_connections 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.992+0000 7f750b11d640 1 -- 172.21.15.50:0/1325455397 wait complete. 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 Processor -- start 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 -- start start 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750406a8f0 0x7f75041567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7504159cc0 0x7f7504158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750415e580 0x7f7504159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75041f14d0 con 0x7f750406a8f0 2023-12-08T08:21:05.000 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75041f0b30 con 0x7f750415e580 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.994+0000 7f750b11d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75041f0e10 con 0x7f7504159cc0 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750406a8f0 0x7f75041567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750406a8f0 0x7f75041567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53666/0 (socket says 172.21.15.50:53666) 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 -- 172.21.15.50:0/2182044010 learned_addr learned my addr 172.21.15.50:0/2182044010 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7503fff640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7504159cc0 0x7f7504158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 -- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7504159cc0 msgr2=0x7f7504158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7504159cc0 0x7f7504158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 -- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750415e580 msgr2=0x7f7504159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.001 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f75096ba640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750415e580 0x7f7504159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750415e580 0x7f7504159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 -- 172.21.15.50:0/2182044010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc009a70 con 0x7f750406a8f0 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f75096ba640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750415e580 0x7f7504159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f7508eb9640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750406a8f0 0x7f75041567a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00efc0 tx=0x7f74fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc014680 con 0x7f750406a8f0 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc00f040 con 0x7f750406a8f0 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec009400 con 0x7f750406a8f0 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc014a00 con 0x7f750406a8f0 2023-12-08T08:21:05.002 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.995+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75041f0800 con 0x7f750406a8f0 2023-12-08T08:21:05.003 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.996+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75041f0ca0 con 0x7f750406a8f0 2023-12-08T08:21:05.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.997+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f74fc014b60 con 0x7f750406a8f0 2023-12-08T08:21:05.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.997+0000 7f75017fa640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f74e406ae40 0x7f74e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.997+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f74fc08a3f0 con 0x7f750406a8f0 2023-12-08T08:21:05.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.997+0000 7f75017fa640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f74e4071140 0x7f74e4073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.004 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.998+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 --> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74e4073c50 con 0x7f74e4071140 2023-12-08T08:21:05.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.998+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74fc08cab0 con 0x7f750406a8f0 2023-12-08T08:21:05.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.998+0000 7f75096ba640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f74e4071140 0x7f74e4073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.998+0000 7f7503fff640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f74e406ae40 0x7f74e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.998+0000 7f75096ba640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f74e4071140 0x7f74e4073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.998+0000 7f7503fff640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f74e406ae40 0x7f74e406d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74ec036000 tx=0x7f74ec03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.005 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:04.999+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== osd.3 v2:172.21.15.50:6809/3350672246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f74e4073c50 con 0x7f74e4071140 2023-12-08T08:21:05.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.012+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 --> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f75040ad1d0 con 0x7f74e4071140 2023-12-08T08:21:05.015 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.012+0000 7f75017fa640 1 -- 172.21.15.50:0/2182044010 <== osd.3 v2:172.21.15.50:6809/3350672246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f74f40017d0 con 0x7f74e4071140 2023-12-08T08:21:05.015 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:05.015 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:05.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f74e4071140 msgr2=0x7f74e4073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.016 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:6809/3350672246,v1:172.21.15.50:6811/3350672246] conn(0x7f74e4071140 0x7f74e4073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f74e406ae40 msgr2=0x7f74e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f74e406ae40 0x7f74e406d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74ec036000 tx=0x7f74ec03c040 comp rx=0 tx=0).stop 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750406a8f0 msgr2=0x7f75041567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 --2- 172.21.15.50:0/2182044010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f750406a8f0 0x7f75041567a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00efc0 tx=0x7f74fc00c490 comp rx=0 tx=0).stop 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f75096ba640 1 -- 172.21.15.50:0/2182044010 reap_dead start 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 shutdown_connections 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 >> 172.21.15.50:0/2182044010 conn(0x7f75040b0d80 msgr2=0x7f75040b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 shutdown_connections 2023-12-08T08:21:05.017 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.013+0000 7f750b11d640 1 -- 172.21.15.50:0/2182044010 wait complete. 2023-12-08T08:21:05.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-08T08:21:05.132 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.130+0000 7f061223d640 1 Processor -- start 2023-12-08T08:21:05.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.130+0000 7f061223d640 1 -- start start 2023-12-08T08:21:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f061223d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f060c0d1d00 0x7f060c0d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f061223d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f060c0b3bf0 0x7f060c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f061223d640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0cdc20 con 0x7f060c0b3340 2023-12-08T08:21:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f061223d640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c0d11d0 con 0x7f060c0b3bf0 2023-12-08T08:21:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f061223d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c0d3a60 con 0x7f060c0d1d00 2023-12-08T08:21:05.134 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060b7fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f060c0b3340 0x7f060c0d15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53854/0 (socket says 172.21.15.50:53854) 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060bfff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f060c0b3bf0 0x7f060c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060b7fe640 1 -- 172.21.15.50:0/1424055533 learned_addr learned my addr 172.21.15.50:0/1424055533 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060affd640 1 --2- 172.21.15.50:0/1424055533 >> v2:172.21.15.170:3300/0 conn(0x7f060c0d1d00 0x7f060c0d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060bfff640 1 -- 172.21.15.50:0/1424055533 >> v2:172.21.15.170:3300/0 conn(0x7f060c0d1d00 msgr2=0x7f060c0d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060bfff640 1 --2- 172.21.15.50:0/1424055533 >> v2:172.21.15.170:3300/0 conn(0x7f060c0d1d00 0x7f060c0d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060bfff640 1 -- 172.21.15.50:0/1424055533 >> v1:172.21.15.50:6789/0 conn(0x7f060c0b3340 legacy=0x7f060c0d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060a7fc640 1 -- 172.21.15.50:0/1424055533 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124322382 0 0) 0x7f060c0cdc20 con 0x7f060c0b3340 2023-12-08T08:21:05.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.131+0000 7f060bfff640 1 -- 172.21.15.50:0/1424055533 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0d3d40 con 0x7f060c0b3bf0 2023-12-08T08:21:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.132+0000 7f060bfff640 1 --2- 172.21.15.50:0/1424055533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0b3bf0 0x7f060c0b5e40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f060c0b4540 tx=0x7f060402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e00fe644e7e53f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.132+0000 7f060a7fc640 1 -- 172.21.15.50:0/1424055533 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060402cbf0 con 0x7f060c0b3bf0 2023-12-08T08:21:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.132+0000 7f060a7fc640 1 -- 172.21.15.50:0/1424055533 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060402cd50 con 0x7f060c0b3bf0 2023-12-08T08:21:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.132+0000 7f060a7fc640 1 -- 172.21.15.50:0/1424055533 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604034660 con 0x7f060c0b3bf0 2023-12-08T08:21:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 -- 172.21.15.50:0/1424055533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0b3bf0 msgr2=0x7f060c0b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 --2- 172.21.15.50:0/1424055533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0b3bf0 0x7f060c0b5e40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f060c0b4540 tx=0x7f060402be40 comp rx=0 tx=0).stop 2023-12-08T08:21:05.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 -- 172.21.15.50:0/1424055533 shutdown_connections 2023-12-08T08:21:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 --2- 172.21.15.50:0/1424055533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0b3bf0 0x7f060c0b5e40 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 --2- 172.21.15.50:0/1424055533 >> v2:172.21.15.170:3300/0 conn(0x7f060c0d1d00 0x7f060c0d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 -- 172.21.15.50:0/1424055533 >> 172.21.15.50:0/1424055533 conn(0x7f060c09c2f0 msgr2=0x7f060c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 -- 172.21.15.50:0/1424055533 shutdown_connections 2023-12-08T08:21:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.133+0000 7f061223d640 1 -- 172.21.15.50:0/1424055533 wait complete. 2023-12-08T08:21:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.134+0000 7f061223d640 1 Processor -- start 2023-12-08T08:21:05.138 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.134+0000 7f061223d640 1 -- start start 2023-12-08T08:21:05.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f061223d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f060c0b3340 0x7f060c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.140 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f061223d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f060c0b3bf0 0x7f060c0ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f061223d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0d1d00 0x7f060c06afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f061223d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c09cd60 con 0x7f060c0d1d00 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f061223d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0ca930 con 0x7f060c0b3bf0 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f061223d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0cac10 con 0x7f060c0b3340 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f060bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0d1d00 0x7f060c06afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f060bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0d1d00 0x7f060c06afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53680/0 (socket says 172.21.15.50:53680) 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.135+0000 7f060bfff640 1 -- 172.21.15.50:0/3225531048 learned_addr learned my addr 172.21.15.50:0/3225531048 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:05.141 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f060bfff640 1 -- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f060c0b3340 msgr2=0x7f060c155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f060bfff640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f060c0b3340 0x7f060c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f060bfff640 1 -- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f060c0b3bf0 msgr2=0x7f060c0ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f060bfff640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f060c0b3bf0 0x7f060c0ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f060bfff640 1 -- 172.21.15.50:0/3225531048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604009a70 con 0x7f060c0d1d00 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f060bfff640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0d1d00 0x7f060c06afc0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0604009e80 tx=0x7f0604004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f0603fff640 1 -- 172.21.15.50:0/3225531048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604040650 con 0x7f060c0d1d00 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f0603fff640 1 -- 172.21.15.50:0/3225531048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06040407d0 con 0x7f060c0d1d00 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c0caef0 con 0x7f060c0d1d00 2023-12-08T08:21:05.142 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f0603fff640 1 -- 172.21.15.50:0/3225531048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604040b80 con 0x7f060c0d1d00 2023-12-08T08:21:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.136+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c1559a0 con 0x7f060c0d1d00 2023-12-08T08:21:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.137+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c09d1f0 con 0x7f060c0d1d00 2023-12-08T08:21:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.137+0000 7f0603fff640 1 -- 172.21.15.50:0/3225531048 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0604040ce0 con 0x7f060c0d1d00 2023-12-08T08:21:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.138+0000 7f0603fff640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f05ec06ae70 0x7f05ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.138+0000 7f0603fff640 1 -- 172.21.15.50:0/3225531048 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f06040ac320 con 0x7f060c0d1d00 2023-12-08T08:21:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.138+0000 7f060b7fe640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f05ec06ae70 0x7f05ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.143 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.138+0000 7f060b7fe640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f05ec06ae70 0x7f05ec06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f05f4007fd0 tx=0x7f05f4007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.144 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.142+0000 7f0603fff640 1 -- 172.21.15.50:0/3225531048 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f060c09d1f0 con 0x7f060c0d1d00 2023-12-08T08:21:05.320 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.318+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f060c0b3720 con 0x7f05ec06ae70 2023-12-08T08:21:05.321 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.319+0000 7f0603fff640 1 -- 172.21.15.50:0/3225531048 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05f40070d0 con 0x7f05ec06ae70 2023-12-08T08:21:05.321 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f05ec06ae70 msgr2=0x7f05ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f05ec06ae70 0x7f05ec06d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f05f4007fd0 tx=0x7f05f4007920 comp rx=0 tx=0).stop 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0d1d00 msgr2=0x7f060c06afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0d1d00 0x7f060c06afc0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0604009e80 tx=0x7f0604004a40 comp rx=0 tx=0).stop 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 shutdown_connections 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f05ec06ae70 0x7f05ec06d330 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f060c0d1d00 0x7f060c06afc0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.324 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f060c0b3bf0 0x7f060c0ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 --2- 172.21.15.50:0/3225531048 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f060c0b3340 0x7f060c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 >> 172.21.15.50:0/3225531048 conn(0x7f060c09c2f0 msgr2=0x7f060c0b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 shutdown_connections 2023-12-08T08:21:05.325 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.321+0000 7f061223d640 1 -- 172.21.15.50:0/3225531048 wait complete. 2023-12-08T08:21:05.334 INFO:tasks.ceph:Scrubbing osd.4 2023-12-08T08:21:05.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:05.444 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.442+0000 7f62a8f51640 1 Processor -- start 2023-12-08T08:21:05.445 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.442+0000 7f62a8f51640 1 -- start start 2023-12-08T08:21:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a8f51640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f62a40cdd10 0x7f62a40d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a8f51640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a406b5e0 con 0x7f62a40cfb60 2023-12-08T08:21:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a8f51640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a40cbc30 con 0x7f62a415d470 2023-12-08T08:21:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a8f51640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40cb3d0 con 0x7f62a40cdd10 2023-12-08T08:21:05.451 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a2d9d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f62a40cfb60 0x7f62a40cc0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53860/0 (socket says 172.21.15.50:53860) 2023-12-08T08:21:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a2d9d640 1 -- 172.21.15.50:0/1033652828 learned_addr learned my addr 172.21.15.50:0/1033652828 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045250877 0 0) 0x7f62a406b5e0 con 0x7f62a40cfb60 2023-12-08T08:21:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6290003520 con 0x7f62a40cfb60 2023-12-08T08:21:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.443+0000 7f62a1d9b640 1 --2- 172.21.15.50:0/1033652828 >> v2:172.21.15.170:3300/0 conn(0x7f62a40cdd10 0x7f62a40d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767193969 0 0) 0x7f6290003520 con 0x7f62a40cfb60 2023-12-08T08:21:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 >> v2:172.21.15.170:3300/0 conn(0x7f62a40cdd10 msgr2=0x7f62a40d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.452 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 --2- 172.21.15.50:0/1033652828 >> v2:172.21.15.170:3300/0 conn(0x7f62a40cdd10 0x7f62a40d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 >> v1:172.21.15.170:6789/0 conn(0x7f62a415d470 legacy=0x7f62a40cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a415d850 con 0x7f62a40cfb60 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f62940019f0 con 0x7f62a40cfb60 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 >> v1:172.21.15.50:6789/0 conn(0x7f62a40cfb60 legacy=0x7f62a40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6290003970 0x7f6290003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62900047c0 0x7f6290004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62900052a0 0x7f629000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.453 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40cb3d0 con 0x7f6290003970 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629000c170 con 0x7f62900047c0 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629000c330 con 0x7f62900052a0 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a259c640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6290003970 0x7f6290003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a1d9b640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62900047c0 0x7f6290004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a2d9d640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62900052a0 0x7f629000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a259c640 1 -- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62900052a0 msgr2=0x7f629000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a259c640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62900052a0 0x7f629000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.454 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a259c640 1 -- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62900047c0 msgr2=0x7f6290004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a259c640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62900047c0 0x7f6290004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a259c640 1 -- 172.21.15.50:0/1033652828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290003520 con 0x7f6290003970 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a2d9d640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62900052a0 0x7f629000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.444+0000 7f62a2d9d640 1 -- 172.21.15.50:0/1033652828 reap_dead start 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a259c640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6290003970 0x7f6290003d90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f629c001720 tx=0x7f62900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d922eb8ba3582f server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c0052d0 con 0x7f6290003970 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c02e050 con 0x7f6290003970 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a159a640 1 -- 172.21.15.50:0/1033652828 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c003830 con 0x7f6290003970 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a8f51640 1 -- 172.21.15.50:0/1033652828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6290003970 msgr2=0x7f6290003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.455 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a8f51640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6290003970 0x7f6290003d90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f629c001720 tx=0x7f62900057f0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a8f51640 1 -- 172.21.15.50:0/1033652828 shutdown_connections 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a8f51640 1 --2- 172.21.15.50:0/1033652828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6290003970 0x7f6290003d90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.445+0000 7f62a8f51640 1 -- 172.21.15.50:0/1033652828 >> 172.21.15.50:0/1033652828 conn(0x7f62a40d0d80 msgr2=0x7f62a40d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.446+0000 7f62a8f51640 1 -- 172.21.15.50:0/1033652828 shutdown_connections 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.446+0000 7f62a8f51640 1 -- 172.21.15.50:0/1033652828 wait complete. 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.447+0000 7f62a8f51640 1 Processor -- start 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.447+0000 7f62a8f51640 1 -- start start 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6290003970 0x7f62a4152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.456 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62a41f2d20 0x7f62a40aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62a41f3180 0x7f62a40af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415e870 con 0x7f62a41f3180 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415f2b0 con 0x7f62a41f2d20 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a415f590 con 0x7f6290003970 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62a41f3180 0x7f62a40af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62a41f3180 0x7f62a40af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53690/0 (socket says 172.21.15.50:53690) 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 -- 172.21.15.50:0/3971792500 learned_addr learned my addr 172.21.15.50:0/3971792500 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a259c640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6290003970 0x7f62a4152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a1d9b640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62a41f2d20 0x7f62a40aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.457 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 -- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6290003970 msgr2=0x7f62a4152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6290003970 0x7f62a4152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 -- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62a41f2d20 msgr2=0x7f62a40aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62a41f2d20 0x7f62a40aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 -- 172.21.15.50:0/3971792500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a415f870 con 0x7f62a41f3180 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a1d9b640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62a41f2d20 0x7f62a40aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a2d9d640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62a41f3180 0x7f62a40af000 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6294000f80 tx=0x7f629400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629400eb90 con 0x7f62a41f3180 2023-12-08T08:21:05.458 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629400ecf0 con 0x7f62a41f3180 2023-12-08T08:21:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a415fb50 con 0x7f62a41f3180 2023-12-08T08:21:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294013620 con 0x7f62a41f3180 2023-12-08T08:21:05.459 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.448+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a415dad0 con 0x7f62a41f3180 2023-12-08T08:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.449+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62a40cb5e0 con 0x7f62a41f3180 2023-12-08T08:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.450+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6294013780 con 0x7f62a41f3180 2023-12-08T08:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.450+0000 7f629affd640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f628406ae40 0x7f628406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.450+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6294089940 con 0x7f62a41f3180 2023-12-08T08:21:05.460 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.450+0000 7f62a259c640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f628406ae40 0x7f628406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.450+0000 7f629affd640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f6284071140 0x7f6284073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.450+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 --> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6284073c50 con 0x7f6284071140 2023-12-08T08:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.450+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f629408e2a0 con 0x7f62a41f3180 2023-12-08T08:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.451+0000 7f62a1d9b640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f6284071140 0x7f6284073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.451+0000 7f62a259c640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f628406ae40 0x7f628406d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f629c033000 tx=0x7f629c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.451+0000 7f62a1d9b640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f6284071140 0x7f6284073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.461 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.452+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== osd.4 v2:172.21.15.170:6824/3545378016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6284073c50 con 0x7f6284071140 2023-12-08T08:21:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.465+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 --> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f62a40cfff0 con 0x7f6284071140 2023-12-08T08:21:05.467 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.465+0000 7f629affd640 1 -- 172.21.15.50:0/3971792500 <== osd.4 v2:172.21.15.170:6824/3545378016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f628c0042c0 con 0x7f6284071140 2023-12-08T08:21:05.468 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:05.468 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:05.468 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f6284071140 msgr2=0x7f6284073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6824/3545378016,v1:172.21.15.170:6825/3545378016] conn(0x7f6284071140 0x7f6284073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f628406ae40 msgr2=0x7f628406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f628406ae40 0x7f628406d300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f629c033000 tx=0x7f629c009030 comp rx=0 tx=0).stop 2023-12-08T08:21:05.469 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62a41f3180 msgr2=0x7f62a40af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 --2- 172.21.15.50:0/3971792500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62a41f3180 0x7f62a40af000 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6294000f80 tx=0x7f629400e530 comp rx=0 tx=0).stop 2023-12-08T08:21:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a2d9d640 1 -- 172.21.15.50:0/3971792500 reap_dead start 2023-12-08T08:21:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 shutdown_connections 2023-12-08T08:21:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 >> 172.21.15.50:0/3971792500 conn(0x7f62a40d0d80 msgr2=0x7f62a40d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 shutdown_connections 2023-12-08T08:21:05.470 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.466+0000 7f62a8f51640 1 -- 172.21.15.50:0/3971792500 wait complete. 2023-12-08T08:21:05.478 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-08T08:21:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.584+0000 7f8f70973640 1 Processor -- start 2023-12-08T08:21:05.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.584+0000 7f8f70973640 1 -- start start 2023-12-08T08:21:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f70973640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f70973640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8f6c0ce190 0x7f8f6c0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.588 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f70973640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c0d0070 con 0x7f8f6c0cd660 2023-12-08T08:21:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f70973640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c160cb0 con 0x7f8f6c0ce190 2023-12-08T08:21:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f70973640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0d02b0 con 0x7f8f6c0b6ac0 2023-12-08T08:21:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:57266/0 (socket says 172.21.15.50:57266) 2023-12-08T08:21:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6a59c640 1 -- 172.21.15.50:0/2605457881 learned_addr learned my addr 172.21.15.50:0/2605457881 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:05.589 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6ad9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8f6c0ce190 0x7f8f6c0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6a59c640 1 -- 172.21.15.50:0/2605457881 >> v2:172.21.15.170:3300/0 conn(0x7f8f6c0ce190 msgr2=0x7f8f6c0cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6a59c640 1 --2- 172.21.15.50:0/2605457881 >> v2:172.21.15.170:3300/0 conn(0x7f8f6c0ce190 0x7f8f6c0cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6a59c640 1 -- 172.21.15.50:0/2605457881 >> v1:172.21.15.170:6789/0 conn(0x7f8f6c0cd660 legacy=0x7f8f6c0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.585+0000 7f8f6a59c640 1 -- 172.21.15.50:0/2605457881 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0cb430 con 0x7f8f6c0b6ac0 2023-12-08T08:21:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.586+0000 7f8f6a59c640 1 --2- 172.21.15.50:0/2605457881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0cfb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009870 tx=0x7f8f5c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=898382d20bf79f4d server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.590 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.586+0000 7f8f69d9b640 1 -- 172.21.15.50:0/2605457881 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0317c0 con 0x7f8f6c0b6ac0 2023-12-08T08:21:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.586+0000 7f8f69d9b640 1 -- 172.21.15.50:0/2605457881 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c031920 con 0x7f8f6c0b6ac0 2023-12-08T08:21:05.591 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.586+0000 7f8f69d9b640 1 -- 172.21.15.50:0/2605457881 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c031cb0 con 0x7f8f6c0b6ac0 2023-12-08T08:21:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 -- 172.21.15.50:0/2605457881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0b6ac0 msgr2=0x7f8f6c0cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 --2- 172.21.15.50:0/2605457881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0cfb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009870 tx=0x7f8f5c02b860 comp rx=0 tx=0).stop 2023-12-08T08:21:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 -- 172.21.15.50:0/2605457881 shutdown_connections 2023-12-08T08:21:05.593 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 --2- 172.21.15.50:0/2605457881 >> v2:172.21.15.170:3300/0 conn(0x7f8f6c0ce190 0x7f8f6c0cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 --2- 172.21.15.50:0/2605457881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0cfb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 -- 172.21.15.50:0/2605457881 >> 172.21.15.50:0/2605457881 conn(0x7f8f6c0d0de0 msgr2=0x7f8f6c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 -- 172.21.15.50:0/2605457881 shutdown_connections 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.587+0000 7f8f70973640 1 -- 172.21.15.50:0/2605457881 wait complete. 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.588+0000 7f8f70973640 1 Processor -- start 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.588+0000 7f8f70973640 1 -- start start 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f70973640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.594 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f70973640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0cd660 0x7f8f6c09d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f70973640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0ce190 0x7f8f6c0b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f70973640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1f3ec0 con 0x7f8f6c0cd660 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f70973640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1f32b0 con 0x7f8f6c0b6ac0 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f70973640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1f3590 con 0x7f8f6c0ce190 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0cd660 0x7f8f6c09d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0cd660 0x7f8f6c09d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53698/0 (socket says 172.21.15.50:53698) 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 -- 172.21.15.50:0/553043441 learned_addr learned my addr 172.21.15.50:0/553043441 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f6a59c640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f6ad9d640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0ce190 0x7f8f6c0b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.595 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 -- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0ce190 msgr2=0x7f8f6c0b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0ce190 0x7f8f6c0b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 -- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f6c0b6ac0 msgr2=0x7f8f6c0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.589+0000 7f8f61d9b640 1 -- 172.21.15.50:0/553043441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0094d0 con 0x7f8f6c0cd660 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.590+0000 7f8f61d9b640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0cd660 0x7f8f6c09d660 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c400 tx=0x7f8f5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.590+0000 7f8f637fe640 1 -- 172.21.15.50:0/553043441 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f540052d0 con 0x7f8f6c0cd660 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.590+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c1f3870 con 0x7f8f6c0cd660 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.590+0000 7f8f637fe640 1 -- 172.21.15.50:0/553043441 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f54005430 con 0x7f8f6c0cd660 2023-12-08T08:21:05.596 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.590+0000 7f8f637fe640 1 -- 172.21.15.50:0/553043441 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54003830 con 0x7f8f6c0cd660 2023-12-08T08:21:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.590+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c09dba0 con 0x7f8f6c0cd660 2023-12-08T08:21:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.591+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c067430 con 0x7f8f6c0cd660 2023-12-08T08:21:05.597 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.591+0000 7f8f637fe640 1 -- 172.21.15.50:0/553043441 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f54003990 con 0x7f8f6c0cd660 2023-12-08T08:21:05.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.592+0000 7f8f637fe640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8f4c06ae40 0x7f8f4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.592+0000 7f8f637fe640 1 -- 172.21.15.50:0/553043441 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8f540888a0 con 0x7f8f6c0cd660 2023-12-08T08:21:05.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.592+0000 7f8f6a59c640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8f4c06ae40 0x7f8f4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.598 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.593+0000 7f8f6a59c640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8f4c06ae40 0x7f8f4c06d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c036000 tx=0x7f8f5c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.602 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.596+0000 7f8f637fe640 1 -- 172.21.15.50:0/553043441 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f54053aa0 con 0x7f8f6c0cd660 2023-12-08T08:21:05.774 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.772+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f6c0cbcd0 con 0x7f8f4c06ae40 2023-12-08T08:21:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.773+0000 7f8f637fe640 1 -- 172.21.15.50:0/553043441 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f5c031a90 con 0x7f8f4c06ae40 2023-12-08T08:21:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2023-12-08T08:21:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8f4c06ae40 msgr2=0x7f8f4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8f4c06ae40 0x7f8f4c06d300 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c036000 tx=0x7f8f5c03d040 comp rx=0 tx=0).stop 2023-12-08T08:21:05.777 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0cd660 msgr2=0x7f8f6c09d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0cd660 0x7f8f6c09d660 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c400 tx=0x7f8f5400c8c0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 shutdown_connections 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f8f4c06ae40 0x7f8f4c06d300 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f6c0cd660 0x7f8f6c09d660 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f6c0ce190 0x7f8f6c0b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 --2- 172.21.15.50:0/553043441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f6c0b6ac0 0x7f8f6c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 >> 172.21.15.50:0/553043441 conn(0x7f8f6c0d0de0 msgr2=0x7f8f6c06e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.778 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 shutdown_connections 2023-12-08T08:21:05.779 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.775+0000 7f8f70973640 1 -- 172.21.15.50:0/553043441 wait complete. 2023-12-08T08:21:05.787 INFO:tasks.ceph:Scrubbing osd.5 2023-12-08T08:21:05.788 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:05.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.896+0000 7f9eda8cf640 1 Processor -- start 2023-12-08T08:21:05.898 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.896+0000 7f9eda8cf640 1 -- start start 2023-12-08T08:21:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.896+0000 7f9eda8cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 0x7f9ed40d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.896+0000 7f9eda8cf640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed40ce900 con 0x7f9ed40d1d00 2023-12-08T08:21:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.896+0000 7f9eda8cf640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed406bfd0 con 0x7f9ed40cfd30 2023-12-08T08:21:05.903 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.896+0000 7f9eda8cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40cdae0 con 0x7f9ed40cf950 2023-12-08T08:21:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed37fe640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9ed40d1d00 0x7f9ed406c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53866/0 (socket says 172.21.15.50:53866) 2023-12-08T08:21:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed37fe640 1 -- 172.21.15.50:0/3856404742 learned_addr learned my addr 172.21.15.50:0/3856404742 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed3fff640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 0x7f9ed40d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054159590 0 0) 0x7f9ed40ce900 con 0x7f9ed40d1d00 2023-12-08T08:21:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ebc003520 con 0x7f9ed40d1d00 2023-12-08T08:21:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1339910120 0 0) 0x7f9ebc003520 con 0x7f9ed40d1d00 2023-12-08T08:21:05.904 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 msgr2=0x7f9ed40d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 0x7f9ed40d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 >> v1:172.21.15.170:6789/0 conn(0x7f9ed40cfd30 legacy=0x7f9ed415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40cdcf0 con 0x7f9ed40d1d00 2023-12-08T08:21:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f9ec8001670 con 0x7f9ed40d1d00 2023-12-08T08:21:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 >> v1:172.21.15.50:6789/0 conn(0x7f9ed40d1d00 legacy=0x7f9ed406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.905 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 0x7f9ebc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ebc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ebc004d00 0x7f9ebc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40cdae0 con 0x7f9ebc003ee0 2023-12-08T08:21:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc00b9e0 con 0x7f9ebc004d00 2023-12-08T08:21:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc00bba0 con 0x7f9ed40cf950 2023-12-08T08:21:05.906 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed37fe640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ebc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.897+0000 7f9ed3fff640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 0x7f9ebc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed8e6c640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ebc004d00 0x7f9ebc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed37fe640 1 -- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 msgr2=0x7f9ebc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed37fe640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40cf950 0x7f9ebc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed37fe640 1 -- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ebc004d00 msgr2=0x7f9ebc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed37fe640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ebc004d00 0x7f9ebc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed37fe640 1 -- 172.21.15.50:0/3856404742 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc003520 con 0x7f9ebc003ee0 2023-12-08T08:21:05.907 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed8e6c640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ebc004d00 0x7f9ebc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.898+0000 7f9ed37fe640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ebc0047c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c190 tx=0x7f9ebc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d53dbbee3b2af22 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8005ad0 con 0x7f9ebc003ee0 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec8005c50 con 0x7f9ebc003ee0 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9ed2ffd640 1 -- 172.21.15.50:0/3856404742 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8007070 con 0x7f9ebc003ee0 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9eda8cf640 1 -- 172.21.15.50:0/3856404742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 msgr2=0x7f9ebc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9eda8cf640 1 --2- 172.21.15.50:0/3856404742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ebc0047c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c190 tx=0x7f9ebc0057f0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9ed8e6c640 1 -- 172.21.15.50:0/3856404742 reap_dead start 2023-12-08T08:21:05.908 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9eda8cf640 1 -- 172.21.15.50:0/3856404742 shutdown_connections 2023-12-08T08:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9eda8cf640 1 -- 172.21.15.50:0/3856404742 >> 172.21.15.50:0/3856404742 conn(0x7f9ed409c2f0 msgr2=0x7f9ed40d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9eda8cf640 1 -- 172.21.15.50:0/3856404742 shutdown_connections 2023-12-08T08:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.899+0000 7f9eda8cf640 1 -- 172.21.15.50:0/3856404742 wait complete. 2023-12-08T08:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.900+0000 7f9eda8cf640 1 Processor -- start 2023-12-08T08:21:05.909 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9eda8cf640 1 -- start start 2023-12-08T08:21:05.913 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9eda8cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ed41f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9eda8cf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed40cb4c0 0x7f9ed41f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9eda8cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40b0c30 0x7f9ed40b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9eda8cf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41f2d70 con 0x7f9ebc003ee0 2023-12-08T08:21:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9eda8cf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40b15f0 con 0x7f9ed40cb4c0 2023-12-08T08:21:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9eda8cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41f6c60 con 0x7f9ed40b0c30 2023-12-08T08:21:05.914 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9ed3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ed41f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9ed3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ed41f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53726/0 (socket says 172.21.15.50:53726) 2023-12-08T08:21:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.901+0000 7f9ed3fff640 1 -- 172.21.15.50:0/19667793 learned_addr learned my addr 172.21.15.50:0/19667793 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed3fff640 1 -- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40b0c30 msgr2=0x7f9ed40b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed3fff640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ed40b0c30 0x7f9ed40b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.915 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed3fff640 1 -- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed40cb4c0 msgr2=0x7f9ed41f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed3fff640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed40cb4c0 0x7f9ed41f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed3fff640 1 -- 172.21.15.50:0/19667793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed41f6f40 con 0x7f9ebc003ee0 2023-12-08T08:21:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed3fff640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ed41f2830 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40119a0 tx=0x7f9ec4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400fa70 con 0x7f9ebc003ee0 2023-12-08T08:21:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec400fbd0 con 0x7f9ebc003ee0 2023-12-08T08:21:05.916 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed41f7220 con 0x7f9ebc003ee0 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4014440 con 0x7f9ebc003ee0 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.902+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed40b7180 con 0x7f9ebc003ee0 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.903+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ed40ce590 con 0x7f9ebc003ee0 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.903+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ec40145a0 con 0x7f9ebc003ee0 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.904+0000 7f9ed0ff9640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ec006ae40 0x7f9ec006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.904+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9ec4089d90 con 0x7f9ebc003ee0 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.904+0000 7f9ed0ff9640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f9ec0071140 0x7f9ec0073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:05.917 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.904+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 --> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ec0073c50 con 0x7f9ec0071140 2023-12-08T08:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.904+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ec408c370 con 0x7f9ebc003ee0 2023-12-08T08:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.904+0000 7f9ed37fe640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ec006ae40 0x7f9ec006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.904+0000 7f9ed8e6c640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f9ec0071140 0x7f9ec0073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.905+0000 7f9ed37fe640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ec006ae40 0x7f9ec006d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8034000 tx=0x7f9ec8007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.905+0000 7f9ed8e6c640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f9ec0071140 0x7f9ec0073580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:05.918 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.906+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== osd.5 v2:172.21.15.170:6816/1598851740 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9ec0073c50 con 0x7f9ec0071140 2023-12-08T08:21:05.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.919+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 --> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ed40ce2b0 con 0x7f9ec0071140 2023-12-08T08:21:05.921 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.919+0000 7f9ed0ff9640 1 -- 172.21.15.50:0/19667793 <== osd.5 v2:172.21.15.170:6816/1598851740 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ecc001c50 con 0x7f9ec0071140 2023-12-08T08:21:05.922 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:05.922 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:05.922 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:05.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.919+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f9ec0071140 msgr2=0x7f9ec0073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.919+0000 7f9eda8cf640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6816/1598851740,v1:172.21.15.170:6817/1598851740] conn(0x7f9ec0071140 0x7f9ec0073580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:05.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.919+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ec006ae40 msgr2=0x7f9ec006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.923 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.919+0000 7f9eda8cf640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f9ec006ae40 0x7f9ec006d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8034000 tx=0x7f9ec8007000 comp rx=0 tx=0).stop 2023-12-08T08:21:05.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.919+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 msgr2=0x7f9ed41f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:05.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.920+0000 7f9eda8cf640 1 --2- 172.21.15.50:0/19667793 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ebc003ee0 0x7f9ed41f2830 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40119a0 tx=0x7f9ec4011e60 comp rx=0 tx=0).stop 2023-12-08T08:21:05.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.920+0000 7f9ed8e6c640 1 -- 172.21.15.50:0/19667793 reap_dead start 2023-12-08T08:21:05.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.920+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 shutdown_connections 2023-12-08T08:21:05.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.920+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 >> 172.21.15.50:0/19667793 conn(0x7f9ed409c2f0 msgr2=0x7f9ed4160f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:05.924 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.920+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 shutdown_connections 2023-12-08T08:21:05.925 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:05.920+0000 7f9eda8cf640 1 -- 172.21.15.50:0/19667793 wait complete. 2023-12-08T08:21:05.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-08T08:21:06.043 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.037+0000 7fa9a9fb0640 1 Processor -- start 2023-12-08T08:21:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.037+0000 7fa9a9fb0640 1 -- start start 2023-12-08T08:21:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a9fb0640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a415b1f0 0x7fa9a40ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a9fb0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa9a40ceef0 0x7fa9a40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a9fb0640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a415b5d0 con 0x7fa9a40cd740 2023-12-08T08:21:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a9fb0640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a40c4d10 con 0x7fa9a415b1f0 2023-12-08T08:21:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a9fb0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a40cf850 con 0x7fa9a40ceef0 2023-12-08T08:21:06.044 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a37fe640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa9a415b1f0 0x7fa9a40ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a3fff640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa9a40cd740 0x7fa9a40cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53870/0 (socket says 172.21.15.50:53870) 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a3fff640 1 -- 172.21.15.50:0/3741562953 learned_addr learned my addr 172.21.15.50:0/3741562953 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.038+0000 7fa9a2ffd640 1 --2- 172.21.15.50:0/3741562953 >> v2:172.21.15.170:3300/0 conn(0x7fa9a40ceef0 0x7fa9a40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a37fe640 1 -- 172.21.15.50:0/3741562953 >> v2:172.21.15.170:3300/0 conn(0x7fa9a40ceef0 msgr2=0x7fa9a40cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a37fe640 1 --2- 172.21.15.50:0/3741562953 >> v2:172.21.15.170:3300/0 conn(0x7fa9a40ceef0 0x7fa9a40cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a37fe640 1 -- 172.21.15.50:0/3741562953 >> v1:172.21.15.50:6789/0 conn(0x7fa9a40cd740 legacy=0x7fa9a40cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a37fe640 1 -- 172.21.15.50:0/3741562953 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40cc710 con 0x7fa9a415b1f0 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a27fc640 1 -- 172.21.15.50:0/3741562953 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173195893 0 0) 0x7fa9a415b5d0 con 0x7fa9a40cd740 2023-12-08T08:21:06.045 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a37fe640 1 --2- 172.21.15.50:0/3741562953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40ce9b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa9a415ec20 tx=0x7fa99402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f2fd8b7dfd68ed server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a27fc640 1 -- 172.21.15.50:0/3741562953 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99402e070 con 0x7fa9a415b1f0 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a27fc640 1 -- 172.21.15.50:0/3741562953 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9940315a0 con 0x7fa9a415b1f0 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.039+0000 7fa9a27fc640 1 -- 172.21.15.50:0/3741562953 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994031930 con 0x7fa9a415b1f0 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/3741562953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a415b1f0 msgr2=0x7fa9a40ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/3741562953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40ce9b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa9a415ec20 tx=0x7fa99402b840 comp rx=0 tx=0).stop 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/3741562953 shutdown_connections 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/3741562953 >> v2:172.21.15.170:3300/0 conn(0x7fa9a40ceef0 0x7fa9a40cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/3741562953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40ce9b0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.046 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/3741562953 >> 172.21.15.50:0/3741562953 conn(0x7fa9a40d0de0 msgr2=0x7fa9a40d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/3741562953 shutdown_connections 2023-12-08T08:21:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.040+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/3741562953 wait complete. 2023-12-08T08:21:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.041+0000 7fa9a9fb0640 1 Processor -- start 2023-12-08T08:21:06.047 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.041+0000 7fa9a9fb0640 1 -- start start 2023-12-08T08:21:06.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a9fb0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9a40cd740 0x7fa9a4159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.049 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a9fb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a40ceef0 0x7fa9a415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a9fb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a9fb0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a415a1b0 con 0x7fa9a40ceef0 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a9fb0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40c8740 con 0x7fa9a415b1f0 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a9fb0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40c8a20 con 0x7fa9a40cd740 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a40ceef0 0x7fa9a415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a40ceef0 0x7fa9a415d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53738/0 (socket says 172.21.15.50:53738) 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a2ffd640 1 -- 172.21.15.50:0/77503666 learned_addr learned my addr 172.21.15.50:0/77503666 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.042+0000 7fa9a37fe640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9a40cd740 0x7fa9a4159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.050 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a3fff640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a2ffd640 1 -- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9a40cd740 msgr2=0x7fa9a4159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a2ffd640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9a40cd740 0x7fa9a4159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a2ffd640 1 -- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a415b1f0 msgr2=0x7fa9a40b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a2ffd640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a2ffd640 1 -- 172.21.15.50:0/77503666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa994009400 con 0x7fa9a40ceef0 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a37fe640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9a40cd740 0x7fa9a4159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a3fff640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a2ffd640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a40ceef0 0x7fa9a415d700 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa99800e870 tx=0x7fa99800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.051 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa98bfff640 1 -- 172.21.15.50:0/77503666 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980094f0 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa98bfff640 1 -- 172.21.15.50:0/77503666 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99800c940 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a40c8d00 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa98bfff640 1 -- 172.21.15.50:0/77503666 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99800ccf0 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.043+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a40c92c0 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.044+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a415b820 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.044+0000 7fa98bfff640 1 -- 172.21.15.50:0/77503666 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa998013470 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.045+0000 7fa98bfff640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa99006ae40 0x7fa99006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.045+0000 7fa98bfff640 1 -- 172.21.15.50:0/77503666 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa9980895c0 con 0x7fa9a40ceef0 2023-12-08T08:21:06.052 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.045+0000 7fa9a37fe640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa99006ae40 0x7fa99006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.046+0000 7fa9a37fe640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa99006ae40 0x7fa99006d300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa994036000 tx=0x7fa99403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.053 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.049+0000 7fa98bfff640 1 -- 172.21.15.50:0/77503666 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa998054830 con 0x7fa9a40ceef0 2023-12-08T08:21:06.227 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.225+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9a40c8b90 con 0x7fa99006ae40 2023-12-08T08:21:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.225+0000 7fa98bfff640 1 -- 172.21.15.50:0/77503666 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9a40c8b90 con 0x7fa99006ae40 2023-12-08T08:21:06.228 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa99006ae40 msgr2=0x7fa99006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa99006ae40 0x7fa99006d300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa994036000 tx=0x7fa99403d040 comp rx=0 tx=0).stop 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a40ceef0 msgr2=0x7fa9a415d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a40ceef0 0x7fa9a415d700 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa99800e870 tx=0x7fa99800ed30 comp rx=0 tx=0).stop 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 shutdown_connections 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fa99006ae40 0x7fa99006d300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa9a40ceef0 0x7fa9a415d700 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.230 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a415b1f0 0x7fa9a40b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 --2- 172.21.15.50:0/77503666 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9a40cd740 0x7fa9a4159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 >> 172.21.15.50:0/77503666 conn(0x7fa9a40d0de0 msgr2=0x7fa9a40cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 shutdown_connections 2023-12-08T08:21:06.231 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.227+0000 7fa9a9fb0640 1 -- 172.21.15.50:0/77503666 wait complete. 2023-12-08T08:21:06.240 INFO:tasks.ceph:Scrubbing osd.6 2023-12-08T08:21:06.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:06.351 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.349+0000 7f14a289b640 1 Processor -- start 2023-12-08T08:21:06.352 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.349+0000 7f14a289b640 1 -- start start 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f14a289b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f149c15d510 0x7f149c15e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f14a289b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f14a289b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c0ce540 con 0x7f149c0cdc00 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f14a289b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c0ce090 con 0x7f149c15d510 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f14a289b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c06b950 con 0x7f149c15eaa0 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f149bfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f149c15d510 0x7f149c15e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f149b7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.354 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f14a0e38640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f149c0cdc00 0x7f149c161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:41056/0 (socket says 172.21.15.50:41056) 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f149bfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f149c15d510 0x7f149c15e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.50:47104/0 (socket says 172.21.15.50:47104) 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f14a0e38640 1 -- 172.21.15.50:0/4072549341 learned_addr learned my addr 172.21.15.50:0/4072549341 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.350+0000 7f149b7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c0cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.50:57352/0 (socket says 172.21.15.50:57352) 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.351+0000 7f149b7fe640 1 -- 172.21.15.50:0/4072549341 >> v2:172.21.15.170:3300/0 conn(0x7f149c15d510 msgr2=0x7f149c15e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.351+0000 7f149b7fe640 1 --2- 172.21.15.50:0/4072549341 >> v2:172.21.15.170:3300/0 conn(0x7f149c15d510 0x7f149c15e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.351+0000 7f149b7fe640 1 -- 172.21.15.50:0/4072549341 >> v1:172.21.15.170:6789/0 conn(0x7f149c0cdc00 legacy=0x7f149c161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.351+0000 7f149b7fe640 1 -- 172.21.15.50:0/4072549341 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c06bc30 con 0x7f149c15eaa0 2023-12-08T08:21:06.355 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.351+0000 7f149b7fe640 1 --2- 172.21.15.50:0/4072549341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c0cd6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f148c0097a0 tx=0x7f148c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113ec68f1bc0e5ad server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.351+0000 7f149affd640 1 -- 172.21.15.50:0/4072549341 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c031830 con 0x7f149c15eaa0 2023-12-08T08:21:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f149affd640 1 -- 172.21.15.50:0/4072549341 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c031990 con 0x7f149c15eaa0 2023-12-08T08:21:06.356 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f149affd640 1 -- 172.21.15.50:0/4072549341 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c031d20 con 0x7f149c15eaa0 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 -- 172.21.15.50:0/4072549341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 msgr2=0x7f149c0cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 --2- 172.21.15.50:0/4072549341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c0cd6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f148c0097a0 tx=0x7f148c02b8d0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 -- 172.21.15.50:0/4072549341 shutdown_connections 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 --2- 172.21.15.50:0/4072549341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c0cd6c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 --2- 172.21.15.50:0/4072549341 >> v2:172.21.15.170:3300/0 conn(0x7f149c15d510 0x7f149c15e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 -- 172.21.15.50:0/4072549341 >> 172.21.15.50:0/4072549341 conn(0x7f149c0d0d90 msgr2=0x7f149c0d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 -- 172.21.15.50:0/4072549341 shutdown_connections 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.352+0000 7f14a289b640 1 -- 172.21.15.50:0/4072549341 wait complete. 2023-12-08T08:21:06.360 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.353+0000 7f14a289b640 1 Processor -- start 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.353+0000 7f14a289b640 1 -- start start 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f14a289b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f149c0cdc00 0x7f149c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f14a289b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149c15d510 0x7f149c1611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f14a289b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f14a289b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c15f7a0 con 0x7f149c0cdc00 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f14a289b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c15f100 con 0x7f149c15d510 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f14a289b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c161d20 con 0x7f149c15eaa0 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f149bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f149c0cdc00 0x7f149c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f149bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f149c0cdc00 0x7f149c1579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53748/0 (socket says 172.21.15.50:53748) 2023-12-08T08:21:06.361 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f149bfff640 1 -- 172.21.15.50:0/3494805034 learned_addr learned my addr 172.21.15.50:0/3494805034 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f149b7fe640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149c15d510 0x7f149c1611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.354+0000 7f14a0e38640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f149bfff640 1 -- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 msgr2=0x7f149c1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f149bfff640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f149c15eaa0 0x7f149c1616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f149bfff640 1 -- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149c15d510 msgr2=0x7f149c1611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f149bfff640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149c15d510 0x7f149c1611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f149bfff640 1 -- 172.21.15.50:0/3494805034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009400 con 0x7f149c0cdc00 2023-12-08T08:21:06.362 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f149bfff640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f149c0cdc00 0x7f149c1579b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f149000e870 tx=0x7f149000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900094f0 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000c940 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c15f3c0 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000ccf0 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.355+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c158470 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.356+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f149c06d2c0 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.356+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1490013470 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.357+0000 7f1498ff9640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f148806ae40 0x7f148806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.357+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1490089570 con 0x7f149c0cdc00 2023-12-08T08:21:06.363 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.357+0000 7f1498ff9640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7f1488071140 0x7f1488073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.357+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 --> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1488073c50 con 0x7f1488071140 2023-12-08T08:21:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.357+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f149008bc30 con 0x7f149c0cdc00 2023-12-08T08:21:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.357+0000 7f149b7fe640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f148806ae40 0x7f148806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.357+0000 7f14a0e38640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7f1488071140 0x7f1488073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.358+0000 7f149b7fe640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f148806ae40 0x7f148806d300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f148c036000 tx=0x7f148c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.364 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.358+0000 7f14a0e38640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7f1488071140 0x7f1488073580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.365 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.358+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== osd.6 v2:172.21.15.170:6800/116888421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1488073c50 con 0x7f1488071140 2023-12-08T08:21:06.373 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.371+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 --> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f149c15fda0 con 0x7f1488071140 2023-12-08T08:21:06.374 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f1498ff9640 1 -- 172.21.15.50:0/3494805034 <== osd.6 v2:172.21.15.170:6800/116888421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1494001cb0 con 0x7f1488071140 2023-12-08T08:21:06.374 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:06.374 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:06.375 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:06.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7f1488071140 msgr2=0x7f1488073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.375 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6800/116888421,v1:172.21.15.170:6801/116888421] conn(0x7f1488071140 0x7f1488073580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f148806ae40 msgr2=0x7f148806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f148806ae40 0x7f148806d300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f148c036000 tx=0x7f148c03c040 comp rx=0 tx=0).stop 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f149c0cdc00 msgr2=0x7f149c1579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 --2- 172.21.15.50:0/3494805034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f149c0cdc00 0x7f149c1579b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f149000e870 tx=0x7f149000ed30 comp rx=0 tx=0).stop 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a0e38640 1 -- 172.21.15.50:0/3494805034 reap_dead start 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 shutdown_connections 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 >> 172.21.15.50:0/3494805034 conn(0x7f149c0d0d90 msgr2=0x7f149c0cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 shutdown_connections 2023-12-08T08:21:06.376 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.372+0000 7f14a289b640 1 -- 172.21.15.50:0/3494805034 wait complete. 2023-12-08T08:21:06.385 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-08T08:21:06.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.489+0000 7feaa770f640 1 Processor -- start 2023-12-08T08:21:06.492 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.489+0000 7feaa770f640 1 -- start start 2023-12-08T08:21:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa770f640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feaa00b0cf0 0x7feaa00d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa770f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b1d70 0x7feaa00cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa770f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa00d20b0 con 0x7feaa01608a0 2023-12-08T08:21:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa770f640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa00d0620 con 0x7feaa00b0cf0 2023-12-08T08:21:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa770f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00d1b80 con 0x7feaa00b1d70 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa4caa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feaa00b0cf0 0x7feaa00d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa4caa640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7feaa00b0cf0 0x7feaa00d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53762/0 (socket says 172.21.15.50:53762) 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.490+0000 7feaa4caa640 1 -- 172.21.15.50:0/4139251913 learned_addr learned my addr 172.21.15.50:0/4139251913 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.491+0000 7feaa4caa640 1 -- 172.21.15.50:0/4139251913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b1d70 msgr2=0x7feaa00cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.491+0000 7feaa5cac640 1 --2- 172.21.15.50:0/4139251913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b1d70 0x7feaa00cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.491+0000 7feaa4caa640 1 --2- 172.21.15.50:0/4139251913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b1d70 0x7feaa00cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.491+0000 7feaa4caa640 1 -- 172.21.15.50:0/4139251913 >> v1:172.21.15.170:6789/0 conn(0x7feaa01608a0 legacy=0x7feaa00d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.494 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.491+0000 7feaa4caa640 1 -- 172.21.15.50:0/4139251913 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00d1dd0 con 0x7feaa00b0cf0 2023-12-08T08:21:06.495 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.491+0000 7feaa5cac640 1 --2- 172.21.15.50:0/4139251913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b1d70 0x7feaa00cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.491+0000 7feaa4caa640 1 --2- 172.21.15.50:0/4139251913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b0cf0 0x7feaa00d1640 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fea94009870 tx=0x7fea9402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a9f4cdaf6c1b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7fea9ffff640 1 -- 172.21.15.50:0/4139251913 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940317c0 con 0x7feaa00b0cf0 2023-12-08T08:21:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7fea9ffff640 1 -- 172.21.15.50:0/4139251913 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94031920 con 0x7feaa00b0cf0 2023-12-08T08:21:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7fea9ffff640 1 -- 172.21.15.50:0/4139251913 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94031cb0 con 0x7feaa00b0cf0 2023-12-08T08:21:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 -- 172.21.15.50:0/4139251913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b0cf0 msgr2=0x7feaa00d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 --2- 172.21.15.50:0/4139251913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b0cf0 0x7feaa00d1640 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fea94009870 tx=0x7fea9402b860 comp rx=0 tx=0).stop 2023-12-08T08:21:06.498 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 -- 172.21.15.50:0/4139251913 shutdown_connections 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 --2- 172.21.15.50:0/4139251913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b1d70 0x7feaa00cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 --2- 172.21.15.50:0/4139251913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b0cf0 0x7feaa00d1640 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 -- 172.21.15.50:0/4139251913 >> 172.21.15.50:0/4139251913 conn(0x7feaa00d3030 msgr2=0x7feaa00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 -- 172.21.15.50:0/4139251913 shutdown_connections 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.492+0000 7feaa770f640 1 -- 172.21.15.50:0/4139251913 wait complete. 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.493+0000 7feaa770f640 1 Processor -- start 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.493+0000 7feaa770f640 1 -- start start 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa770f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b0cf0 0x7feaa00b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.499 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa770f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b1d70 0x7feaa00cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa770f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa01608a0 0x7feaa00ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa770f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00b8a70 con 0x7feaa00b1d70 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa770f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa015bc70 con 0x7feaa01608a0 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa770f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa015bf50 con 0x7feaa00b0cf0 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa4caa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b1d70 0x7feaa00cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa4caa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b1d70 0x7feaa00cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53764/0 (socket says 172.21.15.50:53764) 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa4caa640 1 -- 172.21.15.50:0/170800954 learned_addr learned my addr 172.21.15.50:0/170800954 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa54ab640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b0cf0 0x7feaa00b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.500 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.494+0000 7feaa5cac640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa01608a0 0x7feaa00ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa4caa640 1 -- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b0cf0 msgr2=0x7feaa00b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa4caa640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b0cf0 0x7feaa00b8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa4caa640 1 -- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa01608a0 msgr2=0x7feaa00ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa4caa640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa01608a0 0x7feaa00ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa4caa640 1 -- 172.21.15.50:0/170800954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940094d0 con 0x7feaa00b1d70 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa54ab640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b0cf0 0x7feaa00b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa4caa640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b1d70 0x7feaa00cc8f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fea94009870 tx=0x7fea940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7fea9dffb640 1 -- 172.21.15.50:0/170800954 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94032960 con 0x7feaa00b1d70 2023-12-08T08:21:06.501 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7fea9dffb640 1 -- 172.21.15.50:0/170800954 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94032ac0 con 0x7feaa00b1d70 2023-12-08T08:21:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa015c230 con 0x7feaa00b1d70 2023-12-08T08:21:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7fea9dffb640 1 -- 172.21.15.50:0/170800954 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94032e70 con 0x7feaa00b1d70 2023-12-08T08:21:06.502 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.495+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa015b820 con 0x7feaa00b1d70 2023-12-08T08:21:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.496+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa015c090 con 0x7feaa00b1d70 2023-12-08T08:21:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.496+0000 7fea9dffb640 1 -- 172.21.15.50:0/170800954 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea9404e450 con 0x7feaa00b1d70 2023-12-08T08:21:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.497+0000 7fea9dffb640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea8c06ae40 0x7fea8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.497+0000 7fea9dffb640 1 -- 172.21.15.50:0/170800954 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fea940ab7b0 con 0x7feaa00b1d70 2023-12-08T08:21:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.497+0000 7feaa54ab640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea8c06ae40 0x7fea8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.503 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.498+0000 7feaa54ab640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea8c06ae40 0x7fea8c06d300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fea98006fd0 tx=0x7fea98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.504 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.501+0000 7fea9dffb640 1 -- 172.21.15.50:0/170800954 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feaa015c090 con 0x7feaa00b1d70 2023-12-08T08:21:06.679 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.677+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7feaa0160c80 con 0x7fea8c06ae40 2023-12-08T08:21:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.678+0000 7fea9dffb640 1 -- 172.21.15.50:0/170800954 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fea98009e20 con 0x7fea8c06ae40 2023-12-08T08:21:06.680 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2023-12-08T08:21:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea8c06ae40 msgr2=0x7fea8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.682 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea8c06ae40 0x7fea8c06d300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fea98006fd0 tx=0x7fea98008040 comp rx=0 tx=0).stop 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b1d70 msgr2=0x7feaa00cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b1d70 0x7feaa00cc8f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fea94009870 tx=0x7fea940046c0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 shutdown_connections 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fea8c06ae40 0x7fea8c06d300 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feaa00b1d70 0x7feaa00cc8f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa01608a0 0x7feaa00ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 --2- 172.21.15.50:0/170800954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feaa00b0cf0 0x7feaa00b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.683 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 >> 172.21.15.50:0/170800954 conn(0x7feaa00d3030 msgr2=0x7feaa00ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 shutdown_connections 2023-12-08T08:21:06.684 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.680+0000 7feaa770f640 1 -- 172.21.15.50:0/170800954 wait complete. 2023-12-08T08:21:06.692 INFO:tasks.ceph:Scrubbing osd.7 2023-12-08T08:21:06.693 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-08T08:21:06.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.800+0000 7fdb2f3dc640 1 Processor -- start 2023-12-08T08:21:06.803 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.801+0000 7fdb2f3dc640 1 -- start start 2023-12-08T08:21:06.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.801+0000 7fdb2f3dc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdb280cf950 0x7fdb280d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.801+0000 7fdb2f3dc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cfd30 0x7fdb2815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.801+0000 7fdb2f3dc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb280ce900 con 0x7fdb280d1d00 2023-12-08T08:21:06.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.801+0000 7fdb2f3dc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb280cdae0 con 0x7fdb280cf950 2023-12-08T08:21:06.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.801+0000 7fdb2f3dc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2806bfd0 con 0x7fdb280cfd30 2023-12-08T08:21:06.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2d979640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cfd30 0x7fdb2815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.805 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2d178640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdb280cf950 0x7fdb280d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2c977640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fdb280d1d00 0x7fdb2806c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.50:41072/0 (socket says 172.21.15.50:41072) 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2c977640 1 -- 172.21.15.50:0/556032673 learned_addr learned my addr 172.21.15.50:0/556032673 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb27fff640 1 -- 172.21.15.50:0/556032673 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655413548 0 0) 0x7fdb280ce900 con 0x7fdb280d1d00 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb27fff640 1 -- 172.21.15.50:0/556032673 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb10003520 con 0x7fdb280d1d00 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2d979640 1 -- 172.21.15.50:0/556032673 >> v2:172.21.15.170:3300/0 conn(0x7fdb280cf950 msgr2=0x7fdb280d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2d979640 1 --2- 172.21.15.50:0/556032673 >> v2:172.21.15.170:3300/0 conn(0x7fdb280cf950 0x7fdb280d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2d979640 1 -- 172.21.15.50:0/556032673 >> v1:172.21.15.170:6789/0 conn(0x7fdb280d1d00 legacy=0x7fdb2806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.806 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.802+0000 7fdb2d979640 1 -- 172.21.15.50:0/556032673 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb280cdcf0 con 0x7fdb280cfd30 2023-12-08T08:21:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.803+0000 7fdb2d979640 1 --2- 172.21.15.50:0/556032673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cfd30 0x7fdb2815cc20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009d90 tx=0x7fdb1802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b27aa251d885a5f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.803+0000 7fdb27fff640 1 -- 172.21.15.50:0/556032673 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1802cc50 con 0x7fdb280cfd30 2023-12-08T08:21:06.810 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.803+0000 7fdb27fff640 1 -- 172.21.15.50:0/556032673 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1802cdb0 con 0x7fdb280cfd30 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.803+0000 7fdb27fff640 1 -- 172.21.15.50:0/556032673 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18034640 con 0x7fdb280cfd30 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/556032673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cfd30 msgr2=0x7fdb2815cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 --2- 172.21.15.50:0/556032673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cfd30 0x7fdb2815cc20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009d90 tx=0x7fdb1802bea0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/556032673 shutdown_connections 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 --2- 172.21.15.50:0/556032673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cfd30 0x7fdb2815cc20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 --2- 172.21.15.50:0/556032673 >> v2:172.21.15.170:3300/0 conn(0x7fdb280cf950 0x7fdb280d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/556032673 >> 172.21.15.50:0/556032673 conn(0x7fdb2809c2f0 msgr2=0x7fdb280d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/556032673 shutdown_connections 2023-12-08T08:21:06.811 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.804+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/556032673 wait complete. 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.805+0000 7fdb2f3dc640 1 Processor -- start 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.805+0000 7fdb2f3dc640 1 -- start start 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2f3dc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cf950 0x7fdb280b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2f3dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb280cfd30 0x7fdb280b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2f3dc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb280d1d00 0x7fdb280b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2f3dc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280b7e10 con 0x7fdb280cfd30 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2f3dc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280cbfb0 con 0x7fdb280d1d00 2023-12-08T08:21:06.812 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2f3dc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280cc270 con 0x7fdb280cf950 2023-12-08T08:21:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb280cfd30 0x7fdb280b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb280cfd30 0x7fdb280b81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53770/0 (socket says 172.21.15.50:53770) 2023-12-08T08:21:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 -- 172.21.15.50:0/3376589085 learned_addr learned my addr 172.21.15.50:0/3376589085 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2d178640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cf950 0x7fdb280b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2d979640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb280d1d00 0x7fdb280b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 -- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cf950 msgr2=0x7fdb280b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.813 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb280cf950 0x7fdb280b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 -- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb280d1d00 msgr2=0x7fdb280b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb280d1d00 0x7fdb280b86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2c977640 1 -- 172.21.15.50:0/3376589085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18009a70 con 0x7fdb280cfd30 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.806+0000 7fdb2d979640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb280d1d00 0x7fdb280b86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.807+0000 7fdb2c977640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb280cfd30 0x7fdb280b81a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00c390 tx=0x7fdb1c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.807+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c005ce0 con 0x7fdb280cfd30 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.807+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c005e40 con 0x7fdb280cfd30 2023-12-08T08:21:06.814 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.807+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb280cc550 con 0x7fdb280cfd30 2023-12-08T08:21:06.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.807+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0072f0 con 0x7fdb280cfd30 2023-12-08T08:21:06.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.807+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb280ccb10 con 0x7fdb280cfd30 2023-12-08T08:21:06.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.808+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb280ce590 con 0x7fdb280cfd30 2023-12-08T08:21:06.815 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.808+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb1c007450 con 0x7fdb280cfd30 2023-12-08T08:21:06.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.808+0000 7fdb25ffb640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb1406ae40 0x7fdb1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdb1c088a00 con 0x7fdb280cfd30 2023-12-08T08:21:06.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb25ffb640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7fdb14071140 0x7fdb14073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.816 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb2d178640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb1406ae40 0x7fdb1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 --> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb14073c50 con 0x7fdb14071140 2023-12-08T08:21:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb1c08d2c0 con 0x7fdb280cfd30 2023-12-08T08:21:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb2d979640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7fdb14071140 0x7fdb14073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb2d178640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb1406ae40 0x7fdb1406d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009b40 tx=0x7fdb20009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.809+0000 7fdb2d979640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7fdb14071140 0x7fdb14073580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.817 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.810+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== osd.7 v2:172.21.15.170:6808/2618727353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdb14073c50 con 0x7fdb14071140 2023-12-08T08:21:06.825 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.823+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 --> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdb280ce2b0 con 0x7fdb14071140 2023-12-08T08:21:06.826 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb25ffb640 1 -- 172.21.15.50:0/3376589085 <== osd.7 v2:172.21.15.170:6808/2618727353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdb18034540 con 0x7fdb14071140 2023-12-08T08:21:06.831 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2023-12-08T08:21:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-08T08:21:06.831 INFO:teuthology.orchestra.run.smithi050.stdout:} 2023-12-08T08:21:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7fdb14071140 msgr2=0x7fdb14073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6808/2618727353,v1:172.21.15.170:6809/2618727353] conn(0x7fdb14071140 0x7fdb14073580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb1406ae40 msgr2=0x7fdb1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.832 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fdb1406ae40 0x7fdb1406d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009b40 tx=0x7fdb20009190 comp rx=0 tx=0).stop 2023-12-08T08:21:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb280cfd30 msgr2=0x7fdb280b81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 --2- 172.21.15.50:0/3376589085 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdb280cfd30 0x7fdb280b81a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00c390 tx=0x7fdb1c00c850 comp rx=0 tx=0).stop 2023-12-08T08:21:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2d979640 1 -- 172.21.15.50:0/3376589085 reap_dead start 2023-12-08T08:21:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 shutdown_connections 2023-12-08T08:21:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 >> 172.21.15.50:0/3376589085 conn(0x7fdb2809c2f0 msgr2=0x7fdb280d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 shutdown_connections 2023-12-08T08:21:06.833 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.824+0000 7fdb2f3dc640 1 -- 172.21.15.50:0/3376589085 wait complete. 2023-12-08T08:21:06.836 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-08T08:21:06.944 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.942+0000 7f537630c640 1 Processor -- start 2023-12-08T08:21:06.945 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.942+0000 7f537630c640 1 -- start start 2023-12-08T08:21:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f537630c640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53700ccd70 0x7f53700ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.946 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f537630c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f53700cf1e0 0x7f537006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f537630c640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537006c8f0 con 0x7f537006c480 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f537630c640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53700d0a60 con 0x7f53700ccd70 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f537630c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53700ce7b0 con 0x7f53700cf1e0 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f536ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53700ccd70 0x7f53700ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f53748a9640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f537006c480 0x7f537015ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53876/0 (socket says 172.21.15.50:53876) 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f53748a9640 1 -- 172.21.15.50:0/3200902791 learned_addr learned my addr 172.21.15.50:0/3200902791 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f536ffff640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f53700ccd70 0x7f53700ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53786/0 (socket says 172.21.15.50:53786) 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f536f7fe640 1 --2- 172.21.15.50:0/3200902791 >> v2:172.21.15.170:3300/0 conn(0x7f53700cf1e0 0x7f537006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.947 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f536ffff640 1 -- 172.21.15.50:0/3200902791 >> v2:172.21.15.170:3300/0 conn(0x7f53700cf1e0 msgr2=0x7f537006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f536ffff640 1 --2- 172.21.15.50:0/3200902791 >> v2:172.21.15.170:3300/0 conn(0x7f53700cf1e0 0x7f537006bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f536ffff640 1 -- 172.21.15.50:0/3200902791 >> v1:172.21.15.50:6789/0 conn(0x7f537006c480 legacy=0x7f537015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.943+0000 7f536ffff640 1 -- 172.21.15.50:0/3200902791 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700cf9c0 con 0x7f53700ccd70 2023-12-08T08:21:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.944+0000 7f536ffff640 1 --2- 172.21.15.50:0/3200902791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53700ccd70 0x7f53700ce270 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5370071310 tx=0x7f536002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16411d51c0d69a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.944+0000 7f536effd640 1 -- 172.21.15.50:0/3200902791 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360031830 con 0x7f53700ccd70 2023-12-08T08:21:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.944+0000 7f536effd640 1 -- 172.21.15.50:0/3200902791 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5360031990 con 0x7f53700ccd70 2023-12-08T08:21:06.948 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.944+0000 7f536effd640 1 -- 172.21.15.50:0/3200902791 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360031d20 con 0x7f53700ccd70 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 -- 172.21.15.50:0/3200902791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53700ccd70 msgr2=0x7f53700ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 --2- 172.21.15.50:0/3200902791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53700ccd70 0x7f53700ce270 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5370071310 tx=0x7f536002b8d0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 -- 172.21.15.50:0/3200902791 shutdown_connections 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 --2- 172.21.15.50:0/3200902791 >> v2:172.21.15.170:3300/0 conn(0x7f53700cf1e0 0x7f537006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 --2- 172.21.15.50:0/3200902791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f53700ccd70 0x7f53700ce270 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 -- 172.21.15.50:0/3200902791 >> 172.21.15.50:0/3200902791 conn(0x7f53700d0de0 msgr2=0x7f53700d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 -- 172.21.15.50:0/3200902791 shutdown_connections 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.945+0000 7f537630c640 1 -- 172.21.15.50:0/3200902791 wait complete. 2023-12-08T08:21:06.951 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.946+0000 7f537630c640 1 Processor -- start 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.946+0000 7f537630c640 1 -- start start 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f537630c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537006c480 0x7f5370156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f537630c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53700ccd70 0x7f53700ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f537630c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53700cf1e0 0x7f5370144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f537630c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700cadf0 con 0x7f537006c480 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f537630c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5370147c40 con 0x7f53700ccd70 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f537630c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5370147f20 con 0x7f53700cf1e0 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537006c480 0x7f5370156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.952 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537006c480 0x7f5370156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53788/0 (socket says 172.21.15.50:53788) 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 -- 172.21.15.50:0/3572754647 learned_addr learned my addr 172.21.15.50:0/3572754647 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 -- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53700cf1e0 msgr2=0x7f5370144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53700cf1e0 0x7f5370144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 -- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53700ccd70 msgr2=0x7f53700ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53700ccd70 0x7f53700ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 -- 172.21.15.50:0/3572754647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360009400 con 0x7f537006c480 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.947+0000 7f536ffff640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537006c480 0x7f5370156130 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f5360000c00 tx=0x7f53600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.948+0000 7f536cff9640 1 -- 172.21.15.50:0/3572754647 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53600317d0 con 0x7f537006c480 2023-12-08T08:21:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.948+0000 7f536cff9640 1 -- 172.21.15.50:0/3572754647 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536003ba70 con 0x7f537006c480 2023-12-08T08:21:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.948+0000 7f536cff9640 1 -- 172.21.15.50:0/3572754647 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536003be20 con 0x7f537006c480 2023-12-08T08:21:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.948+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5370157e50 con 0x7f537006c480 2023-12-08T08:21:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.948+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5370157b00 con 0x7f537006c480 2023-12-08T08:21:06.954 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.949+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370158370 con 0x7f537006c480 2023-12-08T08:21:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.949+0000 7f536cff9640 1 -- 172.21.15.50:0/3572754647 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53600453f0 con 0x7f537006c480 2023-12-08T08:21:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.950+0000 7f536cff9640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f535006ae40 0x7f535006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.950+0000 7f536cff9640 1 -- 172.21.15.50:0/3572754647 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f53600ab6c0 con 0x7f537006c480 2023-12-08T08:21:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.950+0000 7f536f7fe640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f535006ae40 0x7f535006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:06.955 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.950+0000 7f536f7fe640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f535006ae40 0x7f535006d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f5358008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:06.956 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:06.954+0000 7f536cff9640 1 -- 172.21.15.50:0/3572754647 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5370158370 con 0x7f537006c480 2023-12-08T08:21:07.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.130+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f53700cd150 con 0x7f535006ae40 2023-12-08T08:21:07.133 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.132+0000 7f536cff9640 1 -- 172.21.15.50:0/3572754647 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f53700cd150 con 0x7f535006ae40 2023-12-08T08:21:07.133 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2023-12-08T08:21:07.135 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f535006ae40 msgr2=0x7f535006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f535006ae40 0x7f535006d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f5358008040 comp rx=0 tx=0).stop 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537006c480 msgr2=0x7f5370156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537006c480 0x7f5370156130 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f5360000c00 tx=0x7f53600046c0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 shutdown_connections 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f535006ae40 0x7f535006d300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53700cf1e0 0x7f5370144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53700ccd70 0x7f53700ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.136 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 --2- 172.21.15.50:0/3572754647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f537006c480 0x7f5370156130 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 >> 172.21.15.50:0/3572754647 conn(0x7f53700d0de0 msgr2=0x7f53700b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:07.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 shutdown_connections 2023-12-08T08:21:07.137 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.133+0000 7f537630c640 1 -- 172.21.15.50:0/3572754647 wait complete. 2023-12-08T08:21:07.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.249+0000 7f192bdc9640 1 Processor -- start 2023-12-08T08:21:07.252 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.250+0000 7f192bdc9640 1 -- start start 2023-12-08T08:21:07.255 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.250+0000 7f192bdc9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 0x7f19240d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.250+0000 7f192bdc9640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240d20b0 con 0x7f19240b0cf0 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.250+0000 7f192bdc9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240d1b80 con 0x7f19240b1d70 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.250+0000 7f192bdc9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240d0620 con 0x7f19241608a0 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.250+0000 7f192a366640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f19240b0cf0 0x7f19240cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:53878/0 (socket says 172.21.15.50:53878) 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.250+0000 7f192a366640 1 -- 172.21.15.50:0/1314280309 learned_addr learned my addr 172.21.15.50:0/1314280309 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1929b65640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 0x7f19240d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970122911 0 0) 0x7f19240d20b0 con 0x7f19240b0cf0 2023-12-08T08:21:07.256 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f190c003520 con 0x7f19240b0cf0 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1413825415 0 0) 0x7f190c003520 con 0x7f19240b0cf0 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 msgr2=0x7f19240d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 0x7f19240d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 >> v1:172.21.15.170:6789/0 conn(0x7f19240b1d70 legacy=0x7f19240d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 --> v1:172.21.15.50:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240d1dd0 con 0x7f19240b0cf0 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 <== mon.0 v1:172.21.15.50:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1003700356 0 0) 0x7f191c001670 con 0x7f19240b0cf0 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 >> v1:172.21.15.50:6789/0 conn(0x7f19240b0cf0 legacy=0x7f19240cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 0x7f190c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.257 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f190c003ee0 0x7f190c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c004d00 0x7f190c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240d0620 con 0x7f190c004d00 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c00ba90 con 0x7f190c003ee0 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190c00bc50 con 0x7f19241608a0 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f192a366640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c004d00 0x7f190c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1929b65640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 0x7f190c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.251+0000 7f1929364640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f190c003ee0 0x7f190c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.252+0000 7f192a366640 1 -- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 msgr2=0x7f190c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:07.258 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.252+0000 7f192a366640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19241608a0 0x7f190c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.252+0000 7f192a366640 1 -- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f190c003ee0 msgr2=0x7f190c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.252+0000 7f192a366640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f190c003ee0 0x7f190c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.252+0000 7f192a366640 1 -- 172.21.15.50:0/1314280309 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c003520 con 0x7f190c004d00 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.252+0000 7f192a366640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c004d00 0x7f190c005180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c210 tx=0x7f190c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7bd8749990e32e server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c005ad0 con 0x7f190c004d00 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c005c30 con 0x7f190c004d00 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f1928b63640 1 -- 172.21.15.50:0/1314280309 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c02c870 con 0x7f190c004d00 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f192bdc9640 1 -- 172.21.15.50:0/1314280309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c004d00 msgr2=0x7f190c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.259 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f192bdc9640 1 --2- 172.21.15.50:0/1314280309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f190c004d00 0x7f190c005180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c210 tx=0x7f190c0057f0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f192a366640 1 -- 172.21.15.50:0/1314280309 reap_dead start 2023-12-08T08:21:07.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f192bdc9640 1 -- 172.21.15.50:0/1314280309 shutdown_connections 2023-12-08T08:21:07.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f192bdc9640 1 -- 172.21.15.50:0/1314280309 >> 172.21.15.50:0/1314280309 conn(0x7f19240d3030 msgr2=0x7f19240d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:07.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f192bdc9640 1 -- 172.21.15.50:0/1314280309 shutdown_connections 2023-12-08T08:21:07.260 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.253+0000 7f192bdc9640 1 -- 172.21.15.50:0/1314280309 wait complete. 2023-12-08T08:21:07.262 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.254+0000 7f192bdc9640 1 Processor -- start 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.254+0000 7f192bdc9640 1 -- start start 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f192bdc9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f192415c160 0x7f19240c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f192bdc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19240b5c20 0x7f19240cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f192bdc9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19240cc860 0x7f192414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f192bdc9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192414cf60 con 0x7f19240b5c20 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f192bdc9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b6080 con 0x7f19240cc860 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f192bdc9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240cb280 con 0x7f192415c160 2023-12-08T08:21:07.263 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19240b5c20 0x7f19240cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19240b5c20 0x7f19240cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53796/0 (socket says 172.21.15.50:53796) 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 -- 172.21.15.50:0/1724216552 learned_addr learned my addr 172.21.15.50:0/1724216552 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929b65640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f192415c160 0x7f19240c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 -- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f192415c160 msgr2=0x7f19240c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f192415c160 0x7f19240c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f192a366640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19240cc860 0x7f192414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 -- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19240cc860 msgr2=0x7f192414d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19240cc860 0x7f192414d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.255+0000 7f1929364640 1 -- 172.21.15.50:0/1724216552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240cb560 con 0x7f19240b5c20 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.256+0000 7f1929b65640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f192415c160 0x7f19240c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.256+0000 7f1929364640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19240b5c20 0x7f19240cc320 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f191800f7c0 tx=0x7f191800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.256+0000 7f19227fc640 1 -- 172.21.15.50:0/1724216552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800fed0 con 0x7f19240b5c20 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.256+0000 7f19227fc640 1 -- 172.21.15.50:0/1724216552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19180052e0 con 0x7f19240b5c20 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.256+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19240cb840 con 0x7f19240b5c20 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.256+0000 7f19227fc640 1 -- 172.21.15.50:0/1724216552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191800d970 con 0x7f19240b5c20 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.256+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19240cbe00 con 0x7f19240b5c20 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.257+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1924067430 con 0x7f19240b5c20 2023-12-08T08:21:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.257+0000 7f19227fc640 1 -- 172.21.15.50:0/1724216552 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f191800dad0 con 0x7f19240b5c20 2023-12-08T08:21:07.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.258+0000 7f19227fc640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f191006ae40 0x7f191006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:07.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.258+0000 7f19227fc640 1 -- 172.21.15.50:0/1724216552 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1918089530 con 0x7f19240b5c20 2023-12-08T08:21:07.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.258+0000 7f1929b65640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f191006ae40 0x7f191006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:07.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.258+0000 7f1929b65640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f191006ae40 0x7f191006d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1914007440 tx=0x7f191400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:07.266 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.262+0000 7f19227fc640 1 -- 172.21.15.50:0/1724216552 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19180547a0 con 0x7f19240b5c20 2023-12-08T08:21:07.434 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.432+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1924160c80 con 0x7f191006ae40 2023-12-08T08:21:07.437 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.435+0000 7f19227fc640 1 -- 172.21.15.50:0/1724216552 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51171 (secure 0 0 0) 0x7f191400f040 con 0x7f191006ae40 2023-12-08T08:21:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:21:07.438 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:21:07.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f191006ae40 msgr2=0x7f191006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f191006ae40 0x7f191006d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1914007440 tx=0x7f191400b040 comp rx=0 tx=0).stop 2023-12-08T08:21:07.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19240b5c20 msgr2=0x7f19240cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:07.439 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19240b5c20 0x7f19240cc320 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f191800f7c0 tx=0x7f191800fc80 comp rx=0 tx=0).stop 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 shutdown_connections 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f191006ae40 0x7f191006d300 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19240b5c20 0x7f19240cc320 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19240cc860 0x7f192414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 --2- 172.21.15.50:0/1724216552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f192415c160 0x7f19240c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 >> 172.21.15.50:0/1724216552 conn(0x7f19240d3030 msgr2=0x7f19240cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 shutdown_connections 2023-12-08T08:21:07.440 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:07.437+0000 7f192bdc9640 1 -- 172.21.15.50:0/1724216552 wait complete. 2023-12-08T08:21:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-12-08T08:21:06.161341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":256228,"kb_used_data":6756,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718492,"statfs":{"total":773094113280,"available":772831735808,"internally_reserved":0,"allocated":6918144,"data_stored":3748517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14927,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-65,"num_write_kb":-38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001659"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-08T08:20:58.375088+0000","last_change":"2023-12-08T08:17:46.156220+0000","last_active":"2023-12-08T08:20:58.375088+0000","last_peered":"2023-12-08T08:20:58.375088+0000","last_clean":"2023-12-08T08:20:58.375088+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:20:58.375088+0000","last_undegraded":"2023-12-08T08:20:58.375088+0000","last_fullsized":"2023-12-08T08:20:58.375088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-08T08:17:44.572416+0000","last_clean_scrub_stamp":"2023-12-08T08:17:44.572416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T11:05:14.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1310720,"data_stored":911468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70599999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.748},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.58399999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.44700000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.623}]},{"osd":4,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.48399999999999999,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63400000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64000000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.68400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66900000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70799999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74399999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.64900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56200000000000006}]},{"osd":4,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.436}]},{"osd":5,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68500000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66700000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.39300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.62},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.498},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71099999999999997,"5min":0.745,"15min":0.745},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.41699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68700000000000006}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.442,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":0.88,"15min":0.88},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80400000000000005,"5min":1.022,"15min":1.022},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67000000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.436},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39300000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76800000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.32100000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.499,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.253},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.32500000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":0.623,"15min":0.623},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63600000000000001,"5min":0.751,"15min":0.751},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.377}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.33700000000000002},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.247,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58999999999999997,"5min":0.623,"15min":0.623},"last":0.373}]},{"osd":3,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.48899999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.307}]},{"osd":4,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88700000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.437}]},{"osd":5,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.876,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.502,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.441},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.437,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.378,"15min":0.377},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.379},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1306624,"data_stored":910449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.223,"5min":0.217,"15min":0.217},"max":{"1min":0.50800000000000001,"5min":0.628,"15min":0.628},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.48799999999999999,"15min":0.53100000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56899999999999995,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.622,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.75},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.89900000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.95499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:07.453 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-08T08:17:44.572416+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=8, tm_min=17, tm_sec=44, tm_wday=4, tm_yday=342, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=8, tm_hour=8, tm_min=21, tm_sec=2, tm_wday=4, tm_yday=342, tm_isdst=0) 2023-12-08T08:21:07.453 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-08T08:21:25.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:25.014 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:27.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-08T08:21:27.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.571+0000 7ffbb5e87640 1 Processor -- start 2023-12-08T08:21:27.574 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.571+0000 7ffbb5e87640 1 -- start start 2023-12-08T08:21:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.572+0000 7ffbb5e87640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00b3340 0x7ffbb00d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.572+0000 7ffbb5e87640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb00cdc20 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.572+0000 7ffbb5e87640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb00d11d0 con 0x7ffbb00d1d00 2023-12-08T08:21:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.572+0000 7ffbb5e87640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb00d3a60 con 0x7ffbb00b3340 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.572+0000 7ffbaeffd640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ffbb00b3bf0 0x7ffbb00d15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57538/0 (socket says 172.21.15.50:57538) 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.572+0000 7ffbaeffd640 1 -- 172.21.15.50:0/3586651981 learned_addr learned my addr 172.21.15.50:0/3586651981 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbaf7fe640 1 --2- 172.21.15.50:0/3586651981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00b3340 0x7ffbb00d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988945348 0 0) 0x7ffbb00cdc20 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb98003520 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776826273 0 0) 0x7ffbb00d11d0 con 0x7ffbb00d1d00 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb00cdc20 con 0x7ffbb00d1d00 2023-12-08T08:21:27.577 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 <== mon.0 v1:172.21.15.50:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2786177825 0 0) 0x7ffb98003520 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbaf7fe640 1 -- 172.21.15.50:0/3586651981 >> v1:172.21.15.170:6789/0 conn(0x7ffbb00d1d00 legacy=0x7ffbb00ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbaf7fe640 1 -- 172.21.15.50:0/3586651981 >> v1:172.21.15.50:6789/0 conn(0x7ffbb00b3bf0 legacy=0x7ffbb00d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.573+0000 7ffbaf7fe640 1 -- 172.21.15.50:0/3586651981 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00d3d40 con 0x7ffbb00b3340 2023-12-08T08:21:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.574+0000 7ffbaf7fe640 1 --2- 172.21.15.50:0/3586651981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00b3340 0x7ffbb00d00c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffba00097d0 tx=0x7ffba002b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70031cd378a84ac7 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.574+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4001670 con 0x7ffbb00b3340 2023-12-08T08:21:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.574+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba002e050 con 0x7ffbb00b3340 2023-12-08T08:21:27.578 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.574+0000 7ffbae7fc640 1 -- 172.21.15.50:0/3586651981 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0030730 con 0x7ffbb00b3340 2023-12-08T08:21:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.575+0000 7ffbb5e87640 1 -- 172.21.15.50:0/3586651981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00b3340 msgr2=0x7ffbb00d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.575+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/3586651981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00b3340 0x7ffbb00d00c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffba00097d0 tx=0x7ffba002b770 comp rx=0 tx=0).stop 2023-12-08T08:21:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.575+0000 7ffbb5e87640 1 -- 172.21.15.50:0/3586651981 shutdown_connections 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.575+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/3586651981 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00b3340 0x7ffbb00d00c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.575+0000 7ffbb5e87640 1 -- 172.21.15.50:0/3586651981 >> 172.21.15.50:0/3586651981 conn(0x7ffbb009c2f0 msgr2=0x7ffbb00d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.575+0000 7ffbb5e87640 1 -- 172.21.15.50:0/3586651981 shutdown_connections 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.575+0000 7ffbb5e87640 1 -- 172.21.15.50:0/3586651981 wait complete. 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.576+0000 7ffbb5e87640 1 Processor -- start 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.576+0000 7ffbb5e87640 1 -- start start 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbb5e87640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb00b3340 0x7ffbb014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.582 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbb5e87640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb00b3bf0 0x7ffbb009cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbb5e87640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00d1d00 0x7ffbb014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbb5e87640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb014c530 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbb5e87640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb009d1a0 con 0x7ffbb00b3340 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbb5e87640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb014c7a0 con 0x7ffbb00d1d00 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb00b3bf0 0x7ffbb009cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb00b3bf0 0x7ffbb009cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46756/0 (socket says 172.21.15.50:46756) 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 -- 172.21.15.50:0/2943941018 learned_addr learned my addr 172.21.15.50:0/2943941018 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaffff640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00d1d00 0x7ffbb014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.583 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaf7fe640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb00b3340 0x7ffbb014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 -- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00d1d00 msgr2=0x7ffbb014e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00d1d00 0x7ffbb014e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 -- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb00b3340 msgr2=0x7ffbb014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb00b3340 0x7ffbb014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaeffd640 1 -- 172.21.15.50:0/2943941018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0009400 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.577+0000 7ffbaf7fe640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb00b3340 0x7ffbb014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.578+0000 7ffbaeffd640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb00b3bf0 0x7ffbb009cc60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c730 tx=0x7ffba400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.578+0000 7ffb97fff640 1 -- 172.21.15.50:0/2943941018 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4005ad0 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.578+0000 7ffb97fff640 1 -- 172.21.15.50:0/2943941018 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4005c30 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.584 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.578+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb014d040 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.578+0000 7ffb97fff640 1 -- 172.21.15.50:0/2943941018 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4007070 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.578+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb014c9f0 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.585 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.579+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb014d1d0 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.579+0000 7ffb97fff640 1 -- 172.21.15.50:0/2943941018 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffba40071d0 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.580+0000 7ffb97fff640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb9c06ae70 0x7ffb9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.580+0000 7ffb97fff640 1 -- 172.21.15.50:0/2943941018 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ffba4088ac0 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.580+0000 7ffbaf7fe640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb9c06ae70 0x7ffb9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.581+0000 7ffbaf7fe640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb9c06ae70 0x7ffb9c06d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffba0034000 tx=0x7ffba0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.586 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.584+0000 7ffb97fff640 1 -- 172.21.15.50:0/2943941018 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffba4053cd0 con 0x7ffbb00b3bf0 2023-12-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.756+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 --> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbb00b3720 con 0x7ffb9c06ae70 2023-12-08T08:21:27.761 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.759+0000 7ffb97fff640 1 -- 172.21.15.50:0/2943941018 <== mgr.4105 v2:172.21.15.170:6832/374285324 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51062 (secure 0 0 0) 0x7ffba0040070 con 0x7ffb9c06ae70 2023-12-08T08:21:27.762 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:21:27.762 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb9c06ae70 msgr2=0x7ffb9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb9c06ae70 0x7ffb9c06d330 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffba0034000 tx=0x7ffba0008030 comp rx=0 tx=0).stop 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb00b3bf0 msgr2=0x7ffbb009cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb00b3bf0 0x7ffbb009cc60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ffba400c730 tx=0x7ffba400cbf0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 shutdown_connections 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7ffb9c06ae70 0x7ffb9c06d330 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffbb00b3bf0 0x7ffbb009cc60 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbb00d1d00 0x7ffbb014e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 --2- 172.21.15.50:0/2943941018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb00b3340 0x7ffbb014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 >> 172.21.15.50:0/2943941018 conn(0x7ffbb009c2f0 msgr2=0x7ffbb00b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:27.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 shutdown_connections 2023-12-08T08:21:27.765 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.761+0000 7ffbb5e87640 1 -- 172.21.15.50:0/2943941018 wait complete. 2023-12-08T08:21:27.774 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-12-08T08:21:26.165345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":256212,"kb_used_data":6756,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754718508,"statfs":{"total":773094113280,"available":772831752192,"internally_reserved":0,"allocated":6918144,"data_stored":3748517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002251"},"pg_stats":[{"pgid":"1.0","version":"59'119","reported_seq":216,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-12-08T08:21:09.002828+0000","last_change":"2023-12-08T08:21:09.002863+0000","last_active":"2023-12-08T08:21:09.002828+0000","last_peered":"2023-12-08T08:21:09.002828+0000","last_clean":"2023-12-08T08:21:09.002828+0000","last_became_active":"2023-12-08T08:17:46.155172+0000","last_became_peered":"2023-12-08T08:17:46.155172+0000","last_unstale":"2023-12-08T08:21:09.002828+0000","last_undegraded":"2023-12-08T08:21:09.002828+0000","last_fullsized":"2023-12-08T08:21:09.002828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'119","last_scrub_stamp":"2023-12-08T08:21:09.002740+0000","last_deep_scrub":"59'119","last_deep_scrub_stamp":"2023-12-08T08:21:09.002740+0000","last_clean_scrub_stamp":"2023-12-08T08:21:09.002740+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T13:39:24.744616+0000","scrub_duration":0.004268226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1310720,"data_stored":911468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.41299999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70599999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.44700000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.48399999999999999,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63400000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.629},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.66400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.375,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64000000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72799999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.69399999999999995}]},{"osd":6,"last update":"Fri Dec 8 08:20:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.69999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.37,"15min":0.37},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.497}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73399999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54900000000000004},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79100000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.66900000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.42199999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70799999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59099999999999997,"15min":0.59499999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72799999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.59299999999999997},"min":{"1min":0.377,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74399999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.64900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72799999999999998,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.307},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68799999999999994,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34200000000000003}]},{"osd":5,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.35599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68500000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.443},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.372}]},{"osd":7,"last update":"Fri Dec 8 08:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.66700000000000004,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.39300000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.80200000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.50900000000000001},"min":{"1min":0.36299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.498},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71099999999999997,"5min":0.745,"15min":0.745},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.41699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.442,"15min":0.42899999999999999},"min":{"1min":0.32000000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.379,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.754,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.81699999999999995,"5min":0.88,"15min":0.88},"last":0.40699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68100000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47599999999999998}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80400000000000005,"5min":1.022,"15min":1.022},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.41199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67000000000000004,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.432}]},{"osd":3,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.313,"15min":0.313},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33400000000000002}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.35199999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76800000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.41699999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.376,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.443},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.499,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.443}]},{"osd":1,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.44400000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.62,"5min":0.623,"15min":0.623},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.45000000000000001,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63600000000000001,"5min":0.751,"15min":0.751},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.432,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Dec 8 08:20:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.441,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.33700000000000002},"min":{"1min":0.26800000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.40799999999999997},"min":{"1min":0.307,"5min":0.247,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.436},{"interface":"front","average":{"1min":0.38,"5min":0.36099999999999999,"15min":0.35499999999999998},"min":{"1min":0.27300000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58999999999999997,"5min":0.623,"15min":0.623},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.30499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.48899999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.377}]},{"osd":4,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.503},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88700000000000001,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.56999999999999995},"min":{"1min":0.39600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Fri Dec 8 08:20:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61499999999999999,"15min":0.60699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.876,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":321100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.502,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39600000000000002,"15min":0.40500000000000003},"min":{"1min":0.28199999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.53400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34100000000000003,"15min":0.34899999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.437,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.499},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.378,"15min":0.377},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.627},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.377,"15min":0.379},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.60399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40600000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.36799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79500000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.623,"15min":0.63400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84599999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63600000000000001,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.74299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1306624,"data_stored":910449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.223,"5min":0.217,"15min":0.217},"max":{"1min":0.50800000000000001,"5min":0.628,"15min":0.628},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.376,"15min":0.36799999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.53200000000000003,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.372}]},{"osd":2,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.59499999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64000000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.48799999999999999,"15min":0.53100000000000003},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56899999999999995,"5min":2.8100000000000001,"15min":2.8100000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.622,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.436}]},{"osd":4,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61499999999999999,"15min":0.623},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38900000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.89900000000000002,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Dec 8 08:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.95499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-08T08:21:27.776 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-08T08:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.880+0000 7fcca86b2640 1 Processor -- start 2023-12-08T08:21:27.883 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.880+0000 7fcca86b2640 1 -- start start 2023-12-08T08:21:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca86b2640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcca00cfa30 0x7fcca00b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca86b2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcca00cfe10 0x7fcca00cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.884 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca86b2640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00c6be0 con 0x7fcca00b4150 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca86b2640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00d3ff0 con 0x7fcca00cfa30 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca86b2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00b4860 con 0x7fcca00cfe10 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca644e640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fcca00cfa30 0x7fcca00b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca5c4d640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fcca00b4150 0x7fcca00b3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57552/0 (socket says 172.21.15.50:57552) 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.881+0000 7fcca5c4d640 1 -- 172.21.15.50:0/3487629766 learned_addr learned my addr 172.21.15.50:0/3487629766 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.882+0000 7fcca6c4f640 1 --2- 172.21.15.50:0/3487629766 >> v2:172.21.15.170:3300/0 conn(0x7fcca00cfe10 0x7fcca00cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.882+0000 7fcca644e640 1 -- 172.21.15.50:0/3487629766 >> v2:172.21.15.170:3300/0 conn(0x7fcca00cfe10 msgr2=0x7fcca00cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.882+0000 7fcca644e640 1 --2- 172.21.15.50:0/3487629766 >> v2:172.21.15.170:3300/0 conn(0x7fcca00cfe10 0x7fcca00cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.885 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.882+0000 7fcca644e640 1 -- 172.21.15.50:0/3487629766 >> v1:172.21.15.50:6789/0 conn(0x7fcca00b4150 legacy=0x7fcca00b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.882+0000 7fcca644e640 1 -- 172.21.15.50:0/3487629766 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00d3d50 con 0x7fcca00cfa30 2023-12-08T08:21:27.886 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.882+0000 7fcca544c640 1 -- 172.21.15.50:0/3487629766 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346210367 0 0) 0x7fcca00c6be0 con 0x7fcca00b4150 2023-12-08T08:21:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca644e640 1 --2- 172.21.15.50:0/3487629766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca00b2f20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fcca008b250 tx=0x7fcc9002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeec7887923f804 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.888 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca544c640 1 -- 172.21.15.50:0/3487629766 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9002cbf0 con 0x7fcca00cfa30 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca544c640 1 -- 172.21.15.50:0/3487629766 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9002cd50 con 0x7fcca00cfa30 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca544c640 1 -- 172.21.15.50:0/3487629766 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90034660 con 0x7fcca00cfa30 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 -- 172.21.15.50:0/3487629766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 msgr2=0x7fcca00b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 --2- 172.21.15.50:0/3487629766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca00b2f20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fcca008b250 tx=0x7fcc9002be40 comp rx=0 tx=0).stop 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 -- 172.21.15.50:0/3487629766 shutdown_connections 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 --2- 172.21.15.50:0/3487629766 >> v2:172.21.15.170:3300/0 conn(0x7fcca00cfe10 0x7fcca00cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 --2- 172.21.15.50:0/3487629766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca00b2f20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 -- 172.21.15.50:0/3487629766 >> 172.21.15.50:0/3487629766 conn(0x7fcca00d3090 msgr2=0x7fcca00d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:27.889 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 -- 172.21.15.50:0/3487629766 shutdown_connections 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.883+0000 7fcca86b2640 1 -- 172.21.15.50:0/3487629766 wait complete. 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.884+0000 7fcca86b2640 1 Processor -- start 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca86b2640 1 -- start start 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca86b2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcca00b4150 0x7fcca01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca86b2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca01f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca86b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca00cfe10 0x7fcca00b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca86b2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b81f0 con 0x7fcca00cfa30 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca86b2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca0155b00 con 0x7fcca00cfe10 2023-12-08T08:21:27.890 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca86b2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b8450 con 0x7fcca00b4150 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca5c4d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca01f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca5c4d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca01f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46762/0 (socket says 172.21.15.50:46762) 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.885+0000 7fcca5c4d640 1 -- 172.21.15.50:0/2339745414 learned_addr learned my addr 172.21.15.50:0/2339745414 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca5c4d640 1 -- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcca00b4150 msgr2=0x7fcca01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca5c4d640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcca00b4150 0x7fcca01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca5c4d640 1 -- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca00cfe10 msgr2=0x7fcca00b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca5c4d640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca00cfe10 0x7fcca00b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca5c4d640 1 -- 172.21.15.50:0/2339745414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc90009a70 con 0x7fcca00cfa30 2023-12-08T08:21:27.891 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca5c4d640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca01f3860 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c430 tx=0x7fcc9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940074e0 con 0x7fcca00cfa30 2023-12-08T08:21:27.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc94007660 con 0x7fcca00cfa30 2023-12-08T08:21:27.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca00b8730 con 0x7fcca00cfa30 2023-12-08T08:21:27.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94004a20 con 0x7fcca00cfa30 2023-12-08T08:21:27.892 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.886+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01f3340 con 0x7fcca00cfa30 2023-12-08T08:21:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.887+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca01f3560 con 0x7fcca00cfa30 2023-12-08T08:21:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.887+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc94004b80 con 0x7fcca00cfa30 2023-12-08T08:21:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.888+0000 7fcc9effd640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc8c06ae40 0x7fcc8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.888+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcc94089300 con 0x7fcca00cfa30 2023-12-08T08:21:27.893 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.888+0000 7fcca644e640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc8c06ae40 0x7fcc8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.889+0000 7fcca644e640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc8c06ae40 0x7fcc8c06d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc9002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:27.894 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:27.892+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc94054550 con 0x7fcca00cfa30 2023-12-08T08:21:28.073 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.071+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fcca0067430 con 0x7fcca00cfa30 2023-12-08T08:21:28.076 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.074+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcc94057b70 con 0x7fcca00cfa30 2023-12-08T08:21:28.077 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.075+0000 7fcc9effd640 1 -- 172.21.15.50:0/2339745414 <== mon.0 v2:172.21.15.50:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcc94054550 con 0x7fcca00cfa30 2023-12-08T08:21:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.076+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc8c06ae40 msgr2=0x7fcc8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.076+0000 7fcca86b2640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc8c06ae40 0x7fcc8c06d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcc90036000 tx=0x7fcc9002e000 comp rx=0 tx=0).stop 2023-12-08T08:21:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.076+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 msgr2=0x7fcca01f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.076+0000 7fcca86b2640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca01f3860 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c430 tx=0x7fcc9400c8f0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.079 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 shutdown_connections 2023-12-08T08:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7fcc8c06ae40 0x7fcc8c06d300 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcca00cfa30 0x7fcca01f3860 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcca00cfe10 0x7fcca00b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 --2- 172.21.15.50:0/2339745414 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcca00b4150 0x7fcca01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 >> 172.21.15.50:0/2339745414 conn(0x7fcca00d3090 msgr2=0x7fcca006b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 shutdown_connections 2023-12-08T08:21:28.080 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.077+0000 7fcca86b2640 1 -- 172.21.15.50:0/2339745414 wait complete. 2023-12-08T08:21:28.090 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-08T08:21:28.090 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-08T08:21:28.196 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.194+0000 7f2c34a9b640 1 Processor -- start 2023-12-08T08:21:28.197 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.194+0000 7f2c34a9b640 1 -- start start 2023-12-08T08:21:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c34a9b640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c3006a4d0 0x7f2c300ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c34a9b640 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3006b070 con 0x7f2c300cf760 2023-12-08T08:21:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c34a9b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3006aab0 con 0x7f2c300cf380 2023-12-08T08:21:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c34a9b640 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c30072290 con 0x7f2c3006a4d0 2023-12-08T08:21:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c2ed9d640 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f2c3006a4d0 0x7f2c300ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.198 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c2dd9b640 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f2c300cf760 0x7f2c300acd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:57566/0 (socket says 172.21.15.50:57566) 2023-12-08T08:21:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c2dd9b640 1 -- 172.21.15.50:0/1188492504 learned_addr learned my addr 172.21.15.50:0/1188492504 (peer_addr_for_me v1:172.21.15.50:0/0) 2023-12-08T08:21:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c2ed9d640 1 -- 172.21.15.50:0/1188492504 >> v1:172.21.15.170:6789/0 conn(0x7f2c300cf380 legacy=0x7f2c30071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-08T08:21:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c2ed9d640 1 -- 172.21.15.50:0/1188492504 >> v1:172.21.15.50:6789/0 conn(0x7f2c300cf760 legacy=0x7f2c300acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.199 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.195+0000 7f2c2ed9d640 1 -- 172.21.15.50:0/1188492504 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3006ad90 con 0x7f2c3006a4d0 2023-12-08T08:21:28.200 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.196+0000 7f2c2ed9d640 1 --2- 172.21.15.50:0/1188492504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c300ad460 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097a0 tx=0x7f2c2802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3affd719f9073b55 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.196+0000 7f2c2d59a640 1 -- 172.21.15.50:0/1188492504 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2802e070 con 0x7f2c3006a4d0 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.196+0000 7f2c2d59a640 1 -- 172.21.15.50:0/1188492504 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2c280315a0 con 0x7f2c3006a4d0 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.196+0000 7f2c2d59a640 1 -- 172.21.15.50:0/1188492504 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28031950 con 0x7f2c3006a4d0 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.197+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1188492504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 msgr2=0x7f2c300ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.197+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1188492504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c300ad460 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097a0 tx=0x7f2c2802b840 comp rx=0 tx=0).stop 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.197+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1188492504 shutdown_connections 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.197+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1188492504 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c300ad460 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.197+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1188492504 >> 172.21.15.50:0/1188492504 conn(0x7f2c300cfda0 msgr2=0x7f2c300d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.201 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.197+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1188492504 shutdown_connections 2023-12-08T08:21:28.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.197+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1188492504 wait complete. 2023-12-08T08:21:28.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.198+0000 7f2c34a9b640 1 Processor -- start 2023-12-08T08:21:28.202 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.198+0000 7f2c34a9b640 1 -- start start 2023-12-08T08:21:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c34a9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c30155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c34a9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c300cf380 0x7f2c30159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c34a9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c300cf760 0x7f2c300b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.204 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c34a9b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300b3810 con 0x7f2c3006a4d0 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c34a9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30155dc0 con 0x7f2c300cf760 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c34a9b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3015a250 con 0x7f2c300cf380 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c30155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c2e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c30155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:46790/0 (socket says 172.21.15.50:46790) 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.199+0000 7f2c2e59c640 1 -- 172.21.15.50:0/1932931083 learned_addr learned my addr 172.21.15.50:0/1932931083 (peer_addr_for_me v2:172.21.15.50:0/0) 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2dd9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c300cf380 0x7f2c30159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2e59c640 1 -- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c300cf380 msgr2=0x7f2c30159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2ed9d640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c300cf760 0x7f2c300b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.205 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2e59c640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c300cf380 0x7f2c30159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2e59c640 1 -- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c300cf760 msgr2=0x7f2c300b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2e59c640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c300cf760 0x7f2c300b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2e59c640 1 -- 172.21.15.50:0/1932931083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28009400 con 0x7f2c3006a4d0 2023-12-08T08:21:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2dd9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c300cf380 0x7f2c30159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-08T08:21:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c2e59c640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c30155880 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c7a0 tx=0x7f2c2000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c26ffd640 1 -- 172.21.15.50:0/1932931083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20003d80 con 0x7f2c3006a4d0 2023-12-08T08:21:28.206 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c26ffd640 1 -- 172.21.15.50:0/1932931083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2c20005070 con 0x7f2c3006a4d0 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c26ffd640 1 -- 172.21.15.50:0/1932931083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20005480 con 0x7f2c3006a4d0 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c300b2c00 con 0x7f2c3006a4d0 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.200+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c300b31c0 con 0x7f2c3006a4d0 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.201+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c30067430 con 0x7f2c3006a4d0 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.202+0000 7f2c26ffd640 1 -- 172.21.15.50:0/1932931083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c200055e0 con 0x7f2c3006a4d0 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.202+0000 7f2c26ffd640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2c1006ae40 0x7f2c1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.202+0000 7f2c26ffd640 1 -- 172.21.15.50:0/1932931083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2c20088960 con 0x7f2c3006a4d0 2023-12-08T08:21:28.207 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.202+0000 7f2c2dd9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2c1006ae40 0x7f2c1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-08T08:21:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.203+0000 7f2c2dd9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2c1006ae40 0x7f2c1006d300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c300b1a40 tx=0x7f2c18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-08T08:21:28.208 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.206+0000 7f2c26ffd640 1 -- 172.21.15.50:0/1932931083 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c20053bd0 con 0x7f2c3006a4d0 2023-12-08T08:21:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.421+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c3015dbc0 con 0x7f2c3006a4d0 2023-12-08T08:21:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.421+0000 7f2c26ffd640 1 -- 172.21.15.50:0/1932931083 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f2c20017e90 con 0x7f2c3006a4d0 2023-12-08T08:21:28.424 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-12-08T08:21:28.424 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6836/3932110318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":3932110318},{"type":"v1","addr":"172.21.15.170:6836","nonce":3932110318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/4267937027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6833","nonce":4267937027},{"type":"v1","addr":"172.21.15.50:6835","nonce":4267937027}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/1019645291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6835","nonce":1019645291},{"type":"v1","addr":"172.21.15.170:6837","nonce":1019645291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6834/3216810814","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":3216810814},{"type":"v1","addr":"172.21.15.50:6834","nonce":3216810814}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-12-08T08:21:28.424 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 25 2023-12-08T08:21:28.425 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2c1006ae40 msgr2=0x7f2c1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2c1006ae40 0x7f2c1006d300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c300b1a40 tx=0x7f2c18009040 comp rx=0 tx=0).stop 2023-12-08T08:21:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 msgr2=0x7f2c30155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-08T08:21:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c30155880 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000c7a0 tx=0x7f2c2000cc60 comp rx=0 tx=0).stop 2023-12-08T08:21:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 shutdown_connections 2023-12-08T08:21:28.426 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:6832/374285324,v1:172.21.15.170:6833/374285324] conn(0x7f2c1006ae40 0x7f2c1006d300 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c300cf760 0x7f2c300b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c300cf380 0x7f2c30159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 --2- 172.21.15.50:0/1932931083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c3006a4d0 0x7f2c30155880 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-08T08:21:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 >> 172.21.15.50:0/1932931083 conn(0x7f2c300cfda0 msgr2=0x7f2c30071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-08T08:21:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 shutdown_connections 2023-12-08T08:21:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:2023-12-08T08:21:28.423+0000 7f2c34a9b640 1 -- 172.21.15.50:0/1932931083 wait complete. 2023-12-08T08:21:28.436 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-08T08:21:28.436 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-08T08:21:28.437 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-08T08:21:28.437 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.446 INFO:tasks.ceph.mds.a:Stopped 2023-12-08T08:21:28.446 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-08T08:21:28.446 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.496 INFO:tasks.ceph.mds.c:Stopped 2023-12-08T08:21:28.496 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-08T08:21:28.496 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.508 INFO:tasks.ceph.mds.b:Stopped 2023-12-08T08:21:28.508 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-08T08:21:28.508 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.560 INFO:tasks.ceph.mds.d:Stopped 2023-12-08T08:21:28.560 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-08T08:21:28.560 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-08T08:21:28.560 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.587 INFO:tasks.ceph.osd.0:Stopped 2023-12-08T08:21:28.587 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-08T08:21:28.587 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.658 INFO:tasks.ceph.osd.1:Stopped 2023-12-08T08:21:28.658 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-08T08:21:28.658 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.732 INFO:tasks.ceph.osd.2:Stopped 2023-12-08T08:21:28.732 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-08T08:21:28.732 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.803 INFO:tasks.ceph.osd.3:Stopped 2023-12-08T08:21:28.803 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-08T08:21:28.803 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.833 INFO:tasks.ceph.osd.4:Stopped 2023-12-08T08:21:28.833 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-08T08:21:28.833 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.905 INFO:tasks.ceph.osd.5:Stopped 2023-12-08T08:21:28.906 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-08T08:21:28.906 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:28.972 INFO:tasks.ceph.osd.6:Stopped 2023-12-08T08:21:28.973 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-08T08:21:28.973 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:29.048 INFO:tasks.ceph.osd.7:Stopped 2023-12-08T08:21:29.048 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-08T08:21:29.048 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-08T08:21:29.048 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:29.072 INFO:tasks.ceph.mgr.y:Stopped 2023-12-08T08:21:29.073 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-08T08:21:29.073 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:29.116 INFO:tasks.ceph.mgr.x:Stopped 2023-12-08T08:21:29.116 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-08T08:21:29.117 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-08T08:21:29.117 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:29.128 INFO:tasks.ceph.mon.a:Stopped 2023-12-08T08:21:29.128 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-08T08:21:29.128 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:29.168 INFO:tasks.ceph.mon.b:Stopped 2023-12-08T08:21:29.168 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-08T08:21:29.168 INFO:teuthology.orchestra.run:waiting for 300 2023-12-08T08:21:29.220 INFO:tasks.ceph.mon.c:Stopped 2023-12-08T08:21:29.220 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-08T08:21:29.220 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-08T08:21:29.257 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:21:29.257 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-08T08:21:29.463 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:21:29.463 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-08T08:21:29.551 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:21:29.552 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-08T08:21:29.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:21:29.610 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-08T08:21:29.684 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:21:29.684 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-08T08:21:29.851 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:21:29.851 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-08T08:21:29.931 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:21:29.932 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-08T08:21:29.989 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:21:29.990 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-08T08:21:30.046 INFO:tasks.ceph:Archiving mon data... 2023-12-08T08:21:30.047 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/data/mon.a.tgz 2023-12-08T08:21:30.047 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2023-12-08T08:21:30.063 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.JJQBeuTdKW 2023-12-08T08:21:30.063 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JJQBeuTdKW 2023-12-08T08:21:30.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.JJQBeuTdKW 2023-12-08T08:21:30.308 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.JJQBeuTdKW is 364KB 2023-12-08T08:21:30.405 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.JJQBeuTdKW 2023-12-08T08:21:30.419 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/data/mon.b.tgz 2023-12-08T08:21:30.420 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2023-12-08T08:21:30.437 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.mYN5Er5Bak 2023-12-08T08:21:30.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mYN5Er5Bak 2023-12-08T08:21:30.611 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.mYN5Er5Bak 2023-12-08T08:21:30.697 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.mYN5Er5Bak is 482KB 2023-12-08T08:21:30.770 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.mYN5Er5Bak 2023-12-08T08:21:30.784 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/data/mon.c.tgz 2023-12-08T08:21:30.784 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2023-12-08T08:21:30.838 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.fzQwn7PAcz 2023-12-08T08:21:30.839 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fzQwn7PAcz 2023-12-08T08:21:30.999 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.fzQwn7PAcz 2023-12-08T08:21:31.084 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.fzQwn7PAcz is 482KB 2023-12-08T08:21:31.182 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.fzQwn7PAcz 2023-12-08T08:21:31.196 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-08T08:21:31.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T08:21:31.199 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-08T08:21:31.288 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-08T08:21:31.317 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-08T08:21:31.318 INFO:tasks.ceph:Archiving crash dumps... 2023-12-08T08:21:31.319 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/remote/smithi050/crash 2023-12-08T08:21:31.320 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T08:21:31.361 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/remote/smithi170/crash 2023-12-08T08:21:31.362 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-08T08:21:31.388 INFO:tasks.ceph:Shutting down logrotate 2023-12-08T08:21:31.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:31.405 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:31.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:31.515 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-08T08:21:31.541 INFO:tasks.ceph:Compressing logs... 2023-12-08T08:21:31.541 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T08:21:31.557 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-08T08:21:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98584.log 2023-12-08T08:21:31.586 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108563.log 2023-12-08T08:21:31.620 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-08T08:21:31.620 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89426.log 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89226.log 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.89426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.95441.log 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89426.log.gz 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.89226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94989.log 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89226.log.gz 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89506.log 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.3.95441.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.94989.log: /var/log/ceph/ceph-client.admin.89506.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-08T08:21:31.621 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89506.log.gz 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.1.94989.log.gz 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.3.95441.log.gz 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89266.log 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89386.log 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.89266.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89266.log.gz 2023-12-08T08:21:31.622 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.89386.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89386.log.gz 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89466.log 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89306.log 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.89466.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.89306.log: /var/log/ceph/ceph-client.admin.89346.log 2023-12-08T08:21:31.623 INFO:teuthology.orchestra.run.smithi170.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89466.log.gz 2023-12-08T08:21:31.624 INFO:teuthology.orchestra.run.smithi170.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89306.log.gz/var/log/ceph/ceph.log: 2023-12-08T08:21:31.624 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-08T08:21:31.624 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.89346.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-08T08:21:31.624 INFO:teuthology.orchestra.run.smithi170.stderr: 88.4%/var/log/ceph/ceph-mon.b.log: -- replaced with /var/log/ceph/ceph-client.admin.89346.log.gz 2023-12-08T08:21:31.624 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-08T08:21:31.624 INFO:teuthology.orchestra.run.smithi170.stderr: 92.2%/var/log/ceph/ceph-mds.d.log: -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T08:21:31.647 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.c.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-08T08:21:31.679 INFO:teuthology.orchestra.run.smithi170.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-08T08:21:31.748 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94360.log 2023-12-08T08:21:31.748 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98584.log: /var/log/ceph/ceph-client.admin.108563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114364.log 2023-12-08T08:21:31.748 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98584.log.gz 2023-12-08T08:21:31.748 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3%/var/log/ceph/ceph-client.admin.94360.log: -- replaced with /var/log/ceph/ceph-client.admin.108563.log.gz 2023-12-08T08:21:31.748 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115274.log 2023-12-08T08:21:31.748 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94360.log.gz 2023-12-08T08:21:31.748 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96454.log 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115274.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114364.log.gz 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94402.log 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115274.log.gz 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98754.log 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114449.log 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96454.log.gz 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94402.log.gz 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110012.log 2023-12-08T08:21:31.749 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98754.log.gz 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107170.log 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110012.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114449.log.gz 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107170.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.97306.log 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110012.log.gz 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107170.log.gz 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96082.log 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109064.log 2023-12-08T08:21:31.750 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97306.log.gz 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108980.log 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96082.log.gz 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95099.log 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111232.log 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109064.log.gz 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108980.log.gz 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112278.log 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95099.log.gz 2023-12-08T08:21:31.751 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111964.log 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109419.log 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111232.log.gz 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112278.log.gz 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.111964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114583.log 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100076.log 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114583.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109419.log.gz 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102427.log 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114583.log.gz 2023-12-08T08:21:31.752 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98122.log 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100076.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.102427.log: /var/log/ceph/ceph-client.admin.96748.log 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.111964.log.gz 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100076.log.gz 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98122.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102427.log.gz 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101933.log 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98122.log.gz 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101263.log 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96748.log.gz 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100034.log 2023-12-08T08:21:31.753 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96250.log 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101933.log.gz 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101263.log.gz 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103151.log 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100034.log.gz 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103067.log 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114796.log 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96250.log.gz 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103151.log.gz 2023-12-08T08:21:31.754 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114000.log 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103067.log.gz 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103907.log 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109106.log 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114796.log.gz 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114000.log.gz 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114627.log 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102983.log 2023-12-08T08:21:31.755 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109106.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103907.log.gz 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107396.log 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109106.log.gz 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114627.log.gz 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104627.log 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104533.log 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102983.log.gz 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107396.log.gz 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113583.log 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104627.log.gz 2023-12-08T08:21:31.756 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99908.log 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98626.log 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104533.log.gz 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99908.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113583.log.gz 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104489.log 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99908.log.gz 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109587.log 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114322.log 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109587.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104489.log.gz 2023-12-08T08:21:31.757 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.98626.log.gz 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105922.log 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109587.log.gz 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95207.log 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114322.log.gz 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96292.log 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113769.log 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105922.log.gz 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96292.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95207.log.gz 2023-12-08T08:21:31.758 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96664.log 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96292.log.gz 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109335.log/var/log/ceph/ceph-client.admin.113769.log: 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102143.log 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113769.log.gz 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96664.log.gz 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103319.log 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109335.log.gz 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104195.log 2023-12-08T08:21:31.759 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101363.log 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102143.log.gz 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103319.log.gz 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98500.log 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.104195.log.gz 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96971.log 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110336.log 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101363.log.gz 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98500.log.gz 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104151.log 2023-12-08T08:21:31.760 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96971.log.gz 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111704.log 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110336.log: /var/log/ceph/ceph-client.admin.104151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105560.log 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110336.log.gz 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104151.log.gz 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106106.log 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111704.log.gz 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.105560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110740.log 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97912.log 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106106.log.gz 2023-12-08T08:21:31.761 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110506.log 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94889.log 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97912.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110740.log.gz 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103571.log 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97912.log.gz 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94889.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110506.log.gz 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94589.log 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103571.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94889.log.gz 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101489.log 2023-12-08T08:21:31.762 INFO:teuthology.orchestra.run.smithi050.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.105560.log.gz 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109190.log 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94589.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103571.log.gz 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97305.log 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94589.log.gz 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101489.log.gz 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114964.log 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102815.log 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109190.log.gz 2023-12-08T08:21:31.763 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114964.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97305.log.gz 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103781.log 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114964.log.gz 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.102815.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.97308.log 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113263.log 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102815.log.gz 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97308.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103781.log.gz 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115006.log 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97308.log.gz 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100244.log 2023-12-08T08:21:31.764 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107312.log 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113263.log.gz 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100244.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115006.log.gz 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106290.log 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100244.log.gz 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96412.log 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110158.log 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107312.log.gz 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96412.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106290.log.gz 2023-12-08T08:21:31.765 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103529.log 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96412.log.gz 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111584.log 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108437.log 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110158.log.gz 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111584.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103529.log.gz 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109671.log 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111584.log.gz 2023-12-08T08:21:31.766 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97304.log 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100538.log 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108437.log.gz 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109671.log.gz 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113499.log 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100538.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97304.log.gz 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111274.log 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104881.log 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100538.log.gz 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111274.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113499.log.gz 2023-12-08T08:21:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112504.log 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111274.log.gz 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103613.log 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104881.log.gz 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114280.log 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98458.log 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112504.log.gz 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114280.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103613.log.gz 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103109.log 2023-12-08T08:21:31.768 INFO:teuthology.orchestra.run.smithi050.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114280.log.gz 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100664.log 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110380.log 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98458.log.gz 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103109.log.gz 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108084.log 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100664.log.gz 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100160.log 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97996.log 2023-12-08T08:21:31.769 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110380.log.gz 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.108084.log.gz 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100412.log 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100160.log.gz 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112925.log 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97996.log: /var/log/ceph/ceph-client.admin.100412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113709.log 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97996.log.gz 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100412.log.gz 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.112925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95141.log 2023-12-08T08:21:31.770 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97641.log 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113709.log: /var/log/ceph/ceph-client.admin.95141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109377.log 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113709.log.gz 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101000.log 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97641.log.gz 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.112925.log.gz 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109232.log 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.95141.log.gz 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114042.log 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109377.log.gz 2023-12-08T08:21:31.771 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101000.log.gz 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104447.log 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96496.log 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109232.log.gz 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114042.log.gz 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105845.log 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104447.log.gz 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100832.log 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96965.log 2023-12-08T08:21:31.772 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96496.log.gz 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114880.log 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.105845.log.gz 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96965.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100832.log.gz 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112362.log 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96965.log.gz 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106795.log 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114880.log.gz 2023-12-08T08:21:31.773 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106332.log 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.106795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108641.log 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112362.log.gz 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105007.log 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106332.log.gz 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115048.log 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105007.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108641.log.gz 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.106795.log.gz 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99756.log 2023-12-08T08:21:31.774 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105007.log.gz 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106148.log 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115048.log: /var/log/ceph/ceph-client.admin.99756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102301.log 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115048.log.gz 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106148.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.99756.log.gz --verbose 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.109970.log 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106148.log.gz 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102301.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82897.log 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109970.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102301.log.gz 2023-12-08T08:21:31.775 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114669.log 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.tmp-client.admin.82897.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109970.log.gz 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107128.log 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82897.log.gz 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107438.log 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113667.log 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114669.log.gz 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2%/var/log/ceph/ceph-client.admin.107438.log: -- replaced with /var/log/ceph/ceph-client.admin.107128.log.gz 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105761.log 2023-12-08T08:21:31.776 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107438.log.gz 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97869.log 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105761.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.113667.log.gz -5 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104839.log 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105761.log.gz 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98416.log 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97869.log.gz 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111174.log 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98416.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104839.log.gz 2023-12-08T08:21:31.777 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95940.log 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98416.log.gz 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97954.log 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97307.log 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111174.log.gz 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97954.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95940.log.gz 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110632.log 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97954.log.gz 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113100.log 2023-12-08T08:21:31.778 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110632.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97307.log.gz 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113100.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110632.log.gz 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98332.log 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113100.log.gz 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104363.log 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101447.log 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104363.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98332.log.gz 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112194.log 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103655.log 2023-12-08T08:21:31.779 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104363.log.gz 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101447.log: /var/log/ceph/ceph-client.admin.112194.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101447.log.gz 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97504.log 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.112194.log.gz 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106248.log 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103655.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98542.log 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103655.log.gz 2023-12-08T08:21:31.780 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97504.log.gz 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100958.log 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106248.log.gz 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100370.log 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96969.log 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98542.log.gz 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100958.log.gz 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98164.log 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96969.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100370.log.gz 2023-12-08T08:21:31.781 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111316.log 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95898.log 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96969.log.gz 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98164.log.gz 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97294.log 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111316.log.gz 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103277.log 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97294.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95898.log.gzgzip 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106022.log 2023-12-08T08:21:31.782 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103277.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97294.log.gz 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108395.log 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106022.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.103277.log.gz -5 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104755.log 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96538.log 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106022.log.gz 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.108395.log.gz 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107354.log 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104755.log.gz 2023-12-08T08:21:31.783 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98080.log 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88912.log 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.96538.log.gz 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98080.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107354.log.gz 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115132.log 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98080.log.gz 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.88912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101651.log 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114838.log 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.88912.log.gz 2023-12-08T08:21:31.784 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101651.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115132.log.gz 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104797.log 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101651.log.gz 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102059.log 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114838.log.gz 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94102.log 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102059.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.104797.log.gz -- 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-client.admin.108521.log 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94102.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.102059.log.gz /var/log/ceph/ceph-client.admin.94445.log 2023-12-08T08:21:31.785 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94102.log.gz 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109545.log 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108521.log.gz 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94487.log 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109545.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94445.log.gz 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89279.log 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109545.log.gz 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110999.log 2023-12-08T08:21:31.786 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.89279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96166.log 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94487.log.gz 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89279.log.gz 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.110999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95057.log 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96972.log 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95057.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96166.log.gz 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112588.log 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95057.log.gz 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105109.log 2023-12-08T08:21:31.787 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96972.log: /var/log/ceph/ceph-client.admin.112588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115192.log 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96972.log.gz 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112588.log.gz 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107480.log 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.110999.log.gz 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103361.log 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115192.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105109.log.gz 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102653.log 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115192.log.gz 2023-12-08T08:21:31.788 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103361.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107480.log.gz 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94183.log 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103361.log.gz 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113457.log 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102653.log.gz 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102527.log 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102695.log 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94183.log.gz 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113457.log.gz 2023-12-08T08:21:31.789 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103403.log 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102695.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.102527.log.gz 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105980.log 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107576.log 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102695.log.gz 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103403.log.gz 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106458.log 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105980.log.gz 2023-12-08T08:21:31.790 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94279.log 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105193.log 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107576.log.gz 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106458.log.gz 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97295.log 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94279.log.gz 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105193.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94803.log 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105193.log.gz 2023-12-08T08:21:31.791 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97295.log.gz 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99950.log 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109766.log 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99950.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94803.log.gz 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101736.log 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99950.log.gz 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104405.log 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109766.log: /var/log/ceph/ceph-client.admin.101736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106416.log 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109766.log.gz 2023-12-08T08:21:31.792 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104405.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.101736.log.gz -5 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104669.log 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104405.log.gz 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107212.log 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111542.log 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106416.log.gz 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104669.log.gz 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96970.log 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107212.log.gz 2023-12-08T08:21:31.793 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100118.log 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111542.log: /var/log/ceph/ceph-client.admin.96970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109148.log 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111542.log.gz 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96970.log.gz 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100916.log 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100118.log.gz 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106374.log 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109148.log: /var/log/ceph/ceph-client.admin.100916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113179.log 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109148.log.gz 2023-12-08T08:21:31.794 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100916.log.gz 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104109.log 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106374.log.gz 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101405.log 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113179.log: /var/log/ceph/ceph-client.admin.104109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108126.log 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113179.log.gz 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104109.log.gz 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102259.log 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101405.log.gz 2023-12-08T08:21:31.795 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102899.log 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108126.log: /var/log/ceph/ceph-client.admin.102259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102569.log 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108126.log.gz 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102259.log.gz 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113305.log 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102899.log.gz 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113625.log 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102569.log: /var/log/ceph/ceph-client.admin.113305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107002.log 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102569.log.gz 2023-12-08T08:21:31.796 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113625.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113305.log.gz 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110590.log 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107044.log 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113625.log.gz 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110590.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107002.log.gz 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101095.log 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110590.log.gz 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.107044.log: /var/log/ceph/ceph-client.admin.98248.log 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96580.log 2023-12-08T08:21:31.797 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107044.log.gz 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101095.log.gz 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100328.log 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97639.log 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98248.log.gz 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96580.log: /var/log/ceph/ceph-client.admin.100328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110202.log 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96580.log.gz 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97639.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100328.log.gz 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114491.log 2023-12-08T08:21:31.798 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97639.log.gz 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97301.log 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110202.log: /var/log/ceph/ceph-client.admin.114491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102217.log 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110202.log.gz 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114491.log.gz 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97643.log 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97301.log.gz 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103697.log 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102217.log: /var/log/ceph/ceph-client.admin.97643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107877.log 2023-12-08T08:21:31.799 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102217.log.gz 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103697.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97643.log.gz 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105803.log 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103697.log.gz 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.107877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111626.log 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94529.log 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105803.log: /var/log/ceph/ceph-client.admin.111626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101305.log 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105803.log.gz 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111626.log.gz 2023-12-08T08:21:31.800 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108896.log 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110422.log 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101305.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94529.log.gz 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108896.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.107877.log.gz 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108854.log 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101305.log.gz 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108896.log.gz 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102773.log 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110422.log: /var/log/ceph/ceph-client.admin.108854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115232.log 2023-12-08T08:21:31.801 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110422.log.gz 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102773.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108854.log.gz 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108210.log 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102773.log.gz 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102343.log 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.115232.log: /var/log/ceph/ceph-client.admin.108210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96024.log 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115232.log.gz 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108210.log.gz 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104321.log 2023-12-08T08:21:31.802 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112462.log 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96024.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102343.log.gz 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94719.log 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96024.log.gz 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104321.log.gz 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112462.log: /var/log/ceph/ceph-client.admin.94719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102611.log 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112462.log.gz 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.3.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94719.log.gz 2023-12-08T08:21:31.803 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100286.log 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100706.log 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102611.log.gz 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99992.log 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96790.log 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100706.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100286.log.gz 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104923.log 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100706.log.gz 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99992.log.gz 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97636.log 2023-12-08T08:21:31.804 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104923.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.104965.log 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96790.log.gz 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104923.log.gz 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100748.log 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104965.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.97636.log.gz --verbose 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.102485.log 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100748.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104965.log.gz 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101780.log 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102485.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100748.log.gz 2023-12-08T08:21:31.805 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114922.log 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102485.log.gz 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107618.log 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101780.log.gz 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94973.log 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114922.log.gz 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105049.log 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107618.log.gz 2023-12-08T08:21:31.806 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99141.log 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105049.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94973.log.gz 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101693.log 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.99141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111400.log 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105049.log.gz 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106536.log 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111400.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101693.log.gz 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108294.log 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.0.99141.log.gz 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106536.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111400.log.gz 2023-12-08T08:21:31.807 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110054.log 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106536.log.gz 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113347.log 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109629.log 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108294.log.gz 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110054.log.gz/var/log/ceph/ceph-client.admin.113347.log: 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108812.log 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109629.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113347.log.gz 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109292.log 2023-12-08T08:21:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108812.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109629.log.gz 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.113811.log 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109292.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108812.log.gz 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100622.log 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109292.log.gz 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94847.log 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113811.log.gz 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112546.log 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94847.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.100622.log.gz -5 2023-12-08T08:21:31.809 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.110464.log 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94847.log.gz 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96208.log 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99798.log 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110464.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112546.log.gz 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110548.log 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110464.log.gz 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99798.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96208.log.gz 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113895.log 2023-12-08T08:21:31.810 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110548.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102385.log 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99798.log.gz 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110548.log.gz 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110674.log 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102385.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113895.log.gz 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112320.log 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102385.log.gz 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-mgr.y.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96370.log 2023-12-08T08:21:31.811 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110294.log 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.110674.log.gz 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111358.log 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112320.log.gz 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 88.6% -5/var/log/ceph/ceph-client.admin.110294.log: --verbose -- /var/log/ceph/ceph-client.admin.103445.log 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96370.log.gz 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111358.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110294.log.gz 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108252.log 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103445.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111358.log.gz 2023-12-08T08:21:31.812 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112136.log 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103445.log.gz 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100790.log 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108252.log.gz 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110252.log 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100790.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112136.log.gz 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103193.log 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100790.log.gz 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104711.log 2023-12-08T08:21:31.813 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110252.log.gz 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100496.log 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104711.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103193.log.gz 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101975.log 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104711.log.gz 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100496.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110096.log 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100496.log.gz 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94631.log 2023-12-08T08:21:31.814 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101975.log.gz 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.110096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89165.log 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94631.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110096.log.gz 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104067.log 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94631.log.gz 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.89165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107086.log 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89165.log.gz 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101531.log 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107086.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104067.log.gz 2023-12-08T08:21:31.815 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108479.log 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107086.log.gz 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113955.log 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101531.log.gz 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114406.log 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113955.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108479.log.gz 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108938.log 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113955.log.gz 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96706.log 2023-12-08T08:21:31.816 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108938.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114406.log.gz 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108938.log.gz 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108168.log 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96706.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108168.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105235.log 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96706.log.gz 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95814.log 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108168.log.gz 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108352.log 2023-12-08T08:21:31.817 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102017.log 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108352.log: 87.7% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.105235.log.gz 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95814.log.gz 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94761.log 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108352.log.gz 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.102017.log: /var/log/ceph/ceph-client.2.99634.log 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94761.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103987.log 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102017.log.gz 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94761.log.gz 2023-12-08T08:21:31.818 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.2.99634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103865.log 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102941.log 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103987.log: /var/log/ceph/ceph-client.admin.103865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103487.log 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.2.99634.log.gz 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102941.log: 87.6% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103987.log.gz 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103865.log.gz 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114712.log 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102941.log.gz 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96622.log 2023-12-08T08:21:31.819 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114712.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103487.log.gz 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.102101.log 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96622.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114712.log.gz 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100202.log 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96622.log.gz 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103235.log 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102101.log.gz 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95637.log 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100202.log.gz 2023-12-08T08:21:31.820 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98206.log 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103235.log.gz 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113853.log 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.98206.log: -5 --verbose -- /var/log/ceph/ceph.log 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113853.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98206.log.gz 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95856.log 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113853.log.gz 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.95637.log.gz 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr:gzip 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-08T08:21:31.821 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105301.log 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106190.log 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95856.log.gz 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101221.log 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105301.log.gz 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98374.log 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106190.log.gz 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101221.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101221.log.gz 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101890.log 2023-12-08T08:21:31.822 INFO:teuthology.orchestra.run.smithi050.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98374.log.gz 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96963.log 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97638.log 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101890.log.gz 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96963.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96963.log.gz 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112420.log 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97638.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113221.log 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112420.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97638.log.gz 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112420.log.gz 2023-12-08T08:21:31.823 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100580.log 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111500.log 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113221.log.gz 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101179.log 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111500.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100580.log.gz 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111500.log.gz 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98038.log 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94675.log 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101179.log.gz 2023-12-08T08:21:31.824 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.98038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96968.log 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94675.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98038.log.gz 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94675.log.gz 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111458.log 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109503.log 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96968.log.gz 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.111458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109846.log 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109503.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111458.log.gz 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109503.log.gz 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109461.log 2023-12-08T08:21:31.825 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107270.log 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109846.log.gz 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96124.log 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.107270.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109461.log.gz 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107270.log.gz 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103025.log 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95982.log 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96124.log.gz 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100454.log 2023-12-08T08:21:31.826 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95982.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103025.log.gz 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95982.log.gz 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104279.log 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.100454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108770.log 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100454.log.gz 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103739.log 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.108770.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104279.log.gz 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108770.log.gz 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114084.log 2023-12-08T08:21:31.827 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.103739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94931.log 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103739.log.gz 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106064.log 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.94931.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114084.log.gz 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94931.log.gz 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114754.log 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.106064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95015.log 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106064.log.gz 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105717.log 2023-12-08T08:21:31.828 INFO:teuthology.orchestra.run.smithi050.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114754.log.gz 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.95015.log: 90.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95015.log.gz 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101137.log 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.105717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103823.log 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.101137.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98290.log 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105717.log.gz 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8%/var/log/ceph/ceph-client.admin.103823.log: -- replaced with /var/log/ceph/ceph-client.admin.101137.log.gz 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97644.log 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103823.log.gz/var/log/ceph/ceph-client.admin.98290.log: 2023-12-08T08:21:31.829 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114541.log 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98290.log.gz 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96966.log 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97644.log.gz/var/log/ceph/ceph-client.admin.114541.log: 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114126.log 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114541.log.gz 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.96966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104577.log 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96966.log.gz 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99262.log 2023-12-08T08:21:31.830 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.114126.log: /var/log/ceph/ceph-client.admin.104577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104237.log 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.99262.log: 88.0% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104577.log.gz 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114126.log.gz 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99262.log.gz 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109022.log 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.104237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112666.log 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104237.log.gz 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115090.log 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109022.log.gz 2023-12-08T08:21:31.831 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109928.log 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105151.log 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr: 87.7%/var/log/ceph/ceph-client.admin.115090.log: -- replaced with /var/log/ceph/ceph-client.admin.112666.log.gz 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.109928.log: 87.8%gzip -5 --verbose -- 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109928.log.gz 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr: /var/log/ceph/ceph-mds.a.log 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115090.log.gz/var/log/ceph/ceph-client.admin.105151.log: 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113541.log 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105151.log.gz 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100874.log 2023-12-08T08:21:31.832 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97642.log 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.113541.log: /var/log/ceph/ceph-client.admin.100874.log: 89.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100874.log.gz 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113541.log.gz 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101573.log 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.97642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112236.log 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97642.log.gz 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.101573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102857.log 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.112236.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101573.log.gz 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112236.log.gz 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101848.log 2023-12-08T08:21:31.833 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.102857.log: /var/log/ceph/ceph-client.admin.101848.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102857.log.gz 2023-12-08T08:21:31.834 INFO:teuthology.orchestra.run.smithi050.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101848.log.gz 2023-12-08T08:21:31.834 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-08T08:21:31.835 INFO:teuthology.orchestra.run.smithi170.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-08T08:21:31.835 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-08T08:21:31.914 INFO:teuthology.orchestra.run.smithi050.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-08T08:21:32.350 INFO:teuthology.orchestra.run.smithi170.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-08T08:21:32.355 INFO:teuthology.orchestra.run.smithi170.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-08T08:21:32.401 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-08T08:21:32.419 INFO:teuthology.orchestra.run.smithi050.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-08T08:21:32.463 INFO:teuthology.orchestra.run.smithi170.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-08T08:21:32.465 INFO:teuthology.orchestra.run.smithi170.stderr: 2023-12-08T08:21:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m0.870s 2023-12-08T08:21:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m3.446s 2023-12-08T08:21:32.465 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.135s 2023-12-08T08:21:32.479 INFO:teuthology.orchestra.run.smithi050.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-08T08:21:32.497 INFO:teuthology.orchestra.run.smithi050.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-08T08:21:32.530 INFO:teuthology.orchestra.run.smithi050.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-08T08:21:32.532 INFO:teuthology.orchestra.run.smithi050.stderr: 2023-12-08T08:21:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m0.962s 2023-12-08T08:21:32.532 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m3.699s 2023-12-08T08:21:32.533 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.361s 2023-12-08T08:21:32.533 INFO:tasks.ceph:Archiving logs... 2023-12-08T08:21:32.533 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/remote/smithi050/log 2023-12-08T08:21:32.534 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T08:21:33.390 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/remote/smithi170/log 2023-12-08T08:21:33.391 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-08T08:21:33.889 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-08T08:21:33.898 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-08T08:21:33.899 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T08:21:33.902 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-08T08:21:33.986 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-08T08:21:34.001 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-08T08:21:34.001 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:21:34.004 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-08T08:21:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:21:34.018 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2023-12-08T08:21:34.022 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:21:34.022 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2023-12-08T08:21:34.022 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +504us[ +519us] +/- 71ms 2023-12-08T08:21:34.022 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -110us[ -95us] +/- 72ms 2023-12-08T08:21:34.022 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -305us[ -290us] +/- 66ms 2023-12-08T08:21:34.023 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:21:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-08T08:21:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2023-12-08T08:21:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 +503us[ +503us] +/- 71ms 2023-12-08T08:21:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -109us[ -104us] +/- 72ms 2023-12-08T08:21:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -306us[ -306us] +/- 66ms 2023-12-08T08:21:34.025 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-08T08:21:34.026 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-08T08:21:34.035 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-08T08:21:34.036 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-08T08:21:34.062 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-08T08:21:34.187 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-08T08:21:34.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T08:21:34.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:21:34.317 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-08T08:21:34.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:21:34.349 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-08T08:21:34.360 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-08T08:21:34.379 INFO:teuthology.task.internal:Duration was 882.551911 seconds 2023-12-08T08:21:34.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-08T08:21:34.412 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-08T08:21:34.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T08:21:34.415 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-08T08:21:34.458 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T08:21:34.463 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-08T08:21:34.793 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-08T08:21:34.793 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2023-12-08T08:21:34.794 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T08:21:34.814 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2023-12-08T08:21:34.814 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-08T08:21:34.840 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-08T08:21:34.841 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T08:21:34.857 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-08T08:21:34.910 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-08T08:21:34.910 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T08:21:34.928 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-08T08:21:35.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-08T08:21:35.055 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-08T08:21:35.055 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T08:21:35.086 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-08T08:21:35.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-08T08:21:35.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:21:35.128 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:21:35.155 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2023-12-08T08:21:35.178 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2023-12-08T08:21:35.194 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:21:35.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:21:35.230 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-08T08:21:35.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-08T08:21:35.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-08T08:21:35.259 INFO:teuthology.task.internal:Transferring archived files... 2023-12-08T08:21:35.260 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/remote/smithi050 2023-12-08T08:21:35.260 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T08:21:35.312 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778/remote/smithi170 2023-12-08T08:21:35.313 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-08T08:21:35.348 INFO:teuthology.task.internal:Removing archive directory... 2023-12-08T08:21:35.349 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T08:21:35.351 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-08T08:21:35.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-08T08:21:35.413 INFO:teuthology.task.internal:Not uploading archives. 2023-12-08T08:21:35.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-08T08:21:35.445 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-08T08:21:35.445 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T08:21:35.448 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-08T08:21:35.460 INFO:teuthology.orchestra.run.smithi050.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 08:21 /home/ubuntu/cephtest 2023-12-08T08:21:35.462 INFO:teuthology.orchestra.run.smithi170.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 8 08:21 /home/ubuntu/cephtest 2023-12-08T08:21:35.463 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-08T08:21:35.480 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-08T08:21:35.547 INFO:teuthology.nuke:Checking targets against current locks 2023-12-08T08:21:35.573 DEBUG:teuthology.nuke:shortname: smithi050 2023-12-08T08:21:35.574 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:21:35.599 DEBUG:teuthology.nuke:shortname: smithi170 2023-12-08T08:21:35.599 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T08:21:35.603 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:58:14.431195', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7oxiOYntLysSSVuZVCqY5GSlTgDlXicqBhjOI9zXL8PLyU0TAggQ/8kMRlcuwHAIkGZHA3MFyVCziOogafIdw='} 2023-12-08T08:21:35.623 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:58:14.433179', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHrqlqrdMfTyN+dpTr/N1G7eeyJKe2GxvX9vOHdIjm6ByxTiwA66XWPGhH9E7WVsXBijxaK2tyDwxtz8lIx32dA='} 2023-12-08T08:21:35.657 INFO:teuthology.orchestra.console.smithi050:Power off 2023-12-08T08:21:35.657 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T08:21:35.685 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2023-12-08T08:21:35.686 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:21:35.701 INFO:teuthology.orchestra.console.smithi170:Power off 2023-12-08T08:21:35.702 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T08:21:35.710 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-08T08:21:35.723 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-12-08T08:21:35.724 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:21:35.746 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-12-08T08:21:39.712 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:21:39.747 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:21:39.822 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2023-12-08T08:21:39.859 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-12-08T08:21:43.826 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:21:43.861 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T08:21:43.939 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2023-12-08T08:21:43.972 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-12-08T08:21:44.040 INFO:teuthology.orchestra.console.smithi050:Power off completed 2023-12-08T08:21:44.073 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-12-08T08:21:44.178 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 882.5519106388092 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bb17a37669d5489f8794574f53a66528 status: fail success: false 2023-12-08T08:21:44.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T08:21:44.344 INFO:teuthology.run:FAIL